-- Logs begin at Wed 2022-10-12 21:48:25 UTC, end at Thu 2022-10-13 00:13:20 UTC. -- Oct 12 22:20:09.134857 n-d-860864-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 22:20:09.143456 n-d-860864-8 devstack@n-api.service[104483]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 22:20:09 2022] *** Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: nodename: n-d-860864-8 Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: machine: x86_64 Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: clock source: unix Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: pcre jit disabled Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: detected number of CPU cores: 4 Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: current working directory: / Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: detected binary path: /usr/bin/uwsgi-core Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: your processes number limit is 47680 Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: your memory page size is 4096 bytes Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: detected max file descriptor number: 2048 Oct 12 22:20:09.145479 n-d-860864-8 devstack@n-api.service[104483]: lock engine: pthread robust mutexes Oct 12 22:20:09.146296 n-d-860864-8 devstack@n-api.service[104483]: thunder lock: enabled Oct 12 22:20:09.146296 n-d-860864-8 devstack@n-api.service[104483]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 22:20:09.146296 n-d-860864-8 devstack@n-api.service[104483]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 22:20:09.184868 n-d-860864-8 devstack@n-api.service[104483]: Python main interpreter initialized at 0x559a8633f9c0 Oct 12 22:20:09.184868 n-d-860864-8 devstack@n-api.service[104483]: python threads support enabled Oct 12 22:20:09.184868 n-d-860864-8 devstack@n-api.service[104483]: your server socket listen backlog is limited to 100 connections Oct 12 22:20:09.184868 n-d-860864-8 devstack@n-api.service[104483]: your mercy for graceful operations on workers is 90 seconds Oct 12 22:20:09.185283 n-d-860864-8 devstack@n-api.service[104483]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 22:20:09.185283 n-d-860864-8 devstack@n-api.service[104483]: *** Operational MODE: preforking *** Oct 12 22:20:09.185532 n-d-860864-8 devstack@n-api.service[104483]: *** uWSGI is running in multiple interpreter mode *** Oct 12 22:20:09.185532 n-d-860864-8 devstack@n-api.service[104483]: spawned uWSGI master process (pid: 104483) Oct 12 22:20:09.185708 n-d-860864-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 22:20:09.188494 n-d-860864-8 devstack@n-api.service[104483]: spawned uWSGI worker 1 (pid: 104484, cores: 1) Oct 12 22:20:09.188494 n-d-860864-8 devstack@n-api.service[104483]: spawned uWSGI worker 2 (pid: 104485, cores: 1) Oct 12 22:20:09.188494 n-d-860864-8 devstack@n-api.service[104483]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 22:20:09.842313 n-d-860864-8 devstack@n-api.service[104485]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 22:20:09.844977 n-d-860864-8 devstack@n-api.service[104484]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 22:20:10.925392 n-d-860864-8 devstack@n-api.service[104484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:20:10.925392 n-d-860864-8 devstack@n-api.service[104484]: from cryptography.utils import int_from_bytes Oct 12 22:20:10.926054 n-d-860864-8 devstack@n-api.service[104485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:20:10.926054 n-d-860864-8 devstack@n-api.service[104485]: from cryptography.utils import int_from_bytes Oct 12 22:20:10.926459 n-d-860864-8 devstack@n-api.service[104484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:20:10.926459 n-d-860864-8 devstack@n-api.service[104484]: from cryptography.utils import int_from_bytes Oct 12 22:20:10.926574 n-d-860864-8 devstack@n-api.service[104485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:20:10.926574 n-d-860864-8 devstack@n-api.service[104485]: from cryptography.utils import int_from_bytes Oct 12 22:20:13.414354 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 22:20:13.415013 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 22:20:13.415117 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 22:20:13.415452 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 22:20:13.415703 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 22:20:13.416124 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.416330 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 22:20:13.416695 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.416795 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 22:20:13.416876 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.417056 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.417161 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 22:20:13.417378 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.417489 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 22:20:13.417690 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 22:20:13.417837 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418003 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418104 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418315 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418403 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418637 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418735 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418892 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.418986 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.419201 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.419295 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.419521 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-8 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.419613 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.419839 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.419958 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.420166 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.420252 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.420470 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.420571 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.420774 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.420868 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.421098 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.421183 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.421416 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.421508 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-8 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.421718 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.421813 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.422022 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.422202 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.422330 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.422636 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.422764 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.422934 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.423053 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.423240 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.423357 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.423540 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.423664 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.423866 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.424067 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.424197 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.424377 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.424512 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.424682 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.424813 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.424991 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.425132 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.425324 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.425423 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.425638 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.425812 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-8 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.425947 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.426128 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.426250 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.426436 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.426564 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.426742 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.426864 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.427150 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.427285 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.427464 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.427572 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-8 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.427776 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.427936 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.428125 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.428235 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.428444 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.428541 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.428751 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.428856 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.429073 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.429171 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.429390 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.429478 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.429705 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.429795 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.430021 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.430117 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.430321 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.430452 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.430626 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.430714 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.430930 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.431024 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.431244 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.431330 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.431546 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.431639 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.431848 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.431989 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.432121 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.432278 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.432428 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.432518 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.432745 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.432833 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.433316 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.433414 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.433626 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.433712 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.433874 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.433967 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.434122 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.434210 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.434437 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.434532 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.434752 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.434839 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.435055 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.435186 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.435326 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.435420 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.435576 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.435672 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.435911 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.436016 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.436233 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.436322 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.436564 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.436650 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.436868 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.436961 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.437188 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.437325 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.437478 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.437565 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.437784 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.437952 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.438091 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.438183 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.438395 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.438490 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.438697 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.438805 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.439017 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.439114 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.439323 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.439409 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.439625 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.439722 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.439960 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.440049 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.440285 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.440385 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.440587 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.440682 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.440903 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.440998 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.441211 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.441305 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.441514 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.441601 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.441815 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.441902 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.442117 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.442203 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.442431 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.442573 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.442756 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.442843 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.443055 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.443141 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.443302 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.443396 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.443598 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.443684 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.443937 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.444027 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.444236 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.444328 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.444540 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.444633 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.444821 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.444905 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.445120 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.445258 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.445418 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.445503 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.445722 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.445824 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.446026 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.446112 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.446335 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.446421 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.446629 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.446725 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.446925 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.447010 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.447226 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.447319 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.447526 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.447624 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.447829 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.447935 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.448156 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.448244 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.448458 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.448557 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.448761 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.448847 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.449068 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.449283 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.449412 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.449498 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.449657 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.449759 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.449955 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.450042 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.450257 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.450353 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.450573 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.450659 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.450875 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.450977 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.451173 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.451260 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.451478 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.451565 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.451775 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.451859 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.452626 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.452738 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.452942 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.453028 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.453242 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.453338 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.453544 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.453632 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.453851 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.453936 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.454146 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.454239 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.454449 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.454544 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.454752 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.454836 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.455050 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.455151 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.455349 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.455435 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.455646 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.455739 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.455964 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.456053 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.456267 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.456356 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.456571 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.456656 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.456865 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.456964 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.457163 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.457247 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.457455 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.457587 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.457753 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.457848 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.458053 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.458139 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.458350 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.458436 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.458651 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.458746 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.458947 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.459034 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.459260 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.459365 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.459572 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.459673 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.459878 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.460010 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.460202 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.460292 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.460508 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.460596 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.460825 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:20:13.460912 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.461159 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.461290 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.461470 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.461557 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.461778 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.461866 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.462087 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.462174 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.462407 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.462532 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.462711 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.462867 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.463015 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.463184 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.463320 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.463495 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.463631 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.463807 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.463964 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.464155 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.464292 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.464464 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.464639 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.464773 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.464900 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.465081 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.465212 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.465397 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.465516 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.465712 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.465828 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.466040 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.466135 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.466352 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.466446 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.466663 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.466759 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.466977 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.467065 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.467283 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.467391 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.467599 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.467745 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.468508 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.468600 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.468829 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.468916 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.469140 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.469243 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.469480 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.469572 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.469787 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.469884 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.470125 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.470229 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.470431 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.470525 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.470738 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.470824 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.471052 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.471146 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.471359 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.471446 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.471663 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.471749 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.471997 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.472103 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.472305 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.472401 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.472612 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.472700 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.472919 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.473015 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.473225 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.473312 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.473541 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.473626 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.473852 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.473939 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.474157 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.474242 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.474466 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.474552 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.474772 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.474865 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.475078 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.475166 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.475383 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.475472 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.475689 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.475786 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.476024 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.476113 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.476333 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.476422 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.476633 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.476721 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.476930 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.477017 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.477233 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.477320 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.477534 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.477623 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.477841 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.477928 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.478143 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.478243 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.478446 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.478533 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.478748 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.478841 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.479054 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.479154 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.479360 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.479478 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.479664 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.479764 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.479990 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.480106 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.480293 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.480391 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.480599 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.480697 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.480902 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.481009 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.481203 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.481300 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.481507 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.481604 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.481812 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.481917 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.482114 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.482210 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.482423 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.482530 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.482722 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.482819 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.483021 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.483117 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.483343 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.483439 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.483653 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.483758 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.483975 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.484073 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.484286 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.484382 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.484584 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.484680 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.484888 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.484992 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.485192 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.485302 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.485498 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.485612 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.485808 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.485905 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.486118 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.486223 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.486424 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.486520 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.486742 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.486837 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.487049 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.487157 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.487358 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.487454 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.487655 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.487776 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.487982 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.488175 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.488287 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.488428 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.488586 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.488674 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.488885 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.488973 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.489188 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.489274 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.489489 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.489594 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.489789 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.489898 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.490086 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.490183 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.490383 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.490479 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.490678 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.490781 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.490979 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.491082 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.491279 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.491376 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.491575 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.491675 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.491871 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.491989 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.492192 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.492296 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.492491 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.492583 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.492810 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.492903 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.493115 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.493216 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.493416 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.493517 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.493714 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.493807 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.494013 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.494114 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.494352 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.494445 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.494655 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.494748 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.494959 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.495063 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.495264 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.495364 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.495571 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.495665 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.495876 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.496000 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.496211 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.496304 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.496521 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.496613 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.496828 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.496925 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.497129 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.497221 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.497435 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.497526 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.497739 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.497830 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.498051 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.498143 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.498349 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.498448 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.498658 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.498751 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.498983 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.499079 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.499313 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.499415 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.499622 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.499716 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.499958 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.500052 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.500262 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.500367 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.500569 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.500661 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.500876 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.500969 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.501184 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.501285 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.501492 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.501585 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.501798 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.501890 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.502112 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.502213 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.502418 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.502510 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.502722 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.502813 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.503024 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.503124 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.503330 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.503509 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.503655 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.503798 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.503979 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.504131 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.504284 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.504436 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.504580 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.504731 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.504885 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.505029 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.505181 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.505324 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.505479 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.505623 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.505779 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.505925 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.506068 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.506211 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.506354 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.506497 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.506653 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.506808 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.506962 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.507116 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.507261 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.507422 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.507567 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.507711 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.507855 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.508038 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.508184 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.508341 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.508487 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.508632 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.508776 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.508920 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.509065 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.509218 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.509373 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.509517 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.509661 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.509804 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.509948 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.510102 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.510247 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.510390 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.510534 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.510677 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.510829 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.510974 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.511135 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.511281 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.511425 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.511574 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.511728 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.511872 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.512076 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.512223 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.512436 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.512586 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.512742 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.512895 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.513048 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.513219 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.513366 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.513520 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.513674 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.513819 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.513964 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.514108 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.514253 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.514398 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.514550 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.515306 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.515456 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.515614 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.515772 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.515949 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.516101 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.516327 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.516480 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.516625 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.516769 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.516987 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.517144 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.517290 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.517444 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.517590 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.517742 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.517907 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.518059 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.518203 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.518347 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.518493 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.518636 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.518798 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.518944 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.519089 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.519232 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.519388 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.519542 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.519696 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.519854 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.520064 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.520212 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.520356 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.520509 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.520655 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.520800 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.520943 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.521094 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.521239 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.521396 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.521541 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.521705 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.521850 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.521850 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.522132 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.522286 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.522432 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.522576 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.522721 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.522872 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.523025 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.523171 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.523321 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.523477 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.523645 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.523645 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.523958 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.524123 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.524268 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.524413 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.524564 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.524708 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.524853 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.525005 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.525150 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.525308 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.525462 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.525627 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.525772 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.525917 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.526070 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.526214 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.526358 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.526502 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.526646 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.526791 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.526944 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.527090 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.527241 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.527396 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.527541 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.527692 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.527846 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.528043 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.528190 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.528335 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.528480 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.528632 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.528786 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.528931 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.529078 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.529222 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.529377 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.529530 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.529682 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.529829 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.529973 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.530118 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.530840 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.531004 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.531152 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.531303 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.531457 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.531602 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.531753 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.531940 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.532096 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.532241 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.532386 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.532540 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.532687 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.532840 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.532986 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.533130 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.533275 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.533420 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.533577 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.533729 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.533892 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.534044 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.534194 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.534339 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.534491 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.534644 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.534644 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.534918 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.535062 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.535206 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.535360 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.535517 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.535673 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.535825 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.536016 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.536179 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.536327 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.536471 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.536614 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.536766 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.536910 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.537064 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.537209 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.537354 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.537498 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.537652 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.537797 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.537949 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.538094 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.538239 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.538384 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.538528 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.538678 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.538832 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.538977 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.539121 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.539265 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.539410 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.539574 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.539726 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.539872 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.540042 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.540188 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.540332 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.540556 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.540705 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.540849 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.540993 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.541138 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.541281 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.541434 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.541592 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.541737 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.541881 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.542025 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.542169 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.542322 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.542468 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.542613 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.542758 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.542902 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.543061 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.543206 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.543361 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.543505 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.543651 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.543796 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.544011 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.544166 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.544312 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.544456 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.544599 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.544744 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.544906 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.545052 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.545197 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.545355 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.545500 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.545644 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.545798 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.545973 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.546118 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.546263 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.546413 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.546567 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.546719 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.546872 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.547017 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.547161 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.547316 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.547470 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.547616 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.547768 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.547939 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.548091 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.548236 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.548396 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.548543 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.548687 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.548832 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.548977 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.549122 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.549285 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.549431 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.549575 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.549719 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.549863 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.550017 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.550162 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.550307 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.550452 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.550606 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.550770 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.550975 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.551137 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.551282 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.551434 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.551580 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.551724 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.551878 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.552080 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.552224 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.552367 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.552511 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.552654 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.552811 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.552957 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.553112 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.553264 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.553410 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.553562 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.553709 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.553860 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.554006 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.554162 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.554306 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.554459 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.554605 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.554749 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.554894 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.555048 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.555194 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.555346 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.555491 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.555635 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.555780 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.555956 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.556108 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.556266 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.556413 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.556557 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.556700 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.556844 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.556998 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.557154 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.557302 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.557452 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.557597 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.557740 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.558147 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.558298 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.558443 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.558587 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.558731 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.558874 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.559027 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.559189 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.559334 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.559486 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.559631 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.559781 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.559975 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.560128 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.560274 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.560418 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.560561 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.560711 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.560865 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.561010 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.561164 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.561346 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.561530 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.561686 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.561832 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.561984 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.562129 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.562273 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.562273 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.562561 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.562708 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.562851 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.563006 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.563157 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.563302 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.563455 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.563601 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.563745 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.563745 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.564056 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.564217 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.564375 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.564375 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.564660 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.564806 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.564960 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.565113 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.565265 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.565410 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.565554 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.565698 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.565842 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.565994 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.566139 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.566283 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.566439 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.566584 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.566730 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.566896 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.567049 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.567193 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.567337 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.567481 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.567624 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.567778 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.567969 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.568121 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.568265 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.568409 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.568628 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.568792 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.568938 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.569082 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.569227 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.569370 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.569523 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.569668 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.569812 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.569957 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.570130 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.570277 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.570431 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.570576 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.570741 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.570887 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.571031 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.571181 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.571334 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.571479 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.571624 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.571768 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.571933 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.572097 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.572243 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.572386 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.572529 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.572686 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.572840 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.572994 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.573146 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.573290 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.573434 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.573615 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.573790 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.573947 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.574111 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.574265 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.574418 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.574575 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.574720 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.574872 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.575017 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.575174 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.575320 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.575464 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.575608 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.575751 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.575949 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.576118 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.576266 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.576411 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.576573 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.576717 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.576874 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.577020 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.577686 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.577833 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.577977 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.578121 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.578280 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.578426 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.578576 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.578731 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.578882 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.579045 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.579263 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.579449 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.579601 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.579746 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.579911 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.580065 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.580221 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.580369 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.580369 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.580652 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.580803 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.580962 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.581118 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.581263 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.581408 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.581554 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.581698 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.581851 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.581997 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.582143 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.582287 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.582434 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.582578 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.582732 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.582888 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.583033 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.583184 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.583329 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.583475 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.583632 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.583778 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.583950 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.584111 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.584258 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.584418 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.584577 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.584723 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.584886 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.585031 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.585176 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.585333 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.585479 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.585631 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.585777 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.585927 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.586080 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.586233 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.586380 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.586524 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.586670 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.586832 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.586978 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.587130 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.587277 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.587421 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.587566 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.587712 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.587865 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.588050 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.588198 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.588342 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.588488 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.588632 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.588797 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.588942 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.589087 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.589238 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.589384 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.589529 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.589681 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.589828 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.589986 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.590138 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.590283 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.590428 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.590595 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.590748 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.590895 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.591039 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.591184 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.591342 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.591489 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.591634 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.591779 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.591970 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.592133 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.592288 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.592435 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.592590 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.593275 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.593442 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.593589 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.593746 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.593893 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.594038 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.594190 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.594336 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.594486 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.594648 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.594795 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.594939 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.595107 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.595262 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.595420 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.595566 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.595712 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.595857 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.596030 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.596177 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.596333 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.596480 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.596625 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.596776 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.596922 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.597084 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.597244 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.597391 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.597535 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.597679 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.597824 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.597969 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.598122 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.598277 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.598423 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.598567 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.598712 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.598875 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.599021 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.599174 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.599320 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.599465 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.599608 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.599771 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.599980 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.600135 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.600281 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.600426 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.600570 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.600570 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.600866 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.601011 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.601164 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.601312 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.601456 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.601613 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.601758 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.601903 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602054 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602199 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602353 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602499 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602650 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602805 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602948 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.602948 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.603240 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.603385 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.603531 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.603683 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.603830 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.604005 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.604163 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.604310 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.604701 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.604879 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.605034 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.605189 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.605345 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.605492 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.605645 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.605791 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.605935 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.606088 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.606236 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.606381 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.606533 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.606696 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.606856 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.607003 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.607147 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.607292 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.607437 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.607581 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.607803 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.607989 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.608140 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.608285 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.608459 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.608626 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.608783 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.608930 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.609083 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.609235 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.609381 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.609535 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.609689 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.609845 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.609990 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.610134 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.610279 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.610446 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.610592 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.610737 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.610889 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.611041 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.611187 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.611340 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.611486 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.611637 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.611790 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.611957 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.612121 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.612278 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.612424 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.612568 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.612713 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.612858 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.613011 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.613157 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.613301 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.613452 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.613597 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.613742 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.613899 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.614045 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.614206 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.614353 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.614505 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.614662 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.614817 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.614964 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.615109 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.615254 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.615468 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.615624 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.615777 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.615961 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.616126 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.616272 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.616272 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.616558 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.616704 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.616848 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.616992 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.617138 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.617282 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.617436 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.617587 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.617739 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.617884 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.618047 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.618047 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.618339 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.618485 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.618629 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.618774 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.618924 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.619082 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.619240 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.619385 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.619529 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.619673 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.619817 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.620014 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.620171 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.620325 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.620471 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.620616 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.620761 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.620915 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.621060 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.621212 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.621358 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.621358 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.621641 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.621797 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.621941 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.622086 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.622230 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.622383 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.622537 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.622683 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.622827 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.622971 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.623115 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.623259 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.623413 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.623565 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.623721 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.623873 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.624098 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.624260 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.624409 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.624566 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.624712 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.624858 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.625002 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.625160 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.625307 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.625453 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.625597 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.625753 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.625899 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.626052 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.626198 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.626342 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.626487 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.626639 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.626785 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.626942 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.627088 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.627233 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.627378 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.627523 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.627679 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.627833 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.628010 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.628158 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.628303 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.628448 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.628606 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.628759 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.628905 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.629050 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.629195 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.629339 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.629517 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.629666 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.629811 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.629964 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.630117 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.630263 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.630420 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.630566 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.630712 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.630857 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631002 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631146 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631300 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631456 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631601 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631746 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631935 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.631935 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.632236 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.632381 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.632525 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.632669 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.632813 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.632971 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.633117 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.633268 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.633424 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.633576 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.633721 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.633878 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634031 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634177 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634321 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634472 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634620 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634778 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634931 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.634931 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.635206 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.635361 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.635581 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.635729 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.635874 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.636049 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.636195 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.636339 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.636495 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.636641 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.636786 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.636930 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.637076 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.637233 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.637387 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.637532 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.637676 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.637821 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.637965 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.638120 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.638266 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.638410 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.638555 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.638707 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.638853 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.639019 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.639174 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.639320 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.639466 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640157 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640255 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640359 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640447 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640530 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640610 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640691 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640829 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.640929 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641011 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641091 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641170 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641250 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641338 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641420 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641499 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641579 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641659 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641738 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641831 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641913 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.641992 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.642070 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.642155 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.642464 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.642607 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.642778 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.642929 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.643087 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.643252 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.643397 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.643577 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.643705 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.643916 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.644037 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.644230 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.644354 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.644558 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.644724 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.644872 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.645017 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.645172 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.645318 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.645464 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.645787 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.645939 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.646124 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.646287 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.646441 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.646588 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.646759 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.646912 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.647057 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.647210 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.647356 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.647510 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.647666 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.647812 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.648031 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.648181 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.648333 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.648480 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.648626 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.648770 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.648923 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.649069 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.649214 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.649358 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.649503 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.649648 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.649801 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.649957 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.650109 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.650254 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.650405 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.650551 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.650704 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.650914 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.651064 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.651216 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.651368 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.651527 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.651674 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.651820 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.652010 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.652158 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.652304 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.652461 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.652608 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.652754 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.652899 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.653043 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.653188 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.653341 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.653494 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.653640 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.653793 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.653949 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.654094 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.654247 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.654392 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.654537 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.654681 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.654827 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.654984 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.655130 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.655817 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.656007 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.656153 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.656308 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.656466 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.656612 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.656756 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.656901 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.657045 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.657189 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.657348 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.657501 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.657656 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.657802 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.657947 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.658092 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.658254 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.658400 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.658551 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.658697 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.658842 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.658996 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.659141 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.659285 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.659435 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.659581 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.659725 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.659882 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.660055 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.660211 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.660366 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.660512 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.660656 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.660809 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.660961 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.661107 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.661258 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.661442 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.661592 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.661746 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.661899 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.662054 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.662207 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.662353 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.662506 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.662652 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.662796 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.662948 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.663099 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.663245 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.663470 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.663626 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.663779 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.663949 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.664123 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.664280 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.664475 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.664631 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.664777 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.664922 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.665067 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.665221 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.665368 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.665522 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.665680 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.665680 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.665966 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.666124 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.666271 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.666416 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.666562 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.666707 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.666853 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.666853 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.667136 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.667281 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.667428 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.667581 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.667751 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.667917 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.668070 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.668215 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.668361 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.668507 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.668664 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.668818 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.668964 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.669109 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.669254 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.669399 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.669557 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.669713 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.669859 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.670005 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.670149 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.670303 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.670449 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 22:20:13.670595 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.670747 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.670960 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.671306 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.671622 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.671993 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.672323 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.672636 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.672949 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.673255 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:20:13.673497 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 22:20:13.822553 n-d-860864-8 devstack@n-api.service[104485]: INFO dbcounter [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Registered counter for database nova_api Oct 12 22:20:13.826058 n-d-860864-8 devstack@n-api.service[104484]: INFO dbcounter [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Registered counter for database nova_api Oct 12 22:20:13.843676 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_db.sqlalchemy.engines [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:13.845976 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_db.sqlalchemy.engines [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:13.850232 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writer thread running {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:13.852508 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writer thread running {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:13.906208 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.context [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=104485) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 22:20:13.908495 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.context [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=104484) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 22:20:13.910099 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.910568 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.912137 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:13.912300 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_concurrency.lockutils [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.912768 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_concurrency.lockutils [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.912872 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.913281 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.914309 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_concurrency.lockutils [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:13.915070 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_concurrency.lockutils [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:20:13.915235 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:13.915462 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_concurrency.lockutils [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:20:13.917223 n-d-860864-8 devstack@n-api.service[104485]: INFO dbcounter [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Registered counter for database nova_cell0 Oct 12 22:20:13.917465 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_concurrency.lockutils [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:20:13.919423 n-d-860864-8 devstack@n-api.service[104484]: INFO dbcounter [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Registered counter for database nova_cell0 Oct 12 22:20:13.921257 n-d-860864-8 devstack@n-api.service[104485]: INFO dbcounter [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Registered counter for database nova_cell1 Oct 12 22:20:13.923360 n-d-860864-8 devstack@n-api.service[104484]: INFO dbcounter [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Registered counter for database nova_cell1 Oct 12 22:20:13.928860 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_db.sqlalchemy.engines [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:13.930045 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_db.sqlalchemy.engines [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:13.932068 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_db.sqlalchemy.engines [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:13.934407 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_db.sqlalchemy.engines [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:13.937707 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writer thread running {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:13.939195 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writer thread running {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:13.939885 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writer thread running {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:13.944995 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writer thread running {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:14.084167 n-d-860864-8 devstack@n-api.service[104485]: INFO dbcounter [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Registered counter for database nova_cell0 Oct 12 22:20:14.084560 n-d-860864-8 devstack@n-api.service[104484]: INFO dbcounter [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Registered counter for database nova_cell0 Oct 12 22:20:14.093246 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_db.sqlalchemy.engines [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:14.094860 n-d-860864-8 devstack@n-api.service[104484]: DEBUG oslo_db.sqlalchemy.engines [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:20:14.098244 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writer thread running {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:14.099476 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writer thread running {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:20:14.433940 n-d-860864-8 devstack@n-api.service[104484]: WARNING keystonemiddleware.auth_token [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:20:14.434797 n-d-860864-8 devstack@n-api.service[104485]: WARNING keystonemiddleware.auth_token [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:20:14.441705 n-d-860864-8 devstack@n-api.service[104484]: WARNING keystonemiddleware.auth_token [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:20:14.442502 n-d-860864-8 devstack@n-api.service[104485]: WARNING keystonemiddleware.auth_token [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:20:14.782186 n-d-860864-8 devstack@n-api.service[104484]: WARNING keystonemiddleware.auth_token [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:20:14.783960 n-d-860864-8 devstack@n-api.service[104485]: WARNING keystonemiddleware.auth_token [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:20:14.788437 n-d-860864-8 devstack@n-api.service[104484]: WARNING keystonemiddleware.auth_token [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:20:14.789884 n-d-860864-8 devstack@n-api.service[104485]: WARNING keystonemiddleware.auth_token [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:20:14.793945 n-d-860864-8 devstack@n-api.service[104484]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559a8633f9c0 pid: 104484 (default app) Oct 12 22:20:14.795168 n-d-860864-8 devstack@n-api.service[104485]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559a8633f9c0 pid: 104485 (default app) Oct 12 22:20:14.796635 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:20:14.797818 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-9536f373-c6ed-4d80-86d9-b6d306ce2156 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002366 Oct 12 22:20:14.798228 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Oct 12 22:20:14 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:35.615773 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:35.617026 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Oct 12 22:21:35.617711 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:35.629165 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_api:SELECT=3 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:35.630308 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_cell1:SELECT=3 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:35.632288 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_cell0:SELECT=3 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:35.633350 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:36.509965 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-80f771c7-7392-4bff-9287-9cb72675ab79 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:36.542856 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-80f771c7-7392-4bff-9287-9cb72675ab79 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919205 Oct 12 22:21:36.543606 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 22:21:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:39.176367 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:39.177384 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-40296c7e-324d-46a8-909a-cfca2383d786 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 12 22:21:39.177959 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:39.617173 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-d01eb616-d336-4c23-9cde-c4230109f7e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "disk": 1, "ram": 256}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:39.663486 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-d01eb616-d336-4c23-9cde-c4230109f7e7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.478710 Oct 12 22:21:39.664096 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:21:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:21:39.678390 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writing DB stats nova_api:SELECT=3 {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:39.679738 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writing DB stats nova_cell0:SELECT=3 {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:39.682372 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writing DB stats nova_cell1:SELECT=3 {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:39.683126 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:21:39.893582 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-98380e9c-dab3-4af8-9877-d8402599f016 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:39.962922 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-98380e9c-dab3-4af8-9877-d8402599f016 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290004 Oct 12 22:21:39.963503 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 12 22:21:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:21:42.599526 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-d01eb616-d336-4c23-9cde-c4230109f7e7 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:42.600708 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-d01eb616-d336-4c23-9cde-c4230109f7e7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Oct 12 22:21:42.602094 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:43.378481 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-5fdc6e5d-81c9-4388-b0bb-e02bfa4c411f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "ram": 512}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:43.424952 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-5fdc6e5d-81c9-4388-b0bb-e02bfa4c411f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.810663 Oct 12 22:21:43.425873 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:21:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:21:43.438721 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-02da88a8-8c87-4e38-a1e0-df70e4ae273c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:43.487632 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-02da88a8-8c87-4e38-a1e0-df70e4ae273c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052656 Oct 12 22:21:43.488540 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 12 22:21:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:46.374269 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-5fdc6e5d-81c9-4388-b0bb-e02bfa4c411f admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:46.374269 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-5fdc6e5d-81c9-4388-b0bb-e02bfa4c411f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 12 22:21:46.374269 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:46.931798 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-afdb302f-861b-4f3f-82c6-4a65eb356001 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "swap": 0, "name": "ds1G", "disk": 10}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:46.954250 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-afdb302f-861b-4f3f-82c6-4a65eb356001 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.571344 Oct 12 22:21:46.955763 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:21:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:21:46.966648 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-4638d6d5-d685-4a1a-905c-274aedfea3e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:46.994913 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-4638d6d5-d685-4a1a-905c-274aedfea3e8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031925 Oct 12 22:21:47.008112 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 12 22:21:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:49.614835 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-afdb302f-861b-4f3f-82c6-4a65eb356001 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:49.615788 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-afdb302f-861b-4f3f-82c6-4a65eb356001 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 12 22:21:49.616278 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:50.090703 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-354241d8-f6b5-497a-9045-a4588801706d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "swap": 0, "name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:50.111761 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-354241d8-f6b5-497a-9045-a4588801706d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489492 Oct 12 22:21:50.112619 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:21:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:21:50.124604 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-933ec875-c4bb-4760-9adf-ecfdc7557116 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:50.158376 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-933ec875-c4bb-4760-9adf-ecfdc7557116 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037277 Oct 12 22:21:50.164533 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 12 22:21:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:52.889455 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-354241d8-f6b5-497a-9045-a4588801706d admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:52.891078 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-354241d8-f6b5-497a-9045-a4588801706d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Oct 12 22:21:52.896236 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:53.321563 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-944f0bd3-a078-415a-8cfd-fbbf334ecaab admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "vcpus": 4, "swap": 0}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:53.343831 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-944f0bd3-a078-415a-8cfd-fbbf334ecaab admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446168 Oct 12 22:21:53.345078 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:21:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:21:53.357382 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-0d7f9c59-c8be-4ec1-8fef-85aae941a15d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:53.387802 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-0d7f9c59-c8be-4ec1-8fef-85aae941a15d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033834 Oct 12 22:21:53.425029 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 12 22:21:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:21:56.067186 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-944f0bd3-a078-415a-8cfd-fbbf334ecaab admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:56.068265 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-944f0bd3-a078-415a-8cfd-fbbf334ecaab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 12 22:21:56.068996 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:56.474779 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-e2ed7a84-2023-4c17-83f7-4ec0b82ca4d8 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:56.499564 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-e2ed7a84-2023-4c17-83f7-4ec0b82ca4d8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.424364 Oct 12 22:21:56.500146 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 22:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:21:59.165759 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-944f0bd3-a078-415a-8cfd-fbbf334ecaab admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:21:59.166803 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-944f0bd3-a078-415a-8cfd-fbbf334ecaab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 12 22:21:59.167225 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:21:59.605170 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-9df40803-3b91-4812-a0ae-21ae88570bda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:59.628997 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-9df40803-3b91-4812-a0ae-21ae88570bda admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.455042 Oct 12 22:21:59.629946 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:21:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:21:59.645630 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-5e8e5678-00e7-4651-bbb3-f526b2fec813 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:21:59.682063 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-5e8e5678-00e7-4651-bbb3-f526b2fec813 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042103 Oct 12 22:21:59.682745 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 12 22:21:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:02.343744 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-9df40803-3b91-4812-a0ae-21ae88570bda admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:02.344814 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-9df40803-3b91-4812-a0ae-21ae88570bda admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Oct 12 22:22:02.345247 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:02.749154 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-6644a2cb-3f7a-4d47-bb63-1e3f65f5a70d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:02.769688 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-6644a2cb-3f7a-4d47-bb63-1e3f65f5a70d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417650 Oct 12 22:22:02.771007 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:22:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:22:02.783595 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-8853ef39-edb5-4710-9012-e83a0c9b1108 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:02.808007 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-8853ef39-edb5-4710-9012-e83a0c9b1108 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028088 Oct 12 22:22:02.808780 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 12 22:22:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:05.401319 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-6644a2cb-3f7a-4d47-bb63-1e3f65f5a70d admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:05.402327 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-6644a2cb-3f7a-4d47-bb63-1e3f65f5a70d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 12 22:22:05.402736 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:05.832323 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-720623c7-1f0f-4d6d-bb93-ed184baf57a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:05.853613 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-720623c7-1f0f-4d6d-bb93-ed184baf57a7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.443982 Oct 12 22:22:05.854350 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:22:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:22:05.866873 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-53476c5b-812b-4504-8976-39e17e283566 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:05.871713 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:05.896230 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-53476c5b-812b-4504-8976-39e17e283566 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033471 Oct 12 22:22:05.897373 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 12 22:22:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:22:08.522292 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-720623c7-1f0f-4d6d-bb93-ed184baf57a7 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:08.524081 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-720623c7-1f0f-4d6d-bb93-ed184baf57a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Oct 12 22:22:08.524791 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:08.967497 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-ebaee8e5-87ee-4edf-9fd7-89405114b49a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "rxtx_factor": 1.0, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:08.987058 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-ebaee8e5-87ee-4edf-9fd7-89405114b49a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456493 Oct 12 22:22:08.987702 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:22:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:22:09.000263 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-18628585-1778-4270-8771-45825706f171 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:09.024934 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-18628585-1778-4270-8771-45825706f171 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028246 Oct 12 22:22:09.025708 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 12 22:22:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:11.725646 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-ebaee8e5-87ee-4edf-9fd7-89405114b49a admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:11.726846 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-ebaee8e5-87ee-4edf-9fd7-89405114b49a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 12 22:22:11.727250 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:12.165269 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-3a47d90c-70a7-4e2a-b806-f4ec11f92925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:12.173907 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:12.187257 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-3a47d90c-70a7-4e2a-b806-f4ec11f92925 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453658 Oct 12 22:22:12.187925 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 12 22:22:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:22:12.200603 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-a12bbb63-2ee3-4fc2-88f0-f432ed1bd348 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:12.227258 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-a12bbb63-2ee3-4fc2-88f0-f432ed1bd348 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030435 Oct 12 22:22:12.228024 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 12 22:22:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:22:32.979382 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-3a47d90c-70a7-4e2a-b806-f4ec11f92925 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:32.980456 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-3a47d90c-70a7-4e2a-b806-f4ec11f92925 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 12 22:22:32.980864 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:32.991386 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:22:33.363845 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-7e1d0dcb-4df6-4d0e-963a-9f150822a7b7 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:33.382798 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-7e1d0dcb-4df6-4d0e-963a-9f150822a7b7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395780 Oct 12 22:22:33.383345 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 22:22:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:22:34.673570 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-3a47d90c-70a7-4e2a-b806-f4ec11f92925 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:34.674577 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-3a47d90c-70a7-4e2a-b806-f4ec11f92925 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 12 22:22:34.674980 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:35.205377 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-319fe1b5-a2da-4063-96e2-8939949075ff admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:35.211600 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.wsgi [None req-319fe1b5-a2da-4063-96e2-8939949075ff admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-319fe1b5-a2da-4063-96e2-8939949075ff admin admin] Request method failure captured: Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: Accept: application/json Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: Accept-Encoding: gzip, deflate Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: Connection: keep-alive Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: Content-Length: 0 Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: Host: 10.222.0.20 Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: Openstack-Api-Version: compute 2.92 Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: Openstack-System-Scope: None Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: User-Agent: python-novaclient Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Auth-Token: gAAAAABjRz4qzWD0ayuWYLUmUPfmo9V8ybx2KAc8hcOZN8cj6IAV_C45KJ14fygbzxFQraOsciCMFl29cONRTBls3PnR5TX_3ihoAS4daRyTHOE-FRA002J89Dgy2UkFxBb1AhUzL2dzEKixxyoslxdeWlkeiNLfwO_lcvoho1EQteY6gG9CXaw Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Domain-Id: None Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Domain-Name: None Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Identity-Status: Confirmed Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Is-Admin-Project: True Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Domain-Id: default Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Domain-Name: Default Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Name: admin Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Role: reader,admin,member Oct 12 22:22:35.214841 n-d-860864-8 devstack@n-api.service[104484]: X-Roles: reader,admin,member Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}] Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant: admin Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant-Name: admin Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-User: admin Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-User-Domain-Id: default Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-User-Domain-Name: Default Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-User-Id: 04e98e4ee5db4af8ac7d158bacfcb2aa Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: X-User-Name: admin Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: method: > Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: exception: Flavor 42 could not be found. Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: action_args: {'id': '42'} Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:35.216588 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:35.217580 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.218978 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-319fe1b5-a2da-4063-96e2-8939949075ff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:35.220712 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-319fe1b5-a2da-4063-96e2-8939949075ff admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391026 Oct 12 22:22:35.220712 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 12 22:22:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:22:35.226041 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-8339005f-77ec-480b-b079-f6cb1790d791 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:35.248204 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-8339005f-77ec-480b-b079-f6cb1790d791 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025709 Oct 12 22:22:35.248749 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 12 22:22:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:22:35.260004 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-36b8d5cb-add0-4fa5-9e6c-98b8c06cd60c admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:35.282023 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-36b8d5cb-add0-4fa5-9e6c-98b8c06cd60c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027068 Oct 12 22:22:35.282555 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 12 22:22:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:22:35.291806 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f2c78d44-5f6a-4c0b-9bd7-255a279f1dbb admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:35.297036 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.wsgi [None req-f2c78d44-5f6a-4c0b-9bd7-255a279f1dbb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f2c78d44-5f6a-4c0b-9bd7-255a279f1dbb admin admin] Request method failure captured: Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: Accept: application/json Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: Accept-Encoding: gzip, deflate Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: Connection: keep-alive Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: Content-Length: 0 Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: Host: 10.222.0.20 Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: Openstack-Api-Version: compute 2.92 Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: Openstack-System-Scope: None Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: User-Agent: python-novaclient Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Auth-Token: gAAAAABjRz4qzWD0ayuWYLUmUPfmo9V8ybx2KAc8hcOZN8cj6IAV_C45KJ14fygbzxFQraOsciCMFl29cONRTBls3PnR5TX_3ihoAS4daRyTHOE-FRA002J89Dgy2UkFxBb1AhUzL2dzEKixxyoslxdeWlkeiNLfwO_lcvoho1EQteY6gG9CXaw Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Domain-Id: None Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Domain-Name: None Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Identity-Status: Confirmed Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Is-Admin-Project: True Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Domain-Id: default Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Domain-Name: Default Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Name: admin Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Role: reader,admin,member Oct 12 22:22:35.300332 n-d-860864-8 devstack@n-api.service[104485]: X-Roles: reader,admin,member Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}] Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant: admin Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant-Name: admin Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-User: admin Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-User-Domain-Id: default Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-User-Domain-Name: Default Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-User-Id: 04e98e4ee5db4af8ac7d158bacfcb2aa Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: X-User-Name: admin Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: method: > Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: exception: Flavor 42 could not be found. Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: action_args: {'id': '42'} Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:35.301875 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:35.303189 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:35.304681 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f2c78d44-5f6a-4c0b-9bd7-255a279f1dbb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:35.305916 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-f2c78d44-5f6a-4c0b-9bd7-255a279f1dbb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013507 Oct 12 22:22:35.305916 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 12 22:22:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 12 22:22:36.498749 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-36b8d5cb-add0-4fa5-9e6c-98b8c06cd60c admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:36.499914 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-36b8d5cb-add0-4fa5-9e6c-98b8c06cd60c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Oct 12 22:22:36.500321 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:37.021489 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f080e39b-8eb3-438e-8117-3838ff9ab0e7 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:37.026554 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.wsgi [None req-f080e39b-8eb3-438e-8117-3838ff9ab0e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f080e39b-8eb3-438e-8117-3838ff9ab0e7 admin admin] Request method failure captured: Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: Accept: application/json Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: Accept-Encoding: gzip, deflate Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: Connection: keep-alive Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: Content-Length: 0 Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: Host: 10.222.0.20 Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: Openstack-Api-Version: compute 2.92 Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: Openstack-System-Scope: None Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: User-Agent: python-novaclient Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Auth-Token: gAAAAABjRz4sYdxnLai5ZiTNfrLtkMcUJHPrm3ns2mmcYtpifD2O8_Ym9tYpLyIYV_DG7tMO-gUuwdoqrnd8rmLdK_3PJ42levbP05yOwWc2J_SicHckkKA8npXVz5y8uCU-Wy2q38y8dHNjUsVwtBxaf27dloSglHCrQc1h7Ibo7xTW57w4kRQ Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Domain-Id: None Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Domain-Name: None Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Identity-Status: Confirmed Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Is-Admin-Project: True Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Domain-Id: default Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Domain-Name: Default Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Name: admin Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Role: reader,admin,member Oct 12 22:22:37.028091 n-d-860864-8 devstack@n-api.service[104485]: X-Roles: reader,admin,member Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}] Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant: admin Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant-Name: admin Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-User: admin Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-User-Domain-Id: default Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-User-Domain-Name: Default Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-User-Id: 04e98e4ee5db4af8ac7d158bacfcb2aa Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: X-User-Name: admin Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: method: > Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: exception: Flavor 84 could not be found. Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: action_args: {'id': '84'} Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:37.029792 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:37.030750 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.031866 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f080e39b-8eb3-438e-8117-3838ff9ab0e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:37.032894 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-f080e39b-8eb3-438e-8117-3838ff9ab0e7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392671 Oct 12 22:22:37.032894 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 12 22:22:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:22:37.039200 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-0bf0a3ab-23eb-4be8-961a-cfb72fbbcdab admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:37.054888 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-0bf0a3ab-23eb-4be8-961a-cfb72fbbcdab admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019247 Oct 12 22:22:37.055417 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 12 22:22:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:22:37.064628 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f02c2921-ceb0-4694-8021-652925f82573 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:37.081991 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-f02c2921-ceb0-4694-8021-652925f82573 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020796 Oct 12 22:22:37.082552 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 12 22:22:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:22:37.092445 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-8563c034-5e82-4e88-a271-7bcb9fac1088 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:37.097366 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.wsgi [None req-8563c034-5e82-4e88-a271-7bcb9fac1088 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-8563c034-5e82-4e88-a271-7bcb9fac1088 admin admin] Request method failure captured: Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: Accept: application/json Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: Accept-Encoding: gzip, deflate Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: Connection: keep-alive Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: Content-Length: 0 Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: Host: 10.222.0.20 Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: Openstack-Api-Version: compute 2.92 Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: Openstack-System-Scope: None Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: User-Agent: python-novaclient Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Auth-Token: gAAAAABjRz4sYdxnLai5ZiTNfrLtkMcUJHPrm3ns2mmcYtpifD2O8_Ym9tYpLyIYV_DG7tMO-gUuwdoqrnd8rmLdK_3PJ42levbP05yOwWc2J_SicHckkKA8npXVz5y8uCU-Wy2q38y8dHNjUsVwtBxaf27dloSglHCrQc1h7Ibo7xTW57w4kRQ Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Domain-Id: None Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Domain-Name: None Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Identity-Status: Confirmed Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Is-Admin-Project: True Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Domain-Id: default Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Domain-Name: Default Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Name: admin Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Role: reader,admin,member Oct 12 22:22:37.099524 n-d-860864-8 devstack@n-api.service[104484]: X-Roles: reader,admin,member Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}] Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant: admin Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant-Name: admin Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-User: admin Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-User-Domain-Id: default Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-User-Domain-Name: Default Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-User-Id: 04e98e4ee5db4af8ac7d158bacfcb2aa Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: X-User-Name: admin Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: method: > Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: exception: Flavor 84 could not be found. Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: action_args: {'id': '84'} Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:37.101086 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:37.102054 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:37.103362 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-8563c034-5e82-4e88-a271-7bcb9fac1088 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:37.104708 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-8563c034-5e82-4e88-a271-7bcb9fac1088 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012015 Oct 12 22:22:37.105172 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 12 22:22:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:22:38.306577 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f02c2921-ceb0-4694-8021-652925f82573 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:38.307585 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-f02c2921-ceb0-4694-8021-652925f82573 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 12 22:22:38.308007 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:38.829560 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-2d6e8752-39e8-4321-86a0-aca4fb9fc577 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:38.835796 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.wsgi [None req-2d6e8752-39e8-4321-86a0-aca4fb9fc577 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-2d6e8752-39e8-4321-86a0-aca4fb9fc577 admin admin] Request method failure captured: Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: Accept: application/json Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: Accept-Encoding: gzip, deflate Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: Connection: keep-alive Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: Content-Length: 0 Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: Host: 10.222.0.20 Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: Openstack-Api-Version: compute 2.92 Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: Openstack-System-Scope: None Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: User-Agent: python-novaclient Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Auth-Token: gAAAAABjRz4u65gDUtZ5JXiZa7S_r1ulbZtyU09LzFdHnPv54qwGr4IAkuTkkNY_yYPZ5X8Vm511lsEnIIGFur06MTrVxzGiOfurJo9lFDzoaGbzDftxPw_yOHIOMYxv5zI7p26lWhYoLwoitvYCbcyTFq4UayKxmkWUzh3oyMoJO-WFyN-gnuE Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Domain-Id: None Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Domain-Name: None Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Identity-Status: Confirmed Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Is-Admin-Project: True Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Domain-Id: default Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Domain-Name: Default Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Project-Name: admin Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Role: reader,admin,member Oct 12 22:22:38.837333 n-d-860864-8 devstack@n-api.service[104484]: X-Roles: reader,admin,member Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}] Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant: admin Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-Tenant-Name: admin Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-User: admin Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-User-Domain-Id: default Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-User-Domain-Name: Default Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-User-Id: 04e98e4ee5db4af8ac7d158bacfcb2aa Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: X-User-Name: admin Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: method: > Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: exception: Flavor 451 could not be found. Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: action_args: {'id': '451'} Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:38.838883 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:38.840690 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.841957 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-2d6e8752-39e8-4321-86a0-aca4fb9fc577 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:38.843167 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-2d6e8752-39e8-4321-86a0-aca4fb9fc577 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394393 Oct 12 22:22:38.843167 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 12 22:22:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:22:38.848518 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-7031a7c9-dd3e-4221-93ed-67ac194f8320 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:38.862954 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-7031a7c9-dd3e-4221-93ed-67ac194f8320 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017980 Oct 12 22:22:38.863473 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 12 22:22:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:22:38.872829 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:38.888013 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018587 Oct 12 22:22:38.888539 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 12 22:22:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:22:38.898238 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f3f3c48f-f31e-4ecf-a7a0-1ba8a3f7f4bd admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:38.903063 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.wsgi [None req-f3f3c48f-f31e-4ecf-a7a0-1ba8a3f7f4bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f3f3c48f-f31e-4ecf-a7a0-1ba8a3f7f4bd admin admin] Request method failure captured: Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: Accept: application/json Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: Accept-Encoding: gzip, deflate Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: Connection: keep-alive Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: Content-Length: 0 Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: Host: 10.222.0.20 Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: Openstack-Api-Version: compute 2.92 Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: Openstack-System-Scope: None Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: User-Agent: python-novaclient Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Auth-Token: gAAAAABjRz4u65gDUtZ5JXiZa7S_r1ulbZtyU09LzFdHnPv54qwGr4IAkuTkkNY_yYPZ5X8Vm511lsEnIIGFur06MTrVxzGiOfurJo9lFDzoaGbzDftxPw_yOHIOMYxv5zI7p26lWhYoLwoitvYCbcyTFq4UayKxmkWUzh3oyMoJO-WFyN-gnuE Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Domain-Id: None Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Domain-Name: None Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Identity-Status: Confirmed Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Is-Admin-Project: True Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Domain-Id: default Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Domain-Name: Default Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Project-Name: admin Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Role: reader,admin,member Oct 12 22:22:38.904601 n-d-860864-8 devstack@n-api.service[104485]: X-Roles: reader,admin,member Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00bedd5e87d34528aa1f76ccf5be6dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00bedd5e87d34528aa1f76ccf5be6dea"}]}] Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant: admin Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant-Id: 00bedd5e87d34528aa1f76ccf5be6dea Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-Tenant-Name: admin Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-User: admin Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-User-Domain-Id: default Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-User-Domain-Name: Default Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-User-Id: 04e98e4ee5db4af8ac7d158bacfcb2aa Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: X-User-Name: admin Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: method: > Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: exception: Flavor 451 could not be found. Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: action_args: {'id': '451'} Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:22:38.906144 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:38.907036 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: ERROR nova.api.openstack.wsgi Oct 12 22:22:38.908253 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-f3f3c48f-f31e-4ecf-a7a0-1ba8a3f7f4bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:22:38.909493 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-f3f3c48f-f31e-4ecf-a7a0-1ba8a3f7f4bd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011806 Oct 12 22:22:38.909493 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 12 22:22:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:22:40.115666 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:40.116697 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 12 22:22:40.117089 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:22:40.632847 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-eaa6051e-71dc-4ac5-923e-68d2fb3cfd62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:40.652165 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-eaa6051e-71dc-4ac5-923e-68d2fb3cfd62 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400082 Oct 12 22:22:40.652751 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 12 22:22:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:22:41.858767 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:41.859801 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 12 22:22:41.860247 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:42.378278 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-62fd178e-ab99-4cda-927b-9d4eaa67a55e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:42.396947 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-62fd178e-ab99-4cda-927b-9d4eaa67a55e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398243 Oct 12 22:22:42.397502 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 12 22:22:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:22:43.610134 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:43.611168 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 12 22:22:43.611566 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:44.122183 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-6da38823-0113-4893-aaaa-0a49efda9163 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:44.140501 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-6da38823-0113-4893-aaaa-0a49efda9163 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.392675 Oct 12 22:22:44.141025 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 12 22:22:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:22:45.345265 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:45.346268 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 12 22:22:45.346686 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:45.863313 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-686e5359-e58f-472d-b9d8-2fa678b3373e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:22:45.882199 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-686e5359-e58f-472d-b9d8-2fa678b3373e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398581 Oct 12 22:22:45.882752 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 12 22:22:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:22:47.078315 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:47.079355 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 12 22:22:47.079939 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:22:47.595029 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-49b8e387-5031-4493-8408-d1bba03bf1b2 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:22:47.615967 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-49b8e387-5031-4493-8408-d1bba03bf1b2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401980 Oct 12 22:22:47.616512 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Oct 12 22:22:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:44.230486 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:44.231486 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-4dd36e93-9462-4168-ae29-8aa6b601c762 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 12 22:23:44.231908 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 12 22:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:23:44.243425 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:44.619554 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-d9e5bb6e-3c31-48b9-8adc-5ce469537810 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:44.639596 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-d9e5bb6e-3c31-48b9-8adc-5ce469537810 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400990 Oct 12 22:23:44.640168 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 22:23:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:23:44.661874 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_api:SELECT=14 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:23:44.665628 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-450a3c98-5ac6-4486-a421-875a570a246a admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:44.672732 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-450a3c98-5ac6-4486-a421-875a570a246a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012990 Oct 12 22:23:44.673245 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Oct 12 22:23:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:44.684695 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-0b77d57e-5f45-4864-b612-e2a8a10326df admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:44.692007 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-0b77d57e-5f45-4864-b612-e2a8a10326df admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010803 Oct 12 22:23:44.692517 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Oct 12 22:23:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:23:44.703325 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-e7ca3faf-a2e2-4e57-83b2-1bed2180fb16 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:44.710748 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-e7ca3faf-a2e2-4e57-83b2-1bed2180fb16 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010831 Oct 12 22:23:44.711248 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Oct 12 22:23:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:23:44.722726 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-74524475-161e-4c6f-956d-e4311ca7c193 admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:23:44.729809 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-74524475-161e-4c6f-956d-e4311ca7c193 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011106 Oct 12 22:23:44.730324 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Oct 12 22:23:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:28:53.084352 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-e7ca3faf-a2e2-4e57-83b2-1bed2180fb16 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:53.085395 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-e7ca3faf-a2e2-4e57-83b2-1bed2180fb16 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 12 22:28:53.085793 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:28:53.224096 n-d-860864-8 devstack@n-api.service[104485]: DEBUG dbcounter [-] [104485] Writing DB stats nova_api:SELECT=6 {{(pid=104485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:28:53.365640 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:53.370322 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:53.370799 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:53.371247 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:53.371991 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:53.372441 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:53.372862 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:53.410981 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-2b9b6d2b-4744-4e8a-ae72-19da2a0be86b admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.188038 Oct 12 22:28:53.411531 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 12 22:28:53 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:28:54.479349 n-d-860864-8 devstack@n-api.service[104484]: DEBUG nova.api.openstack.wsgi [None req-e7ca3faf-a2e2-4e57-83b2-1bed2180fb16 admin admin] Calling method '>' {{(pid=104484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:54.480915 n-d-860864-8 devstack@n-api.service[104484]: INFO nova.api.openstack.requestlog [None req-e7ca3faf-a2e2-4e57-83b2-1bed2180fb16 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 12 22:28:54.481311 n-d-860864-8 devstack@n-api.service[104484]: [pid: 104484|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 12 22:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:28:54.670643 n-d-860864-8 devstack@n-api.service[104485]: DEBUG nova.api.openstack.wsgi [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] Calling method '>' {{(pid=104485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:28:54.674355 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:54.674852 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:54.675298 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:54.676043 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:28:54.676487 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:28:54.676900 n-d-860864-8 devstack@n-api.service[104485]: DEBUG oslo_concurrency.lockutils [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:28:54.699617 n-d-860864-8 devstack@n-api.service[104485]: INFO nova.api.openstack.requestlog [None req-685e1104-37b0-4a98-953c-4c46abf0fdff admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079902 Oct 12 22:28:54.700185 n-d-860864-8 devstack@n-api.service[104485]: [pid: 104485|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 12 22:28:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:29:38.156914 n-d-860864-8 devstack@n-api.service[104483]: Wed Oct 12 22:29:38 2022 - graceful shutdown triggered... Oct 12 22:29:38.157064 n-d-860864-8 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 22:29:38.157994 n-d-860864-8 devstack@n-api.service[104484]: Gracefully killing worker 1 (pid: 104484)... Oct 12 22:29:38.158431 n-d-860864-8 devstack@n-api.service[104485]: Gracefully killing worker 2 (pid: 104485)... Oct 12 22:29:38.284270 n-d-860864-8 devstack@n-api.service[104484]: DEBUG dbcounter [-] [104484] Writing DB stats nova_api:SELECT=4 {{(pid=104484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:29:39.159003 n-d-860864-8 devstack@n-api.service[104483]: worker 1 buried after 1 seconds Oct 12 22:29:39.159003 n-d-860864-8 devstack@n-api.service[104483]: worker 2 buried after 1 seconds Oct 12 22:29:39.159003 n-d-860864-8 devstack@n-api.service[104483]: goodbye to uWSGI. Oct 12 22:29:39.160611 n-d-860864-8 systemd[1]: devstack@n-api.service: Succeeded. Oct 12 22:29:39.161193 n-d-860864-8 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 22:29:39.163982 n-d-860864-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 22:29:39.183118 n-d-860864-8 devstack@n-api.service[120535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 22:29:39 2022] *** Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: nodename: n-d-860864-8 Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: machine: x86_64 Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: clock source: unix Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: pcre jit disabled Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: detected number of CPU cores: 4 Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: current working directory: / Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: detected binary path: /usr/bin/uwsgi-core Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: your processes number limit is 47680 Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: your memory page size is 4096 bytes Oct 12 22:29:39.207792 n-d-860864-8 devstack@n-api.service[120535]: detected max file descriptor number: 2048 Oct 12 22:29:39.208930 n-d-860864-8 devstack@n-api.service[120535]: lock engine: pthread robust mutexes Oct 12 22:29:39.208930 n-d-860864-8 devstack@n-api.service[120535]: thunder lock: enabled Oct 12 22:29:39.208930 n-d-860864-8 devstack@n-api.service[120535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 22:29:39.208930 n-d-860864-8 devstack@n-api.service[120535]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 22:29:39.247795 n-d-860864-8 devstack@n-api.service[120535]: Python main interpreter initialized at 0x55d7ac7049c0 Oct 12 22:29:39.247795 n-d-860864-8 devstack@n-api.service[120535]: python threads support enabled Oct 12 22:29:39.247795 n-d-860864-8 devstack@n-api.service[120535]: your server socket listen backlog is limited to 100 connections Oct 12 22:29:39.247795 n-d-860864-8 devstack@n-api.service[120535]: your mercy for graceful operations on workers is 90 seconds Oct 12 22:29:39.248198 n-d-860864-8 devstack@n-api.service[120535]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 22:29:39.248294 n-d-860864-8 devstack@n-api.service[120535]: *** Operational MODE: preforking *** Oct 12 22:29:39.248513 n-d-860864-8 devstack@n-api.service[120535]: *** uWSGI is running in multiple interpreter mode *** Oct 12 22:29:39.248513 n-d-860864-8 devstack@n-api.service[120535]: spawned uWSGI master process (pid: 120535) Oct 12 22:29:39.248714 n-d-860864-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 22:29:39.249256 n-d-860864-8 devstack@n-api.service[120535]: spawned uWSGI worker 1 (pid: 120542, cores: 1) Oct 12 22:29:39.249772 n-d-860864-8 devstack@n-api.service[120535]: spawned uWSGI worker 2 (pid: 120543, cores: 1) Oct 12 22:29:39.250080 n-d-860864-8 devstack@n-api.service[120535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 22:29:39.905430 n-d-860864-8 devstack@n-api.service[120543]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 22:29:39.910761 n-d-860864-8 devstack@n-api.service[120542]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 22:29:41.049840 n-d-860864-8 devstack@n-api.service[120543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:29:41.049840 n-d-860864-8 devstack@n-api.service[120543]: from cryptography.utils import int_from_bytes Oct 12 22:29:41.050444 n-d-860864-8 devstack@n-api.service[120543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:29:41.050444 n-d-860864-8 devstack@n-api.service[120543]: from cryptography.utils import int_from_bytes Oct 12 22:29:41.073589 n-d-860864-8 devstack@n-api.service[120542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:29:41.073589 n-d-860864-8 devstack@n-api.service[120542]: from cryptography.utils import int_from_bytes Oct 12 22:29:41.074177 n-d-860864-8 devstack@n-api.service[120542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 22:29:41.074177 n-d-860864-8 devstack@n-api.service[120542]: from cryptography.utils import int_from_bytes Oct 12 22:29:43.466232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 22:29:43.466781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 22:29:43.466953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 22:29:43.467317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 22:29:43.467570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 22:29:43.467982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.468309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.468630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.468946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.469268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.469583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.469911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.470222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.470545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.470801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.471118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.471603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-8 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.472019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.472335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.472645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.472968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.473271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.473590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.473900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.474398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.474849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.475155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.475466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.475811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.476150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.476462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.476780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.477085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.477409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.477716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.478120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-8 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.478498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.478811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.479121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.479533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.479848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.480182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.480501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.480836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.481163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.481470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.481787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.482105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.482425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.482724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.483030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.483338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.483653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.483984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.484283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.484533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.484838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.485156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.485474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.485792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.486043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.486291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.486605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.486920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.487223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.487525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.487826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.488158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.488461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.488764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.489065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.489365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.489679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.489990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.490310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.490611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.490923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.491315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.491562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.491869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.492240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.492555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.492860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.493177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.493497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.493606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 22:29:43.494043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 22:29:43.494138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.494138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.494305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 22:29:43.494455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.494659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 22:29:43.494767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.494915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 22:29:43.495042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.495301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.495393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.495581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.495682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.495882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.496081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.496213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.496320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.496531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.496636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.496834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.496940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.497138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.497241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.497443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.497560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.497743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.497912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.498039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.498472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.498472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.498775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.498959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.499333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-8 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.499436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.499634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.499726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.500019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.500190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.500190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.500535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.500919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.501015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.501102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.501210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.501310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.501467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.501665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.501758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.502942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.503970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.504188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.504291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.504516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.504665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.504829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.504931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.505133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.505232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-8 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.505449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.505556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.505747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.505842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.506051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.506144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.506367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.506527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.506669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.506843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.506970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.507156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.507256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.507478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.507587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.507816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.507940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.508149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.508256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.508447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.508552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.508747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.508848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.509043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.509144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.509358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.509463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.510250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.510364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.510521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.510671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.510813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.510945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.511115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.511218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.511420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.511534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.511729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.511839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.512004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.512109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.512330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.512453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.512639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.512751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.512959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.513061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.513281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.513392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.513533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.513649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.513783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.513959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.514105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.514270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.514426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.514594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.514736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.514904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.515044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.515217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.515350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.515527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.515657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.515843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.516043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.516187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.516329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.516520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.516635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.516834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.516947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.517148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.517259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.517463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.517571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.517771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.517879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.518077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.518182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.518397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.518514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.518716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.518814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.519025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.519132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.519331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.519430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.519672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.519780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.520015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.520127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.520330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.520450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.520641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.520742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.520955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.521067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.521264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.521378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.521569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.521668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.521879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.522001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.522197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.522307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.522506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.522599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.522823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.522924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.523072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.523182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.523377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.523472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.523684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.523785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.524025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.524122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.524335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.524429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.524645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.524785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.524954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.525051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.525807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.525914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.526122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.526216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.526431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.526534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.526882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.527003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.527102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.527198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.527339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.527435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.527645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.527747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.527972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.528071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.528282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.528390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.528587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.528692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.528891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.529005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.529191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.529299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.529500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.529600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.529804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.529918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.530112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.530225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.530422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.530567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.530726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.530848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.531054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.531163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.531357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.531460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.531662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.531765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.532007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.532115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.532315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.532422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.532619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.532713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.532929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.533032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.533234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.533338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.533536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.533642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.533854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.533956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.534155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.534268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.534457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.534552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.534776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.534884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.535081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.535185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.535384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.535484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.535689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.535791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.536017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.536114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.536325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.536428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.536630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.536742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.536936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.537031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.537239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.537339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.537539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.537633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.537849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.537950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.538171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.538263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.538481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.538588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.538787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.538880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.539092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.539194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.539410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 22:29:43.539514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.539719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.539821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.540064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.540208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.540373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.540541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.540759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.540952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.541058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.541270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.541375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.541476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.541594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.541701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.541905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.542070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.542243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.542332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.542487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.542609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.542790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.542922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.543092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.543235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.543410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.543545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.543717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.543863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.544043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.544191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.544334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.544522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.544657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.544843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.544987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.545161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.545265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.545478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.545836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.546043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.546169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.546363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.546491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.546691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.546815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.547019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.547136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.547334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.547433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.547677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.547774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.548046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.548144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.548354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.548457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.548667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.548772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.548987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.549083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.549296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.549392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.549604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.549708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.549910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.550012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.550233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.550329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.550543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.550656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.550862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.551015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.551160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.551323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.551478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.551595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.551801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.551938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.552152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.552250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.552446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.552553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.552761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.552864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.553068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.553161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.553376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.553484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.553740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.553885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.553982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.554137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.554286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.554429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.554624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.554745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.554900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.555210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.555526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.555732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.555843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.556104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.556213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.556947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.557073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.557277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.557385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.557589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.557694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.557892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.557999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.558199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.558301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.558508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.558611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.558822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.558917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.559132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.559235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.559456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.559560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.559939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.560216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.560312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.560580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.560675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.560905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.561157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.561284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.561503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.561605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.561813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.561927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.562122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.562315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.562427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.562660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.562762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.562997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.563104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.563330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.563429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.563642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.563742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.563973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.564089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.564300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.564402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.564609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.564709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.564917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.565024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.565236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.565337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.565552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.565695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.565864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.566005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.566179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.566331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.566492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.566644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.566818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.566972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.567131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.567309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.567447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.567548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.567781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.567878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.568128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.568219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.568436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.568541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.568752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.568848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.569080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.569170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.569397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.569498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.569705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.569853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.570017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.570108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.570323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.570421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.570630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.570738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.570938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.571065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.571252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.571353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.571557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.571655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.571862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.571974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.572736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.572880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.573045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.573203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.573351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.573527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.573706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.573849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.573972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.574170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.574260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.574492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.574591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.574825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.574917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.575145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.575237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.575470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.575617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.575790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.575954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.576130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.576228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.576470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.576562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.576793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.576892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.577111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.577381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.577484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.577728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.577819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.578038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.578130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.578351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.578450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.578665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.578763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.578989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.579088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.579302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.579399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.579624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.579715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.579964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.580058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.580292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.580393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.580605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.580781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.580927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.581241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.581621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.581757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.581934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.582077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.582234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.582354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.582551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.582668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.582874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.583010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.583180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.583306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.583497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.583807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.584150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.584463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.584588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.585026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.585296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.585421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.585629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.585766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.585952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.586068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.586260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.586353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.586585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.586685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.586898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.586997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.587220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.587318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.587525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.587626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.587864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.587999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.588222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.588319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.588558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.588660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.588872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.588992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.589186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.589304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.589509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.589629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.589826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.589921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.590141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.590250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.590453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.590544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.590762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.590888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.591071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.591206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.591388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.591521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.591705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.591857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.592039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.592353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.592513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.592664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.592840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.593080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.593255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.593408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.593557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.593706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.593851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.593995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.594157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.594296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.594433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.594578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.594717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.594862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.595019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.595176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.595325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.595473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.595612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.595807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.595974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.596133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.596276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.596416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.596566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.596716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.596859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.597007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.597160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.597302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.597438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.597594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.597843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.597942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.598181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.598289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.598497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.598627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.598818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.598917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.599133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.599224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.599450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.599548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.599763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.599861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.600172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.600278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.600410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.600690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.600783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.601019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.601111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.601343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.601524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.601684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.601825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.601976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.602126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.602274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.602429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.602567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.602704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.602840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.602978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.603155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.603323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.603491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.603636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.603805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.604038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.604164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.604259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.604453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.604561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.604753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.604851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.605084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.605332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.605474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.605675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.605825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.605996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.606200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.606344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.606500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.606638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.606777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.606921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.607072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.607220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.607358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.607508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.607646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.607790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.607965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.608127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.608220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.608460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.608609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.608778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.608880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.609092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.609190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.609407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.609505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.609715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.609805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.610028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.610133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.610337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.610430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.610650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.610742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.610957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.611063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.611269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.611369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.611577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.611690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.611972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.612157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.612257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.612342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.612518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.612618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.612833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.612939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.613139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.613298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.613466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.613559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.613777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.613878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.614084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.614177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.614392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.614483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.614697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.614789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.615044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.615136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.615354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.615456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.615687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.615786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.616039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.616146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.616371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.616462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.616682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.616775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.616989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.617081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.617316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.617421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.617624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.617728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.617929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.618023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.618234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.618341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.618545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.618680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.618855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.619478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.619687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.619798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.620024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.620118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.620338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.620474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.620649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.620756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.620961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.621060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.621266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.621357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.621594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.621738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.621881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.621972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.622203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.622307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.622512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.622611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.622814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.622912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.623121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.623212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.623435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.623525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.623743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.623833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.624075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.624272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.624376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.624606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.624699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.624988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.625297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.625547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.625698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.625852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.625995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.626193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.626341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.626495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.626645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.626793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.626986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.627138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.627319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.627480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.627622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.627763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.628015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.628174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.628319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.628544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.628766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.628917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.629060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.629208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.629364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.629521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.629662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.629803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.629952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.630101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.630252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.630395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.630536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.630685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.630827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.631053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.631210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.631353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.631448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.631614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.631753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.632011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.632216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.632337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.632550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.632673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.632911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.633111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.633258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.633436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.633656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.633830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.633936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.634140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.634318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.634463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.635175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.635315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.635465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.635767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.635925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.636080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.636222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.636427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.636597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.636686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.636853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.636945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.637179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.637271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.637495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.637655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.637810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.638053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.638166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.638395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.638523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.638722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.638825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.639034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.639135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.639347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.639446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.639650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.639750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.639971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.640075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.640299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.640480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.640593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.640875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.640971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.641279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.641406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.641520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.641688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.641922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.642153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.642458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.642773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.643080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.643351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.643455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.643690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.643806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.644027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.644203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.644349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.644505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.644650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.644916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.645098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.645240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.645389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.645544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.645682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.645839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.645929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.646100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.646193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.646418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.646518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.646740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.646838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.647048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.647146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.647357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.647668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.647759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.647998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.648110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.648313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.648416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.648620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.648726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.648982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.649082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.649315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.649416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.649642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.649734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.649945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.650036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.650280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.650376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.650594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.650696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.650912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.651007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.651228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.651366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.651535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.651636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.651859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.652032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.652194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.652362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.652543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.652687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.652838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.652990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.653159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.653309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.653479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.653626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.653819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.653976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.654118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.654264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.654410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.654551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.654690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.654838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.654984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.655129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.655273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.655418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.655565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.655725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.655964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.656066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.656316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.656410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.656633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.656727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.656942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.657037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.657250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.657361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.657566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.657667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.657884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.657975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.658201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.658301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.658511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.658612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.658822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.658914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.659132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.659223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.659463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.659562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.659776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.659866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.660133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.660240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.660449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.660541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.660762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.660852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.661071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.661170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.661379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.661501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.661713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.661824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.662040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.662180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.662341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.662433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.662659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.662757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.662992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.663093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.663315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.663407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.663680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.663789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.664020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.664121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.664340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.664479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.664807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.665145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.665388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.665508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.665714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.665880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.666080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.666194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.666366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.666487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.666680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.666799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.667011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.667278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.667465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.667618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.667745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.668147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.668316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.668316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.668606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.668765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.668908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.669904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.670129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.670224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.670446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.670794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.671039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.671131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.671389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.671520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.671716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.671841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.672145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.672464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.672775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.672980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.673115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.673332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.673466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.673689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.673788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.674025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.674169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.674360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.674509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.674693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.674885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.675007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.675212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.675343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.675530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.675674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.675855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.676032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.676208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.676345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.676534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.676668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.676856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.676998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.677174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.677306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.677496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.677595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.677824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.677923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.678143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.678250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.678464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.678565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.678786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.678887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.679093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.679195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.679398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.679490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.679703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.679803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.680030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.680148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.680357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.680449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.680663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.680769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.680987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.681088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.681296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.682069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.682198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.682394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.682499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.682717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.682821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.683058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.683154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.683361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.683461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.683692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.683785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.684029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.684126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.684357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.684625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.684718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.684947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.685057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.685262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.685367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.685580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.685679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.685896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.685988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.686206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.686309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.686520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.686618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.686831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.686923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.687138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.687238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.687451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.687585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.687767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.687923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.688340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.688446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.688671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.688763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.688987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.689081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.689301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.689401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.689614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.689706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.689929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.690020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.690244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.690336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.690556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.690650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.690869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.690961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.691179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.691270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.691489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.691579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.691806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.691923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.692192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.692367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.692470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.692596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.692754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.692863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.693071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.693173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.693382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.693473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.693696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.693797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.694006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.694098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.694376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.694511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.694693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.694829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.695001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.695193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.695323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.695509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.695637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.695830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.696169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.696496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.696683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.696865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.697040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.697743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.697894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.698038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.698179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.698335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.698478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.698659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.698816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.698967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.699109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.699337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.699482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.699641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.699784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.700016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.700233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.700371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.700580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.700701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.700888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.701005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.701199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.701326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.701523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.701649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.701837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.701953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.702234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.702440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.702567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.702679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.702788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.703056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.703196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.703315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.703495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.703643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.704417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.704588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.704750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.704893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.705033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.705174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.705329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.705472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.705622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.705764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.705913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.706065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.706213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.706373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.706515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.706658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.706807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.706950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.707091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.707241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.707971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.708141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.708286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.708442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.708597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.708758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.708758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.709036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.709186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.709336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.709487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.709630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.709771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.709911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.710052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.710200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.710361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.710503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.710670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.710819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.710971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.711120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.711275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.711416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.711607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.711755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.711926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.712085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.712238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.712563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.712740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.712893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.713035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.713275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.713424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.713573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.713722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.713870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.714012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.714402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.714643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.714790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.714961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.715188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.715343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.715494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.715494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.715769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.715936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.716095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.716293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.716452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.716602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.716744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.716902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.716902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.717181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.717324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.717466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.717607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.717747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.717895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.718046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.718188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.718329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.718478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.718620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.718770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.718920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.719070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.719220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.719360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.719508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.719659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.719801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.719982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.720139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.720287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.720437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.720608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.720759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.720908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.721057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.721199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.721339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.721488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.721679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.721828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.721969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.722110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.722356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.722663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.722836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.722985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.723128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.723294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.723523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.723523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.723798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.723978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.724136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.724487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.724671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.724909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.725059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.725219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.725386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.725620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.725782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.725782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.725782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.726186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.726328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.726480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.726629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.726780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.726929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.727082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.727222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.727371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.727512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.727654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.727801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.727989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.728147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.728326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.728482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.728631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.728779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.728922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.729072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.729222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.729371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.729514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.729654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.729795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.730922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.731192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.731333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.731481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.731622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.731819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.732579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.732872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.733029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.733173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.733324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.733491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.733717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.733867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.734009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.734151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.734303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.734750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.734940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.735127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.735305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.735712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.735926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.736119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.736307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.736502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.736680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.736868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.737057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.737243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.737421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.737606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.737791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.737983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.738160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.738346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.738524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.738712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.738889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.739079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.739257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.739435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.739619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.739796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.739996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.740191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.740370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.740557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.740743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.740930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.741117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.741278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.741429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.741429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.741429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.741885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.742045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.742195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.742337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.742480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.742621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.742762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.743080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.743235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.743384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.743528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.743676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.743676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.744820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.744971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.745113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.745253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.745394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.745549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.745870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.746228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.746385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.746528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.746668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.746819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.746962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.747110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.747252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.747393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.747534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.747683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.747826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.748014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.748014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.748296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.748452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.748595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.748736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.748886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.749622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.751013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.752201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.752201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.752201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.752201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.752201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.752201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.753167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.753167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.753167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.753579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.753579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.753865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.754185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.754496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.754872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.755120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.755433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.755745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.756090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.756403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.756711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.757028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.757344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.757673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.758000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.761024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.761024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.761024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.761024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.761024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.761024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.761024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.762083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.762083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.762083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 22:29:43.762083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 22:29:43.815188 n-d-860864-8 devstack@n-api.service[120543]: INFO dbcounter [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Registered counter for database nova_api Oct 12 22:29:43.823134 n-d-860864-8 devstack@n-api.service[120542]: INFO dbcounter [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Registered counter for database nova_api Oct 12 22:29:43.839441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:43.843119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:43.846901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:43.849724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:43.905866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.context [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=120542) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 22:29:43.907148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.context [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=120543) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 22:29:43.909878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:43.910348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:43.911145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:43.911622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:43.911936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:43.912666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:43.913107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:43.913245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:43.914004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:29:43.915085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:29:43.915196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:43.917145 n-d-860864-8 devstack@n-api.service[120542]: INFO dbcounter [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Registered counter for database nova_cell0 Oct 12 22:29:43.917333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:29:43.919221 n-d-860864-8 devstack@n-api.service[120543]: INFO dbcounter [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Registered counter for database nova_cell0 Oct 12 22:29:43.921480 n-d-860864-8 devstack@n-api.service[120542]: INFO dbcounter [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Registered counter for database nova_cell1 Oct 12 22:29:43.923985 n-d-860864-8 devstack@n-api.service[120543]: INFO dbcounter [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Registered counter for database nova_cell1 Oct 12 22:29:43.929800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:43.932637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:43.934992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:43.936731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:43.938738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:43.941397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:43.941942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:44.087468 n-d-860864-8 devstack@n-api.service[120542]: INFO dbcounter [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Registered counter for database nova_cell0 Oct 12 22:29:44.087663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:44.094348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:44.097475 n-d-860864-8 devstack@n-api.service[120543]: INFO dbcounter [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Registered counter for database nova_cell0 Oct 12 22:29:44.098995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:44.104983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 22:29:44.109654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 22:29:44.418680 n-d-860864-8 devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:29:44.426348 n-d-860864-8 devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:29:44.426527 n-d-860864-8 devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:29:44.433697 n-d-860864-8 devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:29:44.778418 n-d-860864-8 devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:29:44.782152 n-d-860864-8 devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 22:29:44.784413 n-d-860864-8 devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-1745da04-e182-4598-92ee-82fb2e499238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:29:44.788242 n-d-860864-8 devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-a89a9281-eecd-478d-817e-611fbece1784 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 22:29:44.789703 n-d-860864-8 devstack@n-api.service[120543]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7ac7049c0 pid: 120543 (default app) Oct 12 22:29:44.793565 n-d-860864-8 devstack@n-api.service[120542]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7ac7049c0 pid: 120542 (default app) Oct 12 22:30:27.516851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:27.518672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:27.519869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:27.520896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:28.442153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:28.443140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:28.446169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:28.446946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:29.485766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d1292fb-28b9-4def-8730-eda70016f40c tempest-InstanceUsageAuditLogTestJSON-18440850 tempest-InstanceUsageAuditLogTestJSON-18440850-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:29.506988 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d1292fb-28b9-4def-8730-eda70016f40c tempest-InstanceUsageAuditLogTestJSON-18440850 tempest-InstanceUsageAuditLogTestJSON-18440850-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 22:30:27" status: 200 len: 318 microversion: 2.1 time: 2.009897 Oct 12 22:30:29.511933 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 22:30:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2022%3A30%3A27 => generated 318 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:29.633979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b156949-7d9f-4618-80b7-40ab1f17c5f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-581098016", "ram": 512, "vcpus": 1, "disk": 10, "id": 1596371622, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:29.714732 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b156949-7d9f-4618-80b7-40ab1f17c5f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.205300 Oct 12 22:30:29.716317 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2/2] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:30:29 2022] POST /compute/v2.1/flavors => generated 415 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:29.789693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:29.795973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:29.797952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:29.798906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:29.799816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:29.800955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:29.801878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:29.868631 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57309156-c278-44e9-889e-3c225a6333d8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.150600 Oct 12 22:30:29.871130 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3/3] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:30:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:29.958374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43404525-f0a6-4eb1-bce8-07476c89ec17 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-143200647", "ram": 512, "vcpus": 1, "disk": 10, "id": 2080154261, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:29.984933 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-43404525-f0a6-4eb1-bce8-07476c89ec17 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.112480 Oct 12 22:30:29.985842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 4/4] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:30:29 2022] POST /compute/v2.1/flavors => generated 415 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:30.071959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '.version_select at 0x7f45051b0f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:30.092657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=120543) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 22:30:30.093428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.093778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.107379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Calling method '.version_select at 0x7f45053234c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:30.108402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.121475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=120542) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 22:30:30.122622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.123646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.124789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.161391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.162808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.163486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.170872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.171356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.171779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.180785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.181661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.182270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.190304 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3648e7dc-003b-42ed-8e6a-f454cb492fec tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.777839 Oct 12 22:30:30.191635 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1/5] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:30:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:30.197212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-73e426ce-c81c-4497-916f-8322871fb185 tempest-InstanceUsageAuditLogTestJSON-18440850 tempest-InstanceUsageAuditLogTestJSON-18440850-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:30.202308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.205693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.206266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.216774 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5d51dbc-d5ca-4a93-a912-1bf2dab0f9bb tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.229543 Oct 12 22:30:30.218641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 5/6] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 12 22:30:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:30.233806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-73e426ce-c81c-4497-916f-8322871fb185 tempest-InstanceUsageAuditLogTestJSON-18440850 tempest-InstanceUsageAuditLogTestJSON-18440850-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.040686 Oct 12 22:30:30.234539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2/7] 10.222.0.20 () {58 vars in 1185 bytes} [Wed Oct 12 22:30:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:30.239126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e1df0e5-9bbf-499e-9a38-12785bdc0c01 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-27208911"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:30.264247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-4e1df0e5-9bbf-499e-9a38-12785bdc0c01 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid 144ea471-6691-4de6-a9e5-ee71df1ecb3d for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:30.428448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e1df0e5-9bbf-499e-9a38-12785bdc0c01 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.191129 Oct 12 22:30:30.435671 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3/8] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:30 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:30.444167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34f6687e-f13e-4549-833f-973fd06b5f18 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:30.527853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ca7441c-dd98-4cf6-9caa-6f576b573d52 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:30.551969 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34f6687e-f13e-4549-833f-973fd06b5f18 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/2080154261/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.118198 Oct 12 22:30:30.569352 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 4/9] 10.222.0.20 () {60 vars in 1224 bytes} [Wed Oct 12 22:30:30 2022] POST /compute/v2.1/flavors/2080154261/os-extra_specs => generated 66 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:30.577558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Calling method '.version_select at 0x7f4505187820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:30.595857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.597717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.600325 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8ca7441c-dd98-4cf6-9caa-6f576b573d52 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] HTTP exception thrown: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:30.601078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ca7441c-dd98-4cf6-9caa-6f576b573d52 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Request method failure captured: Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/flavors/1596371622/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AB94q_L3x6e5KbTzhhHP9g2Y2DY1FMcAlUm1Va6_5t3jiMbly7_t0Z6wxAZ03SmhheSF0Qu6ArZCxSL_gHfjMrPNSrm66xljwtoe7Ejdu66QDNz0fCGaknwte1AyduP3-OvqJzop85csURe8wcLBgFXePdx9sb0y5m9jJVdCtOV1U Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:30:30.612882 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}] Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7f59fe14cc66491ea196d7c7b9457a02 Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:30.614030 n-d-860864-8 devstack@n-api.service[120543]: exception: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'flavor_id': '1596371622', 'id': 'hw:cpu_thread_policy'} Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:30.614524 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:30.615454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:30.615454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:30.615454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:30.615454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:30.615454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:30.615454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:30.615454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:30.618880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ca7441c-dd98-4cf6-9caa-6f576b573d52 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Returning 404 to user: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:30.620235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ca7441c-dd98-4cf6-9caa-6f576b573d52 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] 10.222.0.20 "GET /compute/v2.1/flavors/1596371622/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.400309 Oct 12 22:30:30.626417 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:30:30 2022] GET /compute/v2.1/flavors/1596371622/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:30.634935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6337990-55db-486c-b17f-b3ace018a2c5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:30.661216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.665980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.666632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.678176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6337990-55db-486c-b17f-b3ace018a2c5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.678665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6337990-55db-486c-b17f-b3ace018a2c5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.679199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6337990-55db-486c-b17f-b3ace018a2c5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.775930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:30.779127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:30.779822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:30.809772 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41688e04-23d7-4072-9a3a-d6d03a56b4e6 tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-860864-8/servers" status: 200 len: 104 microversion: 2.1 time: 0.238887 Oct 12 22:30:30.811411 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1212 bytes} [Wed Oct 12 22:30:30 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-8/servers => generated 104 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:31.196223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67788deb-804f-431c-b0e3-e9f6a5427715 tempest-FlavorsExtraSpecsTestJSON-203201341 tempest-FlavorsExtraSpecsTestJSON-203201341-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.235015 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67788deb-804f-431c-b0e3-e9f6a5427715 tempest-FlavorsExtraSpecsTestJSON-203201341 tempest-FlavorsExtraSpecsTestJSON-203201341-project] 10.222.0.20 "GET /compute/v2.1/flavors/2080154261/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.422338 Oct 12 22:30:31.236926 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1203 bytes} [Wed Oct 12 22:30:30 2022] GET /compute/v2.1/flavors/2080154261/os-extra_specs => generated 66 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.245778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84495e21-77d0-44fa-af99-3585d9872e17 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.249737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-84495e21-77d0-44fa-af99-3585d9872e17 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '7f59fe14cc66491ea196d7c7b9457a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0acae1a56f1485495365cd90e37fd73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84495e21-77d0-44fa-af99-3585d9872e17 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Request method failure captured: Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/flavors/1596371622/os-extra_specs HTTP/1.1 Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 66 Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AB94q_L3x6e5KbTzhhHP9g2Y2DY1FMcAlUm1Va6_5t3jiMbly7_t0Z6wxAZ03SmhheSF0Qu6ArZCxSL_gHfjMrPNSrm66xljwtoe7Ejdu66QDNz0fCGaknwte1AyduP3-OvqJzop85csURe8wcLBgFXePdx9sb0y5m9jJVdCtOV1U Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:31.254339 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}] Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7f59fe14cc66491ea196d7c7b9457a02 Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 12 22:30:31.255655 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'flavor_id': '1596371622', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:31.256355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 22:30:31.257199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.260334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84495e21-77d0-44fa-af99-3585d9872e17 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:31.261431 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84495e21-77d0-44fa-af99-3585d9872e17 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] 10.222.0.20 "POST /compute/v2.1/flavors/1596371622/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023302 Oct 12 22:30:31.262196 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 7/13] 10.222.0.20 () {60 vars in 1224 bytes} [Wed Oct 12 22:30:31 2022] POST /compute/v2.1/flavors/1596371622/os-extra_specs => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:31.269275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Calling method '.version_select at 0x7f4504919550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.271498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:31.272239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:31.272881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:31.302438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:31.305519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:31.306273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:31.317385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:31.317956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:31.318461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:31.325685 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3880f5e4-7c0d-45be-8ddf-e293b7e512ab tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062223 Oct 12 22:30:31.332156 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:31.339084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ee26b43-557f-4cfa-8681-2d06de93a382 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.379569 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ee26b43-557f-4cfa-8681-2d06de93a382 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/2080154261/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046031 Oct 12 22:30:31.385232 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 9/15] 10.222.0.20 () {60 vars in 1224 bytes} [Wed Oct 12 22:30:31 2022] POST /compute/v2.1/flavors/2080154261/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.389808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-efebe554-8d7d-400d-ab8e-3387d7de48f0 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.430555 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-efebe554-8d7d-400d-ab8e-3387d7de48f0 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1596371622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044099 Oct 12 22:30:31.436127 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 10/16] 10.222.0.20 () {60 vars in 1224 bytes} [Wed Oct 12 22:30:31 2022] POST /compute/v2.1/flavors/1596371622/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.441222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Calling method '.version_select at 0x7f4504907b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.445102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:31.446448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:31.447441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:31.465167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:31.465661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:31.466106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:31.475576 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb5d58a9-2a8d-4619-a651-b729f620564f tempest-HypervisorAdminUnderV252Test-656323749 tempest-HypervisorAdminUnderV252Test-656323749-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-860864-8/search" status: 200 len: 104 microversion: 2.1 time: 0.040009 Oct 12 22:30:31.483700 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 11/17] 10.222.0.20 () {58 vars in 1209 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-8/search => generated 104 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:31.490693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cdc9a60-73c5-45b4-a317-f38722535696 tempest-FlavorsExtraSpecsTestJSON-203201341 tempest-FlavorsExtraSpecsTestJSON-203201341-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.501307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cdc9a60-73c5-45b4-a317-f38722535696 tempest-FlavorsExtraSpecsTestJSON-203201341 tempest-FlavorsExtraSpecsTestJSON-203201341-project] 10.222.0.20 "GET /compute/v2.1/flavors/2080154261/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015949 Oct 12 22:30:31.501884 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 12/18] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/flavors/2080154261/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.511457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ae4f99f-bef5-4783-99c0-8922bea689d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.513193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5ae4f99f-bef5-4783-99c0-8922bea689d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '7f59fe14cc66491ea196d7c7b9457a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0acae1a56f1485495365cd90e37fd73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ae4f99f-bef5-4783-99c0-8922bea689d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Request method failure captured: Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AB94q_L3x6e5KbTzhhHP9g2Y2DY1FMcAlUm1Va6_5t3jiMbly7_t0Z6wxAZ03SmhheSF0Qu6ArZCxSL_gHfjMrPNSrm66xljwtoe7Ejdu66QDNz0fCGaknwte1AyduP3-OvqJzop85csURe8wcLBgFXePdx9sb0y5m9jJVdCtOV1U Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:31.515264 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}] Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7f59fe14cc66491ea196d7c7b9457a02 Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:31.516367 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'flavor_id': '1596371622', 'id': 'hw:numa_nodes'} Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:31.516885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.517746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ae4f99f-bef5-4783-99c0-8922bea689d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:31.518492 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5ae4f99f-bef5-4783-99c0-8922bea689d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013844 Oct 12 22:30:31.518492 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 13/19] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:30:31 2022] DELETE /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:31.526774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ecb454fa-f3ba-4a2b-99c7-868a81a3bfb2 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.555599 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ecb454fa-f3ba-4a2b-99c7-868a81a3bfb2 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/2080154261/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035550 Oct 12 22:30:31.557034 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 14/20] 10.222.0.20 () {60 vars in 1224 bytes} [Wed Oct 12 22:30:31 2022] POST /compute/v2.1/flavors/2080154261/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.562157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eaac8bdb-1916-4a8c-9897-8aff1511239b tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.589780 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eaac8bdb-1916-4a8c-9897-8aff1511239b tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1596371622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031433 Oct 12 22:30:31.590290 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 15/21] 10.222.0.20 () {60 vars in 1224 bytes} [Wed Oct 12 22:30:31 2022] POST /compute/v2.1/flavors/1596371622/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.594772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3329deb9-958e-4a39-a4ec-128709e0d371 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.602668 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3329deb9-958e-4a39-a4ec-128709e0d371 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/2080154261/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011207 Oct 12 22:30:31.603762 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 16/22] 10.222.0.20 () {58 vars in 1203 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/flavors/2080154261/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.608393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27337273-39ef-4a72-a85b-7d011f193f60 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.611535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-27337273-39ef-4a72-a85b-7d011f193f60 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '7f59fe14cc66491ea196d7c7b9457a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0acae1a56f1485495365cd90e37fd73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27337273-39ef-4a72-a85b-7d011f193f60 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Request method failure captured: Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 22 Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AB94q_L3x6e5KbTzhhHP9g2Y2DY1FMcAlUm1Va6_5t3jiMbly7_t0Z6wxAZ03SmhheSF0Qu6ArZCxSL_gHfjMrPNSrm66xljwtoe7Ejdu66QDNz0fCGaknwte1AyduP3-OvqJzop85csURe8wcLBgFXePdx9sb0y5m9jJVdCtOV1U Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:31.613132 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0acae1a56f1485495365cd90e37fd73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0acae1a56f1485495365cd90e37fd73"}]}] Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f0acae1a56f1485495365cd90e37fd73 Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7f59fe14cc66491ea196d7c7b9457a02 Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: {"hw:numa_nodes": "1"} Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:31.614348 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'flavor_id': '1596371622', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:31.615208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 22:30:31.616232 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.617844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27337273-39ef-4a72-a85b-7d011f193f60 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:31.617844 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27337273-39ef-4a72-a85b-7d011f193f60 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206 tempest-FlavorsExtraSpecsNegativeTestJSON-1830886206-project] 10.222.0.20 "PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009648 Oct 12 22:30:31.617844 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 17/23] 10.222.0.20 () {60 vars in 1265 bytes} [Wed Oct 12 22:30:31 2022] PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:31.622504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d5948fd-f180-4da0-999d-f97bbc962919 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.653648 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d5948fd-f180-4da0-999d-f97bbc962919 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/2080154261/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.037673 Oct 12 22:30:31.658412 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 18/24] 10.222.0.20 () {60 vars in 1265 bytes} [Wed Oct 12 22:30:31 2022] PUT /compute/v2.1/flavors/2080154261/os-extra_specs/hw:numa_nodes => generated 22 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.659048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-704d0ead-da6a-495f-8dab-7372320fe982 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.670253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-704d0ead-da6a-495f-8dab-7372320fe982 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] HTTP exception thrown: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-704d0ead-da6a-495f-8dab-7372320fe982 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Request method failure captured: Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/flavors/1596371622/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AELYBuuKr4SPZ3ON3XwxGVhjXC2rAqERTOAMiormo-uWmlcBAKTt_IEUdGzHEMkDpIpt7C2jNI8rcOwIGeP6sbTiULwiqOfhRvExiETla6zDTwmFkEpBx1Uc8oiWIu-y2RHukt7x_kE-8VKBn0Ka60A1ZsBTP5prulcCsu3v4xjN4 Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6f76044ae94f43e8a6086892e9f5ca8e Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:31.671659 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f76044ae94f43e8a6086892e9f5ca8e"}]}] Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6f76044ae94f43e8a6086892e9f5ca8e Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 335e5a3754ad4be7b8fc4a724bcc97f9 Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:31.672840 n-d-860864-8 devstack@n-api.service[120542]: exception: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'flavor_id': '1596371622', 'id': 'hw:cpu_thread_policy'} Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.673428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-704d0ead-da6a-495f-8dab-7372320fe982 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Returning 404 to user: Flavor 1596371622 has no extra specs with key hw:cpu_thread_policy. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:31.674706 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-704d0ead-da6a-495f-8dab-7372320fe982 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1596371622/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.017715 Oct 12 22:30:31.675828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 19/25] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:30:31 2022] DELETE /compute/v2.1/flavors/1596371622/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:31.682594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4d1f865-2a34-4c8c-a9c2-4225748470a3 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.691010 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b4d1f865-2a34-4c8c-a9c2-4225748470a3 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/2080154261/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014030 Oct 12 22:30:31.692025 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 20/26] 10.222.0.20 () {58 vars in 1203 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/flavors/2080154261/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.697816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5548493e-0e60-46e2-8db7-c9b6e40050d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.701598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5548493e-0e60-46e2-8db7-c9b6e40050d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5548493e-0e60-46e2-8db7-c9b6e40050d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Request method failure captured: Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 27 Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AELYBuuKr4SPZ3ON3XwxGVhjXC2rAqERTOAMiormo-uWmlcBAKTt_IEUdGzHEMkDpIpt7C2jNI8rcOwIGeP6sbTiULwiqOfhRvExiETla6zDTwmFkEpBx1Uc8oiWIu-y2RHukt7x_kE-8VKBn0Ka60A1ZsBTP5prulcCsu3v4xjN4 Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6f76044ae94f43e8a6086892e9f5ca8e Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:31.703208 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f76044ae94f43e8a6086892e9f5ca8e"}]}] Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6f76044ae94f43e8a6086892e9f5ca8e Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 335e5a3754ad4be7b8fc4a724bcc97f9 Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: {"hw:cpu_policy": "shared"} Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:31.704748 n-d-860864-8 devstack@n-api.service[120542]: exception: Request body and URI mismatch Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'flavor_id': '1596371622', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.705348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.706256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:31.706256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:31.706256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 12 22:30:31.706256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.706256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5548493e-0e60-46e2-8db7-c9b6e40050d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:31.706256 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5548493e-0e60-46e2-8db7-c9b6e40050d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.012298 Oct 12 22:30:31.713502 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 21/27] 10.222.0.20 () {60 vars in 1265 bytes} [Wed Oct 12 22:30:31 2022] PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:30:31.721650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fddba609-27bb-4ac7-a27f-ee014749726d tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.734863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=5,nova_api:SAVEPOINT=12,nova_api:RELEASE=12,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:31.779207 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fddba609-27bb-4ac7-a27f-ee014749726d tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2080154261/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.063924 Oct 12 22:30:31.783071 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 22/28] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:30:31 2022] DELETE /compute/v2.1/flavors/2080154261/os-extra_specs/hw:numa_nodes => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:31.785754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fa4a90a-ded9-4e20-8f4f-dc7164b815f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fa4a90a-ded9-4e20-8f4f-dc7164b815f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Request method failure captured: Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 49 Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AELYBuuKr4SPZ3ON3XwxGVhjXC2rAqERTOAMiormo-uWmlcBAKTt_IEUdGzHEMkDpIpt7C2jNI8rcOwIGeP6sbTiULwiqOfhRvExiETla6zDTwmFkEpBx1Uc8oiWIu-y2RHukt7x_kE-8VKBn0Ka60A1ZsBTP5prulcCsu3v4xjN4 Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6f76044ae94f43e8a6086892e9f5ca8e Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:31.792328 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f76044ae94f43e8a6086892e9f5ca8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f76044ae94f43e8a6086892e9f5ca8e"}]}] Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6f76044ae94f43e8a6086892e9f5ca8e Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 335e5a3754ad4be7b8fc4a724bcc97f9 Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 12 22:30:31.793538 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'flavor_id': '1596371622', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance: Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 12 22:30:31.794368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.799513 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fa4a90a-ded9-4e20-8f4f-dc7164b815f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fa4a90a-ded9-4e20-8f4f-dc7164b815f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012229 Oct 12 22:30:31.800576 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 23/29] 10.222.0.20 () {60 vars in 1265 bytes} [Wed Oct 12 22:30:31 2022] PUT /compute/v2.1/flavors/1596371622/os-extra_specs/hw:numa_nodes => generated 117 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:30:31.801813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92c059e6-c2cf-482e-87ce-5d1688c320bc tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.819856 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6337990-55db-486c-b17f-b3ace018a2c5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 240 microversion: 2.1 time: 1.191584 Oct 12 22:30:31.828340 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92c059e6-c2cf-482e-87ce-5d1688c320bc tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2080154261/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.032436 Oct 12 22:30:31.828448 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 7/30] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:30:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 240 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:31.829174 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 24/31] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:30:31 2022] DELETE /compute/v2.1/flavors/2080154261/os-extra_specs/hw:cpu_policy => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:31.835827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.842196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-014715b3-0693-465b-b6d2-097706b8d57d tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.848093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:31.849574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:31.849574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:31.889396 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-014715b3-0693-465b-b6d2-097706b8d57d tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1596371622" status: 202 len: 0 microversion: 2.1 time: 0.056556 Oct 12 22:30:31.891227 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 8/32] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:30:31 2022] DELETE /compute/v2.1/flavors/1596371622 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:30:31.899256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a21ec40-5134-463e-abdc-6c85498dc514 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.908662 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-860864-8. Oct 12 22:30:31.922183 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a21ec40-5134-463e-abdc-6c85498dc514 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/2080154261/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029788 Oct 12 22:30:31.923714 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 9/33] 10.222.0.20 () {58 vars in 1203 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/flavors/2080154261/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 39 Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:31.924865 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: {"add_host": {"host": "n-h2-860864-8"}} Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:31.925887 n-d-860864-8 devstack@n-api.service[120542]: exception: Aggregate 1 already has host n-h2-860864-8. Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-860864-8'}}} Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:30:31.926527 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-860864-8-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 22:30:31.927425 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 22:30:31.928336 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:30:31.929183 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-860864-8-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 22, 30, 31, 895007), 'updated_at': None, 'host': 'n-h2-860864-8', 'aggregate_id': 1}] Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.930712 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-860864-8. Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.931502 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-860864-8. Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:31.932446 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:31.933401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-860864-8. Oct 12 22:30:31.933401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:31.933401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-860864-8. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:31.933401 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b8887ad-8921-4440-986d-aff1794dc06f tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.096336 Oct 12 22:30:31.933401 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 25/34] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:30:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 12 22:30:31.940117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a501c69b-32e3-4561-8b77-1d5ba6b941d2 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.940214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6053f1c5-a29b-4ac9-a84c-8c6145e81193 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:31.969314 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6053f1c5-a29b-4ac9-a84c-8c6145e81193 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859 tempest-FlavorsExtraSpecsNegativeTestJSON-1640224859-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.034136 Oct 12 22:30:31.970493 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 10/35] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:31.973448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a501c69b-32e3-4561-8b77-1d5ba6b941d2 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2080154261" status: 202 len: 0 microversion: 2.1 time: 0.039706 Oct 12 22:30:31.974605 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 26/36] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:30:31 2022] DELETE /compute/v2.1/flavors/2080154261 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:30:31.989247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9bf9a5cc-1f94-4e5e-b54e-29d86a98a3a3 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:31.999773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27e3b70d-d817-4b1e-960b-d11296da06d2 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:32.003080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bf9a5cc-1f94-4e5e-b54e-29d86a98a3a3 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:32.003653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bf9a5cc-1f94-4e5e-b54e-29d86a98a3a3 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:32.004383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bf9a5cc-1f94-4e5e-b54e-29d86a98a3a3 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:32.053529 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27e3b70d-d817-4b1e-960b-d11296da06d2 tempest-FlavorsExtraSpecsTestJSON-1926998663 tempest-FlavorsExtraSpecsTestJSON-1926998663-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058128 Oct 12 22:30:32.054153 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 27/37] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:30:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:30:32.166488 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9bf9a5cc-1f94-4e5e-b54e-29d86a98a3a3 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 225 microversion: 2.1 time: 0.194705 Oct 12 22:30:32.167179 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 11/38] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:30:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:32.182011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6fb50413-7f2f-4194-9fff-8c013f62fcb6 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:32.221503 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6fb50413-7f2f-4194-9fff-8c013f62fcb6 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.045840 Oct 12 22:30:32.222763 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 28/39] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:32 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:32.233065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce1db14e-f075-4327-a6cd-40c823daa456 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2120054224"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:32.236838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-ce1db14e-f075-4327-a6cd-40c823daa456 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid 229a4de2-709e-434d-9726-44f32281cb7f for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:32.277518 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce1db14e-f075-4327-a6cd-40c823daa456 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048405 Oct 12 22:30:32.280980 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 12/40] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:32.295466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-674e411b-4c0b-43e0-8985-9fbcadd0ece2 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-145808504", "name": "tempest-test_aggregate-202751432"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:32.340175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-674e411b-4c0b-43e0-8985-9fbcadd0ece2 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid 3365835b-24ef-4033-8875-a57514852cc5 for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:32.397247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-674e411b-4c0b-43e0-8985-9fbcadd0ece2 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.108735 Oct 12 22:30:32.399578 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 13/41] 10.222.0.20 () {60 vars in 1165 bytes} [Wed Oct 12 22:30:32 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:30:32.413886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eed78317-81dc-4b45-b148-edcfa10c4c34 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:32.436612 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eed78317-81dc-4b45-b148-edcfa10c4c34 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.029131 Oct 12 22:30:32.437626 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 14/42] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:30:32 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:32.449437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b75528e-e723-41f0-8c08-8e0c88f3d15a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:32.461367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b75528e-e723-41f0-8c08-8e0c88f3d15a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:32.462575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b75528e-e723-41f0-8c08-8e0c88f3d15a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:32.463017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b75528e-e723-41f0-8c08-8e0c88f3d15a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:32.679275 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b75528e-e723-41f0-8c08-8e0c88f3d15a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 312 microversion: 2.1 time: 0.233486 Oct 12 22:30:32.696167 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 15/43] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:30:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:30:32.972226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cccb2ee0-a8ed-49a6-8ffc-310e715c2783 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cccb2ee0-a8ed-49a6-8ffc-310e715c2783 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'edd00d008d8b40098df6e9810401b106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5e3c5f9d0f4f3daab8448f1c73c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cccb2ee0-a8ed-49a6-8ffc-310e715c2783 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Request method failure captured: Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 39 Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ACHeIKxskmceJY_w_a1IV879XvctVU9m3M0CEsbNo1_mPy2UJ0mTdqcpGeFrphxggdTyXv_EarSna1zPRh7ZTXDY0DksgqnaYSo-ck4gQw2tc3zy2o3tTFzAfhGmLhuyqIifjVBMPEoDZTEkDm5P-WL1nTDhY1dsHZa6TYMLWHC8U Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:32.978114 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}] Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: edd00d008d8b40098df6e9810401b106 Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: {"add_host": {"host": "n-h2-860864-8"}} Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:32.979413 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-860864-8'}}} Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:32.980131 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 22:30:32.981015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:32.982771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cccb2ee0-a8ed-49a6-8ffc-310e715c2783 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:32.982771 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cccb2ee0-a8ed-49a6-8ffc-310e715c2783 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.693364 Oct 12 22:30:32.982771 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 29/44] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:30:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 695 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:32.989127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-244a292c-30c7-4a6f-8588-b77b5ceb8237 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.030054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-244a292c-30c7-4a6f-8588-b77b5ceb8237 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.044491 Oct 12 22:30:33.030784 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 16/45] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:32 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:33.042850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6f1db80-a089-49c2-83b0-a90c3767c2e8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-976766842"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.051462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-f6f1db80-a089-49c2-83b0-a90c3767c2e8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid 2b052994-cef5-467d-b2c6-0284839b4dfe for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:33.085500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6f1db80-a089-49c2-83b0-a90c3767c2e8 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.048776 Oct 12 22:30:33.097592 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 30/46] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:33.102364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-748431452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.129582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:33.130297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:33.130874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:33.164922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:33.166522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:33.167203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:33.188384 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-748431452 could not be found. Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 57 Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:30:33.202088 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: {"add_host": {"host": "tempest-nonexist_host-748431452"}} Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.203179 n-d-860864-8 devstack@n-api.service[120543]: exception: Compute host tempest-nonexist_host-748431452 could not be found. Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-748431452'}}} Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-748431452' is not mapped to any cell Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.204417 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 12 22:30:33.205306 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-748431452 could not be found. Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-748431452 could not be found. Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.206235 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.207188 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.207188 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.207188 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.207188 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:33.207188 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:33.207188 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-748431452 could not be found. Oct 12 22:30:33.207188 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.209463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-748431452 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.210533 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d3285d3-f477-472d-b949-a779851ff487 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.113206 Oct 12 22:30:33.211355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 17/47] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:33.219185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37aaa96d-92c2-4e66-8fbe-a65e22f77ca3 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.253676 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37aaa96d-92c2-4e66-8fbe-a65e22f77ca3 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.037984 Oct 12 22:30:33.259910 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 18/48] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:33 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:33.268823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0cb8b78b-9aa9-447a-98e4-ed2803718e7a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0cb8b78b-9aa9-447a-98e4-ed2803718e7a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 283 Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:30:33.274867 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.275984 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:30:33.276473 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.276985 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.277768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.278459 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:30:33.278459 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:30:33.278459 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:30:33.278459 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.280170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0cb8b78b-9aa9-447a-98e4-ed2803718e7a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.281217 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0cb8b78b-9aa9-447a-98e4-ed2803718e7a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016379 Oct 12 22:30:33.281931 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 19/49] 10.222.0.20 () {60 vars in 1165 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:30:33.294598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76a6f524-64e7-4394-abac-5aee542a3676 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76a6f524-64e7-4394-abac-5aee542a3676 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 27 Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:30:33.301387 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: {"aggregate": {"name": ""}} Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.302774 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '' Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.303558 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:30:33.305520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.306695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76a6f524-64e7-4394-abac-5aee542a3676 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.306695 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76a6f524-64e7-4394-abac-5aee542a3676 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014309 Oct 12 22:30:33.306695 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 20/50] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:30:33.315366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8baa52f-7b26-4f7f-9475-aa78c73d36af tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-319681655"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.319687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e8baa52f-7b26-4f7f-9475-aa78c73d36af tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'edd00d008d8b40098df6e9810401b106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5e3c5f9d0f4f3daab8448f1c73c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8baa52f-7b26-4f7f-9475-aa78c73d36af tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Request method failure captured: Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 59 Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ACHeIKxskmceJY_w_a1IV879XvctVU9m3M0CEsbNo1_mPy2UJ0mTdqcpGeFrphxggdTyXv_EarSna1zPRh7ZTXDY0DksgqnaYSo-ck4gQw2tc3zy2o3tTFzAfhGmLhuyqIifjVBMPEoDZTEkDm5P-WL1nTDhY1dsHZa6TYMLWHC8U Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:30:33.324076 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}] Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: edd00d008d8b40098df6e9810401b106 Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: {"aggregate": {"name": "tempest-test_aggregate-319681655"}} Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.325449 n-d-860864-8 devstack@n-api.service[120543]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-319681655'}}} Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:33.326386 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:33.327497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 22:30:33.328791 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.328791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8baa52f-7b26-4f7f-9475-aa78c73d36af tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.328791 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e8baa52f-7b26-4f7f-9475-aa78c73d36af tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.013977 Oct 12 22:30:33.328791 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 21/51] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:30:33.338643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-720754c7-d951-4790-b961-f1cc7fcd7db5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1568578890"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.349121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-720754c7-d951-4790-b961-f1cc7fcd7db5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid f99fdb1a-e07b-4f4b-b22a-bbf78ef36f5a for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:33.402533 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-720754c7-d951-4790-b961-f1cc7fcd7db5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069158 Oct 12 22:30:33.403355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 22/52] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:30:33.419298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65e4b699-5dc9-4c3c-a5e7-707bfa180a9a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1568578890"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.424168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-65e4b699-5dc9-4c3c-a5e7-707bfa180a9a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid f5e59572-ef6b-4cfd-a45d-fec863bde29b for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:33.447276 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-65e4b699-5dc9-4c3c-a5e7-707bfa180a9a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1568578890 already exists. Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65e4b699-5dc9-4c3c-a5e7-707bfa180a9a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 60 Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:30:33.449604 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: {"aggregate": {"name": "tempest-test_aggregate-1568578890"}} Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.450924 n-d-860864-8 devstack@n-api.service[120543]: exception: Aggregate tempest-test_aggregate-1568578890 already exists. Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1568578890'}}} Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 12 22:30:33.451606 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1568578890 already exists. Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:33.452693 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1568578890 already exists. Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1568578890 already exists. Oct 12 22:30:33.453873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.456830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65e4b699-5dc9-4c3c-a5e7-707bfa180a9a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1568578890 already exists. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.457823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65e4b699-5dc9-4c3c-a5e7-707bfa180a9a tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.046487 Oct 12 22:30:33.462737 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 23/53] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:30:33.468941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7f943b5-ad09-4361-85ca-ab0445678da6 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.501570 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7f943b5-ad09-4361-85ca-ab0445678da6 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.037724 Oct 12 22:30:33.506306 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 24/54] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:33 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:33.512845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76bb2242-35cd-447c-9938-93f0e36100ee tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1988039561"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.519479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-76bb2242-35cd-447c-9938-93f0e36100ee tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid 98c6e7f5-81ba-4d7a-8b85-e4f9a464dbe5 for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:33.543434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9,nova_api:DELETE=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:33.565565 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76bb2242-35cd-447c-9938-93f0e36100ee tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056210 Oct 12 22:30:33.568024 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 25/55] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:33.583031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f7e7e7e-3359-4fcb-bfb3-22c2bbaf3b6f tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.584880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f7e7e7e-3359-4fcb-bfb3-22c2bbaf3b6f tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'edd00d008d8b40098df6e9810401b106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5e3c5f9d0f4f3daab8448f1c73c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f7e7e7e-3359-4fcb-bfb3-22c2bbaf3b6f tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Request method failure captured: Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ACHeIKxskmceJY_w_a1IV879XvctVU9m3M0CEsbNo1_mPy2UJ0mTdqcpGeFrphxggdTyXv_EarSna1zPRh7ZTXDY0DksgqnaYSo-ck4gQw2tc3zy2o3tTFzAfhGmLhuyqIifjVBMPEoDZTEkDm5P-WL1nTDhY1dsHZa6TYMLWHC8U Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:30:33.587520 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}] Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: edd00d008d8b40098df6e9810401b106 Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 22:30:33.588860 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '6'} Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:33.589452 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.590331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f7e7e7e-3359-4fcb-bfb3-22c2bbaf3b6f tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.591123 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f7e7e7e-3359-4fcb-bfb3-22c2bbaf3b6f tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.012794 Oct 12 22:30:33.591123 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 26/56] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:33.603805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-17bac884-a44f-4fe7-858a-afec2f6c29ca tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.638686 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-17bac884-a44f-4fe7-858a-afec2f6c29ca tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.042647 Oct 12 22:30:33.639773 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 27/57] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:33.652820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f337923-5b8a-439b-b5d8-488d7456489e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.673172 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-2f337923-5b8a-439b-b5d8-488d7456489e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f337923-5b8a-439b-b5d8-488d7456489e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:30:33.675957 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: exception: Aggregate -1 could not be found. Oct 12 22:30:33.677037 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '-1'} Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:30:33.677645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.678529 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f337923-5b8a-439b-b5d8-488d7456489e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f337923-5b8a-439b-b5d8-488d7456489e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031949 Oct 12 22:30:33.679656 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 28/58] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:30:33 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 22:30:33.690185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c9faf5a-63e6-4769-94a3-a4faac8c83c1 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1969173267"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:33.693532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-6c9faf5a-63e6-4769-94a3-a4faac8c83c1 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid 71276fab-cef8-4f0d-8e2b-90c2023bc43c for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:30:33.730133 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c9faf5a-63e6-4769-94a3-a4faac8c83c1 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043701 Oct 12 22:30:33.733455 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 29/59] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:33.746425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d7fea79-57dc-4f00-b5ca-3dcb570d6619 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.749742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d7fea79-57dc-4f00-b5ca-3dcb570d6619 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'edd00d008d8b40098df6e9810401b106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5e3c5f9d0f4f3daab8448f1c73c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d7fea79-57dc-4f00-b5ca-3dcb570d6619 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Request method failure captured: Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ACHeIKxskmceJY_w_a1IV879XvctVU9m3M0CEsbNo1_mPy2UJ0mTdqcpGeFrphxggdTyXv_EarSna1zPRh7ZTXDY0DksgqnaYSo-ck4gQw2tc3zy2o3tTFzAfhGmLhuyqIifjVBMPEoDZTEkDm5P-WL1nTDhY1dsHZa6TYMLWHC8U Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:30:33.751585 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}] Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: edd00d008d8b40098df6e9810401b106 Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 22:30:33.752651 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7'} Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:33.753226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.754096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d7fea79-57dc-4f00-b5ca-3dcb570d6619 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.754905 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d7fea79-57dc-4f00-b5ca-3dcb570d6619 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.014460 Oct 12 22:30:33.754905 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 30/60] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 22:30:33 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:33.772837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42f4de79-6103-4e82-ae84-75aef8480eec tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.818582 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-42f4de79-6103-4e82-ae84-75aef8480eec tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.053034 Oct 12 22:30:33.821586 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 31/61] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:33 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:30:33.832026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a45c1288-39ac-43e8-acd7-7595eb880702 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.840357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-a45c1288-39ac-43e8-acd7-7595eb880702 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a45c1288-39ac-43e8-acd7-7595eb880702 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:30:33.842009 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: exception: Aggregate -1 could not be found. Oct 12 22:30:33.843068 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '-1'} Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.843668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 22:30:33.844636 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.846289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a45c1288-39ac-43e8-acd7-7595eb880702 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.846289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a45c1288-39ac-43e8-acd7-7595eb880702 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.017325 Oct 12 22:30:33.846289 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 32/62] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:33 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 22:30:33.855727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-308a401b-f976-4d9f-8758-a00b539ee567 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:33.857276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-308a401b-f976-4d9f-8758-a00b539ee567 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'edd00d008d8b40098df6e9810401b106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5e3c5f9d0f4f3daab8448f1c73c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-308a401b-f976-4d9f-8758-a00b539ee567 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Request method failure captured: Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ACHeIKxskmceJY_w_a1IV879XvctVU9m3M0CEsbNo1_mPy2UJ0mTdqcpGeFrphxggdTyXv_EarSna1zPRh7ZTXDY0DksgqnaYSo-ck4gQw2tc3zy2o3tTFzAfhGmLhuyqIifjVBMPEoDZTEkDm5P-WL1nTDhY1dsHZa6TYMLWHC8U Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:30:33.860708 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}] Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: edd00d008d8b40098df6e9810401b106 Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 22:30:33.861801 n-d-860864-8 devstack@n-api.service[120543]: action_args: {} Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:33.862415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:30:33.864100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-308a401b-f976-4d9f-8758-a00b539ee567 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:33.865015 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-308a401b-f976-4d9f-8758-a00b539ee567 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011881 Oct 12 22:30:33.865015 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:30:33 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:30:34.103294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-949206227", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "availability_zone": "tempest-test_az-145808504"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:34.145253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:34.148875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:34.154312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:34.156404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:34.156907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:34.159242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:36.261249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:30:36.892031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:30:36.892526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:30:36.893197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:30:36.893770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:30:36.894331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:30:36.922028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:36.922737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:36.923262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:36.924267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:36.924923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:36.925437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:36.988576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Getting quotas for project a7a41d16a4c3402e8279b72040359451. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:36.997180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Getting quotas for user 373463f220fb402ba15a5c388b45a6aa and project a7a41d16a4c3402e8279b72040359451. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:37.018910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:30:37.022313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:30:37.123678 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e7273b45-f6d9-4b4c-a2da-908f54d0855e tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.923613 Oct 12 22:30:37.124580 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 31/64] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:30:37.141373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79c572a5-efb8-4800-b376-556f76c4cb87 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:37.142361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79c572a5-efb8-4800-b376-556f76c4cb87 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:37.335409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-79c572a5-efb8-4800-b376-556f76c4cb87 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:37.362011 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79c572a5-efb8-4800-b376-556f76c4cb87 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1241 microversion: 2.1 time: 0.226472 Oct 12 22:30:37.363787 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 32/65] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:37 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1241 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:37.369457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:37.373634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:37.374304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:37.374898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:37.376302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:37.377039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:37.377621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:37.417462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-96764a61-eb0f-4160-b191-1beef651da35 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.687402 Oct 12 22:30:37.430963 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1164 bytes} [Wed Oct 12 22:30:36 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:37.434212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:37.436059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:37.436682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:37.437119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:37.437833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:37.438693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:37.439352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:37.483535 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc0c74a7-852d-4098-b823-fad94b5e3879 tempest-AZAdminV2TestJSON-1869814229 tempest-AZAdminV2TestJSON-1869814229-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.054282 Oct 12 22:30:37.484727 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 33/67] 10.222.0.20 () {58 vars in 1185 bytes} [Wed Oct 12 22:30:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:38.386254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-574f9ead-882b-4b90-9635-c476412ebd9a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:38.387388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-574f9ead-882b-4b90-9635-c476412ebd9a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:39.505084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:40.085987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-574f9ead-882b-4b90-9635-c476412ebd9a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:40.114357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-574f9ead-882b-4b90-9635-c476412ebd9a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1241 microversion: 2.1 time: 1.732114 Oct 12 22:30:40.116999 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:38 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1241 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:41.141022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:41.142327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:41.153818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:41.155040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:41.155948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:41.156722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:41.157189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:41.157647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:41.485913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:41.514453 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6c3774dd-c2ec-41a1-96d4-0efdc8a41e44 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1295 microversion: 2.1 time: 0.377898 Oct 12 22:30:41.515758 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:41 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1295 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:42.182757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13070f24-84cf-4125-85b8-6d4c4337d2b3 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Action: 'create', calling method: .version_select at 0x7f450516a310>, body: {"keypair": {"name": "tempest-keypair-1793491234", "type": "ssh", "user_id": "fbef6603a5d6425995ca99421914ae63", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHpGGzR8hxjd0DurJ91Vr2pIKRzfQEwUds5uCIrIf4aGqtF32mlUp09EwEgjAbZN0ZADedu7dw9v/9LrlNZCOUI/ihl6esyMhtuVJcktgy+QvnYzpjL583O9ZOKlougCg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:42.291054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-13070f24-84cf-4125-85b8-6d4c4337d2b3 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Getting quotas for project 2cd888f595d4458388c392b2c9f33621. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:42.307680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-13070f24-84cf-4125-85b8-6d4c4337d2b3 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Getting quotas for user 253e7239463b41d58fac7517e7d79758 and project 2cd888f595d4458388c392b2c9f33621. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:42.395932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13070f24-84cf-4125-85b8-6d4c4337d2b3 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 1.110674 Oct 12 22:30:42.397148 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 36/70] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:30:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 22:30:42.410997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5bf55d5-03f4-4210-999b-fad8c95afb13 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Action: 'create', calling method: .version_select at 0x7f4504414ca0>, body: {"keypair": {"name": "tempest-keypair-1515913322", "type": "ssh", "user_id": "fbef6603a5d6425995ca99421914ae63", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMLtgwIR/QquUEcwmX5IH1+NrSqoyVExsTt7FKDzNdXP79u0FwaD6She1Vv2POZAk0X7aotCQNH6m3zwcwDG/examb9d/vUHQ9Apr8rrA3Y47G00xLGh/iqFjJz8IHKcg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:42.495167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c5bf55d5-03f4-4210-999b-fad8c95afb13 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Getting quotas for project 2cd888f595d4458388c392b2c9f33621. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:42.508530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c5bf55d5-03f4-4210-999b-fad8c95afb13 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Getting quotas for user 253e7239463b41d58fac7517e7d79758 and project 2cd888f595d4458388c392b2c9f33621. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:42.543173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:42.544216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:42.556173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:42.556652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:42.564823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:42.568290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:42.568802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:42.575485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:42.618131 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5bf55d5-03f4-4210-999b-fad8c95afb13 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.211401 Oct 12 22:30:42.625568 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 35/71] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:30:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 219 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:30:42.639301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd35b866-55a8-47e9-bdd9-c3af38015009 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Calling method '.version_select at 0x7f45044145e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:42.654980 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd35b866-55a8-47e9-bdd9-c3af38015009 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1793491234?user_id=fbef6603a5d6425995ca99421914ae63" status: 200 len: 512 microversion: 2.10 time: 0.027682 Oct 12 22:30:42.665495 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1340 bytes} [Wed Oct 12 22:30:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1793491234?user_id=fbef6603a5d6425995ca99421914ae63 => generated 512 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:42.671256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0f9dca6-5924-43c0-a73f-fad1b50380d7 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Action: 'create', calling method: .version_select at 0x7f4504405040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-508775732", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyiMWObZafKCRDIO+J3yjPkvqGDVIfcubxEzd11579DR2XQgKVF+INE5auqBLfEkLh9WHdaI2Gb9eCeiHs48fxcWlrbZE3QM+6toNfo52nucpweJMdQiimjEwS7tDp4LQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:42.727621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a0f9dca6-5924-43c0-a73f-fad1b50380d7 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Getting quotas for project 2cd888f595d4458388c392b2c9f33621. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:42.745251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a0f9dca6-5924-43c0-a73f-fad1b50380d7 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Getting quotas for user 253e7239463b41d58fac7517e7d79758 and project 2cd888f595d4458388c392b2c9f33621. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:42.830192 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0f9dca6-5924-43c0-a73f-fad1b50380d7 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.162742 Oct 12 22:30:42.832314 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 37/73] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:30:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:30:42.852590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7683a2be-fac1-4c26-8623-6ee41011e6f8 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Calling method '.version_select at 0x7f4504414790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:42.862806 n-d-860864-8 devstack@n-api.service[120542]: WARNING oslo_db.sqlalchemy.utils [None req-7683a2be-fac1-4c26-8623-6ee41011e6f8 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:30:42.899738 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7683a2be-fac1-4c26-8623-6ee41011e6f8 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=fbef6603a5d6425995ca99421914ae63" status: 200 len: 726 microversion: 2.10 time: 0.050810 Oct 12 22:30:42.900811 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Oct 12 22:30:42 2022] GET /compute/v2.1/os-keypairs?user_id=fbef6603a5d6425995ca99421914ae63 => generated 726 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:42.912817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4669615-1267-4e34-a02d-2b56940ad83b tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Calling method '.version_select at 0x7f45043abd30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:42.948109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:42.965473 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4669615-1267-4e34-a02d-2b56940ad83b tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-508775732" status: 204 len: 0 microversion: 2.10 time: 0.057415 Oct 12 22:30:42.966075 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 39/75] 10.222.0.20 () {60 vars in 1322 bytes} [Wed Oct 12 22:30:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-508775732 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:30:43.036265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:43.078038 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78c7d802-bb4a-4766-a0cf-6a0f2a9fe776 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1295 microversion: 2.1 time: 0.539502 Oct 12 22:30:43.079277 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 37/76] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:42 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1295 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:30:43.103566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6a52c8c-e0bb-4c0a-a43f-d26bfbbdd5fb tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Calling method '.version_select at 0x7f4504609790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:43.204427 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6a52c8c-e0bb-4c0a-a43f-d26bfbbdd5fb tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515913322?user_id=fbef6603a5d6425995ca99421914ae63" status: 204 len: 0 microversion: 2.10 time: 0.121100 Oct 12 22:30:43.207021 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 38/77] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515913322?user_id=fbef6603a5d6425995ca99421914ae63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:30:43.234607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38904939-7602-4d80-8dce-67fe39859bf9 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] Calling method '.version_select at 0x7f450459b9d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:43.303247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38904939-7602-4d80-8dce-67fe39859bf9 tempest-KeyPairsV210TestJSON-909289705 tempest-KeyPairsV210TestJSON-909289705-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793491234?user_id=fbef6603a5d6425995ca99421914ae63" status: 204 len: 0 microversion: 2.10 time: 0.090741 Oct 12 22:30:43.315418 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 39/78] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793491234?user_id=fbef6603a5d6425995ca99421914ae63 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:30:43.945735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36fc9b63-8bf8-4a7d-a0ad-2b4fb44d742b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:43.966376 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36fc9b63-8bf8-4a7d-a0ad-2b4fb44d742b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.999095 Oct 12 22:30:44.000427 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 40/79] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:30:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:44.108975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:44.111282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:44.139426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:44.142765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:44.143408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:44.145379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:44.153086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:44.156333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:44.508278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:44.519147 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62f644eb-3758-4fb8-9b53-5a6e8b87b708 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.420840 Oct 12 22:30:44.520429 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 41/80] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:44 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:45.081588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6298375a-1145-4c2d-a837-5c11148cdc5f tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-964763116", "id": 1587180701, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:45.115553 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6298375a-1145-4c2d-a837-5c11148cdc5f tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 1.133493 Oct 12 22:30:45.120084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 40/81] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:30:43 2022] POST /compute/v2.1/flavors => generated 424 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:45.136669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46e811a5-1617-4510-8acc-2715206ed5c4 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:45.176242 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46e811a5-1617-4510-8acc-2715206ed5c4 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038623 Oct 12 22:30:45.178272 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1182 bytes} [Wed Oct 12 22:30:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:30:45.190588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d68f7540-fdf0-4656-8317-1d0f99534977 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-654181720", "id": 1115412368, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:45.249241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d68f7540-fdf0-4656-8317-1d0f99534977 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.062393 Oct 12 22:30:45.251455 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 42/83] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:30:45 2022] POST /compute/v2.1/flavors => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:45.267759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-513a1c32-fccf-4339-94d0-3a34ac303d89 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:45.297229 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-513a1c32-fccf-4339-94d0-3a34ac303d89 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034056 Oct 12 22:30:45.299101 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 43/84] 10.222.0.20 () {58 vars in 1182 bytes} [Wed Oct 12 22:30:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:30:45.321361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c58cb7ce-7634-43dd-aa8d-5fd28e8dd1d2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Action: 'create', calling method: .version_select at 0x7f45046099d0>, body: {"keypair": {"name": "tempest-keypair-1745987402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVNHBLsPXgVh/8YxLEk6EASe9/gsTBgycciEtJWwJ2kaAi2JGQMsZO2RsgmIGFxrkeqoBZzGwwbIyi5LVDGiIKDMtSdyZpoXOYz7i68DT3lXVqfLbAbNsLWV0j6rEMMEQ=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:45.365646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c58cb7ce-7634-43dd-aa8d-5fd28e8dd1d2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Getting quotas for project 73a41ac7523f4592ae88851113a895ce. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:45.371636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c58cb7ce-7634-43dd-aa8d-5fd28e8dd1d2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Getting quotas for user d9dd6cd5ae4f432b8afc184210820c10 and project 73a41ac7523f4592ae88851113a895ce. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:45.443573 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c58cb7ce-7634-43dd-aa8d-5fd28e8dd1d2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136009 Oct 12 22:30:45.448386 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 44/85] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:30:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:30:45.548184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:45.549042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:45.568636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:45.569387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:45.570004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:45.570733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:45.571187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:45.581566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:45.617665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58805d75-387e-4c18-bcf1-b7f8b5c8061e tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Calling method '.version_select at 0x7f45043abaf0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:45.620543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-58805d75-387e-4c18-bcf1-b7f8b5c8061e tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '8fec82153fc54ce6ab739977df41eb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49ff1ea0dd74ef79b8eaf99e9fbccab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58805d75-387e-4c18-bcf1-b7f8b5c8061e tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Request method failure captured: Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0APlTTBzMtF6ce0FwRvhrmzBvU27Pvm9OR9x4_OBo5HrIVpMapmSl-3rbcc7RBsfK7l6Qx3CErBsZhyz77iQv5GQTNcdalD1x8T6j9iiEfdMMF4NXOzALiq4d4p4ee3BtGjRvDuAurdsBdTi4VWT9z8ILX0WeFAdRN9fPS4EUggmsE Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:45.623180 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}] Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 8fec82153fc54ce6ab739977df41eb7b Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:30:45.624502 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:45.625447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 22:30:45.627113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.635832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58805d75-387e-4c18-bcf1-b7f8b5c8061e tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:45.640006 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58805d75-387e-4c18-bcf1-b7f8b5c8061e tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.104194 Oct 12 22:30:45.648556 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 12 22:30:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:45.681861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-abd91ec5-69c5-4c4f-ae39-5257fdb282af tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Calling method '.version_select at 0x7f4504353310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:45.689167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-abd91ec5-69c5-4c4f-ae39-5257fdb282af tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '8fec82153fc54ce6ab739977df41eb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49ff1ea0dd74ef79b8eaf99e9fbccab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-abd91ec5-69c5-4c4f-ae39-5257fdb282af tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Request method failure captured: Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0APlTTBzMtF6ce0FwRvhrmzBvU27Pvm9OR9x4_OBo5HrIVpMapmSl-3rbcc7RBsfK7l6Qx3CErBsZhyz77iQv5GQTNcdalD1x8T6j9iiEfdMMF4NXOzALiq4d4p4ee3BtGjRvDuAurdsBdTi4VWT9z8ILX0WeFAdRN9fPS4EUggmsE Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:45.691166 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}] Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 8fec82153fc54ce6ab739977df41eb7b Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:30:45.692551 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:45.693424 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 22:30:45.694860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.696792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-abd91ec5-69c5-4c4f-ae39-5257fdb282af tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:45.698946 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-abd91ec5-69c5-4c4f-ae39-5257fdb282af tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.047657 Oct 12 22:30:45.699691 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:30:45 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:45.723215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb0e5f9f-2114-4758-bac8-844ea4a1178c tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Calling method '.version_select at 0x7f4504353310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:45.735648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bb0e5f9f-2114-4758-bac8-844ea4a1178c tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '8fec82153fc54ce6ab739977df41eb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49ff1ea0dd74ef79b8eaf99e9fbccab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb0e5f9f-2114-4758-bac8-844ea4a1178c tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Request method failure captured: Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0APlTTBzMtF6ce0FwRvhrmzBvU27Pvm9OR9x4_OBo5HrIVpMapmSl-3rbcc7RBsfK7l6Qx3CErBsZhyz77iQv5GQTNcdalD1x8T6j9iiEfdMMF4NXOzALiq4d4p4ee3BtGjRvDuAurdsBdTi4VWT9z8ILX0WeFAdRN9fPS4EUggmsE Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:45.751118 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}] Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 8fec82153fc54ce6ab739977df41eb7b Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:30:45.752756 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:45.753528 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 22:30:45.754639 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:45.759820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb0e5f9f-2114-4758-bac8-844ea4a1178c tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:45.762314 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bb0e5f9f-2114-4758-bac8-844ea4a1178c tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.053133 Oct 12 22:30:45.770210 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 44/88] 10.222.0.20 () {58 vars in 1179 bytes} [Wed Oct 12 22:30:45 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:46.059849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:46.125342 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b9eb8eb9-dde3-45d0-ac22-6a3af5748492 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.581557 Oct 12 22:30:46.136772 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:45 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:46.766787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Calling method '.version_select at 0x7f4504563550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:46.777036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.777953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.778541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:46.816470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.818940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.820925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:46.852751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.855435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.860489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:46.878063 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1150f5d6-649f-41d9-a45c-e0ef780a1aac tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.100982 Oct 12 22:30:46.887791 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 45/90] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:30:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:46.896406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-334dffe5-742c-4101-a327-64295ef6f981 tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Calling method '.version_select at 0x7f4504353af0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:46.899435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-334dffe5-742c-4101-a327-64295ef6f981 tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '8fec82153fc54ce6ab739977df41eb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49ff1ea0dd74ef79b8eaf99e9fbccab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-334dffe5-742c-4101-a327-64295ef6f981 tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Request method failure captured: Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0APlTTBzMtF6ce0FwRvhrmzBvU27Pvm9OR9x4_OBo5HrIVpMapmSl-3rbcc7RBsfK7l6Qx3CErBsZhyz77iQv5GQTNcdalD1x8T6j9iiEfdMMF4NXOzALiq4d4p4ee3BtGjRvDuAurdsBdTi4VWT9z8ILX0WeFAdRN9fPS4EUggmsE Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:46.902865 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}] Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 8fec82153fc54ce6ab739977df41eb7b Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1'} Oct 12 22:30:46.904082 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:46.904982 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 22:30:46.905980 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.912002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-334dffe5-742c-4101-a327-64295ef6f981 tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:46.914057 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-334dffe5-742c-4101-a327-64295ef6f981 tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024173 Oct 12 22:30:46.920452 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 46/91] 10.222.0.20 () {58 vars in 1173 bytes} [Wed Oct 12 22:30:46 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:46.929869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db356763-e816-4cc5-9e52-a7261b576995 tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Calling method '.version_select at 0x7f4504405c10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:46.931949 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-db356763-e816-4cc5-9e52-a7261b576995 tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] HTTP exception thrown: Hypervisor with ID '9e813519-866b-4d65-a7eb-00a29c039e7e' could not be found. Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db356763-e816-4cc5-9e52-a7261b576995 tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Request method failure captured: Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/9e813519-866b-4d65-a7eb-00a29c039e7e/uptime HTTP/1.1 Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AU6MeJHH-bUU81I5YBVEQm_9d0DDg6kPxAGSiQngX97KEtUxK-AoRqxl2yHnpr6zQy_FMsb9Y_GJdrljVYMl9VkqK8pE0Fbsu83MMoVs7Q-0OWyyVYBYU2cEQq6-WPb7RyunyARkvj046xi2cC12JZqHminYiqcYhLyEmkG1pWQHE Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 503e36037a0b440bab9d6dabb275d14a Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1794543498 Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:46.934787 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/503e36037a0b440bab9d6dabb275d14a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/503e36037a0b440bab9d6dabb275d14a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_503e36037a0b440bab9d6dabb275d14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/503e36037a0b440bab9d6dabb275d14a"}]}] Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1794543498 Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 503e36037a0b440bab9d6dabb275d14a Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1794543498 Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0c0bf379c1f2475992897f87a8bf52b5 Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: exception: Hypervisor with ID '9e813519-866b-4d65-a7eb-00a29c039e7e' could not be found. Oct 12 22:30:46.936230 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '9e813519-866b-4d65-a7eb-00a29c039e7e'} Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9e813519-866b-4d65-a7eb-00a29c039e7e' Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 22:30:46.937132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9e813519-866b-4d65-a7eb-00a29c039e7e' could not be found. Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:46.938305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.939451 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:46.939451 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:46.939451 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:46.939451 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:46.939451 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:46.939451 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9e813519-866b-4d65-a7eb-00a29c039e7e' could not be found. Oct 12 22:30:46.939451 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:46.944211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db356763-e816-4cc5-9e52-a7261b576995 tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Returning 404 to user: Hypervisor with ID '9e813519-866b-4d65-a7eb-00a29c039e7e' could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:46.945859 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db356763-e816-4cc5-9e52-a7261b576995 tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/9e813519-866b-4d65-a7eb-00a29c039e7e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.023391 Oct 12 22:30:46.951844 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 47/92] 10.222.0.20 () {58 vars in 1278 bytes} [Wed Oct 12 22:30:46 2022] GET /compute/v2.1/os-hypervisors/9e813519-866b-4d65-a7eb-00a29c039e7e/uptime => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:46.958598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Calling method '.version_select at 0x7f4504414310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:46.963088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.963907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.964575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:46.986700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:46.997694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:46.998709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:47.032152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:47.048214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:47.049447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:47.060688 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-432426f4-4df9-4e87-959a-8ba7e6a0d5bb tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.107354 Oct 12 22:30:47.068966 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 48/93] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:30:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:47.076295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-813374ef-b747-4338-b428-3ca2a0e706ae tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Calling method '.version_select at 0x7f45043530d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:47.078859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-813374ef-b747-4338-b428-3ca2a0e706ae tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '8fec82153fc54ce6ab739977df41eb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49ff1ea0dd74ef79b8eaf99e9fbccab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-813374ef-b747-4338-b428-3ca2a0e706ae tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Request method failure captured: Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0APlTTBzMtF6ce0FwRvhrmzBvU27Pvm9OR9x4_OBo5HrIVpMapmSl-3rbcc7RBsfK7l6Qx3CErBsZhyz77iQv5GQTNcdalD1x8T6j9iiEfdMMF4NXOzALiq4d4p4ee3BtGjRvDuAurdsBdTi4VWT9z8ILX0WeFAdRN9fPS4EUggmsE Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:47.081517 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49ff1ea0dd74ef79b8eaf99e9fbccab"}]}] Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d49ff1ea0dd74ef79b8eaf99e9fbccab Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810 Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 8fec82153fc54ce6ab739977df41eb7b Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1835794810-project Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1'} Oct 12 22:30:47.082612 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:47.083317 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 22:30:47.084287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.087635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-813374ef-b747-4338-b428-3ca2a0e706ae tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:47.090357 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-813374ef-b747-4338-b428-3ca2a0e706ae tempest-HypervisorAdminNegativeTestJSON-1835794810 tempest-HypervisorAdminNegativeTestJSON-1835794810-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.019274 Oct 12 22:30:47.102563 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 49/94] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:30:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:47.119714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2afb627-1e2e-466a-bc09-e7458f138f6a tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Calling method '.version_select at 0x7f45044058b0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:47.125489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e2afb627-1e2e-466a-bc09-e7458f138f6a tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] HTTP exception thrown: Hypervisor with ID '47d1827d-e56f-4753-af79-3047b9f94189' could not be found. Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2afb627-1e2e-466a-bc09-e7458f138f6a tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Request method failure captured: Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/47d1827d-e56f-4753-af79-3047b9f94189 HTTP/1.1 Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AU6MeJHH-bUU81I5YBVEQm_9d0DDg6kPxAGSiQngX97KEtUxK-AoRqxl2yHnpr6zQy_FMsb9Y_GJdrljVYMl9VkqK8pE0Fbsu83MMoVs7Q-0OWyyVYBYU2cEQq6-WPb7RyunyARkvj046xi2cC12JZqHminYiqcYhLyEmkG1pWQHE Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 503e36037a0b440bab9d6dabb275d14a Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1794543498 Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:47.134669 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/503e36037a0b440bab9d6dabb275d14a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/503e36037a0b440bab9d6dabb275d14a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_503e36037a0b440bab9d6dabb275d14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/503e36037a0b440bab9d6dabb275d14a"}]}] Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1794543498 Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 503e36037a0b440bab9d6dabb275d14a Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1794543498 Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0c0bf379c1f2475992897f87a8bf52b5 Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: exception: Hypervisor with ID '47d1827d-e56f-4753-af79-3047b9f94189' could not be found. Oct 12 22:30:47.136090 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '47d1827d-e56f-4753-af79-3047b9f94189'} Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '47d1827d-e56f-4753-af79-3047b9f94189' Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 22:30:47.136890 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:30:47.140456 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '47d1827d-e56f-4753-af79-3047b9f94189' could not be found. Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '47d1827d-e56f-4753-af79-3047b9f94189' could not be found. Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2afb627-1e2e-466a-bc09-e7458f138f6a tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] Returning 404 to user: Hypervisor with ID '47d1827d-e56f-4753-af79-3047b9f94189' could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:47.141455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2afb627-1e2e-466a-bc09-e7458f138f6a tempest-HypervisorAdminNegativeTestJSON-1794543498 tempest-HypervisorAdminNegativeTestJSON-1794543498-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/47d1827d-e56f-4753-af79-3047b9f94189" status: 404 len: 123 microversion: 2.1 time: 0.031490 Oct 12 22:30:47.144419 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 50/95] 10.222.0.20 () {58 vars in 1257 bytes} [Wed Oct 12 22:30:47 2022] GET /compute/v2.1/os-hypervisors/47d1827d-e56f-4753-af79-3047b9f94189 => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:47.305428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ecc646aa-73d5-4a67-8ba2-798f0e46a159 tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-963960769", "id": 768747618, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:47.353592 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ecc646aa-73d5-4a67-8ba2-798f0e46a159 tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.874514 Oct 12 22:30:47.356997 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 46/96] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:30:46 2022] POST /compute/v2.1/flavors => generated 464 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:47.373116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:47.373978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:47.402330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:47.411594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:47.412155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:47.412564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:47.413804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:47.414249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:47.414669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:47.449449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:48.164269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:48.173939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2fdcab1f-ffd1-40a5-bd15-a68c188baae6 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.815772 Oct 12 22:30:48.182398 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 47/97] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:47 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:48.575422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Calling method '.version_select at 0x7f450447fd30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:48.579578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:48.580089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:48.580525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:48.585682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:48.586471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:48.588987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:48.721558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93f0c037-a66e-4281-9a19-b6ea789c49f3 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 1.554887 Oct 12 22:30:48.724923 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 51/98] 10.222.0.20 () {58 vars in 1128 bytes} [Wed Oct 12 22:30:47 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:30:49.313766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ac07b5b-1f42-4eb5-9837-1046170a6bda tempest-FlavorsV261TestJSON-207578082 tempest-FlavorsV261TestJSON-207578082-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:49.350246 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ac07b5b-1f42-4eb5-9837-1046170a6bda tempest-FlavorsV261TestJSON-207578082 tempest-FlavorsV261TestJSON-207578082-project] 10.222.0.20 "GET /compute/v2.1/flavors/768747618" status: 200 len: 464 microversion: 2.61 time: 1.161728 Oct 12 22:30:49.353130 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 48/99] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Oct 12 22:30:48 2022] GET /compute/v2.1/flavors/768747618 => generated 464 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:49.387028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:49.388056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:49.435061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:49.438112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:49.438987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:49.443265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:49.445446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:49.449540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:49.451135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe2f3d99-2a92-4695-9435-876b8e7e0e2a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Calling method '.version_select at 0x7f45045634c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:49.459842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fe2f3d99-2a92-4695-9435-876b8e7e0e2a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '29f23b5ef5bc4f079cc91b79b29ecb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27067728ca4e47f58946fed243739250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe2f3d99-2a92-4695-9435-876b8e7e0e2a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Request method failure captured: Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AR-qfp3Vxsu6LB3LXyewmktSVCvFcd4AtAEj_B40sJxUjQN7lIxYWt2RVOy8p7CbORazIMpfDgrSX45geMaA9e5X6eR1HsW31-0fyfDppru6JgOepudB-xSJaBoSDnsuIKrEKa7qiJ1-uxB5QkD4yIE9mYMTBUvO62jEA6eqqxMiY Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:49.462407 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27067728ca4e47f58946fed243739250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27067728ca4e47f58946fed243739250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}] Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 29f23b5ef5bc4f079cc91b79b29ecb95 Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:30:49.463517 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:49.464322 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 22:30:49.465296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.469942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe2f3d99-2a92-4695-9435-876b8e7e0e2a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:49.471242 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe2f3d99-2a92-4695-9435-876b8e7e0e2a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.737785 Oct 12 22:30:49.475287 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 52/100] 10.222.0.20 () {58 vars in 1128 bytes} [Wed Oct 12 22:30:48 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 743 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:30:49.484809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01c07f17-67d5-4717-ac72-6979f64a17a1 tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] Action: 'update', calling method: .version_select at 0x7f45056dcb80>, body: {"flavor": {"description": "new"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:49.616381 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-01c07f17-67d5-4717-ac72-6979f64a17a1 tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/768747618" status: 200 len: 465 microversion: 2.61 time: 0.138999 Oct 12 22:30:49.621139 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 53/101] 10.222.0.20 () {62 vars in 1216 bytes} [Wed Oct 12 22:30:49 2022] PUT /compute/v2.1/flavors/768747618 => generated 465 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:30:49.630782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cdd5962c-d484-4f1e-a93b-eccc7397041a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Calling method '.version_select at 0x7f45043abc10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:49.634529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cdd5962c-d484-4f1e-a93b-eccc7397041a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '29f23b5ef5bc4f079cc91b79b29ecb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27067728ca4e47f58946fed243739250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cdd5962c-d484-4f1e-a93b-eccc7397041a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Request method failure captured: Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/n-d-860864-8/reboot HTTP/1.1 Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AR-qfp3Vxsu6LB3LXyewmktSVCvFcd4AtAEj_B40sJxUjQN7lIxYWt2RVOy8p7CbORazIMpfDgrSX45geMaA9e5X6eR1HsW31-0fyfDppru6JgOepudB-xSJaBoSDnsuIKrEKa7qiJ1-uxB5QkD4yIE9mYMTBUvO62jEA6eqqxMiY Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:49.643112 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27067728ca4e47f58946fed243739250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27067728ca4e47f58946fed243739250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}] Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 29f23b5ef5bc4f079cc91b79b29ecb95 Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8'} Oct 12 22:30:49.644293 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:49.644943 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 22:30:49.645865 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.656313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cdd5962c-d484-4f1e-a93b-eccc7397041a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:49.657661 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cdd5962c-d484-4f1e-a93b-eccc7397041a tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-860864-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.035069 Oct 12 22:30:49.658737 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 54/102] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Oct 12 22:30:49 2022] GET /compute/v2.1/os-hosts/n-d-860864-8/reboot => generated 111 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:49.677641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a52232eb-7d31-4ead-a0cc-a5739725612a tempest-FlavorsV261TestJSON-207578082 tempest-FlavorsV261TestJSON-207578082-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:49.783350 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a52232eb-7d31-4ead-a0cc-a5739725612a tempest-FlavorsV261TestJSON-207578082 tempest-FlavorsV261TestJSON-207578082-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 7154 microversion: 2.61 time: 0.123274 Oct 12 22:30:49.803578 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 55/103] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:30:49 2022] GET /compute/v2.1/flavors/detail => generated 7154 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:49.818260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a79af9c-563f-4ae8-b07e-1b7f8a42b58d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Calling method '.version_select at 0x7f4504353040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:49.889023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6a79af9c-563f-4ae8-b07e-1b7f8a42b58d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a79af9c-563f-4ae8-b07e-1b7f8a42b58d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:49.892419 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:30:49.893767 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:49.894601 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 22:30:49.895835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:49.897059 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:49.915190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a79af9c-563f-4ae8-b07e-1b7f8a42b58d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:49.925268 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a79af9c-563f-4ae8-b07e-1b7f8a42b58d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.112473 Oct 12 22:30:49.926116 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 56/104] 10.222.0.20 () {58 vars in 1212 bytes} [Wed Oct 12 22:30:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:30:49.958002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4950e5b1-09cb-4a2b-9560-647a9921519e tempest-FlavorsV261TestJSON-207578082 tempest-FlavorsV261TestJSON-207578082-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.110529 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4950e5b1-09cb-4a2b-9560-647a9921519e tempest-FlavorsV261TestJSON-207578082 tempest-FlavorsV261TestJSON-207578082-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.61 time: 0.177966 Oct 12 22:30:50.119205 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 57/105] 10.222.0.20 () {60 vars in 1166 bytes} [Wed Oct 12 22:30:49 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:50.161483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e26335a-9b65-4b52-9e3f-dee7fbc79e24 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Calling method '.version_select at 0x7f45044055e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.182626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e26335a-9b65-4b52-9e3f-dee7fbc79e24 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '29f23b5ef5bc4f079cc91b79b29ecb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27067728ca4e47f58946fed243739250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e26335a-9b65-4b52-9e3f-dee7fbc79e24 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Request method failure captured: Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/n-d-860864-8 HTTP/1.1 Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AR-qfp3Vxsu6LB3LXyewmktSVCvFcd4AtAEj_B40sJxUjQN7lIxYWt2RVOy8p7CbORazIMpfDgrSX45geMaA9e5X6eR1HsW31-0fyfDppru6JgOepudB-xSJaBoSDnsuIKrEKa7qiJ1-uxB5QkD4yIE9mYMTBUvO62jEA6eqqxMiY Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:50.188753 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27067728ca4e47f58946fed243739250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27067728ca4e47f58946fed243739250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}] Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 29f23b5ef5bc4f079cc91b79b29ecb95 Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8'} Oct 12 22:30:50.190135 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:50.190932 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 22:30:50.192613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.208944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e26335a-9b65-4b52-9e3f-dee7fbc79e24 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.212465 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e26335a-9b65-4b52-9e3f-dee7fbc79e24 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-860864-8" status: 403 len: 109 microversion: 2.1 time: 0.089335 Oct 12 22:30:50.218378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 58/106] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/os-hosts/n-d-860864-8 => generated 109 bytes in 97 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:50.233681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23880e08-050b-419b-9eb1-88f1294de1cc tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.321841 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23880e08-050b-419b-9eb1-88f1294de1cc tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/768747618" status: 202 len: 0 microversion: 2.61 time: 0.098287 Oct 12 22:30:50.333251 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 59/107] 10.222.0.20 () {60 vars in 1199 bytes} [Wed Oct 12 22:30:50 2022] DELETE /compute/v2.1/flavors/768747618 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:30:50.349559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21f63836-27d9-4ce9-86fc-afceb3960791 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Calling method '.version_select at 0x7f4504353ca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.391525 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-21f63836-27d9-4ce9-86fc-afceb3960791 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21f63836-27d9-4ce9-86fc-afceb3960791 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:50.402130 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:30:50.403296 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.403969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.404881 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.407236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21f63836-27d9-4ce9-86fc-afceb3960791 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.408287 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21f63836-27d9-4ce9-86fc-afceb3960791 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.073709 Oct 12 22:30:50.413899 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 60/108] 10.222.0.20 () {58 vars in 1191 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:30:50.433980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2febd2de-62c1-4a28-9e0f-97c29499f163 tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.504613 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2febd2de-62c1-4a28-9e0f-97c29499f163 tempest-FlavorsV261TestJSON-427060616 tempest-FlavorsV261TestJSON-427060616-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6699 microversion: 2.61 time: 0.079281 Oct 12 22:30:50.520360 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 61/109] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/flavors/detail => generated 6699 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:30:50.562354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec508d33-2bed-4a30-8445-f71df8339e8e tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Calling method '.version_select at 0x7f450439ab80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.576900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec508d33-2bed-4a30-8445-f71df8339e8e tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '29f23b5ef5bc4f079cc91b79b29ecb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27067728ca4e47f58946fed243739250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec508d33-2bed-4a30-8445-f71df8339e8e tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Request method failure captured: Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/n-d-860864-8/shutdown HTTP/1.1 Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AR-qfp3Vxsu6LB3LXyewmktSVCvFcd4AtAEj_B40sJxUjQN7lIxYWt2RVOy8p7CbORazIMpfDgrSX45geMaA9e5X6eR1HsW31-0fyfDppru6JgOepudB-xSJaBoSDnsuIKrEKa7qiJ1-uxB5QkD4yIE9mYMTBUvO62jEA6eqqxMiY Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:50.590982 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27067728ca4e47f58946fed243739250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27067728ca4e47f58946fed243739250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}] Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 29f23b5ef5bc4f079cc91b79b29ecb95 Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8'} Oct 12 22:30:50.592302 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:50.593110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 22:30:50.594256 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.599102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec508d33-2bed-4a30-8445-f71df8339e8e tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.601755 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec508d33-2bed-4a30-8445-f71df8339e8e tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-860864-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.078105 Oct 12 22:30:50.611044 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 62/110] 10.222.0.20 () {58 vars in 1194 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/os-hosts/n-d-860864-8/shutdown => generated 113 bytes in 89 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:50.644919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7438b3b-0d70-47c7-b1a6-c9e1bb612f17 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Calling method '.version_select at 0x7f4504353dc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.681083 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d7438b3b-0d70-47c7-b1a6-c9e1bb612f17 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7438b3b-0d70-47c7-b1a6-c9e1bb612f17 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:50.689753 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:30:50.690994 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:50.691736 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 22:30:50.692743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.693716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.695581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7438b3b-0d70-47c7-b1a6-c9e1bb612f17 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.696705 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d7438b3b-0d70-47c7-b1a6-c9e1bb612f17 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.082808 Oct 12 22:30:50.703245 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 63/111] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:30:50.709394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b523430-87c5-4b98-b355-1dd6e3eefb91 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Calling method '.version_select at 0x7f4504353820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.712124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7b523430-87c5-4b98-b355-1dd6e3eefb91 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '29f23b5ef5bc4f079cc91b79b29ecb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27067728ca4e47f58946fed243739250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b523430-87c5-4b98-b355-1dd6e3eefb91 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Request method failure captured: Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/n-d-860864-8/startup HTTP/1.1 Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AR-qfp3Vxsu6LB3LXyewmktSVCvFcd4AtAEj_B40sJxUjQN7lIxYWt2RVOy8p7CbORazIMpfDgrSX45geMaA9e5X6eR1HsW31-0fyfDppru6JgOepudB-xSJaBoSDnsuIKrEKa7qiJ1-uxB5QkD4yIE9mYMTBUvO62jEA6eqqxMiY Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:50.714329 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27067728ca4e47f58946fed243739250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27067728ca4e47f58946fed243739250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}] Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 29f23b5ef5bc4f079cc91b79b29ecb95 Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8'} Oct 12 22:30:50.715514 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:50.716717 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 22:30:50.717831 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.720080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b523430-87c5-4b98-b355-1dd6e3eefb91 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.721973 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b523430-87c5-4b98-b355-1dd6e3eefb91 tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-860864-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.017063 Oct 12 22:30:50.730280 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 64/112] 10.222.0.20 () {58 vars in 1191 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/os-hosts/n-d-860864-8/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:50.735818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb6db694-7570-4777-a55c-c331653d965d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Calling method '.version_select at 0x7f4504563550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:50.746264 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-cb6db694-7570-4777-a55c-c331653d965d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb6db694-7570-4777-a55c-c331653d965d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:50.753134 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'nonexistent_hostname'} Oct 12 22:30:50.754278 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:50.754914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 22:30:50.755821 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:50.757012 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.761476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb6db694-7570-4777-a55c-c331653d965d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.762643 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb6db694-7570-4777-a55c-c331653d965d tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030957 Oct 12 22:30:50.774560 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 65/113] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 12 22:30:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:30:50.779477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bf0a4bd-f9b3-4694-8727-bb7e0d4b2fa4 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Action: 'update', calling method: .version_select at 0x7f450431bc10>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bf0a4bd-f9b3-4694-8727-bb7e0d4b2fa4 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/os-hosts/n-d-860864-8 HTTP/1.1 Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 51 Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:50.792564 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: {"status": "enable", "maintenance_mode": "invalid"} Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.794061 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance: Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.794788 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.796206 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.797154 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.797154 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:30:50.797154 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:30:50.797154 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.797154 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.799056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bf0a4bd-f9b3-4694-8727-bb7e0d4b2fa4 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.805651 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8bf0a4bd-f9b3-4694-8727-bb7e0d4b2fa4 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-860864-8" status: 400 len: 199 microversion: 2.1 time: 0.024389 Oct 12 22:30:50.814117 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 66/114] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:30:50 2022] PUT /compute/v2.1/os-hosts/n-d-860864-8 => generated 199 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:30:50.827058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9d1a088-49c7-42ac-af50-7deecead2c1b tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Action: 'update', calling method: .version_select at 0x7f4504353d30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9d1a088-49c7-42ac-af50-7deecead2c1b tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/os-hosts/n-d-860864-8 HTTP/1.1 Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 51 Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:50.838598 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: {"status": "invalid", "maintenance_mode": "enable"} Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.839781 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance: Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.840498 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.841710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.842646 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.842646 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:30:50.842646 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:30:50.842646 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 22:30:50.842646 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.851162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9d1a088-49c7-42ac-af50-7deecead2c1b tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.852533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9d1a088-49c7-42ac-af50-7deecead2c1b tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-860864-8" status: 400 len: 189 microversion: 2.1 time: 0.037166 Oct 12 22:30:50.863745 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 67/115] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:30:50 2022] PUT /compute/v2.1/os-hosts/n-d-860864-8 => generated 189 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:30:50.871310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-673d3b92-07a3-4cc6-b9d0-f3d2cb5c803f tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Action: 'update', calling method: .version_select at 0x7f45042974c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:50.893950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-673d3b92-07a3-4cc6-b9d0-f3d2cb5c803f tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '29f23b5ef5bc4f079cc91b79b29ecb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27067728ca4e47f58946fed243739250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-673d3b92-07a3-4cc6-b9d0-f3d2cb5c803f tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Request method failure captured: Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/os-hosts/n-d-860864-8 HTTP/1.1 Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 50 Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AR-qfp3Vxsu6LB3LXyewmktSVCvFcd4AtAEj_B40sJxUjQN7lIxYWt2RVOy8p7CbORazIMpfDgrSX45geMaA9e5X6eR1HsW31-0fyfDppru6JgOepudB-xSJaBoSDnsuIKrEKa7qiJ1-uxB5QkD4yIE9mYMTBUvO62jEA6eqqxMiY Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:50.901087 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27067728ca4e47f58946fed243739250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27067728ca4e47f58946fed243739250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27067728ca4e47f58946fed243739250"}]}] Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 27067728ca4e47f58946fed243739250 Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2124003851 Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 29f23b5ef5bc4f079cc91b79b29ecb95 Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2124003851-project Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 22:30:50.902229 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:50.902945 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 22:30:50.905078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.907457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-673d3b92-07a3-4cc6-b9d0-f3d2cb5c803f tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.908624 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-673d3b92-07a3-4cc6-b9d0-f3d2cb5c803f tempest-HostsAdminNegativeTestJSON-2124003851 tempest-HostsAdminNegativeTestJSON-2124003851-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-860864-8" status: 403 len: 111 microversion: 2.1 time: 0.043537 Oct 12 22:30:50.931039 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 68/116] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:30:50 2022] PUT /compute/v2.1/os-hosts/n-d-860864-8 => generated 111 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:50.944008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4817536b-f176-4923-826d-f78ca1b24c08 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Action: 'update', calling method: .version_select at 0x7f4504297940>, body: {"status": null, "maintenance_mode": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4817536b-f176-4923-826d-f78ca1b24c08 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/os-hosts/n-d-860864-8 HTTP/1.1 Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 42 Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:50.957738 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: {"status": null, "maintenance_mode": null} Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 22:30:50.958965 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-d-860864-8', 'body': {'status': None, 'maintenance_mode': None}} Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance: Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi None Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.959720 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:50.961060 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:50.962109 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:30:50.962109 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:30:50.962109 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 22:30:50.962109 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:50.962109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4817536b-f176-4923-826d-f78ca1b24c08 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:50.962109 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4817536b-f176-4923-826d-f78ca1b24c08 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-860864-8" status: 400 len: 127 microversion: 2.1 time: 0.026768 Oct 12 22:30:50.978244 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 69/117] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:30:50 2022] PUT /compute/v2.1/os-hosts/n-d-860864-8 => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:30:50.987304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-952b6ee9-7072-4f04-979a-e1445007b214 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Action: 'update', calling method: .version_select at 0x7f45043abee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:50.998505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.hosts [None req-952b6ee9-7072-4f04-979a-e1445007b214 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Enabling host nonexistent_hostname. Oct 12 22:30:51.059256 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-952b6ee9-7072-4f04-979a-e1445007b214 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-952b6ee9-7072-4f04-979a-e1445007b214 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Request method failure captured: Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 50 Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AW6_EMBu4M0u1vW0YBlErqgn5VDxeBPvEoB6Au6qw3GXdawAHx-HShDkVk5ShNVZC7cQl00jyEtFkX9iEtEzzoDATgtZR8PtxGdWG87GovsptghTBnISpI7HkE7xkinyjkMdi6loK-CN_AiiDbVx06pO-lF7CAE0wdvABNjz4NRTs Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:30:51.064486 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ba57141ac5647458723569ec1f6e095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ba57141ac5647458723569ec1f6e095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ba57141ac5647458723569ec1f6e095"}]}] Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 9ba57141ac5647458723569ec1f6e095 Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-47489904 Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 473338482ae2418698f0ea42436d097b Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-47489904-project-admin Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:51.065685 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:30:51.066376 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:30:51.067295 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 22:30:51.068307 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:51.079001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-952b6ee9-7072-4f04-979a-e1445007b214 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:51.081524 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-952b6ee9-7072-4f04-979a-e1445007b214 tempest-HostsAdminNegativeTestJSON-47489904 tempest-HostsAdminNegativeTestJSON-47489904-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.102263 Oct 12 22:30:51.093772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 70/118] 10.222.0.20 () {60 vars in 1211 bytes} [Wed Oct 12 22:30:50 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:30:51.348287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:51.372835 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-efe83c7d-12f1-4f73-aba6-e5aa17a470b3 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 2.010215 Oct 12 22:30:51.374889 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 49/119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:49 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:51.442653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1489768039", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "1115412368", "adminPass": "***", "networks": [{"uuid": "be016120-0736-46bc-971a-f216e24bcb37"}], "security_groups": [{"name": "tempest-securitygroup--395111797"}], "key_name": "tempest-keypair-1745987402", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:52.039430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] validate_networks() for [('be016120-0736-46bc-971a-f216e24bcb37', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:30:52.470879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8c078e8a-a0c5-472e-b222-38e45288b63b req-bbbdd6b2-e5c3-4a26-9716-304ecfa55506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011630b4-4bdc-4342-860e-75de5850ac96", "tag": "55d2272e-b936-4fe2-8d99-5c54641c5f86"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:52.493296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8c078e8a-a0c5-472e-b222-38e45288b63b req-bbbdd6b2-e5c3-4a26-9716-304ecfa55506 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:52.495522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8c078e8a-a0c5-472e-b222-38e45288b63b req-bbbdd6b2-e5c3-4a26-9716-304ecfa55506 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:52.496201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8c078e8a-a0c5-472e-b222-38e45288b63b req-bbbdd6b2-e5c3-4a26-9716-304ecfa55506 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:52.519348 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8c078e8a-a0c5-472e-b222-38e45288b63b req-bbbdd6b2-e5c3-4a26-9716-304ecfa55506 service nova] Creating event network-changed:55d2272e-b936-4fe2-8d99-5c54641c5f86 for instance 011630b4-4bdc-4342-860e-75de5850ac96 on n-h2-860864-8 Oct 12 22:30:52.520207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8c078e8a-a0c5-472e-b222-38e45288b63b req-bbbdd6b2-e5c3-4a26-9716-304ecfa55506 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:30:52.520904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8c078e8a-a0c5-472e-b222-38e45288b63b req-bbbdd6b2-e5c3-4a26-9716-304ecfa55506 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:30:52.522830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:52.523580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:52.524216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:52.525185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:52.525786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:52.526343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:52.537462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.compute.rpcapi [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 22:30:52.539279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] Releasing lock "compute-rpcapi-router" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:30:52.563339 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bbce1148-e797-4a80-8b6b-5adfc4a7a370 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.403781 Oct 12 22:30:52.564729 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 71/120] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:30:52.577159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:52.577912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:52.591473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:52.596058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:52.596789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:52.597687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:52.601193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:52.601854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:52.764664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=20 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:53.196258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:53.213151 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e379bff-8668-48d8-ba13-94bac52647ad tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.646852 Oct 12 22:30:53.227937 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 72/121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:52 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:54.065443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea17ff7d-7aad-406b-8989-237c53b018d1 tempest-AZAdminNegativeTestJSON-1640266819 tempest-AZAdminNegativeTestJSON-1640266819-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:54.071075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea17ff7d-7aad-406b-8989-237c53b018d1 tempest-AZAdminNegativeTestJSON-1640266819 tempest-AZAdminNegativeTestJSON-1640266819-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e234bf29b0d143d6803cc01e7514b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4c398dbe50436ab469fab31a1eb14e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea17ff7d-7aad-406b-8989-237c53b018d1 tempest-AZAdminNegativeTestJSON-1640266819 tempest-AZAdminNegativeTestJSON-1640266819-project] Request method failure captured: Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AZA0pTETo3HqynLYiAFc1xYe4em8n3YpuBJWycJScTi9jSWg9MkmndPP43Ue1y4fk7e7bRzn1bqPE0sjR7NRc4cz2Wp2lFTvNIyEAJ039AhoLiLhDw2xT1I3VZNOtv_iFl5aJ0LIWYaRKWndE1ibeaKL9ge5Ro6CaJ65Er1RLid0I Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ee4c398dbe50436ab469fab31a1eb14e Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1640266819 Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:30:54.075930 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee4c398dbe50436ab469fab31a1eb14e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee4c398dbe50436ab469fab31a1eb14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee4c398dbe50436ab469fab31a1eb14e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee4c398dbe50436ab469fab31a1eb14e"}]}] Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AZAdminNegativeTestJSON-1640266819 Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ee4c398dbe50436ab469fab31a1eb14e Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1640266819 Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AZAdminNegativeTestJSON-1640266819-project Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e234bf29b0d143d6803cc01e7514b789 Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AZAdminNegativeTestJSON-1640266819-project Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 22:30:54.077176 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:30:54.079348 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:30:54.080905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea17ff7d-7aad-406b-8989-237c53b018d1 tempest-AZAdminNegativeTestJSON-1640266819 tempest-AZAdminNegativeTestJSON-1640266819-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:30:54.082195 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea17ff7d-7aad-406b-8989-237c53b018d1 tempest-AZAdminNegativeTestJSON-1640266819 tempest-AZAdminNegativeTestJSON-1640266819-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.707090 Oct 12 22:30:54.082195 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 73/122] 10.222.0.20 () {58 vars in 1185 bytes} [Wed Oct 12 22:30:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 710 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:30:54.244034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:54.245052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:54.264787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:54.266177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:54.267989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:54.269126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:54.271405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:54.272684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:54.578148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:54.586292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b1e3b56-0821-44c2-9475-27161764c819 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.349199 Oct 12 22:30:54.587084 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 74/123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:54 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:30:55.238792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:30:55.239347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:30:55.239519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:30:55.240261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:30:55.241400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:30:55.262481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:55.265814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:55.267528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:55.269697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:55.271178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:55.273507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:55.334517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Getting quotas for project 73a41ac7523f4592ae88851113a895ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:30:55.344573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Getting quotas for user d9dd6cd5ae4f432b8afc184210820c10 and project 73a41ac7523f4592ae88851113a895ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:30:55.385849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:30:55.393690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:30:55.437908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:55.538622 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8a13acc-8786-4070-bf16-6b2fcbc20fd7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.101531 Oct 12 22:30:55.556381 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 50/124] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:30:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 4120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:30:55.561879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2c59b97-b12e-4df5-a3d7-39f758412b19 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:55.562806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2c59b97-b12e-4df5-a3d7-39f758412b19 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:55.610144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:55.613219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:55.622974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:55.626613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:55.627200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:55.629138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:55.629746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:55.632784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:55.760840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2c59b97-b12e-4df5-a3d7-39f758412b19 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:55.805781 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2c59b97-b12e-4df5-a3d7-39f758412b19 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1265 microversion: 2.1 time: 0.248216 Oct 12 22:30:55.831492 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 75/125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:55 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:56.077771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:56.089913 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e35f990d-5a80-4137-86c4-cf474c28b3bf tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.482100 Oct 12 22:30:56.093473 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 51/126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:55 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:56.845785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40bb49ee-14b2-4bca-859d-7a5aac48c979 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:56.846709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40bb49ee-14b2-4bca-859d-7a5aac48c979 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:56.905536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40bb49ee-14b2-4bca-859d-7a5aac48c979 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:56.914265 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40bb49ee-14b2-4bca-859d-7a5aac48c979 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1265 microversion: 2.1 time: 0.072275 Oct 12 22:30:56.919828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 76/127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:56 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:57.122873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:57.125955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:57.147990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:57.148573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:57.149020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:57.150785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:57.151234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:57.151840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:57.352249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:57.362636 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62474881-bb7c-4f7f-9c60-c23528a4de27 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.251691 Oct 12 22:30:57.363803 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 52/128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:57 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:57.938908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:57.940243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:57.961338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:57.965484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:57.966149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:57.967732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:57.969958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:57.970968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:58.134842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:58.146180 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3922a617-e35d-4e6e-91b7-c5aa08ad4878 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1323 microversion: 2.1 time: 0.211303 Oct 12 22:30:58.147179 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 77/129] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:57 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:58.385448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:58.386055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:58.399344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:58.401503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:58.402256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:58.403692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:58.405338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:58.406141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:58.414137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=63 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:30:58.615976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:58.629293 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4a71996-9a1f-43ff-8d4d-8d7589c66b2d tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.247627 Oct 12 22:30:58.630738 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 53/130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:58 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:59.137576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1700671830", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:30:59.171029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:59.172024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:59.183531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:59.185381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:59.186808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:59.189595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:59.190647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:59.193041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:59.218713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:30:59.330412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:59.343336 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc996d2a-bb7f-447f-97df-28d6f8bd37bd tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1323 microversion: 2.1 time: 0.177543 Oct 12 22:30:59.344379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 54/131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:59 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:30:59.654087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:30:59.655273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:30:59.667313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:59.667816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:59.672466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:59.678943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:30:59.684449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:30:59.684449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:30:59.940837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:30:59.950361 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-715fe8f1-905d-4816-9195-82793906ecaa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.300163 Oct 12 22:30:59.952499 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 55/132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:30:59 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:30:59.980483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:30:59.981087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:30:59.981784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:30:59.982356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:30:59.982961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:00.005150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.007916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.008666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.009951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.010513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.011146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.029837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=79 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:00.046568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Getting quotas for project 09e75a75b4f24f0f8c23d5d8cff4262c. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:00.052619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Getting quotas for user 36c3460feeb4440db6dff38198d5dd68 and project 09e75a75b4f24f0f8c23d5d8cff4262c. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:00.069352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:00.073131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:31:00.201220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54ede250-508b-4db0-993e-d933e3ec040d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.685371 Oct 12 22:31:00.202196 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 78/133] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:31:00.218889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0036186-a64e-4a78-aab1-83d473695134 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:00.219503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b0036186-a64e-4a78-aab1-83d473695134 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:00.607353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f450459baf0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:00.611040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.611624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.619137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.620170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.620830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.621270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.657041 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-095bbb97-6524-41e9-97de-8509d8b753fe tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.702371 Oct 12 22:31:00.664675 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 56/134] 10.222.0.20 () {58 vars in 1128 bytes} [Wed Oct 12 22:30:59 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:00.679336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:00.680024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:00.688590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.689634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.690255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.691452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.692095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.692779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.821872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:00.837882 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54980413-8de4-4d92-9c7c-5dd8966d2b02 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1323 microversion: 2.1 time: 0.171691 Oct 12 22:31:00.857192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b0036186-a64e-4a78-aab1-83d473695134 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:00.857646 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 57/135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:00 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:00.870114 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0036186-a64e-4a78-aab1-83d473695134 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1219 microversion: 2.1 time: 0.658834 Oct 12 22:31:00.870762 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 79/136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:00 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1219 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:00.874570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f4504679700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:00.886687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.889708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.890921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.894001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.896226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.897892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.973168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:00.973943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:00.995716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.996251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:00.996684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:00.997390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:00.997834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:01.000129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:01.015215 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f1703116-ae6e-45ad-854a-583289aeccca tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.152819 Oct 12 22:31:01.035345 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 58/137] 10.222.0.20 () {58 vars in 1139 bytes} [Wed Oct 12 22:31:00 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:01.281596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ef39dd8-eacf-4840-b192-d93f41946f02 tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-801009696", "id": 981898500, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:01.312473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ef39dd8-eacf-4840-b192-d93f41946f02 tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.274159 Oct 12 22:31:01.313147 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 59/138] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:31:01 2022] POST /compute/v2.1/flavors => generated 467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:01.319364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f450459b5e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:01.323749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:01.324447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:01.325591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:01.326498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:01.327096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:01.327680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:01.367126 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f8c2522-aa88-42ad-8302-3cbdf19ba64a tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.052075 Oct 12 22:31:01.368140 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 60/139] 10.222.0.20 () {58 vars in 1145 bytes} [Wed Oct 12 22:31:01 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:31:01.372685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3106307-4fee-4e97-9dca-1241127827cb tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:01.437595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:01.449543 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6df5f69a-00b1-4419-8e5a-795e57e1ef7c tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.479259 Oct 12 22:31:01.450582 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 80/140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:00 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:01.665981 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3106307-4fee-4e97-9dca-1241127827cb tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/981898500/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.296644 Oct 12 22:31:01.667481 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 61/141] 10.222.0.20 () {62 vars in 1262 bytes} [Wed Oct 12 22:31:01 2022] POST /compute/v2.1/flavors/981898500/os-extra_specs => generated 62 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:01.692514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b712d9e-b0d6-44c7-a44b-566f4ff9e96c tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:01.715404 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b712d9e-b0d6-44c7-a44b-566f4ff9e96c tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/981898500" status: 202 len: 0 microversion: 2.86 time: 0.030502 Oct 12 22:31:01.729788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3fdc01c8-926a-4e72-8482-069f3ff50965 tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:01.732060 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 81/142] 10.222.0.20 () {60 vars in 1199 bytes} [Wed Oct 12 22:31:01 2022] DELETE /compute/v2.1/flavors/981898500 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:01.760537 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3fdc01c8-926a-4e72-8482-069f3ff50965 tempest-FlavorMetadataValidation-1369995376 tempest-FlavorMetadataValidation-1369995376-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.037098 Oct 12 22:31:01.761898 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 62/143] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:31:01 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:01.862485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:01.863365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:01.882295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:01.882783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:01.883210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:01.884074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:01.884941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:01.885539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:01.901789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:01.903168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:01.911918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:01.920864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:01.921643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:01.922590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:01.923395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:01.924085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:02.028778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:02.039300 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-652146a6-9b3d-4998-ab88-ba7fe325b92d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1323 microversion: 2.1 time: 0.179621 Oct 12 22:31:02.046082 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 82/144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:01 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1323 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:02.096341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:02.120193 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2592cba-56af-44ea-ab10-b490412faa6f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1223 microversion: 2.1 time: 0.224364 Oct 12 22:31:02.121959 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 63/145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:01 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1223 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:02.473098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:02.474289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:02.486134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:02.488292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:02.491012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:02.491962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:02.495530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:02.496351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:02.766111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-469c4749-bf9d-45f7-8241-b6ba2901bc67 req-f1dc46df-e6d6-4ebb-acc3-181c1b99cd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011630b4-4bdc-4342-860e-75de5850ac96", "name": "network-vif-plugged", "status": "completed", "tag": "55d2272e-b936-4fe2-8d99-5c54641c5f86"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:02.785378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-469c4749-bf9d-45f7-8241-b6ba2901bc67 req-f1dc46df-e6d6-4ebb-acc3-181c1b99cd2c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:02.785954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-469c4749-bf9d-45f7-8241-b6ba2901bc67 req-f1dc46df-e6d6-4ebb-acc3-181c1b99cd2c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:02.786454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-469c4749-bf9d-45f7-8241-b6ba2901bc67 req-f1dc46df-e6d6-4ebb-acc3-181c1b99cd2c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:02.820149 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-469c4749-bf9d-45f7-8241-b6ba2901bc67 req-f1dc46df-e6d6-4ebb-acc3-181c1b99cd2c service nova] Creating event network-vif-plugged:55d2272e-b936-4fe2-8d99-5c54641c5f86 for instance 011630b4-4bdc-4342-860e-75de5850ac96 on n-h2-860864-8 Oct 12 22:31:02.820986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-469c4749-bf9d-45f7-8241-b6ba2901bc67 req-f1dc46df-e6d6-4ebb-acc3-181c1b99cd2c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:31:02.821683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-469c4749-bf9d-45f7-8241-b6ba2901bc67 req-f1dc46df-e6d6-4ebb-acc3-181c1b99cd2c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:31:02.822976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:02.823515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:02.824102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:02.824889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:02.825410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:02.825964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:02.839087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.rpcapi [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 22:31:02.840380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] Releasing lock "compute-rpcapi-router" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:31:02.867383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af752114-2666-4a2e-8993-6fa5d670e11f None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194280 Oct 12 22:31:02.868609 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 64/146] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:03.050403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:03.063813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40dc8fd5-10ab-4163-ad6f-b42d5596a001 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.594720 Oct 12 22:31:03.069126 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 83/147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:02 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:03.106350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:03.107246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:03.134149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:03.137001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:03.138330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:03.140334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:03.142144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:03.142753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:03.146729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:03.147483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:03.160257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:03.164458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:03.165202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:03.172613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:03.173812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:03.174291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:03.375185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:03.402322 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-20452fc7-a1b9-43b2-a0b7-2a3026f7c53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1215 microversion: 2.1 time: 0.257740 Oct 12 22:31:03.407026 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 84/148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:03 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:03.674361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:03.686489 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-45bc02f1-ae11-4b27-aa9a-ea5b7eb4fbc0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1323 microversion: 2.1 time: 0.601962 Oct 12 22:31:03.687086 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 65/149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:03 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1323 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:04.101947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:04.102575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:04.125432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.129196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.129687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.130421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.131445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.140879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.438165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:04.441730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:04.450466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.452035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.453331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.454887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.455724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.456324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.632103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:04.645136 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7149c37e-9820-49c0-8911-9f39b1ecb680 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1277 microversion: 2.1 time: 0.212141 Oct 12 22:31:04.648055 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 66/150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:04 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:04.720161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:04.721247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:04.723963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:04.736255 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-05f21121-34e3-4ca1-bd4a-37350e3f971a tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.642784 Oct 12 22:31:04.738820 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 85/151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:04 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:04.747230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.751419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.754257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.764655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:04.767159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:04.767877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:04.977644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:04.989680 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7d67acf-4721-4e51-97d5-8c65af165fab tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1323 microversion: 2.1 time: 0.278207 Oct 12 22:31:04.994332 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 67/152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:04 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:05.673032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:05.673870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:05.687253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:05.691565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:05.693843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:05.696459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:05.697462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:05.699984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:05.701786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:05.760173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:05.766865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:05.768843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:05.780154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:05.780904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:05.781565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:05.782852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:05.783518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:05.784642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:06.183848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:06.213924 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b724267-3a1c-4d54-90cb-776a6a74c61b tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1337 microversion: 2.1 time: 0.450703 Oct 12 22:31:06.216196 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 68/153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:05 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1337 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:06.240708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:06.242865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:06.258319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:06.258805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:06.263720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:06.267121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:06.267681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:06.268161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:06.805337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:06.822770 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9de61ffc-393e-4a0d-8431-b0da4438b574 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.600693 Oct 12 22:31:06.825921 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 69/154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:06 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:06.845887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:06.877849 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-87b33ac3-f8b3-4fa4-854d-9acac263b693 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 1.209665 Oct 12 22:31:06.883583 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 86/155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:05 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:07.239472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:07.241514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:07.247928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:07.248581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:07.249731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:07.251225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:07.253033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:07.253658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:07.454864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-26badab6-7acd-4be8-b19c-6eb1257fcecb req-90b3b7a7-9fe3-4d9d-8045-8ef5de84a6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ebc875-f3fa-40df-ad56-125ba35d8cd7", "tag": "2ce906c4-08eb-4ccf-b13a-b0c489cb8437"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:07.479700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-26badab6-7acd-4be8-b19c-6eb1257fcecb req-90b3b7a7-9fe3-4d9d-8045-8ef5de84a6b0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:07.480804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-26badab6-7acd-4be8-b19c-6eb1257fcecb req-90b3b7a7-9fe3-4d9d-8045-8ef5de84a6b0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:07.481646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-26badab6-7acd-4be8-b19c-6eb1257fcecb req-90b3b7a7-9fe3-4d9d-8045-8ef5de84a6b0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:07.495556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:07.504691 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e5b321a-e9f1-417f-91aa-803efeaea1f2 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1487 microversion: 2.1 time: 0.268752 Oct 12 22:31:07.505573 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 70/156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:07 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:07.529878 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-26badab6-7acd-4be8-b19c-6eb1257fcecb req-90b3b7a7-9fe3-4d9d-8045-8ef5de84a6b0 service nova] Creating event network-changed:2ce906c4-08eb-4ccf-b13a-b0c489cb8437 for instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 on n-h1-860864-8 Oct 12 22:31:07.530883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:07.531443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:07.538785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:07.539207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:07.540105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:07.541639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:07.542100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:07.542560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:07.550835 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-26badab6-7acd-4be8-b19c-6eb1257fcecb req-90b3b7a7-9fe3-4d9d-8045-8ef5de84a6b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103384 Oct 12 22:31:07.552923 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 87/157] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:07.896739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4aa2a7a3-99e2-403b-9c23-6a68d201d77a tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Calling method '.version_select at 0x7f450447fdc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:07.985518 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4aa2a7a3-99e2-403b-9c23-6a68d201d77a tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c" status: 200 len: 371 microversion: 2.1 time: 0.320755 Oct 12 22:31:07.986107 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 88/158] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 22:31:07 2022] GET /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c => generated 371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:07.993811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:07.994560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:08.018007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.018593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.022868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.023970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.027397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.028102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.297115 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5746dcf6-f161-4af6-a776-cf72092d663d tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1638 microversion: 2.1 time: 0.771535 Oct 12 22:31:08.298713 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 71/159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:07 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1638 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:08.320307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:08.321041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:08.329485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.332230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.335019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.336030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.341369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.341941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.524377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:08.533872 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4e87af66-58cf-4b44-aa2a-4c4b1add6892 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 0.231207 Oct 12 22:31:08.546339 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 72/160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:08 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:08.554055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Action: 'update', calling method: .version_select at 0x7f4504679700>, body: {"quota_set": {"ram": "5120"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:08.632774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.633500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.633997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.634775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.635370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.635856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.699227 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a63a606-39ae-4cdc-8840-0667b828b7ad tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c" status: 200 len: 328 microversion: 2.1 time: 0.150502 Oct 12 22:31:08.703969 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 73/161] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:31:08 2022] PUT /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c => generated 328 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:08.705895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:08.706485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:08.713299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.713886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.714323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.715139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:08.715596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:08.716043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:08.744787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:31:08.761257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:08.771070 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ed8007f1-d36a-445e-addf-0dfe99a57c21 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.781077 Oct 12 22:31:08.771709 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 89/162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:07 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:08.781962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4765b899-6d47-472f-a451-ef5c7aab424a tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:08.815333 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4765b899-6d47-472f-a451-ef5c7aab424a tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c" status: 202 len: 0 microversion: 2.1 time: 0.040943 Oct 12 22:31:08.816639 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 90/163] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:31:08 2022] DELETE /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:31:08.824525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d503fcb1-693b-4bcf-8341-bf048caba0a8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Calling method '.version_select at 0x7f45042974c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:08.914691 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d503fcb1-693b-4bcf-8341-bf048caba0a8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c" status: 200 len: 371 microversion: 2.1 time: 0.093879 Oct 12 22:31:08.916367 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 91/164] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 22:31:08 2022] GET /compute/v2.1/os-quota-sets/e29e0acead2045ffa277919fe73a9c8c => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:08.999188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:09.077237 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a603cf6a-2ec0-4745-bb2a-e67796e34723 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 204 len: 0 microversion: 2.1 time: 0.375091 Oct 12 22:31:09.078092 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 74/165] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:31:08 2022] DELETE /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:09.086959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e06cec19-7ab0-423d-aa54-4c2200462730 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Calling method '.version_select at 0x7f450431bb80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:09.088770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:09.089468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:09.096996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:09.097652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:09.098235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.099827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:09.100488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:09.101110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.305632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:09.315445 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-338860a1-f70d-481d-8943-4d606142f8ef tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1493 microversion: 2.1 time: 0.230655 Oct 12 22:31:09.316519 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 75/166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:09 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1493 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:09.341682 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e06cec19-7ab0-423d-aa54-4c2200462730 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.259072 Oct 12 22:31:09.342257 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 92/167] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:31:09 2022] GET /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e/defaults => generated 371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:09.406913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5b513751-c5c9-40e0-b103-43972bdfa18e req-847e6eec-76af-447a-9fe1-4abda6406a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b2d603-856b-432d-9eb5-80f56b1f1b66", "tag": "832d6d08-7a12-4545-8d9d-0a1673f1aa52"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:09.422614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5b513751-c5c9-40e0-b103-43972bdfa18e req-847e6eec-76af-447a-9fe1-4abda6406a5d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:09.423510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5b513751-c5c9-40e0-b103-43972bdfa18e req-847e6eec-76af-447a-9fe1-4abda6406a5d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:09.424277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5b513751-c5c9-40e0-b103-43972bdfa18e req-847e6eec-76af-447a-9fe1-4abda6406a5d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.439779 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5b513751-c5c9-40e0-b103-43972bdfa18e req-847e6eec-76af-447a-9fe1-4abda6406a5d service nova] Creating event network-changed:832d6d08-7a12-4545-8d9d-0a1673f1aa52 for instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 on n-h1-860864-8 Oct 12 22:31:09.455547 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5b513751-c5c9-40e0-b103-43972bdfa18e req-847e6eec-76af-447a-9fe1-4abda6406a5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136274 Oct 12 22:31:09.456441 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 76/168] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:09.557043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:09.557659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:09.570038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:09.574249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:09.574694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.575434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:09.575885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:09.576345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.671755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Action: 'update', calling method: .version_select at 0x7f4504679700>, body: {"quota_set": {"ram": "5120"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:09.887028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:09.887764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:09.888467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.889409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:09.890071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:09.890736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:09.939254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=88,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:09.972001 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35813665-596e-44f9-a001-4c25c4316e74 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306" status: 200 len: 328 microversion: 2.1 time: 0.304504 Oct 12 22:31:09.982358 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 77/169] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:31:09 2022] PUT /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306 => generated 328 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:09.995042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:09.996788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:10.012845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.013536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.013987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.014760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.015636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.016207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.031020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:10.438308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:10.457817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f3d8f66-ce14-45dc-9f52-ec4cce061aff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 0.904489 Oct 12 22:31:10.463185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 93/170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:09 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:10.471226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Calling method '.version_select at 0x7f4504405280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:10.596526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:10.608796 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8af8d86-7b47-4fa4-8522-aac1becb08d4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.623410 Oct 12 22:31:10.609703 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 78/171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:09 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:10.623778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:10.624616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:10.633436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.634054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.634866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.635636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.636198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.636676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.646363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.648862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.649598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.650500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:10.652876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:10.653461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:10.698800 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d9a39fdb-9a64-4384-8731-d58ee3581d68 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306/detail" status: 200 len: 916 microversion: 2.1 time: 0.233387 Oct 12 22:31:10.699498 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 94/172] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:31:10 2022] GET /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306/detail => generated 916 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:10.922888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Action: 'update', calling method: .version_select at 0x7f4504353160>, body: {"quota_set": {"ram": "2048"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:11.003495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.004126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.004549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.005799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.013758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.014441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.111617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.112182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.112544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.113256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.113697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.114104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.140503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:11.155611 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e38fc7e7-e4e7-424b-88f3-6f223e7bf468 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1493 microversion: 2.1 time: 0.538765 Oct 12 22:31:11.156335 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 79/173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:10 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1493 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:11.289799 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-edd5bedb-366f-42b8-a727-baecd3e05571 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306?user_id=47909f13629048c0bd4c335f7b1bd6c0" status: 200 len: 328 microversion: 2.1 time: 0.370270 Oct 12 22:31:11.299106 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 95/174] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:31:10 2022] PUT /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306?user_id=47909f13629048c0bd4c335f7b1bd6c0 => generated 328 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:11.303193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f4f9f82-2210-488b-a0c6-2493f99c7644 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Calling method '.version_select at 0x7f45044acb80>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:11.488042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:11.488776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:11.492339 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f4f9f82-2210-488b-a0c6-2493f99c7644 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306?user_id=47909f13629048c0bd4c335f7b1bd6c0" status: 200 len: 370 microversion: 2.1 time: 0.193412 Oct 12 22:31:11.496240 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 80/175] 10.222.0.20 () {58 vars in 1323 bytes} [Wed Oct 12 22:31:11 2022] GET /compute/v2.1/os-quota-sets/cda817ddac6b4401b898ca1bfaa2d306?user_id=47909f13629048c0bd4c335f7b1bd6c0 => generated 370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:11.510940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.515199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.515835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.518755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.519227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.521817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.651765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:11.655197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:11.676459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.684567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.685026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:11.685773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:11.686230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:11.686654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:12.303472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:12.308896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:12.315428 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93ae5665-3d82-4bd7-8dd4-3d344096167f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.683728 Oct 12 22:31:12.319473 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 81/176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:11 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:12.323062 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d35428c3-b9f0-4879-9eaf-9145e68c7753 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 0.840928 Oct 12 22:31:12.328510 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 96/177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:11 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:12.348455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:12.351169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:12.367808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2ec61a77-24e7-4a28-a68a-10948f96154c req-75323817-077c-4a13-b7e8-ff7bf2980cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011630b4-4bdc-4342-860e-75de5850ac96", "name": "network-vif-deleted", "tag": "55d2272e-b936-4fe2-8d99-5c54641c5f86"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:12.378819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:12.386900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:12.389985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:12.391995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:12.394516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:12.398345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:12.426888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ec61a77-24e7-4a28-a68a-10948f96154c req-75323817-077c-4a13-b7e8-ff7bf2980cdb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:12.428492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ec61a77-24e7-4a28-a68a-10948f96154c req-75323817-077c-4a13-b7e8-ff7bf2980cdb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:12.430222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ec61a77-24e7-4a28-a68a-10948f96154c req-75323817-077c-4a13-b7e8-ff7bf2980cdb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:12.469758 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2ec61a77-24e7-4a28-a68a-10948f96154c req-75323817-077c-4a13-b7e8-ff7bf2980cdb service nova] Creating event network-vif-deleted:55d2272e-b936-4fe2-8d99-5c54641c5f86 for instance 011630b4-4bdc-4342-860e-75de5850ac96 on n-h2-860864-8 Oct 12 22:31:12.483992 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2ec61a77-24e7-4a28-a68a-10948f96154c req-75323817-077c-4a13-b7e8-ff7bf2980cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150934 Oct 12 22:31:12.485329 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 97/178] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:12.493520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0741dffb-6c9c-46b9-9591-779b8cc6486b tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Calling method '.version_select at 0x7f4504297940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:12.748198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '373463f220fb402ba15a5c388b45a6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a41d16a4c3402e8279b72040359451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:12.761286 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d2f52f6-d574-4a68-a630-771bf5c63a81 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 200 len: 1322 microversion: 2.1 time: 0.438290 Oct 12 22:31:12.765446 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 82/179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:12 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:12.993290 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0741dffb-6c9c-46b9-9591-779b8cc6486b tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.506483 Oct 12 22:31:12.995507 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 98/180] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:31:12 2022] GET /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e/defaults => generated 371 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:13.011474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Action: 'update', calling method: .version_select at 0x7f450452f160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:13.340640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:13.341526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:13.357668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.358164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.358600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.359303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.360407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.361439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.392343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.393423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.400690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.401758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.402413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.403017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.683136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:13.710495 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-76dc2928-b268-4ab4-aee5-4cc8c69505b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.371321 Oct 12 22:31:13.714213 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 99/181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:13 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:13.744538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:13.748246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:13.769923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.772547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.772991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.778882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.779378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.788732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.916964 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-14e49262-4315-4cdc-a418-ab0e3d0f5155 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e" status: 200 len: 329 microversion: 2.1 time: 0.909510 Oct 12 22:31:13.918249 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 83/182] 10.222.0.20 () {60 vars in 1263 bytes} [Wed Oct 12 22:31:13 2022] PUT /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e => generated 329 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:13.923100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:13.924029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:13.933357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.933915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.934353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.935235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:13.935844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:13.937233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:13.953837 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] HTTP exception thrown: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Request method failure captured: Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 HTTP/1.1 Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ABXvVFqXt1YxV9YFPzO2vLfVtXwqNSlmKd8gg4HSQptWDsNVpIeNni3-DbHpjGdDXHEUMFUMSsjxqJaJwD5mEzYVRXewHn9nHgq6tKw4J3XFPOG2g_BNR2-oTD8puJ6Hwzk5VLAgZcr-rRwAfgwaeHWdsVJJ7re2s1p-qNhb47YgA Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a7a41d16a4c3402e8279b72040359451 Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:31:13.956898 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7a41d16a4c3402e8279b72040359451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a7a41d16a4c3402e8279b72040359451"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a7a41d16a4c3402e8279b72040359451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7a41d16a4c3402e8279b72040359451"}]}] Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a7a41d16a4c3402e8279b72040359451 Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminTestJSON-934135273-project Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 373463f220fb402ba15a5c388b45a6aa Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminTestJSON-934135273-project Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:13.959635 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '011630b4-4bdc-4342-860e-75de5850ac96'} Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:13.960449 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:13.962822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:13.965577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Returning 404 to user: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:13.965577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9808fc9-b464-48d7-8c65-7b78322c83aa tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 404 len: 111 microversion: 2.1 time: 0.039186 Oct 12 22:31:13.965577 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 84/183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:13 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:13.968773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Action: 'update', calling method: .version_select at 0x7f450459ba60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:14.040492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:14.050837 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eaeda4ea-20f5-474e-8fd3-ba1c74072098 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 0.333905 Oct 12 22:31:14.052687 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 100/184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:13 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:14.069870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca07ba21-edfb-42f8-8a9e-71de3c8b5178 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:14.091084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca07ba21-edfb-42f8-8a9e-71de3c8b5178 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:14.091843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca07ba21-edfb-42f8-8a9e-71de3c8b5178 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:14.092635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca07ba21-edfb-42f8-8a9e-71de3c8b5178 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:14.341061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:14.343707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:14.344439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:14.346044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:14.346828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:14.349115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:14.738689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:INSERT=23,nova_api:SELECT=70,nova_api:UPDATE=7 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:15.000266 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca07ba21-edfb-42f8-8a9e-71de3c8b5178 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 297 microversion: 2.1 time: 0.945940 Oct 12 22:31:15.010626 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 101/185] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:31:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 297 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:15.019278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:15.021900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:15.055396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.057066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.057487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ad3c891-7d1f-4cd7-9ecc-2d17d35b39d8 tempest-QuotasAdminTestJSON-2125330176 tempest-QuotasAdminTestJSON-2125330176-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e" status: 200 len: 329 microversion: 2.1 time: 1.091731 Oct 12 22:31:15.058283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.059779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.061007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.061638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.070237 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 85/186] 10.222.0.20 () {60 vars in 1263 bytes} [Wed Oct 12 22:31:13 2022] PUT /compute/v2.1/os-quota-sets/090c40e945f04ec581f92179ab25365e => generated 329 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:15.075647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-952d7c55-88ae-452e-9681-f2d1300e71d0 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:15.126149 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-952d7c55-88ae-452e-9681-f2d1300e71d0 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.054539 Oct 12 22:31:15.126739 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 86/187] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:31:15 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:15.138588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:15.139882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:15.162529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.163106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.163560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.165456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.167084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.169961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.524015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:15.535783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac9acc51-6323-4bf6-b95a-6e519aab7b3a tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 0.406229 Oct 12 22:31:15.537884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:15.547924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 87/188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:15 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:15.555573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-96763a8f-9ad0-4e47-80e4-40e9a2f95b92 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1072940204"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:15.568870 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-236eda3f-e688-40d8-9363-9afc9fd0abf0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.556165 Oct 12 22:31:15.570324 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 102/189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:15 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:15.596649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-96763a8f-9ad0-4e47-80e4-40e9a2f95b92 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid 144bff26-3c9f-4601-aad1-7d7164466a1a for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:15.640361 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-96763a8f-9ad0-4e47-80e4-40e9a2f95b92 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.099557 Oct 12 22:31:15.641334 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 88/190] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:15.655156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99a23feb-caf9-40f3-8c62-8fa2b2b1f732 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:15.668936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99a23feb-caf9-40f3-8c62-8fa2b2b1f732 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.669746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99a23feb-caf9-40f3-8c62-8fa2b2b1f732 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.670603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99a23feb-caf9-40f3-8c62-8fa2b2b1f732 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:15.860828 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99a23feb-caf9-40f3-8c62-8fa2b2b1f732 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.210780 Oct 12 22:31:15.861424 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 103/191] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:31:15 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:15.874045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd1263df-8c78-4ce1-9a6f-1bfc922a1fcd tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:15.886033 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd1263df-8c78-4ce1-9a6f-1bfc922a1fcd tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.015865 Oct 12 22:31:15.886844 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 89/192] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 22:31:15 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:15.899104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ac004ec-45a7-433a-9f91-a2d8b5baa763 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:15.923117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac004ec-45a7-433a-9f91-a2d8b5baa763 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:15.923755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac004ec-45a7-433a-9f91-a2d8b5baa763 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:15.924354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac004ec-45a7-433a-9f91-a2d8b5baa763 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.081309 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ac004ec-45a7-433a-9f91-a2d8b5baa763 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.186777 Oct 12 22:31:16.084246 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 104/193] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:31:15 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:16.096682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b23f985a-483e-4a04-befb-e2d6cf1f9cd0 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:16.130304 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b23f985a-483e-4a04-befb-e2d6cf1f9cd0 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.037280 Oct 12 22:31:16.131748 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 90/194] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:31:16 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:16.144819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-025cf305-b4cd-46b9-a314-ab3a0c6a36da tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1346219382"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:16.150260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-025cf305-b4cd-46b9-a314-ab3a0c6a36da tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid 258a4145-6ea0-4267-bd0b-40a5c599e685 for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:16.189779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-025cf305-b4cd-46b9-a314-ab3a0c6a36da tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050444 Oct 12 22:31:16.191646 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 105/195] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:16.205685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72431a57-1cb4-4c1a-bf45-a6f72cf02e43 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:16.227100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72431a57-1cb4-4c1a-bf45-a6f72cf02e43 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.227586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72431a57-1cb4-4c1a-bf45-a6f72cf02e43 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.228110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72431a57-1cb4-4c1a-bf45-a6f72cf02e43 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.364886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8dfd7df0-6ce5-40a5-85e7-6fa730f19045 req-0d99c16c-cccd-4ded-bebe-9e113c1507b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ebc875-f3fa-40df-ad56-125ba35d8cd7", "name": "network-vif-plugged", "status": "completed", "tag": "2ce906c4-08eb-4ccf-b13a-b0c489cb8437"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:16.378114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8dfd7df0-6ce5-40a5-85e7-6fa730f19045 req-0d99c16c-cccd-4ded-bebe-9e113c1507b7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.378599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8dfd7df0-6ce5-40a5-85e7-6fa730f19045 req-0d99c16c-cccd-4ded-bebe-9e113c1507b7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.379103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8dfd7df0-6ce5-40a5-85e7-6fa730f19045 req-0d99c16c-cccd-4ded-bebe-9e113c1507b7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.397976 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8dfd7df0-6ce5-40a5-85e7-6fa730f19045 req-0d99c16c-cccd-4ded-bebe-9e113c1507b7 service nova] Creating event network-vif-plugged:2ce906c4-08eb-4ccf-b13a-b0c489cb8437 for instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 on n-h1-860864-8 Oct 12 22:31:16.408212 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8dfd7df0-6ce5-40a5-85e7-6fa730f19045 req-0d99c16c-cccd-4ded-bebe-9e113c1507b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050049 Oct 12 22:31:16.409658 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 106/196] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:16.448837 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-72431a57-1cb4-4c1a-bf45-a6f72cf02e43 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.249166 Oct 12 22:31:16.456037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 91/197] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:31:16 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:16.466353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b6b4631b-4a29-48dc-994f-5e66f9182d18 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:16.482752 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b6b4631b-4a29-48dc-994f-5e66f9182d18 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.024962 Oct 12 22:31:16.483772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 107/198] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:31:16 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:16.495128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7a170d5-236c-40e5-83c9-7ea049f1d590 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:16.509327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a170d5-236c-40e5-83c9-7ea049f1d590 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.509845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a170d5-236c-40e5-83c9-7ea049f1d590 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.511378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a170d5-236c-40e5-83c9-7ea049f1d590 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.562450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:16.563179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:16.577911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.578393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.578822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.579513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.579979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.580395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.605789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:16.670731 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7a170d5-236c-40e5-83c9-7ea049f1d590 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.179380 Oct 12 22:31:16.671798 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 92/199] 10.222.0.20 () {60 vars in 1191 bytes} [Wed Oct 12 22:31:16 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:16.680756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:16.681441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:16.689976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.690631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.691135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.691917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.693144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.693789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:16.854335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:16.865285 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7e2cb319-95f2-4ac7-9170-baba513034bf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.192228 Oct 12 22:31:16.866187 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 93/200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:16 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:16.872073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a88f81cf-2e6a-4251-8dbd-6a8d61d9b0a6 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:16.896095 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a88f81cf-2e6a-4251-8dbd-6a8d61d9b0a6 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.028078 Oct 12 22:31:16.897000 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 94/201] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:31:16 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:16.907796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19adb123-f19b-4c21-befa-80edb793d6fe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-141558025"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:16.915175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-19adb123-f19b-4c21-befa-80edb793d6fe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid 74c417cb-ba1e-487e-9eb6-b9a6cbf79e1d for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:16.955732 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19adb123-f19b-4c21-befa-80edb793d6fe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052399 Oct 12 22:31:16.957236 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 95/202] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:16.976087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1279ab0-45a2-4442-8ef3-2921638bdddd tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:16.992834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1279ab0-45a2-4442-8ef3-2921638bdddd tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:16.993663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1279ab0-45a2-4442-8ef3-2921638bdddd tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:16.994383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1279ab0-45a2-4442-8ef3-2921638bdddd tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:17.037728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:17.055227 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9f1cec4-6f25-435c-8ac9-0a03594e2bb3 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 0.496579 Oct 12 22:31:17.075804 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 108/203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:16 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:17.145994 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1279ab0-45a2-4442-8ef3-2921638bdddd tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.179656 Oct 12 22:31:17.147453 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 96/204] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 22:31:16 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:17.161679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5002462-7990-48ca-9e1d-a39604294922 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:17.177909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5002462-7990-48ca-9e1d-a39604294922 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:17.179207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5002462-7990-48ca-9e1d-a39604294922 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:17.179879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5002462-7990-48ca-9e1d-a39604294922 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:17.299960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:17.340927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f5002462-7990-48ca-9e1d-a39604294922 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.185845 Oct 12 22:31:17.342846 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 109/205] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 22:31:17 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:17.354913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4331cdd7-b14e-4995-92f5-56462f40f853 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.384345 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4331cdd7-b14e-4995-92f5-56462f40f853 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.033005 Oct 12 22:31:17.385565 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 97/206] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:17 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:17.399243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a7ce6bc-091b-4900-a34c-8881509c2b74 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1318181181"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:17.405549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-5a7ce6bc-091b-4900-a34c-8881509c2b74 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid d751d1b3-cf4a-4312-b28b-c0f935e99880 for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:17.425119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30d44f40-20c5-4e4d-8a47-6ca3332bd579 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-518569170"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:17.435681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-30d44f40-20c5-4e4d-8a47-6ca3332bd579 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid b48ce23c-d474-478c-b66e-f4ac103b511d for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:17.482344 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30d44f40-20c5-4e4d-8a47-6ca3332bd579 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061588 Oct 12 22:31:17.489694 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a7ce6bc-091b-4900-a34c-8881509c2b74 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095494 Oct 12 22:31:17.489901 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 98/207] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:17.496369 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 110/208] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:17.499869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-181e9937-713b-4d3b-b373-0a3d7dcfdbd5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:17.502891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8288797e-94fa-404b-aa9d-66a86a47bd9f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.516327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-181e9937-713b-4d3b-b373-0a3d7dcfdbd5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:17.517272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-181e9937-713b-4d3b-b373-0a3d7dcfdbd5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:17.517901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-181e9937-713b-4d3b-b373-0a3d7dcfdbd5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:17.557434 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8288797e-94fa-404b-aa9d-66a86a47bd9f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.056901 Oct 12 22:31:17.558988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 111/209] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:17 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:17.577275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ec0d696-ae06-4cf9-8f1b-0c34f8ff0bbe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.589135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5ec0d696-ae06-4cf9-8f1b-0c34f8ff0bbe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ec0d696-ae06-4cf9-8f1b-0c34f8ff0bbe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Request method failure captured: Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AFiwyWIpr0UrsA_IPvfZoK3uUfSt_NXzdHC2EPtI4I5axcEKSv1mzfUMiHVValkWvTk2WqqluFsVB3gNj_bvpkFuZ0FWJHNnHjgut1-VxxKkLm4sFuePDgmnc_P1N6E1QoCKaQFXnNU_SyVm2jGYQAfUHDdekrBtT97a305jMxdT4 Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:31:17.598514 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/734e373838c84c8c811fa621b968570f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_734e373838c84c8c811fa621b968570f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}] Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 530c4469ff9d44fa817a926193861d2e Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: exception: Aggregate 11 could not be found. Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '11'} Oct 12 22:31:17.599845 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.601616 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 12 22:31:17.602635 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.603557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ec0d696-ae06-4cf9-8f1b-0c34f8ff0bbe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:17.603557 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5ec0d696-ae06-4cf9-8f1b-0c34f8ff0bbe tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.033584 Oct 12 22:31:17.607065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 112/210] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:31:17 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:31:17.617804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce593e07-7779-47e7-93d6-07adb48a6a61 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.640811 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ce593e07-7779-47e7-93d6-07adb48a6a61 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce593e07-7779-47e7-93d6-07adb48a6a61 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Request method failure captured: Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AFiwyWIpr0UrsA_IPvfZoK3uUfSt_NXzdHC2EPtI4I5axcEKSv1mzfUMiHVValkWvTk2WqqluFsVB3gNj_bvpkFuZ0FWJHNnHjgut1-VxxKkLm4sFuePDgmnc_P1N6E1QoCKaQFXnNU_SyVm2jGYQAfUHDdekrBtT97a305jMxdT4 Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:31:17.642795 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/734e373838c84c8c811fa621b968570f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_734e373838c84c8c811fa621b968570f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}] Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 530c4469ff9d44fa817a926193861d2e Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: exception: Aggregate 11 could not be found. Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '11'} Oct 12 22:31:17.644264 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:31:17.644962 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.647396 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.650366 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.650366 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:17.650366 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:17.650366 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 12 22:31:17.650366 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.664562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce593e07-7779-47e7-93d6-07adb48a6a61 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:17.665867 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce593e07-7779-47e7-93d6-07adb48a6a61 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.056522 Oct 12 22:31:17.671327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 113/211] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:17 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:31:17.677245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a46b768-3091-4503-a246-9ec5535a51c3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-342709778", "name": "tempest-test_aggregate-389571940"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:17.705229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-3a46b768-3091-4503-a246-9ec5535a51c3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid f8c62618-8def-46c1-961c-ca40c4ba387c for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:17.751588 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-181e9937-713b-4d3b-b373-0a3d7dcfdbd5 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.259823 Oct 12 22:31:17.752991 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 99/212] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 22:31:17 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:17.766283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4314e66f-e446-4139-9458-b86be5a15894 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:17.768737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a46b768-3091-4503-a246-9ec5535a51c3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.095675 Oct 12 22:31:17.769377 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 114/213] 10.222.0.20 () {60 vars in 1165 bytes} [Wed Oct 12 22:31:17 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:17.771325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4314e66f-e446-4139-9458-b86be5a15894 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'edd00d008d8b40098df6e9810401b106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5e3c5f9d0f4f3daab8448f1c73c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4314e66f-e446-4139-9458-b86be5a15894 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Request method failure captured: Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 42 Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ACHeIKxskmceJY_w_a1IV879XvctVU9m3M0CEsbNo1_mPy2UJ0mTdqcpGeFrphxggdTyXv_EarSna1zPRh7ZTXDY0DksgqnaYSo-ck4gQw2tc3zy2o3tTFzAfhGmLhuyqIifjVBMPEoDZTEkDm5P-WL1nTDhY1dsHZa6TYMLWHC8U Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:31:17.773111 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe5e3c5f9d0f4f3daab8448f1c73c8b3"}]}] Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fe5e3c5f9d0f4f3daab8448f1c73c8b3 Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-155764711 Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: edd00d008d8b40098df6e9810401b106 Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-155764711-project Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: {"remove_host": {"host": "n-h2-860864-8"}} Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:31:17.774398 n-d-860864-8 devstack@n-api.service[120543]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-860864-8'}}} Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:31:17.775319 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 22:31:17.777357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.783044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4314e66f-e446-4139-9458-b86be5a15894 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:17.783281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9b5cfe3-192f-4bfa-accd-0ce79ec4e950 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.785208 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4314e66f-e446-4139-9458-b86be5a15894 tempest-AggregatesAdminNegativeTestJSON-155764711 tempest-AggregatesAdminNegativeTestJSON-155764711-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.023695 Oct 12 22:31:17.786960 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 100/214] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 22:31:17 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:17.803310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc098fce-ac8c-4018-832d-3752431c767e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:17.838220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:UPDATE=7,nova_api:SELECT=72,nova_api:INSERT=12,nova_api:DELETE=9 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:17.838730 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9b5cfe3-192f-4bfa-accd-0ce79ec4e950 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.058038 Oct 12 22:31:17.839284 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 115/215] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:17 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:17.846299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc098fce-ac8c-4018-832d-3752431c767e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:17.846871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc098fce-ac8c-4018-832d-3752431c767e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:17.847511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc098fce-ac8c-4018-832d-3752431c767e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:17.849530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e481f008-ab2a-4b77-be8f-bb3bb8091fed tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.867782 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e481f008-ab2a-4b77-be8f-bb3bb8091fed tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e481f008-ab2a-4b77-be8f-bb3bb8091fed tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Request method failure captured: Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AFiwyWIpr0UrsA_IPvfZoK3uUfSt_NXzdHC2EPtI4I5axcEKSv1mzfUMiHVValkWvTk2WqqluFsVB3gNj_bvpkFuZ0FWJHNnHjgut1-VxxKkLm4sFuePDgmnc_P1N6E1QoCKaQFXnNU_SyVm2jGYQAfUHDdekrBtT97a305jMxdT4 Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:31:17.871327 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/734e373838c84c8c811fa621b968570f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_734e373838c84c8c811fa621b968570f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}] Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 530c4469ff9d44fa817a926193861d2e Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: exception: Aggregate 13 could not be found. Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '13'} Oct 12 22:31:17.873027 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.873721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 12 22:31:17.874695 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:17.880712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e481f008-ab2a-4b77-be8f-bb3bb8091fed tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:17.882349 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e481f008-ab2a-4b77-be8f-bb3bb8091fed tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.037665 Oct 12 22:31:17.887818 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 116/216] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:31:17 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:31:17.894727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:17.895592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:17.908264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:17.909161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:17.909748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:17.910539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:17.911651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:17.912276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.113447 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc098fce-ac8c-4018-832d-3752431c767e tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.321496 Oct 12 22:31:18.114648 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 101/217] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 22:31:17 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.129569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-538a7e7b-d35c-4b41-bcee-12fedf45e02f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.154066 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-538a7e7b-d35c-4b41-bcee-12fedf45e02f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-538a7e7b-d35c-4b41-bcee-12fedf45e02f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Request method failure captured: Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AFiwyWIpr0UrsA_IPvfZoK3uUfSt_NXzdHC2EPtI4I5axcEKSv1mzfUMiHVValkWvTk2WqqluFsVB3gNj_bvpkFuZ0FWJHNnHjgut1-VxxKkLm4sFuePDgmnc_P1N6E1QoCKaQFXnNU_SyVm2jGYQAfUHDdekrBtT97a305jMxdT4 Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:31:18.161824 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/734e373838c84c8c811fa621b968570f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_734e373838c84c8c811fa621b968570f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/734e373838c84c8c811fa621b968570f"}]}] Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 734e373838c84c8c811fa621b968570f Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1792456511 Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 530c4469ff9d44fa817a926193861d2e Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AggregatesAdminTestJSON-1792456511-project-admin Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: exception: Aggregate 13 could not be found. Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '13'} Oct 12 22:31:18.163319 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:31:18.164447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.165454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:18.167113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:18.167113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:18.167113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:18.167113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 12 22:31:18.167113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.167113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-538a7e7b-d35c-4b41-bcee-12fedf45e02f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:18.167113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-538a7e7b-d35c-4b41-bcee-12fedf45e02f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.049251 Oct 12 22:31:18.173878 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 102/218] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:18 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:31:18.182856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.183473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:18.190396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.191246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.192008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.193540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.194222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.194856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.423410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:18.437884 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58b6dd93-6d01-4835-96fe-e89854103589 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.548513 Oct 12 22:31:18.438652 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 117/219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:17 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:18.443242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30e4f5f5-9d7c-498f-9f74-23d3d7dee67c tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.468114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:18.476701 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9afe2d62-f386-49ad-b4cd-7c5dca1be7af tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1319 microversion: 2.1 time: 0.301712 Oct 12 22:31:18.495491 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 103/220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:18.500466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-832c5fdd-9038-4214-bf2b-b43fb1a1b92f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-116675369"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:18.506844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-832c5fdd-9038-4214-bf2b-b43fb1a1b92f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid 805ae33b-474e-478b-9649-b8d46b4b3f38 for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:18.519918 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30e4f5f5-9d7c-498f-9f74-23d3d7dee67c tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.080365 Oct 12 22:31:18.522018 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 118/221] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:18.531841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4f1aaa56-14b7-4597-a25f-28e422e74888 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1845224728"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:18.548792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-4f1aaa56-14b7-4597-a25f-28e422e74888 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Generated uuid c43c0a93-91f2-4ca2-a69c-79552f154bd1 for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:18.578486 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-832c5fdd-9038-4214-bf2b-b43fb1a1b92f tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081610 Oct 12 22:31:18.579840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 104/222] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.594155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f45044acc10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.602996 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4f1aaa56-14b7-4597-a25f-28e422e74888 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074811 Oct 12 22:31:18.604089 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 119/223] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:18.605740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.607560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.609541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.611706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.614983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e07e134d-dca9-494b-836f-1e3664db0cf3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.617616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.618245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.634934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=19 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:18.637854 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e07e134d-dca9-494b-836f-1e3664db0cf3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.029738 Oct 12 22:31:18.649004 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 120/224] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.659289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:18.689135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.690071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.692662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.697118 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5be6ab58-23d0-4543-b27e-23a0971514a3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.116024 Oct 12 22:31:18.700054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 105/225] 10.222.0.20 () {58 vars in 1128 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.712227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3c83b595-05a8-41b1-a96b-3ae65105ab50 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:18.712569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.713683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.716216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.738065 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.compute.aggregates [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 22:31:18.738065 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Request method failure captured: Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 42 Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AES-sdyQLCsrWG51BDVFtlAFjhrag-BuaapOhK6UUHoYLhCxHyBtMN2npwRXthuf_5ukw31LlpkuRZ6yz6gBAo8PUv-48Z2Xqpi1W2ERW_VujuclE-nSUGE7fGUqSpI5d_TnKZUL6S2kgjxsQT9NhYZBgEg-S8tE54om-qPFODTcs Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:31:18.738751 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/36ae647cdacc435f823463d46f766f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_36ae647cdacc435f823463d46f766f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/36ae647cdacc435f823463d46f766f95"}]}] Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 36ae647cdacc435f823463d46f766f95 Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-550531051 Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 15f77cd8d2944892a64524b1bd22d711 Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: {"remove_host": {"host": "nonexist_host"}} Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:18.740543 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 12 22:31:18.741368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 12 22:31:18.742475 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.744716 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a93b89c0-44e2-4511-93ec-5f96453846d4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.090483 Oct 12 22:31:18.747785 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 121/226] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 22:31:18 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:31:18.758551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f45042129d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.767055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.771182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.771986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.773119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.776574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.777268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.797582 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3c83b595-05a8-41b1-a96b-3ae65105ab50 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.096287 Oct 12 22:31:18.798408 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 106/227] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 22:31:18 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.821795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0bb8e408-4633-4774-9963-cd7b0e89b3a4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.822406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93de1f21-6d99-40c8-8678-36ec727f4a77 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.071122 Oct 12 22:31:18.823259 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 122/228] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.842701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b32dc3e-9dac-469e-954b-9735315954de tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.855042 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b32dc3e-9dac-469e-954b-9735315954de tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.029612 Oct 12 22:31:18.855992 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 123/229] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.867022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f45041f3670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.871234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.871715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.872172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.872891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:18.874408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:18.875243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:18.875545 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0bb8e408-4633-4774-9963-cd7b0e89b3a4 tempest-AggregatesAdminNegativeTestJSON-550531051 tempest-AggregatesAdminNegativeTestJSON-550531051-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.067832 Oct 12 22:31:18.880663 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 107/230] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:18 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:18.890504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c0e37d8-f27f-491c-8555-b1aa47bbc0e1 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.944124 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c0e37d8-f27f-491c-8555-b1aa47bbc0e1 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.064705 Oct 12 22:31:18.950384 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 108/231] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:18 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:18.957927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-73387bae-d897-4bd7-b80e-f0fd6da6bc76 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.100559 Oct 12 22:31:18.960335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-170a27d1-f6e3-4bc3-a9c7-224a9f7f47d1 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-252298028", "availability_zone": "tempest-test_az-1527279715"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:18.962756 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 124/232] 10.222.0.20 () {58 vars in 1128 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:18.977603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f45043abf70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:18.999032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.000618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.001523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.016006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.aggregate [None req-170a27d1-f6e3-4bc3-a9c7-224a9f7f47d1 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid dc97d423-1d0e-4835-8a09-a65a73870b3d for aggregate {{(pid=120543) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:19.024386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.025602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.027706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.059012 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62ea9cc2-25a6-4082-bcfb-94981e7178c3 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-860864-8" status: 200 len: 332 microversion: 2.1 time: 0.090972 Oct 12 22:31:19.065824 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 125/233] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 12 22:31:18 2022] GET /compute/v2.1/os-hosts/n-h2-860864-8 => generated 332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:19.069141 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-170a27d1-f6e3-4bc3-a9c7-224a9f7f47d1 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.116743 Oct 12 22:31:19.073472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Calling method '.version_select at 0x7f4504212ee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:19.077931 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 109/234] 10.222.0.20 () {60 vars in 1165 bytes} [Wed Oct 12 22:31:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:19.083765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.084981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.086175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.090237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c2bcc9c3-81f1-4c19-b98b-edead0c8564a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-252298028_new", "availability_zone": "tempest-test_az-1527279715_new"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:19.106655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.133881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.134766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.183382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-98b821d8-47c6-49a7-8aa5-d57eeb933d89 tempest-HostsAdminTestJSON-1008206410 tempest-HostsAdminTestJSON-1008206410-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-860864-8" status: 200 len: 598 microversion: 2.1 time: 0.116152 Oct 12 22:31:19.192239 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 126/235] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 12 22:31:19 2022] GET /compute/v2.1/os-hosts/n-h1-860864-8 => generated 598 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:19.357106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2bcc9c3-81f1-4c19-b98b-edead0c8564a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.360173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2bcc9c3-81f1-4c19-b98b-edead0c8564a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.362946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2bcc9c3-81f1-4c19-b98b-edead0c8564a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.469240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:19.470244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:19.481370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c2bcc9c3-81f1-4c19-b98b-edead0c8564a tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 336 microversion: 2.1 time: 0.402188 Oct 12 22:31:19.482691 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 110/236] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Oct 12 22:31:19 2022] PUT /compute/v2.1/os-aggregates/16 => generated 336 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:19.491676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.492223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.492759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.497137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.497712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.499451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.501527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e14d465b-6685-4b68-8bfa-91c932e0d311 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:19.523058 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e14d465b-6685-4b68-8bfa-91c932e0d311 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.029994 Oct 12 22:31:19.527988 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 111/237] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:31:19 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:19.534909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:19.543923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:19.567418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.570743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.571446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:19.572973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:19.575613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:19.578876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:20.030539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:20.042112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b8c391a-f93a-46fa-be70-cfbb7c580fb6 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.581430 Oct 12 22:31:20.048835 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 127/238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:19 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:20.059952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3164df7e-a038-4e9f-be5f-cf21f2c9d9b3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:20.127287 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3164df7e-a038-4e9f-be5f-cf21f2c9d9b3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.072320 Oct 12 22:31:20.128601 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 128/239] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:20 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:20.146203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bca339b8-6bae-4d2a-8e34-fc6d9cdf2c85 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1887272535"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:20.161141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-bca339b8-6bae-4d2a-8e34-fc6d9cdf2c85 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Generated uuid 417cc0d5-b346-48e0-8fe4-29e4cbd5f6ea for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:20.656221 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bca339b8-6bae-4d2a-8e34-fc6d9cdf2c85 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.519754 Oct 12 22:31:20.657027 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 129/240] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 22:31:20 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:20.672910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8dc8b543-eac1-44c6-8ed1-ac38459296b3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:20.687436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:20.695337 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8dc8b543-eac1-44c6-8ed1-ac38459296b3 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.027129 Oct 12 22:31:20.696587 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 130/241] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:31:20 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:20.697753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc4a7e8e-4b01-4154-b88e-e33098a9a53b tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1468 microversion: 2.1 time: 1.168397 Oct 12 22:31:20.720588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d63c6bc8-704c-4144-8f0b-524007443f58 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:20.736672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 112/242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:19 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1468 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:20.803396 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d63c6bc8-704c-4144-8f0b-524007443f58 tempest-AggregatesAdminTestJSON-1792456511 tempest-AggregatesAdminTestJSON-1792456511-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.092362 Oct 12 22:31:20.815679 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 131/243] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 22:31:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 22:31:20.828087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:20.828585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:20.874906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:20.875862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:20.876463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:20.877340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:20.881037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:20.881661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:20.932325 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] HTTP exception thrown: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Request method failure captured: Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 HTTP/1.1 Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ABXvVFqXt1YxV9YFPzO2vLfVtXwqNSlmKd8gg4HSQptWDsNVpIeNni3-DbHpjGdDXHEUMFUMSsjxqJaJwD5mEzYVRXewHn9nHgq6tKw4J3XFPOG2g_BNR2-oTD8puJ6Hwzk5VLAgZcr-rRwAfgwaeHWdsVJJ7re2s1p-qNhb47YgA Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a7a41d16a4c3402e8279b72040359451 Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:31:20.940729 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7a41d16a4c3402e8279b72040359451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a7a41d16a4c3402e8279b72040359451"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a7a41d16a4c3402e8279b72040359451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7a41d16a4c3402e8279b72040359451"}]}] Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a7a41d16a4c3402e8279b72040359451 Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminTestJSON-934135273-project Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 373463f220fb402ba15a5c388b45a6aa Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminTestJSON-934135273-project Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:20.942758 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '011630b4-4bdc-4342-860e-75de5850ac96'} Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:20.943530 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:20.945606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:20.958776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Returning 404 to user: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:20.960062 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e5c2d535-10c3-4276-b6a2-cc2f19805a57 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 404 len: 111 microversion: 2.1 time: 0.140129 Oct 12 22:31:20.970575 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 132/244] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:31:20 2022] DELETE /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:20.987840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:20.990567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] [instance: 011630b4-4bdc-4342-860e-75de5850ac96] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:21.009974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:21.010515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:21.014736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:21.025949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:21.031563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:21.033643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:21.085714 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] HTTP exception thrown: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Request method failure captured: Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 HTTP/1.1 Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ABXvVFqXt1YxV9YFPzO2vLfVtXwqNSlmKd8gg4HSQptWDsNVpIeNni3-DbHpjGdDXHEUMFUMSsjxqJaJwD5mEzYVRXewHn9nHgq6tKw4J3XFPOG2g_BNR2-oTD8puJ6Hwzk5VLAgZcr-rRwAfgwaeHWdsVJJ7re2s1p-qNhb47YgA Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a7a41d16a4c3402e8279b72040359451 Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:31:21.088663 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7a41d16a4c3402e8279b72040359451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a7a41d16a4c3402e8279b72040359451"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a7a41d16a4c3402e8279b72040359451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a7a41d16a4c3402e8279b72040359451"}]}] Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a7a41d16a4c3402e8279b72040359451 Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-934135273 Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AggregatesAdminTestJSON-934135273-project Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 373463f220fb402ba15a5c388b45a6aa Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AggregatesAdminTestJSON-934135273-project Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:21.090094 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '011630b4-4bdc-4342-860e-75de5850ac96'} Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:21.090993 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. Oct 12 22:31:21.092536 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:21.095147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] Returning 404 to user: Instance 011630b4-4bdc-4342-860e-75de5850ac96 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:21.097502 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c7e60d8-edea-49b9-9379-f6033b4e5498 tempest-AggregatesAdminTestJSON-934135273 tempest-AggregatesAdminTestJSON-934135273-project] 10.222.0.20 "GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96" status: 404 len: 111 microversion: 2.1 time: 0.125878 Oct 12 22:31:21.104721 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 133/245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:20 2022] GET /compute/v2.1/servers/011630b4-4bdc-4342-860e-75de5850ac96 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:21.113699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:21.115718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:21.130676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:21.132270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:21.134482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:21.137385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:21.142217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:21.142985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:21.271042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=30 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:21.475134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2041884738", "block_migration": true, "disk_over_commit": false}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:21.478446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:21.504186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:21.507476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:21.508054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:21.509874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:21.513892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:21.514430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:22.072199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:22.097926 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19fd8502-db9a-4c2c-9f16-d1c824b6e2a8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 0.983344 Oct 12 22:31:22.100561 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 134/246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:21 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:22.489964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3ae7d700-4b37-4f49-a21c-fe1cc30796ca req-cab04471-5022-4882-a760-db7b4985f833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b2d603-856b-432d-9eb5-80f56b1f1b66", "name": "network-vif-plugged", "status": "completed", "tag": "832d6d08-7a12-4545-8d9d-0a1673f1aa52"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:22.507283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3ae7d700-4b37-4f49-a21c-fe1cc30796ca req-cab04471-5022-4882-a760-db7b4985f833 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:22.508793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3ae7d700-4b37-4f49-a21c-fe1cc30796ca req-cab04471-5022-4882-a760-db7b4985f833 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:22.509397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3ae7d700-4b37-4f49-a21c-fe1cc30796ca req-cab04471-5022-4882-a760-db7b4985f833 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:22.535352 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3ae7d700-4b37-4f49-a21c-fe1cc30796ca req-cab04471-5022-4882-a760-db7b4985f833 service nova] Creating event network-vif-plugged:832d6d08-7a12-4545-8d9d-0a1673f1aa52 for instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 on n-h1-860864-8 Oct 12 22:31:22.544126 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3ae7d700-4b37-4f49-a21c-fe1cc30796ca req-cab04471-5022-4882-a760-db7b4985f833 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058310 Oct 12 22:31:22.545402 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 135/247] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:22.734021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lazy-loading 'flavor' on Instance uuid 02ebc875-f3fa-40df-ad56-125ba35d8cd7 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:22.776564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-545895060", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": "none"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:22.830495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Going to try to live migrate instance to tempest-host-2041884738 {{(pid=120543) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:31:22.839063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:22.845533 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] HTTP exception thrown: Compute host tempest-host-2041884738 could not be found. Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Request method failure captured: Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7/action HTTP/1.1 Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 107 Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AirG3smq3VmB6-IOaGS-D4xnoXanUt9n3kQao922S3ikoxDZ_X7s8P5LRRga1VS6Oxarb7I9ZOLZ_8rxNqYopIOSn8VM4KIACWXxotq_oTE37WQIuM7VbPV1ufzd-8P8vTjDW0ps-IuqjypsHvNEjYevqV0KJ7FJW6IWIu-Km30wA Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 7e98297941bf4d7884537d37b2cf0098 Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveMigrationNegativeTest-910268259 Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:31:22.851525 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98297941bf4d7884537d37b2cf0098"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e98297941bf4d7884537d37b2cf0098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e98297941bf4d7884537d37b2cf0098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98297941bf4d7884537d37b2cf0098"}]}] Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveMigrationNegativeTest-910268259 Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 7e98297941bf4d7884537d37b2cf0098 Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-910268259 Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveMigrationNegativeTest-910268259-project-admin Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5291a07fbba9438195e2613bb1575513 Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveMigrationNegativeTest-910268259-project-admin Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: {"os-migrateLive": {"host": "tempest-host-2041884738", "block_migration": true, "disk_over_commit": false}} Oct 12 22:31:22.853481 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: exception: Compute host tempest-host-2041884738 could not be found. Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '02ebc875-f3fa-40df-ad56-125ba35d8cd7', 'body': {'os-migrateLive': {'host': 'tempest-host-2041884738', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:31:22.854645 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2041884738 could not be found. Oct 12 22:31:22.855886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2041884738 could not be found. Oct 12 22:31:22.859036 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2041884738 could not be found. Oct 12 22:31:22.860794 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:22.864123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Returning 400 to user: Compute host tempest-host-2041884738 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:22.865383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c247a61-3ea6-4760-958d-ec26b75795ce tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7/action" status: 400 len: 100 microversion: 2.1 time: 2.127396 Oct 12 22:31:22.866886 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 113/248] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Oct 12 22:31:20 2022] POST /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7/action => generated 100 bytes in 2129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:31:22.875624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:22.876878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:22.883767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:22.884506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:22.885192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:22.885811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:22.886457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:22.891511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:22.892670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:22.893148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:22.893898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:22.894932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:22.895948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:22.916276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:22.919627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:22.920346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:22.924148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:22.925919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:22.926920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:22.976460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Getting quotas for project d1b2e6f32faa4127ba19cc03ec7936a3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:22.990432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=11,nova_api:INSERT=5 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:22.992294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Getting quotas for user 783a3886ae0e42d78df6ff0c7c5282bc and project d1b2e6f32faa4127ba19cc03ec7936a3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:23.029097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:23.036097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:31:23.183770 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7bc738af-edfd-472d-9e41-9ce670a9577a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.636927 Oct 12 22:31:23.184457 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 136/249] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:31:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:31:23.210755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:23.211383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:23.263204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:23.264999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:23.265699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:23.267937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:23.268598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:23.272774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:23.472926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:23.482699 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b0c856b-bb3b-4ee9-baba-0ef1c79fe49f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1468 microversion: 2.1 time: 0.611728 Oct 12 22:31:23.484509 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 114/250] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:22 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1468 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:23.526086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-82ff67db-cd1c-459a-aa15-e6d794f78789 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:23.540561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-82ff67db-cd1c-459a-aa15-e6d794f78789 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:23.847327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82ff67db-cd1c-459a-aa15-e6d794f78789 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:23.861147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82ff67db-cd1c-459a-aa15-e6d794f78789 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:23.865379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82ff67db-cd1c-459a-aa15-e6d794f78789 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:23.878819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-82ff67db-cd1c-459a-aa15-e6d794f78789 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "PUT /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1358 microversion: 2.75 time: 0.392971 Oct 12 22:31:23.905869 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 115/251] 10.222.0.20 () {62 vars in 1297 bytes} [Wed Oct 12 22:31:23 2022] PUT /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:23.918764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-897830345", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:24.018966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:31:24.304109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:24.320084 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b8e756b-5af3-4993-a85f-84cba725b6a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1390 microversion: 2.1 time: 1.134507 Oct 12 22:31:24.320753 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 137/252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:23 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1390 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:24.339000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:24.339659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:24.372340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:24.375241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:24.378521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:24.379524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:24.382673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:24.383862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:24.648944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:24.663250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:24.664719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:24.679205 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-de9dd65f-c51d-48c9-b134-0d3aff2a535c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1362 microversion: 2.75 time: 0.357385 Oct 12 22:31:24.682912 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 138/253] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:24 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:25.368366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:25.369009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:25.392039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:25.414564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:25.416940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:25.421197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:25.423690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:25.425396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:25.470686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:25.471283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:25.476806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:25.477626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:25.478196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:25.498463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:25.507946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:25.508575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:25.509489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:25.510046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:25.512507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:25.599125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Getting quotas for project 09e75a75b4f24f0f8c23d5d8cff4262c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:25.631754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Getting quotas for user 36c3460feeb4440db6dff38198d5dd68 and project 09e75a75b4f24f0f8c23d5d8cff4262c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:25.673302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:25.676220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:31:25.827798 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4981baa8-6ce6-4651-ba79-98922fd563f9 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.916350 Oct 12 22:31:25.828945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 116/254] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:31:25.852636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:25.853739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:25.864993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:25.868489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:25.870514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:25.871853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:25.872575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:25.876688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:26.129657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:26.142737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f45eaf9a-22cb-460f-a75a-492bb44fd597 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1588 microversion: 2.1 time: 0.797002 Oct 12 22:31:26.183327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 139/255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:25 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1588 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:26.190006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a32ecda-5c98-45f1-b61b-b5000818eb3d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:26.190958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a32ecda-5c98-45f1-b61b-b5000818eb3d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:26.320573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a32ecda-5c98-45f1-b61b-b5000818eb3d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:26.335455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a32ecda-5c98-45f1-b61b-b5000818eb3d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1218 microversion: 2.1 time: 0.150328 Oct 12 22:31:26.339460 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 140/256] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:26 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:26.354318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:26.359194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:26.372291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:26.377216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:26.378667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:26.389413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:26.395236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:26.395671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:26.401531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:26.402005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:26.402426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:26.404202 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ed5ff414-592b-4cd2-87fa-7b45c708e883 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1428 microversion: 2.75 time: 0.570653 Oct 12 22:31:26.406902 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 117/257] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:25 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1428 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:26.713438 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aae28cfd-8e8b-488f-8bf4-bf6125955e5b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.370735 Oct 12 22:31:26.721939 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 141/258] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:31:26 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66/os-interface => generated 285 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:27.335254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1266534978", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "5db0f38e-eee3-4a98-9554-12cc124c1fa6"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:27.360115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:27.360225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:27.371012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:27.373943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:27.374627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:27.376213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:27.390045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:27.390754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:27.499876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] validate_networks() for [('5db0f38e-eee3-4a98-9554-12cc124c1fa6', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:31:27.530414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:27.543118 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12dfe78a-d314-4e92-9a40-195571610157 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1270 microversion: 2.1 time: 0.187578 Oct 12 22:31:27.552231 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 142/259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:27 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:27.568112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:27.569083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:27.579038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:27.579818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:27.580637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:27.583319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:27.584170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:27.585019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:27.725393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:27.735350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:27.737805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:27.744518 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fca14f7e-16d2-429c-ae94-36c8bad4e967 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1416 microversion: 2.75 time: 0.195046 Oct 12 22:31:27.763663 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 143/260] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:27 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1416 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:28.569055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:28.569665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:28.580780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:28.581285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:28.581720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:28.582973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:28.583414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:28.592588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:28.733180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:28.742141 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-270a459e-3f56-464d-b001-9f79d69be997 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1276 microversion: 2.1 time: 0.176882 Oct 12 22:31:28.747618 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 144/261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:28 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:28.774933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:28.775453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:28.783712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:28.784232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:28.784662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:28.790424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:28.790953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:28.791393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:28.915200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:28.933030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:28.940314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:28.953299 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9e46839-7e7e-48c1-ae5c-0fced1783042 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1416 microversion: 2.75 time: 0.182186 Oct 12 22:31:28.954365 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 145/262] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:28 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1416 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:29.535002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Calling method '.version_select at 0x7f4504172dc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:29.543935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:29.545235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:29.548923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:29.606925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:29.609163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:29.611067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:29.622004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:29.676367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:29.676868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:29.677301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:29.698304 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b5840073-20cd-479e-901c-5ba9d7deb325 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.716815 Oct 12 22:31:29.717650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 146/263] 10.222.0.20 () {60 vars in 1208 bytes} [Wed Oct 12 22:31:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:29.729716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc0f9d4e-fa31-474c-a88a-d8523bd1559a tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-46648025"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:29.739649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-bc0f9d4e-fa31-474c-a88a-d8523bd1559a tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Generated uuid d4aca1a5-3b71-4819-9928-66353743a74e for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 22:31:29.793113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc0f9d4e-fa31-474c-a88a-d8523bd1559a tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.073256 Oct 12 22:31:29.801861 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 147/264] 10.222.0.20 () {62 vars in 1205 bytes} [Wed Oct 12 22:31:29 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:29.817800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:29.818420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:29.830197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:29.830667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:29.833922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:29.837219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:29.838345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:29.840744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.358642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:30.359785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:30.360678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:30.361297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:30.361930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:30.377277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.381188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.383069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.384155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.388611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.389352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.434244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:30.441680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:30.457717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for user 03a180537b9149b1bf4250bc9965bb7b and project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:30.465650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:30.472402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=5,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:30.474313 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c786149-d899-46b1-bd57-f09c91b42913 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1318 microversion: 2.1 time: 0.671391 Oct 12 22:31:30.474894 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 148/265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:29 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:30.492136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f2824d7a-7bfd-4f2b-a2d8-081e3bcf308c tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1246682690"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:30.495607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:30.497878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:31:30.569813 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f0061619-7e7a-4331-ad1d-613572634b43 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.499840 Oct 12 22:31:30.579379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 118/266] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:31:30.894327 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f2824d7a-7bfd-4f2b-a2d8-081e3bcf308c tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.410161 Oct 12 22:31:30.902509 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 149/267] 10.222.0.20 () {62 vars in 1213 bytes} [Wed Oct 12 22:31:30 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:30.913190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:30.923041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:30.940582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.950172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.950973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:30.951930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:30.952476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:30.952973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:31.247176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.262645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.266474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.282508 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dfc812ec-1e91-4ebe-a238-b1e233470f3b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1437 microversion: 2.75 time: 0.376871 Oct 12 22:31:31.286192 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 150/268] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:30 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1437 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:31.306836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e921235c-1d80-4aea-80ea-4f05f0a271fe tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:31.317040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e921235c-1d80-4aea-80ea-4f05f0a271fe tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:31.382256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-819602636", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "b7ba0f5c-73e2-4094-b8e5-360f49f48593"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:31.533691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] validate_networks() for [('b7ba0f5c-73e2-4094-b8e5-360f49f48593', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:31:31.539979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e921235c-1d80-4aea-80ea-4f05f0a271fe tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.554985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e921235c-1d80-4aea-80ea-4f05f0a271fe tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.556188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e921235c-1d80-4aea-80ea-4f05f0a271fe tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:31.567315 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e921235c-1d80-4aea-80ea-4f05f0a271fe tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1262 microversion: 2.25 time: 0.275745 Oct 12 22:31:31.569907 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 151/269] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:31 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1262 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:31.589314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-763c3fe4-0a21-4fc2-a0ac-7f380559a7e7 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:31.621571 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-763c3fe4-0a21-4fc2-a0ac-7f380559a7e7 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.048524 Oct 12 22:31:31.622796 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 152/270] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 12 22:31:31 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:31.630591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:31.636835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:31.654096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:31.654598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:31.655110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:31.655809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:31.656706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:31.657290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:31.822560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:31.840473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:31.840473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:31.840473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:31.840473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:31.961592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:31.973218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:31.978640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:31.979197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:31.981282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:31.981755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:31.982183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.242543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:32.273493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:32.277596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:32.290913 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d6935e6a-444f-4c2e-9db3-f4fe23ab9695 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "POST /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2/action" status: 202 len: 1494 microversion: 2.75 time: 0.666175 Oct 12 22:31:32.293136 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 153/271] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:31:31 2022] POST /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2/action => generated 1494 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:31:32.298879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:32.300437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:32.308025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.308801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.310138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.311198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.311857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.312515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.436325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:32.436906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:32.437355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:32.444490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:32.445153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:32.462808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.463842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.465156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.466196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.466826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.467393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.511840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:32.517845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for user dd8fdd646f8546a0a3aae53d1b55a8b1 and project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:32.547661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:32.552185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:31:32.655914 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62efd9ee-3323-4bed-ba9f-b913a9667d38 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074893 Oct 12 22:31:32.657458 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 119/272] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:31:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:31:32.665712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:32.667819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:32.678447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.679853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.680653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.681615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:32.682262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:32.682953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:32.917297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:32.936262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23f5a4d9-2468-466a-a921-2e42eadd129b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 200 len: 1588 microversion: 2.1 time: 0.639407 Oct 12 22:31:32.939824 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 154/273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:32 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 1588 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:32.949990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-79575d42-8694-4a24-bd26-fa0dd9f6d993 req-8d03fe9f-a840-446e-87d4-dcae9b10a702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b2d603-856b-432d-9eb5-80f56b1f1b66", "tag": "832d6d08-7a12-4545-8d9d-0a1673f1aa52"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:32.974250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=15 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:32.975294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:32.986210 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16684fca-1805-425a-a353-897be1ae0b68 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1318 microversion: 2.1 time: 0.327466 Oct 12 22:31:33.000346 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 120/274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:32 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:33.003174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-79575d42-8694-4a24-bd26-fa0dd9f6d993 req-8d03fe9f-a840-446e-87d4-dcae9b10a702 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.004209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-79575d42-8694-4a24-bd26-fa0dd9f6d993 req-8d03fe9f-a840-446e-87d4-dcae9b10a702 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.009771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-79575d42-8694-4a24-bd26-fa0dd9f6d993 req-8d03fe9f-a840-446e-87d4-dcae9b10a702 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.042735 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-79575d42-8694-4a24-bd26-fa0dd9f6d993 req-8d03fe9f-a840-446e-87d4-dcae9b10a702 service nova] Creating event network-changed:832d6d08-7a12-4545-8d9d-0a1673f1aa52 for instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 on n-h1-860864-8 Oct 12 22:31:33.058389 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-79575d42-8694-4a24-bd26-fa0dd9f6d993 req-8d03fe9f-a840-446e-87d4-dcae9b10a702 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116665 Oct 12 22:31:33.062025 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 155/275] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:33.076805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4a4d2ed-a214-4203-b7d9-99de7640b305 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:33.125922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4a4d2ed-a214-4203-b7d9-99de7640b305 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.135429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4a4d2ed-a214-4203-b7d9-99de7640b305 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.138224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4a4d2ed-a214-4203-b7d9-99de7640b305 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.419525 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4a4d2ed-a214-4203-b7d9-99de7640b305 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.354610 Oct 12 22:31:33.420153 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 156/276] 10.222.0.20 () {62 vars in 1235 bytes} [Wed Oct 12 22:31:33 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:33.429433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f4685571-ea50-450a-b26c-9fa3c9687aba req-f6978b89-6634-4a9f-861e-9ee08df6dcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e61d4ee-f0d0-4dce-96df-a541f64cac13", "tag": "d33ea051-fd77-4e41-a4e2-eead72e31280"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:33.454147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f4685571-ea50-450a-b26c-9fa3c9687aba req-f6978b89-6634-4a9f-861e-9ee08df6dcf0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.454620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f4685571-ea50-450a-b26c-9fa3c9687aba req-f6978b89-6634-4a9f-861e-9ee08df6dcf0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.455045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f4685571-ea50-450a-b26c-9fa3c9687aba req-f6978b89-6634-4a9f-861e-9ee08df6dcf0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.468490 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f4685571-ea50-450a-b26c-9fa3c9687aba req-f6978b89-6634-4a9f-861e-9ee08df6dcf0 service nova] Creating event network-changed:d33ea051-fd77-4e41-a4e2-eead72e31280 for instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 on n-h2-860864-8 Oct 12 22:31:33.487199 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f4685571-ea50-450a-b26c-9fa3c9687aba req-f6978b89-6634-4a9f-861e-9ee08df6dcf0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065748 Oct 12 22:31:33.487811 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 157/277] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:33.494429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:33.499987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:33.521905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.522380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.522816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.523579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.524063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.524483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.527142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-942566397", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:33.665987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:31:33.708741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:33.719746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:33.721244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:33.741008 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bf18b68e-0496-472b-84d9-171c61f276ef tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.251050 Oct 12 22:31:33.754912 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 158/278] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:33 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:33.768081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:33.778395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:33.786650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.794846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.795628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:33.797062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:33.797919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:33.798566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.041429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.058073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.061224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.065598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ffab4874-a15c-4b29-aed3-8046ed29caff tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1320 microversion: 2.25 time: 0.316829 Oct 12 22:31:34.067397 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 159/279] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:33 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:34.077185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:34.080469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:34.091505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.092237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.092857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.094475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.096196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.103819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.264413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:34.264837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:34.265321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:34.265887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:34.266214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:34.283481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.284270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.286452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.291124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:34.302152 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b5a1ac9-58ca-41b8-b9dd-ef7520480b12 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1206 microversion: 2.1 time: 0.232983 Oct 12 22:31:34.302752 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 160/280] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:34 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1206 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:34.306737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.307337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.311159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.365843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Getting quotas for project c4d056c78993473094318bd1c6ff182e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:34.370119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Getting quotas for user 46089674b2894f9cb105c4c1232421a9 and project c4d056c78993473094318bd1c6ff182e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:34.384763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:34.390375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:31:34.479604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7496d50f-1342-490f-8362-b7a7973bbfab tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:34.482531 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7496d50f-1342-490f-8362-b7a7973bbfab tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7496d50f-1342-490f-8362-b7a7973bbfab tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275-project-admin] Request method failure captured: Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BFfJias4qquqcMJAAmkG1hWdgUDuo_USImqobHoN5c3Q6MaUA3N3bAOkcXQLsckcMUYPs69mBa0mtzsetFSZe6bf1Q7xRJMOerOOCq9fwUSL-VytKpt6hSty0CZvEGDd9WylTo98rWzq6tt5np6D-cdkhxyLGp6Jb_6PH6O18bZB0 Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 95db216d7e0f4ad38c86be8138a0bdca Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:31:34.494369 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95db216d7e0f4ad38c86be8138a0bdca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95db216d7e0f4ad38c86be8138a0bdca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95db216d7e0f4ad38c86be8138a0bdca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95db216d7e0f4ad38c86be8138a0bdca"}]}] Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 95db216d7e0f4ad38c86be8138a0bdca Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275-project-admin Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 076d1b5832b24a7a97fd455fe103c60d Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275-project-admin Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:34.496099 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid timestamp for date invalid_time Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'invalid_time'} Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:34.496880 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7496d50f-1342-490f-8362-b7a7973bbfab tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:34.498390 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7496d50f-1342-490f-8362-b7a7973bbfab tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275 tempest-InstanceUsageAuditLogNegativeTestJSON-1973797275-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.192867 Oct 12 22:31:34.499390 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 161/281] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Oct 12 22:31:34 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:31:34.513911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3e851a3-2c89-42e7-ac1e-cbd133171bd5 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:34.520575 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c84bc3a0-1b14-4835-a863-40e9094f762d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518997 Oct 12 22:31:34.521824 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 121/282] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:31:34.528509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:34.529983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:34.538489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.539206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.539799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.540688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.541341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.542177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.556381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e851a3-2c89-42e7-ac1e-cbd133171bd5 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:34.556948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e851a3-2c89-42e7-ac1e-cbd133171bd5 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:34.557382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e851a3-2c89-42e7-ac1e-cbd133171bd5 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:34.810766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3e851a3-2c89-42e7-ac1e-cbd133171bd5 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.308927 Oct 12 22:31:34.811408 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 162/283] 10.222.0.20 () {62 vars in 1235 bytes} [Wed Oct 12 22:31:34 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:35.011363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:35.025516 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-55d0c3f9-186d-4cb5-a351-96b18a246f3f tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1318 microversion: 2.1 time: 0.502404 Oct 12 22:31:35.026122 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 122/284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:34 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:35.043513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12839f99-f4aa-449a-b543-2a44d416a3fd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.046177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12839f99-f4aa-449a-b543-2a44d416a3fd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:35.153067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2661038d-1783-4826-b8f2-3047ba826a26 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.155363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2661038d-1783-4826-b8f2-3047ba826a26 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '832d6dc25d8f4ed7a28538db2c722356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be61e8227f1f4439a3bc0e917827b080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2661038d-1783-4826-b8f2-3047ba826a26 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Request method failure captured: Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BDEXqvdY0hoBB5IEsUPUOE46IGFFjqPrjH5ODyMdobc3yIyhOAEpum48plUKlcXhVnF0yxqn4ZC9kDp8z-xr4lKSt85QShVh3PH1rH85kfMM4mmr8S28nFE8yfkJIlHZhblRYosn8BJ0bWJ5_ag1Zc8oAhlfJggc1CfJu6qMWpMcY Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: be61e8227f1f4439a3bc0e917827b080 Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:31:35.158796 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be61e8227f1f4439a3bc0e917827b080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be61e8227f1f4439a3bc0e917827b080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be61e8227f1f4439a3bc0e917827b080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be61e8227f1f4439a3bc0e917827b080"}]}] Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: be61e8227f1f4439a3bc0e917827b080 Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 832d6dc25d8f4ed7a28538db2c722356 Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project Oct 12 22:31:35.160050 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:31:35.160606 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 22:31:35.161668 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:35.162692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2661038d-1783-4826-b8f2-3047ba826a26 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:35.164579 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2661038d-1783-4826-b8f2-3047ba826a26 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.349766 Oct 12 22:31:35.170551 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 163/285] 10.222.0.20 () {58 vars in 1185 bytes} [Wed Oct 12 22:31:34 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 358 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:35.183566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.185294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:35.204105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.205728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.206390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.208118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.209115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.211296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.306892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12839f99-f4aa-449a-b543-2a44d416a3fd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:35.313957 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12839f99-f4aa-449a-b543-2a44d416a3fd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1219 microversion: 2.1 time: 0.285021 Oct 12 22:31:35.314624 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 123/286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:35 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1219 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:35.326595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a34d1e0-9ef7-470d-b799-52b1abfa8679 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.396135 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a34d1e0-9ef7-470d-b799-52b1abfa8679 tempest-AggregatesAdminTestV241-902966977 tempest-AggregatesAdminTestV241-902966977-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.080108 Oct 12 22:31:35.396860 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 124/287] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Oct 12 22:31:35 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:35.403452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.405121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:35.428918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.438540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.439220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.440336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.442313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.442971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.775833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:35.784437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:35.786424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:35.804013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:35.816383 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8aaee5ef-40ec-48f8-ab27-6118bf0c33cf tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.643893 Oct 12 22:31:35.817489 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 164/288] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:35 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:35.836658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8411f8ab-14b5-4df6-8236-82a911c8893f tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.844151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8411f8ab-14b5-4df6-8236-82a911c8893f tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '832d6dc25d8f4ed7a28538db2c722356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be61e8227f1f4439a3bc0e917827b080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8411f8ab-14b5-4df6-8236-82a911c8893f tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Request method failure captured: Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2022:31:35 HTTP/1.1 Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BDEXqvdY0hoBB5IEsUPUOE46IGFFjqPrjH5ODyMdobc3yIyhOAEpum48plUKlcXhVnF0yxqn4ZC9kDp8z-xr4lKSt85QShVh3PH1rH85kfMM4mmr8S28nFE8yfkJIlHZhblRYosn8BJ0bWJ5_ag1Zc8oAhlfJggc1CfJu6qMWpMcY Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: be61e8227f1f4439a3bc0e917827b080 Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:31:35.848195 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be61e8227f1f4439a3bc0e917827b080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be61e8227f1f4439a3bc0e917827b080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be61e8227f1f4439a3bc0e917827b080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be61e8227f1f4439a3bc0e917827b080"}]}] Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: be61e8227f1f4439a3bc0e917827b080 Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 832d6dc25d8f4ed7a28538db2c722356 Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project Oct 12 22:31:35.849438 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2022-10-12 22:31:35'} Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:31:35.849976 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 22:31:35.851025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:35.860003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8411f8ab-14b5-4df6-8236-82a911c8893f tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:35.861059 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8411f8ab-14b5-4df6-8236-82a911c8893f tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199 tempest-InstanceUsageAuditLogNegativeTestJSON-1150744199-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 22:31:35" status: 403 len: 128 microversion: 2.1 time: 0.042474 Oct 12 22:31:35.864697 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 165/289] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 22:31:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2022%3A31%3A35 => generated 128 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:35.875385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:35.877461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:35.892621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.894738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.897693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:35.898644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:35.899287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:35.905400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:36.107957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:36.142569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:36.151597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:36.161473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3159bd6e-ee25-4748-834f-020138a2d557 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1362 microversion: 2.25 time: 0.763331 Oct 12 22:31:36.171975 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 125/290] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:35 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1362 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:36.193538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:36.197609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:36.198259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:36.211005 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-692ebce2-ef60-4fad-ad07-287746820d1c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1268 microversion: 2.1 time: 0.344932 Oct 12 22:31:36.216469 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 166/291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:35 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1268 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:36.218081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:36.221025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:36.221504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:36.223408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:36.225185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:36.227162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:36.339040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:36.339652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:36.351004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:36.351514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:36.351975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:36.363869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:36.364396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:36.364845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:36.548109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:36.561498 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c9090a9-f23c-4d0b-8b7c-9d243c3283a1 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1318 microversion: 2.1 time: 0.387564 Oct 12 22:31:36.563265 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 126/292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:36 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:36.583616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:36.593523 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-656d1d6f-dbe0-438d-a766-d505483b1def tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1271 microversion: 2.1 time: 0.258732 Oct 12 22:31:36.597954 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 167/293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:36 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:36.852455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:36.853732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:36.866486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:36.866997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:36.867459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:36.868198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:36.868645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:36.869897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.053555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.066205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.069931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.076779 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08ff934c-64f4-4159-97cc-0d6da8c113e6 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.231729 Oct 12 22:31:37.093012 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 127/294] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:36 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:37.198448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:37.199746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:37.211425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.211917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.212352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.213363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.213978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.214691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.235419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:37.236205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:37.247790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.249634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.250481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.251706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.252445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.253010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.402407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.415771 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-248c89ce-4cf6-47e0-8eea-e2a8dca2e93e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1268 microversion: 2.1 time: 0.184132 Oct 12 22:31:37.417131 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 128/295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:37 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:37.425323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f01e3ad3-3853-49de-84fd-a04fa7d12af0 req-eff4fe93-327b-4657-84eb-678feb1ecdcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "379c4c15-434c-4786-9738-63649c335334", "tag": "a7e0e2d1-e880-4aab-a151-307201918d79"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:37.444990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f01e3ad3-3853-49de-84fd-a04fa7d12af0 req-eff4fe93-327b-4657-84eb-678feb1ecdcc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.445470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f01e3ad3-3853-49de-84fd-a04fa7d12af0 req-eff4fe93-327b-4657-84eb-678feb1ecdcc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.445893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f01e3ad3-3853-49de-84fd-a04fa7d12af0 req-eff4fe93-327b-4657-84eb-678feb1ecdcc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.468096 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f01e3ad3-3853-49de-84fd-a04fa7d12af0 req-eff4fe93-327b-4657-84eb-678feb1ecdcc service nova] Creating event network-changed:a7e0e2d1-e880-4aab-a151-307201918d79 for instance 379c4c15-434c-4786-9738-63649c335334 on n-h1-860864-8 Oct 12 22:31:37.474368 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f01e3ad3-3853-49de-84fd-a04fa7d12af0 req-eff4fe93-327b-4657-84eb-678feb1ecdcc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055712 Oct 12 22:31:37.475061 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 129/296] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:37.600269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:37.601888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:37.609036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.609516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.610027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.610893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.611652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.612246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.720862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.733411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.741004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.742652 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9e6f27b-d9b8-48e5-9725-2ae7ffc56e95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1362 microversion: 2.25 time: 0.548097 Oct 12 22:31:37.743460 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 168/297] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:37 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1362 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:37.750266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:37.756365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:37.766436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.767179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.767820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.768720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:37.769760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:37.770409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:37.843803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.855936 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b84d1fdf-8bfd-4e64-b416-fcfa1f003616 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1318 microversion: 2.1 time: 0.271752 Oct 12 22:31:37.857253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 130/298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:37 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:37.965243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:37.971145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:37.973549 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b02de23-17d5-4426-b22e-6731c605d696 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1277 microversion: 2.1 time: 0.227348 Oct 12 22:31:37.979726 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 169/299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:37 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:38.038801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-153e8f9c-d435-48e1-99ef-20dda83d4d4c req-47ccb3c8-bc96-400b-a21e-37a4071b89aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e61d4ee-f0d0-4dce-96df-a541f64cac13", "name": "network-vif-plugged", "status": "completed", "tag": "d33ea051-fd77-4e41-a4e2-eead72e31280"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:38.063611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-153e8f9c-d435-48e1-99ef-20dda83d4d4c req-47ccb3c8-bc96-400b-a21e-37a4071b89aa service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.066882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-153e8f9c-d435-48e1-99ef-20dda83d4d4c req-47ccb3c8-bc96-400b-a21e-37a4071b89aa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.068113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-153e8f9c-d435-48e1-99ef-20dda83d4d4c req-47ccb3c8-bc96-400b-a21e-37a4071b89aa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.099623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-153e8f9c-d435-48e1-99ef-20dda83d4d4c req-47ccb3c8-bc96-400b-a21e-37a4071b89aa service nova] Creating event network-vif-plugged:d33ea051-fd77-4e41-a4e2-eead72e31280 for instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 on n-h2-860864-8 Oct 12 22:31:38.111401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:38.112299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:38.113913 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-153e8f9c-d435-48e1-99ef-20dda83d4d4c req-47ccb3c8-bc96-400b-a21e-37a4071b89aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082022 Oct 12 22:31:38.116626 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 131/300] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:38.149848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.151844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.174514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.179588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.180788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.181848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.302251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.317454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.320991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.341647 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b46b84f-8b2d-408b-85a9-1625db9d6736 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.237816 Oct 12 22:31:38.343026 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 170/301] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:38 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:38.448353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:38.449216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:38.465269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.465913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.466618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.468354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.470266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.470906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.679563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.688621 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-571f2ff0-203c-4509-a73e-7049f8f53c23 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1310 microversion: 2.1 time: 0.246510 Oct 12 22:31:38.689750 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 132/302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:38 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1310 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:38.774771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:38.775387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:38.782097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.782707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.783152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.783991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.784710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.785274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.879104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:38.879721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:38.885625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.886373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.887484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.888981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:38.889659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:38.890295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:38.980872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.996470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:38.998722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:39.009227 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-640b4f4f-ae29-45cf-ab47-468138e73939 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1362 microversion: 2.25 time: 0.238296 Oct 12 22:31:39.009838 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 171/303] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:38 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:39.016431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:39.017485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:39.027060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.028295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.028946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:39.030782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.031625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.033248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:39.232906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:39.266370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c767bbeb-1ab8-4af4-b263-383e1044412e tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1318 microversion: 2.1 time: 0.390826 Oct 12 22:31:39.268219 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 133/304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:38 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:39.374814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:39.376501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:39.385692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.386622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.387518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:39.389051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.389698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.391152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:39.507997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:39.524833 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b3e4d7e-c8d4-4e93-b0ce-b56cfe906d71 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.510855 Oct 12 22:31:39.526462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 172/305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:39 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:39.584831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:39.600885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:39.605444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:39.621763 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2ecf31c-97a6-4677-92fd-f8cb35d15231 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.252313 Oct 12 22:31:39.622966 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 134/306] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:39 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:39.711987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:39.712891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:39.719284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.720123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.720800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:39.721674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:39.722795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:39.723444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.037202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:40.039264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:40.045876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.046363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.046793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.047680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.048162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.050063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.224224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.241199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.243561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.244862 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12509192-801c-4831-b131-3858cd9c9b05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1362 microversion: 2.25 time: 0.213789 Oct 12 22:31:40.260802 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 135/307] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:40 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:40.266389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.277823 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-efdbbefe-c5d9-4e3f-8b0a-95cf7249cfc3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1310 microversion: 2.1 time: 0.569700 Oct 12 22:31:40.278406 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 173/308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:39 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1310 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:40.298897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:40.299671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:40.306741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.307747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.308408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.309413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.310023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.310725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.494221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.502287 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1714e954-4fc5-448a-927d-43652e04b5ef tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1467 microversion: 2.1 time: 0.207568 Oct 12 22:31:40.530082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:40.530675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:40.533909 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 136/309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:40 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:40.542317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.544397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.550575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.551784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.552582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.553313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.554195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:40.554822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:40.569902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.571500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.572038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.572867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.574637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.575193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.625206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:40.648137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lazy-loading 'flavor' on Instance uuid 5e61d4ee-f0d0-4dce-96df-a541f64cac13 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:40.809984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d407852c-00a1-471d-ac66-94126e7f914a tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13/action" status: 202 len: 0 microversion: 2.1 time: 0.283303 Oct 12 22:31:40.811214 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 174/310] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:31:40 2022] POST /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:31:40.820355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:40.821060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:40.830747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.831941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.832541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.833563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:40.834161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:40.834644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:40.859445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:40.869226 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cbd11b6f-1b9a-46a9-8f8f-e89dc78df392 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.321063 Oct 12 22:31:40.870465 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 137/311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:40 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:41.059695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.072690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.076106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.095403 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0001a5c4-9fb7-4209-a46b-34a55e4c4c98 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.282901 Oct 12 22:31:41.111556 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 175/312] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:40 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:41.128849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.130499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:41.139572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.140231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.140776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.141492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.141932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.142486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.245089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6bd02def-49f1-4deb-aaa3-46368d6efc38 tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1229210033", "id": 809938221, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:41.264043 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6bd02def-49f1-4deb-aaa3-46368d6efc38 tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.392153 Oct 12 22:31:41.264733 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 138/313] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:31:40 2022] POST /compute/v2.1/flavors => generated 446 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:41.288369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f3e574a4-21e7-4204-b02f-53e6ee3087db req-4d6f0873-d0c3-455a-9480-2be38af3a360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6", "tag": "95bae054-475a-40d0-aca7-9f2771d8157a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:41.303935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f3e574a4-21e7-4204-b02f-53e6ee3087db req-4d6f0873-d0c3-455a-9480-2be38af3a360 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.304746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f3e574a4-21e7-4204-b02f-53e6ee3087db req-4d6f0873-d0c3-455a-9480-2be38af3a360 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.304746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f3e574a4-21e7-4204-b02f-53e6ee3087db req-4d6f0873-d0c3-455a-9480-2be38af3a360 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.352781 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f3e574a4-21e7-4204-b02f-53e6ee3087db req-4d6f0873-d0c3-455a-9480-2be38af3a360 service nova] Creating event network-changed:95bae054-475a-40d0-aca7-9f2771d8157a for instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 on n-h1-860864-8 Oct 12 22:31:41.362991 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f3e574a4-21e7-4204-b02f-53e6ee3087db req-4d6f0873-d0c3-455a-9480-2be38af3a360 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079361 Oct 12 22:31:41.368786 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 139/314] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:41.374924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.376097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:41.385707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.386305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.386726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.387426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.387872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.388356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.545378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:41.555762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.567536 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb5537b3-fdb4-43c0-b3a6-913a9f88b6f5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1475 microversion: 2.1 time: 0.449869 Oct 12 22:31:41.572689 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 176/315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1475 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:41.675796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.684301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.686059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.687313 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af1c868f-33a7-455c-be7e-37afba404d95 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1362 microversion: 2.25 time: 0.316956 Oct 12 22:31:41.687972 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 140/316] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:41.700205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.700907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:41.707719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.708437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.709135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.710014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.710945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.711467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.725540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6de25597-d227-4d04-8ab4-fad424a8bd99 tempest-FlavorsV255TestJSON-106451398 tempest-FlavorsV255TestJSON-106451398-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.734022 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6de25597-d227-4d04-8ab4-fad424a8bd99 tempest-FlavorsV255TestJSON-106451398 tempest-FlavorsV255TestJSON-106451398-project] 10.222.0.20 "GET /compute/v2.1/flavors/809938221" status: 200 len: 446 microversion: 2.55 time: 0.160212 Oct 12 22:31:41.735243 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 177/317] 10.222.0.20 () {60 vars in 1196 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/flavors/809938221 => generated 446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:41.751681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d490cb2e-d0f7-430a-8f7d-48387a3f7e9d tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:41.785406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d490cb2e-d0f7-430a-8f7d-48387a3f7e9d tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/809938221" status: 200 len: 447 microversion: 2.55 time: 0.040328 Oct 12 22:31:41.795118 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 178/318] 10.222.0.20 () {62 vars in 1216 bytes} [Wed Oct 12 22:31:41 2022] PUT /compute/v2.1/flavors/809938221 => generated 447 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:41.800259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-529b0f8d-88bd-4e40-854f-5dd04205d8cb tempest-FlavorsV255TestJSON-106451398 tempest-FlavorsV255TestJSON-106451398-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.825140 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-529b0f8d-88bd-4e40-854f-5dd04205d8cb tempest-FlavorsV255TestJSON-106451398 tempest-FlavorsV255TestJSON-106451398-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.028903 Oct 12 22:31:41.826827 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 179/319] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:41.855506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9593b079-53b2-4b7a-86de-d742d513b97f tempest-FlavorsV255TestJSON-106451398 tempest-FlavorsV255TestJSON-106451398-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.888748 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9593b079-53b2-4b7a-86de-d742d513b97f tempest-FlavorsV255TestJSON-106451398 tempest-FlavorsV255TestJSON-106451398-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.044194 Oct 12 22:31:41.890031 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 180/320] 10.222.0.20 () {60 vars in 1166 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:41.896953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.897803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:41.905320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.906486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.907307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.908330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:41.909065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:41.910218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:41.943730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:41.954140 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99cefdd8-ffc8-4f2b-91f4-7d746a62676f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1310 microversion: 2.1 time: 0.264878 Oct 12 22:31:41.954776 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 141/321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1310 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:41.961852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7cd9798-5c3c-46ab-8a41-cdaebab946df tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:41.985218 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7cd9798-5c3c-46ab-8a41-cdaebab946df tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/809938221" status: 202 len: 0 microversion: 2.55 time: 0.028925 Oct 12 22:31:41.986098 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 142/322] 10.222.0.20 () {60 vars in 1199 bytes} [Wed Oct 12 22:31:41 2022] DELETE /compute/v2.1/flavors/809938221 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:41.995124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be97cebf-833d-44dc-b379-cdcf2e981b02 tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:42.001595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10,nova_api:DELETE=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:42.018197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be97cebf-833d-44dc-b379-cdcf2e981b02 tempest-FlavorsV255TestJSON-475607568 tempest-FlavorsV255TestJSON-475607568-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.027792 Oct 12 22:31:42.019341 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 143/323] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:42.132471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:42.137927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:42.148354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.148855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.149247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.153393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.153873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.154797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.181248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:42.198282 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1e48e86-ea24-4a94-9557-16bdc808e046 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.306475 Oct 12 22:31:42.199183 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 181/324] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:41 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:42.234187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:42.245451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:42.247249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:42.252633 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-240a1c4d-b7d0-4fe6-823c-3c69624ced94 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.129734 Oct 12 22:31:42.254107 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 144/325] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:42 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:42.601235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:42.603128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:42.611441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.614590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.616350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.617891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.619518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.620371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.712836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:42.713442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:42.724366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.725154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.725750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.726757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.727361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.728187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.924403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:42.933411 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-525918fc-a8c2-4645-8f7f-1ea0c5ad995d tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1458 microversion: 2.1 time: 0.341841 Oct 12 22:31:42.937313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 182/326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:42 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1458 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:42.955672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:42.957675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:42.968686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.969429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.974426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:42.975462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:42.976115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:42.976696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.158012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.167542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.169555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.170933 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3b1af9c-02bf-460b-b89a-66aadacaa3b7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1362 microversion: 2.25 time: 0.461953 Oct 12 22:31:43.171758 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 145/327] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:42 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1362 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:43.194607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:43.195431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:43.202942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.203568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.204135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.204968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.205536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.206835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.362299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.371247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9bc9b35c-1368-40ed-b038-9531fce34ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1310 microversion: 2.1 time: 0.181074 Oct 12 22:31:43.371840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 146/328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:43 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1310 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:43.376857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:43.377701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:43.391516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.392802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.393235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.394565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.395165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.395631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.572491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.581410 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af843e22-7e8c-4119-8445-98ef8451e8d2 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.208190 Oct 12 22:31:43.582165 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 147/329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:43 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:43.586928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:43.593016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:43.603510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.603925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.604497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.605434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.606042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.606804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.706817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.723068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.724944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:43.734442 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ffa7ecf-8704-481b-ac58-59a3353946be tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.148218 Oct 12 22:31:43.735309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 148/330] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:43 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:43.748528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e931971b-e1b3-4392-bbaa-0b83b86a86c4 req-1a4f119e-8aaa-4a93-82ff-73a4202615ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379c4c15-434c-4786-9738-63649c335334", "name": "network-vif-plugged", "status": "completed", "tag": "a7e0e2d1-e880-4aab-a151-307201918d79"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:43.769242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e931971b-e1b3-4392-bbaa-0b83b86a86c4 req-1a4f119e-8aaa-4a93-82ff-73a4202615ca service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.770090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e931971b-e1b3-4392-bbaa-0b83b86a86c4 req-1a4f119e-8aaa-4a93-82ff-73a4202615ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.770666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e931971b-e1b3-4392-bbaa-0b83b86a86c4 req-1a4f119e-8aaa-4a93-82ff-73a4202615ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.783341 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e931971b-e1b3-4392-bbaa-0b83b86a86c4 req-1a4f119e-8aaa-4a93-82ff-73a4202615ca service nova] Creating event network-vif-plugged:a7e0e2d1-e880-4aab-a151-307201918d79 for instance 379c4c15-434c-4786-9738-63649c335334 on n-h1-860864-8 Oct 12 22:31:43.788560 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e931971b-e1b3-4392-bbaa-0b83b86a86c4 req-1a4f119e-8aaa-4a93-82ff-73a4202615ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045598 Oct 12 22:31:43.789159 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 149/331] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:43.794823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4f9da157-2e04-4de1-afaf-b1f4fe6a838f req-54c1742a-a421-49b4-9d80-42859fc024e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23325c7-98a1-4a12-8917-e3a6c87bf88f", "tag": "98b7712b-ef88-422d-b63f-f0186afc6969"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:43.805219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f9da157-2e04-4de1-afaf-b1f4fe6a838f req-54c1742a-a421-49b4-9d80-42859fc024e9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:43.805917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f9da157-2e04-4de1-afaf-b1f4fe6a838f req-54c1742a-a421-49b4-9d80-42859fc024e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:43.806481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f9da157-2e04-4de1-afaf-b1f4fe6a838f req-54c1742a-a421-49b4-9d80-42859fc024e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:43.818664 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4f9da157-2e04-4de1-afaf-b1f4fe6a838f req-54c1742a-a421-49b4-9d80-42859fc024e9 service nova] Creating event network-changed:98b7712b-ef88-422d-b63f-f0186afc6969 for instance a23325c7-98a1-4a12-8917-e3a6c87bf88f on n-h2-860864-8 Oct 12 22:31:43.823505 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4f9da157-2e04-4de1-afaf-b1f4fe6a838f req-54c1742a-a421-49b4-9d80-42859fc024e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032881 Oct 12 22:31:43.824361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 150/332] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:44.200885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:44.201912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:44.216978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.217613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.218284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.220054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.220711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.221533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.349873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=9 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:44.416927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03f4293d-21b4-47b8-b7a0-418180911299 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1609 microversion: 2.1 time: 1.464523 Oct 12 22:31:44.418202 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 183/333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:42 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1609 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:44.443004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:44.444001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:44.450649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.451357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.451531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.452229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.455352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.456594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.457184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.463582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.466903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.468286 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4058d05-093a-4070-adde-68157e3c4de8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1362 microversion: 2.25 time: 0.275590 Oct 12 22:31:44.469300 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 151/334] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:44 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:44.482315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:44.492243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.492243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.492243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.492243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.497406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.498120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.529270 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-442aa344-c802-4a0b-a0cf-2646af6a8394 tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057582 Oct 12 22:31:44.530209 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 152/335] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:31:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:44.546073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-8", "block_migration": true, "disk_over_commit": false}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:44.549906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:44.558462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.560230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.560843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.561746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.562405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.563085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.594857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Lazy-loading 'flavor' on Instance uuid 5e61d4ee-f0d0-4dce-96df-a541f64cac13 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:44.613617 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 while it is in vm_state suspended Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Request method failure captured: Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13/action HTTP/1.1 Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 97 Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AirG3smq3VmB6-IOaGS-D4xnoXanUt9n3kQao922S3ikoxDZ_X7s8P5LRRga1VS6Oxarb7I9ZOLZ_8rxNqYopIOSn8VM4KIACWXxotq_oTE37WQIuM7VbPV1ufzd-8P8vTjDW0ps-IuqjypsHvNEjYevqV0KJ7FJW6IWIu-Km30wA Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 7e98297941bf4d7884537d37b2cf0098 Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveMigrationNegativeTest-910268259 Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:31:44.615439 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98297941bf4d7884537d37b2cf0098"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e98297941bf4d7884537d37b2cf0098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e98297941bf4d7884537d37b2cf0098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e98297941bf4d7884537d37b2cf0098"}]}] Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveMigrationNegativeTest-910268259 Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 7e98297941bf4d7884537d37b2cf0098 Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-910268259 Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveMigrationNegativeTest-910268259-project-admin Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5291a07fbba9438195e2613bb1575513 Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveMigrationNegativeTest-910268259-project-admin Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: {"os-migrateLive": {"host": "n-h1-860864-8", "block_migration": true, "disk_over_commit": false}} Oct 12 22:31:44.616917 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: exception: Cannot 'os-migrateLive' instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 while it is in vm_state suspended Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5e61d4ee-f0d0-4dce-96df-a541f64cac13', 'body': {'os-migrateLive': {'host': 'n-h1-860864-8', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 22:31:44.617715 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:44.618896 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 while it is in vm_state suspended Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 while it is in vm_state suspended Oct 12 22:31:44.621787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:44.623364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 while it is in vm_state suspended {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:44.624309 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f39c41d-db95-4dd3-9a13-a1b26f7a384c tempest-LiveMigrationNegativeTest-910268259 tempest-LiveMigrationNegativeTest-910268259-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13/action" status: 409 len: 155 microversion: 2.1 time: 0.084847 Oct 12 22:31:44.630213 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 153/336] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:31:44 2022] POST /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13/action => generated 155 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:31:44.636448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:44.636747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:44.644570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.645057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.645513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.647157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.647618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.648101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.845255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.859708 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-804d121b-12c7-42e6-bc00-b84ca402c877 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.227798 Oct 12 22:31:44.860552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 154/337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:44 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:44.866147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:44.867306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:44.875157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.875992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.876624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.877519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:44.878518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:44.878980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:44.924157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:31:44.979616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:44.990189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0a26ab92-6510-4f91-af57-3da2920b731d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1310 microversion: 2.1 time: 0.554610 Oct 12 22:31:44.996581 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 184/338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:44 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1310 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:45.016417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:45.019867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:45.042300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.047523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.051421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.055568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.057543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.059292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.064429 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e2b35a4-3ef6-43c9-acf9-34fe4c4704c5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 204 len: 0 microversion: 2.1 time: 0.202175 Oct 12 22:31:45.066907 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 155/339] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:31:44 2022] DELETE /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:45.076047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:45.077725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:45.091506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.096690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.097295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.098177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.098773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.099339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.261108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.274909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.280204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.290920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce44bb4f-d985-414a-9816-5bbb792248ca tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.291399 Oct 12 22:31:45.312882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:45.324066 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 185/340] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:44 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:45.432703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.440580 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47c5957d-b19b-42bb-9445-6c5f5e235eff tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1464 microversion: 2.1 time: 0.369259 Oct 12 22:31:45.452946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 156/341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:45 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:45.496161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:45.497287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:45.504028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.504509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.504933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.505619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.506060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.506776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.882729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:45.883484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:45.894877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.895380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.895803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.896645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:45.896974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:45.897392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:45.966497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.977158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.978607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:45.979765 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc81564b-7a90-4573-b2ea-05a11d4e9e60 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1558 microversion: 2.25 time: 0.487741 Oct 12 22:31:45.980354 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 186/342] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:45 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1558 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:46.193191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:46.203919 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53d2d6d1-d981-46fa-99fc-98b0bb631e29 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.325172 Oct 12 22:31:46.207224 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 157/343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:45 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:31:46.236663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:46.237560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:46.244601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.245390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.246090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.247480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.248113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.248688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.254393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:46.472784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:46.481833 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2285fe5a-193a-42b8-a2bd-fa8707c67472 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1310 microversion: 2.1 time: 0.273586 Oct 12 22:31:46.497850 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 158/344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:46 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:46.510995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:46.511612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:46.522504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.523000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.523423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.524467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.526689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.527302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.573203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cb57fab-9ef0-4266-ac11-26e0c38e1061 tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] Calling method '.version_select at 0x7f4504106c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:46.589915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7cb57fab-9ef0-4266-ac11-26e0c38e1061 tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.089948 Oct 12 22:31:46.591415 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 159/345] 10.222.0.20 () {60 vars in 1226 bytes} [Wed Oct 12 22:31:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:46.596362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:46.598303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:46.606865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.607610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.608548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.610206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.611228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.611845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.684290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:46.694571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:46.696315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:46.701684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38468c43-b2fa-4d62-851e-65f4781ad30d tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.108986 Oct 12 22:31:46.702447 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 160/346] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:46 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:46.706950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:46.708345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:46.714285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.714874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.715923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.716999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:46.716999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:46.717306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:46.883425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:46.894141 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-359af56f-b464-41d2-b0ca-54521d96672c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1464 microversion: 2.1 time: 0.190020 Oct 12 22:31:46.894897 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 161/347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:46 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:46.902555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43eb8235-630d-4bcb-bee0-3c44ca4504f1 tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] Action: 'update', calling method: .version_select at 0x7f4504106b80>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:46.967537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 379c4c15-434c-4786-9738-63649c335334 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:47.030469 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-635a3af5-f3c5-4803-b6ba-33007381e1f8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 2051 microversion: 2.25 time: 1.028786 Oct 12 22:31:47.044580 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 187/348] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:46 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 2051 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:47.057416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-94a16bf3-f40e-4b7c-a7d4-da6cbe5a9b9b req-66338af6-eecf-4062-94bd-703e0b96412a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6", "name": "network-vif-plugged", "status": "completed", "tag": "95bae054-475a-40d0-aca7-9f2771d8157a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:47.067551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-94a16bf3-f40e-4b7c-a7d4-da6cbe5a9b9b req-66338af6-eecf-4062-94bd-703e0b96412a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.068291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-94a16bf3-f40e-4b7c-a7d4-da6cbe5a9b9b req-66338af6-eecf-4062-94bd-703e0b96412a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.068868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-94a16bf3-f40e-4b7c-a7d4-da6cbe5a9b9b req-66338af6-eecf-4062-94bd-703e0b96412a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.082922 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-94a16bf3-f40e-4b7c-a7d4-da6cbe5a9b9b req-66338af6-eecf-4062-94bd-703e0b96412a service nova] Creating event network-vif-plugged:95bae054-475a-40d0-aca7-9f2771d8157a for instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 on n-h1-860864-8 Oct 12 22:31:47.088609 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-94a16bf3-f40e-4b7c-a7d4-da6cbe5a9b9b req-66338af6-eecf-4062-94bd-703e0b96412a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042210 Oct 12 22:31:47.089911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 188/349] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:47.097196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:47.098450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:47.106975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.108247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.108846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.109693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.110438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.110996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.133814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:47.195054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-43eb8235-630d-4bcb-bee0-3c44ca4504f1 tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.298379 Oct 12 22:31:47.195843 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 162/350] 10.222.0.20 () {62 vars in 1247 bytes} [Wed Oct 12 22:31:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:47.207245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-31a4f69a-ca9e-4f4e-8236-42ff4dc7e462 tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] Calling method '.version_select at 0x7f45040d9160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:47.217387 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-31a4f69a-ca9e-4f4e-8236-42ff4dc7e462 tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015065 Oct 12 22:31:47.218145 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 163/351] 10.222.0.20 () {60 vars in 1226 bytes} [Wed Oct 12 22:31:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:47.231066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24de15f6-34cd-4067-9c3f-7368c194cd1e tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] Action: 'update', calling method: .version_select at 0x7f450416b8b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:47.283481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=13,nova_api:INSERT=7 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:47.311697 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24de15f6-34cd-4067-9c3f-7368c194cd1e tempest-QuotaClassesAdmin257Test-942724228 tempest-QuotaClassesAdmin257Test-942724228-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.085686 Oct 12 22:31:47.319304 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 164/352] 10.222.0.20 () {62 vars in 1247 bytes} [Wed Oct 12 22:31:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:31:47.319304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:47.319304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:47.333716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.334655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.335241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.336311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.337901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.338946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.505051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.514472 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cf143485-8f90-4a52-a2a5-71375323b44c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.200754 Oct 12 22:31:47.521712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 379c4c15-434c-4786-9738-63649c335334 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:47.535796 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 165/353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:47 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:47.537398 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eacd8af0-c26a-4ab7-8e03-426cc2a55834 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 2051 microversion: 2.25 time: 0.445927 Oct 12 22:31:47.549863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:47.549863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:47.550821 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 189/354] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:47 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 2051 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:47.555940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.555940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.555940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.555940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.556322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.556322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.568745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:47.572774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.573417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.574027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.574903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.575492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.576083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.608029 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-092da44c-4066-46d3-9ba5-f7c4e0b7a670 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045510 Oct 12 22:31:47.608635 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 190/355] 10.222.0.20 () {60 vars in 1217 bytes} [Wed Oct 12 22:31:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:31:47.621745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": "auto"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:47.624923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:47.630684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.631165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.631595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.632445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.632894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.633309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.811165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.825137 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-987a5568-8aa8-4144-86ce-d28398b9b547 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1310 microversion: 2.1 time: 0.287558 Oct 12 22:31:47.839643 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 166/356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:47 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1310 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:47.848110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:47.849139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:47.856075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.856847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.857350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.858937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:47.859493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:47.860070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:47.957551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'flavor' on Instance uuid 379c4c15-434c-4786-9738-63649c335334 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:47.965346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.978069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 379c4c15-434c-4786-9738-63649c335334] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:31:47.981192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:47.988466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:48.011694 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8854faeb-36f5-4562-b597-7410c6d90b3f tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.170135 Oct 12 22:31:48.014641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 167/357] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:47 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:48.030758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:48.033164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:48.052000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:48.055227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:48.055846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:48.056919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:48.066358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:48.066358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:48.285785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:48.296295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-015d8c7b-f883-49d6-987e-beaebb7afb3c tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 200 len: 1422 microversion: 2.1 time: 0.280490 Oct 12 22:31:48.316607 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 168/358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:48 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 1422 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:48.390031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f3c623e4-1574-4216-a287-2d0e94760930 req-0129128b-84eb-4b4b-922e-455286374752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e61d4ee-f0d0-4dce-96df-a541f64cac13", "name": "network-vif-deleted", "tag": "d33ea051-fd77-4e41-a4e2-eead72e31280"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:48.413944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f3c623e4-1574-4216-a287-2d0e94760930 req-0129128b-84eb-4b4b-922e-455286374752 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:48.415844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f3c623e4-1574-4216-a287-2d0e94760930 req-0129128b-84eb-4b4b-922e-455286374752 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:48.419002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f3c623e4-1574-4216-a287-2d0e94760930 req-0129128b-84eb-4b4b-922e-455286374752 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:48.440296 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f3c623e4-1574-4216-a287-2d0e94760930 req-0129128b-84eb-4b4b-922e-455286374752 service nova] Creating event network-vif-deleted:d33ea051-fd77-4e41-a4e2-eead72e31280 for instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 on n-h2-860864-8 Oct 12 22:31:48.459287 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f3c623e4-1574-4216-a287-2d0e94760930 req-0129128b-84eb-4b4b-922e-455286374752 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074189 Oct 12 22:31:48.465787 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 169/359] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:48.544670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:48.558341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:48.584578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:48.586662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:48.591135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:48.592129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:48.595029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:48.595753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:48.941437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:48.962800 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef18c9da-df59-4bb1-a537-a404b5fc6b2f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.425427 Oct 12 22:31:48.982804 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 170/360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:48 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:48.988611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:48.992699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:49.001431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.002170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.002973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.003909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.004578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.005360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.347739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:49.366206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-66fa473c-faec-4c5b-83f9-17420de42090 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1492 microversion: 2.1 time: 0.379745 Oct 12 22:31:49.369865 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 171/361] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:48 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1492 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:49.411518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:49.413542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:49.431202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.433533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.434432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.435381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.438694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.439773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.593198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:49.609066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:49.611071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:49.621239 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98936d34-0117-4d6e-aa9a-c3801802e710 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.248955 Oct 12 22:31:49.630671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 172/362] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:49 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:49.641338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-460b183a-ee31-4caa-949e-ee631c657765 req-2b8bbc16-07a9-48db-950f-b9a4c23212e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23325c7-98a1-4a12-8917-e3a6c87bf88f", "name": "network-vif-plugged", "status": "completed", "tag": "98b7712b-ef88-422d-b63f-f0186afc6969"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:49.665744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-460b183a-ee31-4caa-949e-ee631c657765 req-2b8bbc16-07a9-48db-950f-b9a4c23212e6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.666612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-460b183a-ee31-4caa-949e-ee631c657765 req-2b8bbc16-07a9-48db-950f-b9a4c23212e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.668870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-460b183a-ee31-4caa-949e-ee631c657765 req-2b8bbc16-07a9-48db-950f-b9a4c23212e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.682625 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-460b183a-ee31-4caa-949e-ee631c657765 req-2b8bbc16-07a9-48db-950f-b9a4c23212e6 service nova] Creating event network-vif-plugged:98b7712b-ef88-422d-b63f-f0186afc6969 for instance a23325c7-98a1-4a12-8917-e3a6c87bf88f on n-h2-860864-8 Oct 12 22:31:49.688351 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-460b183a-ee31-4caa-949e-ee631c657765 req-2b8bbc16-07a9-48db-950f-b9a4c23212e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051847 Oct 12 22:31:49.689168 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 173/363] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:49.695599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:49.696424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 5e61d4ee-f0d0-4dce-96df-a541f64cac13] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:49.704315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.704315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.704315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.705604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:49.706306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:49.706820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:49.726855 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] HTTP exception thrown: Instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 could not be found. Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Request method failure captured: Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 HTTP/1.1 Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AgxACRpQJUe7bJTAHMukiGHNAlN5cr28YcTgkvK05LfnMN99c4r8HGXUi9zbCb6OLBxrF2NasJZJI0T--ZCo-WQn1XcuJhpayl6kXU1XIC1Krl8MXRcpWHuI4RDWlCEaapglZewBjzM4aXg-l7xKVGcvKEWAe2izQGpMTyyZJsaHI Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 09e75a75b4f24f0f8c23d5d8cff4262c Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveMigrationNegativeTest-1079410314 Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:31:49.728740 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09e75a75b4f24f0f8c23d5d8cff4262c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09e75a75b4f24f0f8c23d5d8cff4262c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09e75a75b4f24f0f8c23d5d8cff4262c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09e75a75b4f24f0f8c23d5d8cff4262c"}]}] Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveMigrationNegativeTest-1079410314 Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 09e75a75b4f24f0f8c23d5d8cff4262c Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1079410314 Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveMigrationNegativeTest-1079410314-project Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 36c3460feeb4440db6dff38198d5dd68 Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveMigrationNegativeTest-1079410314-project Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 could not be found. Oct 12 22:31:49.730248 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5e61d4ee-f0d0-4dce-96df-a541f64cac13'} Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 could not be found. Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:49.731083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 could not be found. Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 could not be found. Oct 12 22:31:49.732968 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:49.734297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Returning 404 to user: Instance 5e61d4ee-f0d0-4dce-96df-a541f64cac13 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:49.734297 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59be834c-7920-4559-8fb3-c5fbe64eac84 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13" status: 404 len: 111 microversion: 2.1 time: 0.041382 Oct 12 22:31:49.736247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 174/364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:49 2022] GET /compute/v2.1/servers/5e61d4ee-f0d0-4dce-96df-a541f64cac13 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:50.056547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:50.057921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:50.069755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.070923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.072034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.074512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.075718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.078906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.345341 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c1415d2-acf2-4a47-8bd8-3aef68a8a8e1 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1643 microversion: 2.1 time: 0.607339 Oct 12 22:31:50.345903 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 175/365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:49 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1643 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:50.357362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:50.358025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:50.374933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.375433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.375869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.378942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.379338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.379774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.423726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:31:50.536057 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-462526c3-f029-4ec0-ac5c-680fdf2a7c12 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 204 len: 0 microversion: 2.1 time: 0.186879 Oct 12 22:31:50.536895 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 176/366] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:31:50 2022] DELETE /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:50.550569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:50.552559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:50.562985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.563570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.564262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.566075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.567048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.567805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.845305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:50.854732 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac909b3e-6ced-40ca-82a0-25096eb88996 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1319 microversion: 2.1 time: 0.311072 Oct 12 22:31:50.857342 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 177/367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:50 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:50.862463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:50.863069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:50.870977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.871631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.872135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.872991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:50.873695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:50.873991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:50.977672 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e84cc185-3fa6-4389-ba10-e6c2867eb5ac tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334/action" status: 202 len: 0 microversion: 2.25 time: 3.359734 Oct 12 22:31:50.979012 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 191/368] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:31:47 2022] POST /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334/action => generated 0 bytes in 3361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:50.986216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:50.987154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:50.999967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.000453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.000878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.002390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.003623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.004384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.102370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c2e9d10f-73b0-4933-a7cc-ed5855906861 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1643 microversion: 2.1 time: 0.243954 Oct 12 22:31:51.116587 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 178/369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:50 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1643 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:51.127366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:51.130331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:51.137540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.139050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.140060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.140999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.141690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.142352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.174144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:51.234440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.247042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.250100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.258294 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a4f4adb0-8c9f-48e6-996b-48307febb9bc tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.140213 Oct 12 22:31:51.259197 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 179/370] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:51 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:51.264676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:51.265393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:51.271421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.272245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.273541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.274486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.275380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.276112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.322324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.337940 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a7955b3-70fe-49c9-a270-2aca936b9b43 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1474 microversion: 2.1 time: 0.357701 Oct 12 22:31:51.357028 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 192/371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:50 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:51.365595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:51.389256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.392993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.394332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.395447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.396167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.397351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.469947 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46195bfc-cf61-4fb9-a3af-37f61f11b090 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111411 Oct 12 22:31:51.474570 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 193/372] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:31:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:51.488123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": true, "disk_over_commit": false}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:51.491585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.497070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:51.500542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.501999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:51.503417 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03c60d1a-6990-4f73-9629-476b039a68fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.242859 Oct 12 22:31:51.512531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.514169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.514770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.515713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.516388 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 180/373] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:51 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:51.516640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.517307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.552916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lazy-loading 'flavor' on Instance uuid abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:51.568223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:31:51.880966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:51.881604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:51.889286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.889778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.890207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:51.890900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:51.894540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:51.895704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:52.226994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:52.241660 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2fffa325-595b-4001-88e9-f56f07a90fe6 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1469 microversion: 2.1 time: 0.366812 Oct 12 22:31:52.243984 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 181/374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:51 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:52.583709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:52.584485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:52.593902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:52.594835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:52.596887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:52.597890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:52.598872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:52.599521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:52.647457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:31:52.864459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c11c06ec-0296-46ad-b43b-f796cca20ae3 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 204 len: 0 microversion: 2.1 time: 0.594571 Oct 12 22:31:52.867946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 182/375] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:31:52 2022] DELETE /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:31:52.876840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:52.877985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:52.884853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:52.885673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:52.886562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:52.887475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:52.890694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:52.891814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:52.981208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:53.001216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:53.006304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:53.016833 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4581269-d4c7-4e07-a9a5-d61672b1e694 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.147088 Oct 12 22:31:53.028512 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 183/376] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:52 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:53.043473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:53.044281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:53.051717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:53.051975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:53.052451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:53.053340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:53.053798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:53.054325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:53.488102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c3460feeb4440db6dff38198d5dd68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e75a75b4f24f0f8c23d5d8cff4262c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:53.500210 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-132a518f-88b5-4437-9132-00fad5f41e63 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 200 len: 1474 microversion: 2.1 time: 0.470465 Oct 12 22:31:53.500807 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 184/377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:53 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 1474 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:53.625193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac9f7b61-34b5-49de-b8c4-37b94ec02db8 tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] Calling method '.version_select at 0x7f450406e820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:53.649207 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac9f7b61-34b5-49de-b8c4-37b94ec02db8 tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.146946 Oct 12 22:31:53.651667 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 185/378] 10.222.0.20 () {58 vars in 1185 bytes} [Wed Oct 12 22:31:53 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:53.664752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:53.665627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:53.682790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:53.683634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:53.684713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:53.687792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:53.688778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:53.690658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:53.965844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:53.978686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:53.983008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:53.989730 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-82959522-885a-4cc8-9c39-58262329d6fa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.335060 Oct 12 22:31:53.993822 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 186/379] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:53 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:54.008106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:54.008877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:54.026556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:54.028831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:54.029590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:54.031724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:54.033207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:54.035385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:54.273456 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12229454-dd42-4777-86a7-d700bc7cb4ff tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6/action" status: 202 len: 0 microversion: 2.1 time: 2.790000 Oct 12 22:31:54.274386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 194/380] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:31:51 2022] POST /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6/action => generated 0 bytes in 2792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:31:54.281227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-15b84399-bb0f-4791-af5b-5bd8409bec00 req-7aeaa65c-3b23-445b-b4b5-97ad55cea5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ebc875-f3fa-40df-ad56-125ba35d8cd7", "name": "network-vif-deleted", "tag": "2ce906c4-08eb-4ccf-b13a-b0c489cb8437"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:54.318354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-15b84399-bb0f-4791-af5b-5bd8409bec00 req-7aeaa65c-3b23-445b-b4b5-97ad55cea5c8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:54.324611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-15b84399-bb0f-4791-af5b-5bd8409bec00 req-7aeaa65c-3b23-445b-b4b5-97ad55cea5c8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:54.325100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-15b84399-bb0f-4791-af5b-5bd8409bec00 req-7aeaa65c-3b23-445b-b4b5-97ad55cea5c8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:54.384790 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-15b84399-bb0f-4791-af5b-5bd8409bec00 req-7aeaa65c-3b23-445b-b4b5-97ad55cea5c8 service nova] Creating event network-vif-deleted:2ce906c4-08eb-4ccf-b13a-b0c489cb8437 for instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 on n-h1-860864-8 Oct 12 22:31:54.396620 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-15b84399-bb0f-4791-af5b-5bd8409bec00 req-7aeaa65c-3b23-445b-b4b5-97ad55cea5c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120725 Oct 12 22:31:54.399805 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 195/381] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:54.405734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:54.414353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-381f2f5a-52a8-4261-b5a2-bcbd43402b01 tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffe629d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:54.417249 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3520b63e-fbd0-4ed8-9d0b-36c1ce42c84d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1475 microversion: 2.1 time: 0.422138 Oct 12 22:31:54.431961 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 187/382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:53 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1475 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:54.434400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:54.435268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:54.452822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:54.453631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:54.454251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:54.455138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:54.456014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:54.456589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:54.509258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:54.673563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=6,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:54.902364 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-381f2f5a-52a8-4261-b5a2-bcbd43402b01 tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.500974 Oct 12 22:31:54.903236 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 196/383] 10.222.0.20 () {60 vars in 1206 bytes} [Wed Oct 12 22:31:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:54.907780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:54.908637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:54.917369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:54.917861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:54.918299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:54.919157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:54.919617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:54.920069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.063322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.073373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.079652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.096061 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d0ec2a4-1f43-41ef-8e3c-3d4335cdc3ac tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.672112 Oct 12 22:31:55.096618 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 188/384] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:54 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:55.130813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:55.132423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] [instance: 02ebc875-f3fa-40df-ad56-125ba35d8cd7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:55.139066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.140177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.141084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.142464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.143374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.144054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.162005 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] HTTP exception thrown: Instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 could not be found. Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Request method failure captured: Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 HTTP/1.1 Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AgxACRpQJUe7bJTAHMukiGHNAlN5cr28YcTgkvK05LfnMN99c4r8HGXUi9zbCb6OLBxrF2NasJZJI0T--ZCo-WQn1XcuJhpayl6kXU1XIC1Krl8MXRcpWHuI4RDWlCEaapglZewBjzM4aXg-l7xKVGcvKEWAe2izQGpMTyyZJsaHI Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 09e75a75b4f24f0f8c23d5d8cff4262c Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveMigrationNegativeTest-1079410314 Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:31:55.164469 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09e75a75b4f24f0f8c23d5d8cff4262c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09e75a75b4f24f0f8c23d5d8cff4262c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09e75a75b4f24f0f8c23d5d8cff4262c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09e75a75b4f24f0f8c23d5d8cff4262c"}]}] Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveMigrationNegativeTest-1079410314 Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 09e75a75b4f24f0f8c23d5d8cff4262c Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1079410314 Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveMigrationNegativeTest-1079410314-project Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 36c3460feeb4440db6dff38198d5dd68 Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveMigrationNegativeTest-1079410314-project Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 could not be found. Oct 12 22:31:55.166208 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '02ebc875-f3fa-40df-ad56-125ba35d8cd7'} Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 could not be found. Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:55.167011 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 could not be found. Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 could not be found. Oct 12 22:31:55.168269 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:31:55.170843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] Returning 404 to user: Instance 02ebc875-f3fa-40df-ad56-125ba35d8cd7 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:55.171832 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-958cc752-ad54-4ac9-a210-7fb0ae4839a5 tempest-LiveMigrationNegativeTest-1079410314 tempest-LiveMigrationNegativeTest-1079410314-project] 10.222.0.20 "GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7" status: 404 len: 111 microversion: 2.1 time: 0.058826 Oct 12 22:31:55.172530 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 189/385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:55 2022] GET /compute/v2.1/servers/02ebc875-f3fa-40df-ad56-125ba35d8cd7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:55.179417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ba8fab2d-215f-4002-8e23-eaea2717e867 tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] Calling method '.version_select at 0x7f450406d670>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:55.198295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ba8fab2d-215f-4002-8e23-eaea2717e867 tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.024329 Oct 12 22:31:55.201491 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 190/386] 10.222.0.20 () {58 vars in 1185 bytes} [Wed Oct 12 22:31:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:55.207027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:55.208026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:55.229758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.230668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.231508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.233041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.233846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.234608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.380772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.389991 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a45b84a-a08e-4146-be54-05d2c194977d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.485880 Oct 12 22:31:55.394708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 197/387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:54 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:55.405251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d41929e6-d85e-4d3a-981c-ac096679ea3e tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffe0f5e0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:55.646966 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d41929e6-d85e-4d3a-981c-ac096679ea3e tempest-QuotaClassesAdminTestJSON-846323868 tempest-QuotaClassesAdminTestJSON-846323868-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.250776 Oct 12 22:31:55.647741 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 198/388] 10.222.0.20 () {60 vars in 1206 bytes} [Wed Oct 12 22:31:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:55.654085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:55.655918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:55.689301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.692058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.692210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.692835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:55.694217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:55.694629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:55.888602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.902427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.908897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:55.910610 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bdb1d290-34ce-4f5f-9a71-9d97f2a37601 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.707733 Oct 12 22:31:55.911388 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 191/389] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:55 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:56.138478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:56.139376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:56.150212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:56.153613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:56.155050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:56.165179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:56.168822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:56.171505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:56.287653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:56.297760 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2ebb070-e4d2-4e78-978f-2293e6aff2cd tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1475 microversion: 2.1 time: 0.648360 Oct 12 22:31:56.302533 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 199/390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:55 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1475 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:56.399525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:56.411975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:56.418167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:56.418777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:56.419962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:56.436779 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f63ecc8-0dbc-41ec-9629-7fa0d8fcc88b tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.309319 Oct 12 22:31:56.437875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:56.438122 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 192/391] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:56 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:56.439138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:56.442415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:56.443336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:56.444004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:56.444608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:56.597588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fb511d44-2915-40d3-bd5f-f8f05badbb0d req-d2c4761e-95fe-4205-81d3-1d0105189ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379c4c15-434c-4786-9738-63649c335334", "name": "network-vif-unplugged", "status": "completed", "tag": "a7e0e2d1-e880-4aab-a151-307201918d79"}, {"name": "network-changed", "server_uuid": "379c4c15-434c-4786-9738-63649c335334", "tag": "a7e0e2d1-e880-4aab-a151-307201918d79"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:56.622058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fb511d44-2915-40d3-bd5f-f8f05badbb0d req-d2c4761e-95fe-4205-81d3-1d0105189ff7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:56.622735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fb511d44-2915-40d3-bd5f-f8f05badbb0d req-d2c4761e-95fe-4205-81d3-1d0105189ff7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:56.624823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fb511d44-2915-40d3-bd5f-f8f05badbb0d req-d2c4761e-95fe-4205-81d3-1d0105189ff7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:56.649816 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fb511d44-2915-40d3-bd5f-f8f05badbb0d req-d2c4761e-95fe-4205-81d3-1d0105189ff7 service nova] Creating event network-vif-unplugged:a7e0e2d1-e880-4aab-a151-307201918d79 for instance 379c4c15-434c-4786-9738-63649c335334 on n-h1-860864-8 Oct 12 22:31:56.655938 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fb511d44-2915-40d3-bd5f-f8f05badbb0d req-d2c4761e-95fe-4205-81d3-1d0105189ff7 service nova] Creating event network-changed:a7e0e2d1-e880-4aab-a151-307201918d79 for instance 379c4c15-434c-4786-9738-63649c335334 on n-h1-860864-8 Oct 12 22:31:56.663420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fb511d44-2915-40d3-bd5f-f8f05badbb0d req-d2c4761e-95fe-4205-81d3-1d0105189ff7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071352 Oct 12 22:31:56.669476 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 193/392] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:31:56.940470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:56.942039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:56.959280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:56.960153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:56.960792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:56.961887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:56.964141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:56.964948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.288187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.311533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-97e6c4c3-44d6-43af-9d76-9ef6e1ff52d9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.895684 Oct 12 22:31:57.333768 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 200/393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:56 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:57.347455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5d1d35ef-50d6-4e1b-a27e-d26ad7319e58 req-034042a8-ad29-40ff-9d06-128c84e3d91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23325c7-98a1-4a12-8917-e3a6c87bf88f", "name": "network-vif-deleted", "tag": "98b7712b-ef88-422d-b63f-f0186afc6969"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:57.373180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5d1d35ef-50d6-4e1b-a27e-d26ad7319e58 req-034042a8-ad29-40ff-9d06-128c84e3d91b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.373916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5d1d35ef-50d6-4e1b-a27e-d26ad7319e58 req-034042a8-ad29-40ff-9d06-128c84e3d91b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.374575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5d1d35ef-50d6-4e1b-a27e-d26ad7319e58 req-034042a8-ad29-40ff-9d06-128c84e3d91b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.416240 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5d1d35ef-50d6-4e1b-a27e-d26ad7319e58 req-034042a8-ad29-40ff-9d06-128c84e3d91b service nova] Creating event network-vif-deleted:98b7712b-ef88-422d-b63f-f0186afc6969 for instance a23325c7-98a1-4a12-8917-e3a6c87bf88f on n-h2-860864-8 Oct 12 22:31:57.437157 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5d1d35ef-50d6-4e1b-a27e-d26ad7319e58 req-034042a8-ad29-40ff-9d06-128c84e3d91b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101498 Oct 12 22:31:57.443980 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 201/394] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:31:57.454981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:57.456588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:57.498499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.499011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.503780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.506995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.508490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.509787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.614173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.614173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.614397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.615056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lazy-loading 'fault' on Instance uuid a23325c7-98a1-4a12-8917-e3a6c87bf88f {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:31:57.672182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.684953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.693891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.701301 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c149f93a-f926-4a2c-877b-15beb402b12b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.766397 Oct 12 22:31:57.702116 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 194/395] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:56 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:31:57.706876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:57.721325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:57.728140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.728630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.729065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.729765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:57.730220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:57.730643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:57.809703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.822715 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebfba40e-ba76-4bf5-a6b9-22d33c022dd4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 200 len: 1309 microversion: 2.1 time: 0.377378 Oct 12 22:31:57.837465 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 202/396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:57 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:57.972322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.990147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:57.992054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:58.004036 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc4ad1c2-b7b0-4032-b3d0-31616f08d62c tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.299998 Oct 12 22:31:58.006022 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 195/397] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:57 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:58.348584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:58.349208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:58.359078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.359606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.360059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.362210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.362806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.363429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.643863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:58.656864 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b599ff3b-c029-4f03-b2bd-0ebd396b9728 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.314656 Oct 12 22:31:58.657437 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 203/398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:58 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:31:58.730696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:58.731324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:58.738101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.738593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.739029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.739738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.745049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.758521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.853610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:58.857492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:58.872066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.874494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.874995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.875756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:58.876237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:58.876672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:58.919123 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] HTTP exception thrown: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Request method failure captured: Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f HTTP/1.1 Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BBP3an80YTqqmcBGr_pzRWLX70XaNv_y0bqPpzsx4AFyjKRsh8EtnRyZMDdEirHLTOkFVRQF7128r2wQ9zVWTX--AKf78_IPTa12UlYUKf1q1462cRrmpEj2Bi9XeG_TlgFTJJDHAU64PtgbcJmR77Yrfl6xkxNe55BiWWSf8bwpE Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:31:58.925664 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4d056c78993473094318bd1c6ff182e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}] Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 46089674b2894f9cb105c4c1232421a9 Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:31:58.927199 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a23325c7-98a1-4a12-8917-e3a6c87bf88f'} Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:31:58.928501 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:31:58.929978 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:31:58.938834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Returning 404 to user: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:31:58.940495 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3da07e29-ae73-484a-94de-90f16392fd2d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 404 len: 111 microversion: 2.1 time: 0.094458 Oct 12 22:31:58.960249 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 204/399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:58 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:31:59.035772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:59.036328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:59.046060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.048201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.049035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:59.056533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.057205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.057808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:59.102721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:59.111045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:59.112607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:59.116102 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7273250-60dd-4e42-b740-518d02dc432a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.387129 Oct 12 22:31:59.120356 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 196/400] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:58 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:59.171727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:59.181125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1161602878", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:31:59.183403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:59.187145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:31:59.194083 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cbccef0d-36ad-4271-ab4f-c04b1f8e2739 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1446 microversion: 2.75 time: 0.162976 Oct 12 22:31:59.195445 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 205/401] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:31:59 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:31:59.271727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:31:59.682854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:31:59.683461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:31:59.698437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.701640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.702537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:59.703461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.704214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.707643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:59.714607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:31:59.715268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:31:59.716692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:31:59.717369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:31:59.717984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:31:59.752988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.753456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.753890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:59.758073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:59.764739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:31:59.765278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:31:59.765731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:31:59.792111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=96 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:31:59.810676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Getting quotas for project c4d056c78993473094318bd1c6ff182e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:31:59.841298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Getting quotas for user 46089674b2894f9cb105c4c1232421a9 and project c4d056c78993473094318bd1c6ff182e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:31:59.880912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:31:59.886971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:00.002255 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-418ead7d-21ac-4d10-8073-ca1423197f44 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827471 Oct 12 22:32:00.005184 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 197/402] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:32:00.039045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8f98e0f-bb22-491d-b4c9-3226a8cb035c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:00.039805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8f98e0f-bb22-491d-b4c9-3226a8cb035c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:00.057380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.066049 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1c43f66c-8605-4175-9e47-17525a54b019 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.387419 Oct 12 22:32:00.066645 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 206/403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:31:59 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:00.148362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:00.149229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:00.178890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:00.181580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:00.182142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:00.183315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:00.184007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:00.193046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:00.553406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.570121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.572391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.574633 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a021755e-a0c1-4f21-8f1d-df32181b36b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.431318 Oct 12 22:32:00.589554 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 207/404] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:00 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:00.609219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:00.620374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8f98e0f-bb22-491d-b4c9-3226a8cb035c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.625842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:00.637596 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8f98e0f-bb22-491d-b4c9-3226a8cb035c tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1220 microversion: 2.1 time: 0.625194 Oct 12 22:32:00.640002 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 198/405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:00 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1220 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:00.647119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:00.648265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:00.648979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:00.650415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:00.651354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:00.652166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:00.768481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.788077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.789575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:00.795621 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b230c2f-b923-4ed8-842e-ce485c2f1293 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1452 microversion: 2.75 time: 0.191443 Oct 12 22:32:00.796529 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 208/406] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:00 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:01.095116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:01.096021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:01.102510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.103080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.103568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.104375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.104942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.105438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.110389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:01.280648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.293903 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-915d1641-a635-485d-a699-3a4ca2661ec7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.203029 Oct 12 22:32:01.294699 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 199/407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:01 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:01.434419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:01.450351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6818cdcf-7112-46c2-be37-7d6d991c978e tempest-NetworksTest-1971865094 tempest-NetworksTest-1971865094-project-admin] Calling method '.version_select at 0x7f44ffe66e50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:01.605969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:01.606530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:01.620855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.621518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.624152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.626864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.627661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.628391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.796958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.806187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.808224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.809750 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1f63492-3478-4489-9ec9-b7808eb460f3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.208992 Oct 12 22:32:01.810647 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 200/408] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:01 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:01.821251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:01.824059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:01.832993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.834018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.834604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.835418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.836000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.836498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.934043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:01.954231 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eef4955a-e14e-400b-b77e-3e864f4112c0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1216 microversion: 2.1 time: 0.136889 Oct 12 22:32:01.955621 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 201/409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:01 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:01.968364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:01.969409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:01.983736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.985011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.986175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:01.997047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:01.997933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:01.998665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:02.126263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:02.142165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:02.144275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:02.151417 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c53ddc7-6e44-4673-a554-9c704df77307 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1452 microversion: 2.75 time: 0.193245 Oct 12 22:32:02.152788 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 202/410] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:01 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:02.201423 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6818cdcf-7112-46c2-be37-7d6d991c978e tempest-NetworksTest-1971865094 tempest-NetworksTest-1971865094-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 8142 microversion: 2.1 time: 0.910598 Oct 12 22:32:02.203154 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 209/411] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:01 2022] GET /compute/v2.1/os-networks => generated 8142 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:02.212126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47488a6a-ea12-4933-9dba-85d1f0ffeb74 tempest-NetworksTest-1971865094 tempest-NetworksTest-1971865094-project-admin] Calling method '.version_select at 0x7f45040304c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:02.318455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:02.319396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:02.325854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:02.326690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:02.327338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:02.328287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:02.328950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:02.329614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:02.423323 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47488a6a-ea12-4933-9dba-85d1f0ffeb74 tempest-NetworksTest-1971865094 tempest-NetworksTest-1971865094-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/803390f5-753f-47de-a009-db74d26740a1" status: 200 len: 652 microversion: 2.1 time: 0.214675 Oct 12 22:32:02.424961 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 203/412] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:32:02 2022] GET /compute/v2.1/os-networks/803390f5-753f-47de-a009-db74d26740a1 => generated 652 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:02.434062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-45a5a879-b68e-4192-b3ec-d1dd4d6cc59b tempest-NetworksTest-1971865094 tempest-NetworksTest-1971865094-project-admin] Calling method '.version_select at 0x7f45041065e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:02.664214 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-45a5a879-b68e-4192-b3ec-d1dd4d6cc59b tempest-NetworksTest-1971865094 tempest-NetworksTest-1971865094-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 8142 microversion: 2.1 time: 0.233792 Oct 12 22:32:02.665549 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 204/413] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:02 2022] GET /compute/v2.1/os-networks => generated 8142 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:02.719771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:02.728953 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe32db48-e437-4aa0-bdfb-9b850dbaab64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.414857 Oct 12 22:32:02.734565 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 210/414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:02 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:02.839255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:02.840264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:02.849186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:02.850024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:02.850796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:02.851831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:02.852754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:02.853459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:02.985542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:02.988243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:03.000815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.003028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.004963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.007360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.008077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.009884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.148394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.159264 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a28c6477-71fe-40f5-b099-2f474e4003a3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1272 microversion: 2.1 time: 0.184431 Oct 12 22:32:03.162782 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 211/415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:02 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:03.181093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:03.182037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:03.191100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.204662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.206458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.207436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.208138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.208771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.409836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.410794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.421312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.422774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.424038 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b16dd8a-75b6-4cd1-bbc8-deeb8d77ca87 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.589674 Oct 12 22:32:03.432398 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 205/416] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:02 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:03.432881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.440814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:03.462934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-492b0f0d-0a8b-4e20-b8ae-4cce5a96281a tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1437 microversion: 2.75 time: 0.284822 Oct 12 22:32:03.464632 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 212/417] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:03 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1437 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:03.745737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:03.749637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:03.760922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.762342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.762985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.764083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.765114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.765754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.777744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:03.778471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:03.791146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.791661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.801502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.802817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:03.803449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:03.804697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:03.905893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:03.906559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:03.907203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:03.907770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:03.908611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:04.018359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:04.029098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.029849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.032140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.033247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.033940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.035056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.315623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:04.440437 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f95959d5-00f9-48d5-a2f0-76e0da499263 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2/action" status: 202 len: 1940 microversion: 2.75 time: 0.950674 Oct 12 22:32:04.441748 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 206/418] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:32:03 2022] POST /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2/action => generated 1940 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:32:04.457133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:04.460875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:04.484973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.487728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.488379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.492484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.494274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.495053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.589215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:04.597970 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95950768-d2a3-484a-bd97-ae778125167f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.835250 Oct 12 22:32:04.598563 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 213/419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:03 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:04.603062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:04.603670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:04.616936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:04.631418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.631939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.632381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.633260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.633881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.634507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.638273 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18789f0e-4d8d-4159-914d-064f3df16d3f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1278 microversion: 2.1 time: 0.192151 Oct 12 22:32:04.640342 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 207/420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:04 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:04.654486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:04.655368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:04.671442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.672202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.672805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.677707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:04.678360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:04.678949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:04.935267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:04.987878 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-263a9f7e-333e-479f-8b04-d57ac35fe176 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.340590 Oct 12 22:32:04.988907 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 208/421] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:04 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:05.133765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:05.149461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:05.150994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:05.152213 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-51fa9e8a-4c4c-4f5e-858a-4ff13bed826f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1568 microversion: 2.25 time: 0.552692 Oct 12 22:32:05.155057 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 214/422] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:04 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1568 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:05.620650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:05.621273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:05.631226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:05.631726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:05.632195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:05.632907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:05.633361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:05.633791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:05.670574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:05.671397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:05.676184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=25,nova_cell0:UPDATE=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:05.693329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:05.693851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:05.694293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:05.700832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:05.701418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:05.703241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:05.869560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:05.883770 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92ccee24-82db-41a1-bd3b-6da11de0adc0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1278 microversion: 2.1 time: 0.218468 Oct 12 22:32:05.884627 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 215/423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:05 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:06.020227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:06.020753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:06.045509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.051863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.052341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:06.053076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.053524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.053941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:06.348787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:06.398135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a747128-c95f-458c-a72e-b5e4270a4b76 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.384216 Oct 12 22:32:06.398736 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 216/424] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:06 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:06.403335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:06.411914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:06.417609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=19 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:06.434035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.434875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.435481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:06.436371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.436828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.437248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:06.442608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:06.455131 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58dca886-fff8-407a-9728-f25458f5bff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.837689 Oct 12 22:32:06.458050 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 209/425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:05 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:06.910498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:06.911424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:06.920710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.921602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.922653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:06.924440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:06.926006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:06.926810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.140276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:07.153004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:07.156924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:07.179253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dfda76a6-7e80-4b55-ae2a-adb7b133fdb1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1558 microversion: 2.25 time: 0.761293 Oct 12 22:32:07.196716 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 217/426] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:06 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1558 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:07.221500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0299c24-4ff5-4994-9461-7ef4aaebb8c4 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '.version_select at 0x7f450402ab80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:07.230059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0299c24-4ff5-4994-9461-7ef4aaebb8c4 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:07.235390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0299c24-4ff5-4994-9461-7ef4aaebb8c4 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:07.237981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0299c24-4ff5-4994-9461-7ef4aaebb8c4 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.258671 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0299c24-4ff5-4994-9461-7ef4aaebb8c4 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1343 microversion: 2.25 time: 0.046825 Oct 12 22:32:07.259479 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 218/427] 10.222.0.20 () {60 vars in 1184 bytes} [Wed Oct 12 22:32:07 2022] GET /compute/v2.1/os-migrations => generated 1343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:07.276124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:07.276962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:07.284074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:07.284834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:07.285472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.286372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:07.286993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:07.287594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.527464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:07.549674 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-126d8bcf-43fc-49d8-a5cb-9af1c4167e17 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.645239 Oct 12 22:32:07.559375 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 210/428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:06 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:07.573578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:07.576209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:07.592924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:07.594011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:07.594717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.596364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:07.597221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:07.598018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.632027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:32:07.833018 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0be3c06d-a90f-468d-b4b6-5783db653ac0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 204 len: 0 microversion: 2.1 time: 0.268915 Oct 12 22:32:07.842144 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 211/429] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:07 2022] DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:07.843808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:07.847384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:07.857995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:07.858501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:07.859678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.860848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:07.861123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:07.861556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:07.969820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 379c4c15-434c-4786-9738-63649c335334 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:08.022808 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6cf4195b-2b82-4cdf-9683-39bd92796b6a tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 2051 microversion: 2.25 time: 0.751183 Oct 12 22:32:08.024695 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 219/430] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:07 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 2051 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:08.034855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:08.037212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:08.051691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:08.052595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:08.053258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:08.054185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:08.054839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:08.055464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:08.151005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:08.167148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:08.215456 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-449d1669-9b80-4d3f-817a-d97b771931da tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.378515 Oct 12 22:32:08.218139 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 212/431] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:07 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:08.234664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-610620754", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "1587180701", "adminPass": "***", "networks": [{"uuid": "be016120-0736-46bc-971a-f216e24bcb37"}], "security_groups": [{"name": "tempest-securitygroup--395111797"}], "key_name": "tempest-keypair-1745987402", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:08.569027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:08.580803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc50ddf3-63a2-48de-8eef-e30d45f6fa16 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.550992 Oct 12 22:32:08.583977 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 220/432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:08 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:08.600219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1356874280", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "5db0f38e-eee3-4a98-9554-12cc124c1fa6"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:08.724088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] validate_networks() for [('5db0f38e-eee3-4a98-9554-12cc124c1fa6', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:08.891707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] validate_networks() for [('be016120-0736-46bc-971a-f216e24bcb37', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:09.777247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:09.808346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:09.808882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:09.809556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:09.810070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:09.810594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:09.830628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:09.831306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:09.831869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:09.833442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:09.837498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:09.838284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:09.885771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:09.905974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for user 03a180537b9149b1bf4250bc9965bb7b and project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:09.926111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:09.930470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:10.015504 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f7db6ec-e090-400e-9cae-e2215640b7d4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.428077 Oct 12 22:32:10.016388 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 221/433] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:32:10.021421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:10.022833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:10.042738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:10.043465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:10.044317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:10.045203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:10.045805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:10.046366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:10.632945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=41,nova_cell0:UPDATE=7 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:10.913737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:10.934433 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e61f5a3-7177-47f1-b7d2-0378f5ef1522 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.911530 Oct 12 22:32:10.941122 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 222/434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:10 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:10.972372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-afc11a7b-9417-4495-9b99-4b0664827637 req-449b8c2e-41ec-4194-a9ff-0e5beeeba8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d0e2e2-8bf7-47d7-99b9-c45da17cf378", "tag": "8c40c9bb-024f-4382-973f-3b6aa11e2aa9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:11.000029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-afc11a7b-9417-4495-9b99-4b0664827637 req-449b8c2e-41ec-4194-a9ff-0e5beeeba8fb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.000521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-afc11a7b-9417-4495-9b99-4b0664827637 req-449b8c2e-41ec-4194-a9ff-0e5beeeba8fb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.000951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-afc11a7b-9417-4495-9b99-4b0664827637 req-449b8c2e-41ec-4194-a9ff-0e5beeeba8fb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.024235 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-afc11a7b-9417-4495-9b99-4b0664827637 req-449b8c2e-41ec-4194-a9ff-0e5beeeba8fb service nova] Creating event network-changed:8c40c9bb-024f-4382-973f-3b6aa11e2aa9 for instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 on n-h2-860864-8 Oct 12 22:32:11.033851 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-afc11a7b-9417-4495-9b99-4b0664827637 req-449b8c2e-41ec-4194-a9ff-0e5beeeba8fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087164 Oct 12 22:32:11.036660 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 223/435] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:11.050353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:11.051067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:11.062917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.063415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.068483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.069308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.069793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.070237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.479572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:11.540646 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8d7d6b40-ecff-488c-bf10-86fd6d41e160 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.502345 Oct 12 22:32:11.541584 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 224/436] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:11 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:11.556972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:11.560653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:11.574823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:11.575664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.576260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:11.577765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:11.578393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:11.578656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.579187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.579522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:11.579845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.580335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.580764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.605272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:11.607952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.608696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.609342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.610290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.611487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.612573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.658398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Getting quotas for project 73a41ac7523f4592ae88851113a895ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:11.674301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Getting quotas for user d9dd6cd5ae4f432b8afc184210820c10 and project 73a41ac7523f4592ae88851113a895ce. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:11.709075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:11.717451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:11.815356 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb78686c-ca03-4ca3-8fe1-75b639de3ad8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.593103 Oct 12 22:32:11.816071 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 213/437] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 3597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:32:11.843328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:11.843797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:11.852122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.852620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.853056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:11.853761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:11.862753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:11.863236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.085855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:12.109865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:12.114981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:12.119576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-182fb2b9-8915-4b47-b6dd-22c48d751ef4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1314 microversion: 2.25 time: 0.291404 Oct 12 22:32:12.142156 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 214/438] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:11 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:12.264859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:12.292566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b98bf18-c513-4a0b-bd78-985b4ecea439 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.749192 Oct 12 22:32:12.309773 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 225/439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:11 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:12.327095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96797b50-9169-4f38-a92f-11a3521913e2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:12.328003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96797b50-9169-4f38-a92f-11a3521913e2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:12.333400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffeced30>, body: {"quota_set": {"ram": "5120"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:12.434284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.434809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.435236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.435976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.436496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.436917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.569049 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-acb1f05d-edfa-47c8-9a13-e3292ca4c270 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182" status: 200 len: 148 microversion: 2.57 time: 0.425241 Oct 12 22:32:12.570456 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 215/440] 10.222.0.20 () {62 vars in 1303 bytes} [Wed Oct 12 22:32:12 2022] PUT /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182 => generated 148 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:12.575650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:12.576620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:12.584725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.585511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.586485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.587937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.593185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.594471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.622645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96797b50-9169-4f38-a92f-11a3521913e2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:12.631781 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96797b50-9169-4f38-a92f-11a3521913e2 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1264 microversion: 2.1 time: 0.319770 Oct 12 22:32:12.633924 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 226/441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:12 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1264 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:12.646066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:12.649472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:12.664298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.666897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.667435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.668303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:12.670259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:12.670788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:12.990336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:13.030439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-60fb8e33-8aee-4bd5-8117-c65f6038a26b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.392060 Oct 12 22:32:13.031445 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 227/442] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:12 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:13.036247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Calling method '.version_select at 0x7f44fff79280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:13.146219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.148894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.151987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.153104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.156884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.158301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.227836 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e4d2614-d3de-4513-bd5a-75008366fc91 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182/detail" status: 200 len: 463 microversion: 2.57 time: 0.194930 Oct 12 22:32:13.228500 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 228/443] 10.222.0.20 () {60 vars in 1304 bytes} [Wed Oct 12 22:32:13 2022] GET /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182/detail => generated 463 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:13.238047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:13.238047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:13.253981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.254467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.254899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.255777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.256270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.268245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.311300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:13.321283 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a0bd5b57-f85e-4734-9d2e-aa7394e1b406 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.749547 Oct 12 22:32:13.325147 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 216/444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:12 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:13.341888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:13.342838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:13.382614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.383184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.383758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.388684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.389450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.390207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.639970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:13.653278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:13.661428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:13.664819 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1db59d96-9db8-4f9e-82f1-9ad8861f0fc2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1320 microversion: 2.25 time: 0.433499 Oct 12 22:32:13.665935 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 229/445] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:13 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:13.675396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffe19f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:13.809412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.810118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.810799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.811738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.813107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.814119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.888081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.888559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.888992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.891393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:13.893519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:13.895016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:13.999261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24706b3e-d9e6-40b4-aae9-8d43affc6005 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182?user_id=3b51b4c7f30e4ab89c262ca8b190117c" status: 200 len: 148 microversion: 2.57 time: 0.329707 Oct 12 22:32:14.000570 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 230/446] 10.222.0.20 () {62 vars in 1384 bytes} [Wed Oct 12 22:32:13 2022] PUT /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182?user_id=3b51b4c7f30e4ab89c262ca8b190117c => generated 148 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:14.011189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:14.025931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:14.036774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.037266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.037702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.038415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.038868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.039290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.255810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:14.268221 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4c8d380-aae9-4bf1-b340-ef00eaaec14d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1334 microversion: 2.1 time: 0.265677 Oct 12 22:32:14.269086 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 231/447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:14 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1334 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:14.279007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a1d0320-e6a4-4287-ab50-6d9618a0c041 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] Calling method '.version_select at 0x7f44ffe62430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:14.324691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:14.337610 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e71deba-ebce-4b52-9d78-1a947c7ba1bb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 1.011151 Oct 12 22:32:14.338711 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 217/448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:13 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:14.348454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:14.352120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:14.366285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.366781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.367215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.367937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.368546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.369110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.406683 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a1d0320-e6a4-4287-ab50-6d9618a0c041 tempest-QuotasAdminTestV257-1567228935 tempest-QuotasAdminTestV257-1567228935-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182?user_id=3b51b4c7f30e4ab89c262ca8b190117c" status: 200 len: 190 microversion: 2.57 time: 0.133560 Oct 12 22:32:14.407810 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 232/449] 10.222.0.20 () {60 vars in 1364 bytes} [Wed Oct 12 22:32:14 2022] GET /compute/v2.1/os-quota-sets/928b56e1aa2a4adaa58f61820f939182?user_id=3b51b4c7f30e4ab89c262ca8b190117c => generated 190 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:14.457916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:14.461328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:14.497652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.499453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.502398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.509331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.510154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.512187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.570526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:14.615490 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ee74c68-2b90-485a-9c98-78d6b03e2dc2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.275448 Oct 12 22:32:14.616100 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 218/450] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:14 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:14.650132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e2418ba0-cce1-44ed-a5b1-4de0ee0a8291 req-0bc37b1b-7ba4-4c75-860d-02046e9f61ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b2d603-856b-432d-9eb5-80f56b1f1b66", "name": "network-vif-deleted", "tag": "832d6d08-7a12-4545-8d9d-0a1673f1aa52"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:14.667079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:14.669351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e2418ba0-cce1-44ed-a5b1-4de0ee0a8291 req-0bc37b1b-7ba4-4c75-860d-02046e9f61ff service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.670003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e2418ba0-cce1-44ed-a5b1-4de0ee0a8291 req-0bc37b1b-7ba4-4c75-860d-02046e9f61ff service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.670587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e2418ba0-cce1-44ed-a5b1-4de0ee0a8291 req-0bc37b1b-7ba4-4c75-860d-02046e9f61ff service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.694154 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e2418ba0-cce1-44ed-a5b1-4de0ee0a8291 req-0bc37b1b-7ba4-4c75-860d-02046e9f61ff service nova] Creating event network-vif-deleted:832d6d08-7a12-4545-8d9d-0a1673f1aa52 for instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 on n-h1-860864-8 Oct 12 22:32:14.708587 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e2418ba0-cce1-44ed-a5b1-4de0ee0a8291 req-0bc37b1b-7ba4-4c75-860d-02046e9f61ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069816 Oct 12 22:32:14.712620 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 219/451] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:14.725329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:14.727233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:14.748747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.749237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.749671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:14.750382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:14.758309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:14.759108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.045272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:15.056447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:15.059840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:15.065316 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d15a34c4-037b-48f8-a3e5-2ff31139d517 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1320 microversion: 2.25 time: 0.351083 Oct 12 22:32:15.066066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 220/452] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:14 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:15.202789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:15.216190 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b9d789a-c928-4d66-8489-9615b127afa4 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.807098 Oct 12 22:32:15.216817 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 233/453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:14 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:15.297721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:15.298407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:15.308577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.309159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.309595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.316824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.317473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.318722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.366976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:15.367646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:15.379663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.381683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.382129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.383642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.384384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.386151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.588456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:15.597450 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-453d3e37-1ed8-427f-82f3-8659baf149a0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1322 microversion: 2.1 time: 0.304852 Oct 12 22:32:15.616626 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 221/454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:15 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:15.651659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:15.652518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:15.664432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.666550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.668709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.669451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:15.669913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:15.670347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:15.776610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:15.785676 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b5f2a29-9845-44d7-9277-ee2ec2a71a94 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.426207 Oct 12 22:32:15.786267 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 234/455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:15 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:15.998596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:16.033147 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6b9fecc-21f2-4353-9d9c-89a580f62b4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.385087 Oct 12 22:32:16.033931 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 222/456] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:15 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:16.105181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:16.105491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:16.123544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.124093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.124604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.131949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.132764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.133389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.244193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:16.244843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:16.258424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.268716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.269416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.270317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.272886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.273523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.570928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.580855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.584041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.585665 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab149679-f0b9-44f8-b523-fd7811ed8ee5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 0.493698 Oct 12 22:32:16.586959 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 235/457] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:16 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:16.640469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:16.642204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:16.658106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.658710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.659716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.663199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.665049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.667368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.858838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.871573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:16.885709 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79b7de63-b82f-49c2-bdda-e95d551b738f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.645282 Oct 12 22:32:16.886308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 223/458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:16 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:16.892316 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-815bc800-685e-460e-b3d9-66c51e4e2db0 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1322 microversion: 2.1 time: 0.248772 Oct 12 22:32:16.893114 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 236/459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:16 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:16.906037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:16.906822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:16.930494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.930983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.931416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:16.932490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:16.932940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:16.933387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.143073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74368a2e-5b04-4b97-9c7c-ca1fc2a5188c tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Calling method '.version_select at 0x7f44ffe19ca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:17.225128 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74368a2e-5b04-4b97-9c7c-ca1fc2a5188c tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.330814 Oct 12 22:32:17.225865 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 237/460] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 22:32:16 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:32:17.241549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e5a23324-d520-4d2f-80d2-bf902b2ed53c req-b4a19afa-3dbe-497f-9936-aeb4eb720dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "95bae054-475a-40d0-aca7-9f2771d8157a"}, {"name": "network-changed", "server_uuid": "abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6", "tag": "95bae054-475a-40d0-aca7-9f2771d8157a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:17.269956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e5a23324-d520-4d2f-80d2-bf902b2ed53c req-b4a19afa-3dbe-497f-9936-aeb4eb720dac service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.270443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e5a23324-d520-4d2f-80d2-bf902b2ed53c req-b4a19afa-3dbe-497f-9936-aeb4eb720dac service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.270871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e5a23324-d520-4d2f-80d2-bf902b2ed53c req-b4a19afa-3dbe-497f-9936-aeb4eb720dac service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.302116 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e5a23324-d520-4d2f-80d2-bf902b2ed53c req-b4a19afa-3dbe-497f-9936-aeb4eb720dac service nova] Creating event network-vif-unplugged:95bae054-475a-40d0-aca7-9f2771d8157a for instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 on n-h1-860864-8 Oct 12 22:32:17.303452 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e5a23324-d520-4d2f-80d2-bf902b2ed53c req-b4a19afa-3dbe-497f-9936-aeb4eb720dac service nova] Creating event network-changed:95bae054-475a-40d0-aca7-9f2771d8157a for instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 on n-h1-860864-8 Oct 12 22:32:17.315155 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e5a23324-d520-4d2f-80d2-bf902b2ed53c req-b4a19afa-3dbe-497f-9936-aeb4eb720dac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.078737 Oct 12 22:32:17.318310 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 238/461] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:17.342793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:17.347124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:17.364721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.367664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.370311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.372139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.378906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.381203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.449083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:17.465109 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-045b872e-99ba-4657-87fd-7ba4a6a23903 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.576779 Oct 12 22:32:17.465913 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 224/462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:16 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:17.476866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e567930c-4567-45e7-b309-28ecef95b98c tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Action: 'create', calling method: .version_select at 0x7f450416b4c0>, body: {"pool": "non_exist_pool"} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:17.597576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-e567930c-4567-45e7-b309-28ecef95b98c tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] HTTP exception thrown: Floating IP pool not found. Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e567930c-4567-45e7-b309-28ecef95b98c tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Request method failure captured: Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 26 Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0BwX0zVLn60GMVvmpJmg6IkASZ_tNWFZUga0esf8OQ4Ozqk1TbgsTqKcd2_HjnZ9XddCSEFoZvQFLgP5RMv6qpEdrw2XcY-lhL437Zv7xXsIp1QeRWTQh8G9LzcSyJRg-OIoNLwgbfOnplU3jbSEQQBgJEKnoLAPIWMdW1Or6reQ34 Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d651bc9e28834766a4948dc3f8eff495 Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-943451880 Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:32:17.603765 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d651bc9e28834766a4948dc3f8eff495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d651bc9e28834766a4948dc3f8eff495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d651bc9e28834766a4948dc3f8eff495"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d651bc9e28834766a4948dc3f8eff495"}]}] Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-943451880 Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d651bc9e28834766a4948dc3f8eff495 Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-943451880 Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FloatingIPsNegativeTestJSON-943451880-project Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7101a1cd9d1841e3bd41eea9a5dd105e Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-943451880-project Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: {"pool": "non_exist_pool"} Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: exception: Floating IP pool not found. Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 12 22:32:17.605334 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:17.606371 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 12 22:32:17.607675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.609652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e567930c-4567-45e7-b309-28ecef95b98c tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Returning 404 to user: Floating IP pool not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:17.611278 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e567930c-4567-45e7-b309-28ecef95b98c tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.139890 Oct 12 22:32:17.612199 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 225/463] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:32:17 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:32:17.626780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:17.627612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:17.651066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.652177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.653036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.654147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.654815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.656005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.761176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:17.807665 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8fd67d01-db0b-45ac-ae36-8d8da4003576 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.488074 Oct 12 22:32:17.810996 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 239/464] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:17 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:17.818487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff05b6a9-da99-4a18-aa00-fedb30fc4251 tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Calling method '.version_select at 0x7f44ffe19940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:17.890680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-ff05b6a9-da99-4a18-aa00-fedb30fc4251 tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5590675e-63e7-4325-96a6-b0dfd8163d09 could not be found", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:32:17.891666 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ff05b6a9-da99-4a18-aa00-fedb30fc4251 tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] HTTP exception thrown: Floating IP not found for ID 5590675e-63e7-4325-96a6-b0dfd8163d09 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff05b6a9-da99-4a18-aa00-fedb30fc4251 tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Request method failure captured: Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-floating-ips/5590675e-63e7-4325-96a6-b0dfd8163d09 HTTP/1.1 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BwX0zVLn60GMVvmpJmg6IkASZ_tNWFZUga0esf8OQ4Ozqk1TbgsTqKcd2_HjnZ9XddCSEFoZvQFLgP5RMv6qpEdrw2XcY-lhL437Zv7xXsIp1QeRWTQh8G9LzcSyJRg-OIoNLwgbfOnplU3jbSEQQBgJEKnoLAPIWMdW1Or6reQ34 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d651bc9e28834766a4948dc3f8eff495 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-943451880 Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:17.912707 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d651bc9e28834766a4948dc3f8eff495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d651bc9e28834766a4948dc3f8eff495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d651bc9e28834766a4948dc3f8eff495"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d651bc9e28834766a4948dc3f8eff495"}]}] Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-943451880 Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d651bc9e28834766a4948dc3f8eff495 Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-943451880 Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsNegativeTestJSON-943451880-project Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7101a1cd9d1841e3bd41eea9a5dd105e Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-943451880-project Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: exception: Floating IP not found for ID 5590675e-63e7-4325-96a6-b0dfd8163d09 Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '5590675e-63e7-4325-96a6-b0dfd8163d09'} Oct 12 22:32:17.914075 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:32:17.914808 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5590675e-63e7-4325-96a6-b0dfd8163d09 could not be found Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-544cdb3e-9350-4666-ae40-afc4aa88c1b8'] Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5590675e-63e7-4325-96a6-b0dfd8163d09. Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:17.918174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5590675e-63e7-4325-96a6-b0dfd8163d09 Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:17.920191 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:17.922255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5590675e-63e7-4325-96a6-b0dfd8163d09 Oct 12 22:32:17.922255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:17.924999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff05b6a9-da99-4a18-aa00-fedb30fc4251 tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] Returning 404 to user: Floating IP not found for ID 5590675e-63e7-4325-96a6-b0dfd8163d09 {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:17.926176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff05b6a9-da99-4a18-aa00-fedb30fc4251 tempest-FloatingIPsNegativeTestJSON-943451880 tempest-FloatingIPsNegativeTestJSON-943451880-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/5590675e-63e7-4325-96a6-b0dfd8163d09" status: 404 len: 111 microversion: 2.1 time: 0.114007 Oct 12 22:32:17.927323 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 240/465] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:32:17 2022] DELETE /compute/v2.1/os-floating-ips/5590675e-63e7-4325-96a6-b0dfd8163d09 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:17.932558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:17.933884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:17.942716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.943509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.945124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:17.946266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:17.947694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:17.948547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.360907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:18.369889 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac4624e9-2c2b-45ac-9509-5b6e0269353b tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.440769 Oct 12 22:32:18.384443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 241/466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:17 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:18.391016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:18.392673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:18.400946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.401739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.402401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.403339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.404054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.404727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.762093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:18.774067 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6610a45-a9ce-4dab-a84f-9d81128e4373 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.388062 Oct 12 22:32:18.785225 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 242/467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:18 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:18.799476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:18.801961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:18.817255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.818380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.820926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:18.821866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:18.823214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:18.823816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:19.134437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.161629 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a084deed-dec4-449f-96d1-b4e4fbe1d1f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.374681 Oct 12 22:32:19.167172 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 243/468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:18 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:19.193650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:19.196436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:19.211329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:19.215694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:19.216200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:19.216925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:19.218475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:19.220067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:19.220797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:19.338900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.355666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.360258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.362350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c70e8089-381e-44e3-a523-0d7b440f1593 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 1.748097 Oct 12 22:32:19.363847 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 226/469] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:17 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:19.387159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:19.395367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:19.396590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:19.403105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:19.403594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:19.404054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:19.404749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:19.405197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:19.405611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:19.426321 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b04fa80c-085e-4150-a3ed-fb6df36644a2 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.256798 Oct 12 22:32:19.437546 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 244/470] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:19 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:19.804171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:19.804171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:19.809631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:19.810387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:19.811192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:19.812412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:19.813636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:19.814249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:19.921905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:19.931431 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c69e3c3-12aa-489d-a78a-388813d028b4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.540473 Oct 12 22:32:19.952237 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 227/471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:19 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:20.004644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:20.014663 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22e451d6-68e6-402d-8231-6a5bb7039785 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.217081 Oct 12 22:32:20.029450 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 245/472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:19 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:20.189585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:20.190703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:20.202423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.203408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.204843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.206510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.207210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.208247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.390348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:20.391923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:20.399666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.400367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.400957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.401665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.402325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.402954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.428796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:20.606783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:20.620441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:20.621988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:20.623104 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a041b1a-81d4-40bd-a2d3-e31ff8e60134 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 0.236731 Oct 12 22:32:20.623819 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 246/473] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:20 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:20.629097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:20.629927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:20.636335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.637487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.638459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.639367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.640600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.641768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.746245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:20.768010 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc8dde9d-52d8-4b7a-8849-031aa6acddc8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.142819 Oct 12 22:32:20.769296 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 247/474] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:20 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:20.775629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2dda33cb-b65d-460c-8b28-79139e08afbe req-12a253fd-2302-4675-84b9-25a8a83e365e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d0e2e2-8bf7-47d7-99b9-c45da17cf378", "name": "network-vif-plugged", "status": "completed", "tag": "8c40c9bb-024f-4382-973f-3b6aa11e2aa9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:20.787370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2dda33cb-b65d-460c-8b28-79139e08afbe req-12a253fd-2302-4675-84b9-25a8a83e365e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.788175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2dda33cb-b65d-460c-8b28-79139e08afbe req-12a253fd-2302-4675-84b9-25a8a83e365e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.788811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2dda33cb-b65d-460c-8b28-79139e08afbe req-12a253fd-2302-4675-84b9-25a8a83e365e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.801745 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2dda33cb-b65d-460c-8b28-79139e08afbe req-12a253fd-2302-4675-84b9-25a8a83e365e service nova] Creating event network-vif-plugged:8c40c9bb-024f-4382-973f-3b6aa11e2aa9 for instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 on n-h2-860864-8 Oct 12 22:32:20.809000 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2dda33cb-b65d-460c-8b28-79139e08afbe req-12a253fd-2302-4675-84b9-25a8a83e365e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037580 Oct 12 22:32:20.812821 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 248/475] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:20.964222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:20.965567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:20.980994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.982425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.983549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:20.984506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:20.985351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:20.986333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.168655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.178258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4c0c645-ae87-4f04-8525-ec25ce94ba6a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.224129 Oct 12 22:32:21.179058 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 249/476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:20 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:21.183966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:21.184195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:21.190545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.191021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.191455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.192365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.192602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.193021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.265046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.272983 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18988e20-9bad-46a2-81a5-8addec6e26e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 1.087691 Oct 12 22:32:21.273898 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 228/477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:20 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:21.382916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.404934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f9fbff0c-7754-433e-814d-188cd2340715 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1320 microversion: 2.1 time: 0.214988 Oct 12 22:32:21.407559 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 250/478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:21 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:21.421887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a39d0f3f-63c4-4e50-a97d-d04bd3b29d6a req-afdacc02-9af7-446c-9335-39b037a15c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c3fadd-3c92-4818-b641-8799d43ed387", "tag": "08d5fd64-1e78-4647-b7f5-b975906b2fcb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:21.437335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a39d0f3f-63c4-4e50-a97d-d04bd3b29d6a req-afdacc02-9af7-446c-9335-39b037a15c64 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.438732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a39d0f3f-63c4-4e50-a97d-d04bd3b29d6a req-afdacc02-9af7-446c-9335-39b037a15c64 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.439445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a39d0f3f-63c4-4e50-a97d-d04bd3b29d6a req-afdacc02-9af7-446c-9335-39b037a15c64 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.456419 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a39d0f3f-63c4-4e50-a97d-d04bd3b29d6a req-afdacc02-9af7-446c-9335-39b037a15c64 service nova] Creating event network-changed:08d5fd64-1e78-4647-b7f5-b975906b2fcb for instance 04c3fadd-3c92-4818-b641-8799d43ed387 on n-h1-860864-8 Oct 12 22:32:21.462216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a39d0f3f-63c4-4e50-a97d-d04bd3b29d6a req-afdacc02-9af7-446c-9335-39b037a15c64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052246 Oct 12 22:32:21.463273 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 251/479] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:21.494110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1442516131", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:21.553495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:21.651355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:21.652698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:21.661390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.661539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.662947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.666538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.667039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.668119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.892669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.901661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.903274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:21.904797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62fd8586-f3a5-413e-8ee5-d3699712e9f6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 0.257950 Oct 12 22:32:21.916039 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 252/480] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:21 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:21.916039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:21.916039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:21.921959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.923105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.923680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:21.924409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:21.925014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:21.925442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.240290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:22.259820 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46963bde-587b-46d7-bca3-0b4d57723d9e tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.352709 Oct 12 22:32:22.260829 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 253/481] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:21 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:22.272846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:22.273461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:22.283296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.284135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.284569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.285322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.285898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.286365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.441468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:22.449735 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7529a801-415d-4b95-b3af-789e9c66994f tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.180688 Oct 12 22:32:22.450306 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 254/482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:22 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:22.454912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:22.470476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:22.471093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:22.477089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:22.477304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.477758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.477921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:22.478307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.478546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:22.478952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:22.479352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:22.479651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.480125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.480920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.489453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.489855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.490468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.491294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.491765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.492383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.509536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Getting quotas for project aa1830ddea9a4dd9affc6b62a2bfdf1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:22.515379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Getting quotas for user ca520967e5914fe7b5e982f0bbbb9847 and project aa1830ddea9a4dd9affc6b62a2bfdf1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:22.530797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:22.534172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:22.580449 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90652fb0-f40a-496f-9d60-1c27047cb429 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305254 Oct 12 22:32:22.581762 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 229/483] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:32:22.596823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:22.597694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:22.605808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.606607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.607813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.608964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:22.609590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:22.610215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:22.691418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:22.702670 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ee15663b-7118-4d9a-bbe9-2d51ed5f7e03 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.237640 Oct 12 22:32:22.720170 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 255/484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:22 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:22.736567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1107796485", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:22.823262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:23.209026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:23.209681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:23.209850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:23.210252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:23.210657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:23.224682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.225165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.225587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.226305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.226759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.227172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.261478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Getting quotas for project aa1830ddea9a4dd9affc6b62a2bfdf1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:23.270216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Getting quotas for user ca520967e5914fe7b5e982f0bbbb9847 and project aa1830ddea9a4dd9affc6b62a2bfdf1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:23.307845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:23.310205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:23.367197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.379060 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9cd217e9-d6ee-44e0-8a23-3eabba613486 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657309 Oct 12 22:32:23.379921 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 256/485] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:32:23.380969 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b4d0190-0831-4acb-ad58-c883f99d7817 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1470 microversion: 2.1 time: 0.795184 Oct 12 22:32:23.385479 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 230/486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:22 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1470 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:23.395112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:23.396884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:23.402725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:23.406440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:23.413327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.416905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.417167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.417908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.418583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.419813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.433009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.435395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.436199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.439019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.440025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.441274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.582657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:23.623116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58ec2a22-e76f-447c-b42b-e9516ac23e80 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.235931 Oct 12 22:32:23.623885 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 231/487] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:23 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:23.631064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38e07e8b-584b-48b4-8bb3-5b562fa14478 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:23.631677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38e07e8b-584b-48b4-8bb3-5b562fa14478 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:23.697068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.710193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.711728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.716257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-939ddc64-c22c-459b-b58e-eea2ce79b4d3 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 0.333597 Oct 12 22:32:23.716931 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 257/488] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:23 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:23.729123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:23.734094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:23.747436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.751113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.751671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.752518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.753068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.753587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.894617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-38e07e8b-584b-48b4-8bb3-5b562fa14478 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:23.901813 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38e07e8b-584b-48b4-8bb3-5b562fa14478 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1214 microversion: 2.1 time: 0.274509 Oct 12 22:32:23.905572 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 232/489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:23 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:23.910970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:23.911585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:23.934699 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b3716b2-ef27-4d9a-ac24-31fa651cb597 tempest-DeleteServersAdminTestJSON-991000389 tempest-DeleteServersAdminTestJSON-991000389-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378/action" status: 202 len: 0 microversion: 2.1 time: 0.213788 Oct 12 22:32:23.936557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.938350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.939028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.942416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:23.943072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:23.945720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:23.945852 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 258/490] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:32:23 2022] POST /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:23.954728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:23.958264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-96b66084-104e-40f4-9ece-1713df7b577c req-41be4449-1845-4c12-94fe-06a67f3a73be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b01c019-d599-40ea-8038-0f768d2868ae", "tag": "a072eeb6-744d-42c6-bd66-020b75653f91"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:23.999812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96b66084-104e-40f4-9ece-1713df7b577c req-41be4449-1845-4c12-94fe-06a67f3a73be service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.001922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96b66084-104e-40f4-9ece-1713df7b577c req-41be4449-1845-4c12-94fe-06a67f3a73be service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.002380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96b66084-104e-40f4-9ece-1713df7b577c req-41be4449-1845-4c12-94fe-06a67f3a73be service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.020833 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-96b66084-104e-40f4-9ece-1713df7b577c req-41be4449-1845-4c12-94fe-06a67f3a73be service nova] Creating event network-changed:a072eeb6-744d-42c6-bd66-020b75653f91 for instance 2b01c019-d599-40ea-8038-0f768d2868ae on n-h1-860864-8 Oct 12 22:32:24.027783 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-96b66084-104e-40f4-9ece-1713df7b577c req-41be4449-1845-4c12-94fe-06a67f3a73be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079987 Oct 12 22:32:24.028511 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 259/491] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:24.034815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:24.035527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:24.043386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.043986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.044638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.045194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.045652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.046071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.423708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:24.432710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90c1b811-bbd4-49fd-8dca-483624015bc8 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.525872 Oct 12 22:32:24.436183 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 233/492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:23 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:24.454930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:24.458037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:24.466617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.467204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.467793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.483878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.486873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.489674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.552596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.553620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.555220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.556966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lazy-loading 'fault' on Instance uuid 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:24.594768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:24.606756 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0d0a495d-5d3d-42cf-9840-28e87cc847b9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.577046 Oct 12 22:32:24.629044 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 260/493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:24 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:24.654397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:24.655548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:24.663799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.664762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.666008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:24.667154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:24.667840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:24.668500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.056523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:25.103134 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-647cde21-a84f-4297-9166-791d195fe8db tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.453580 Oct 12 22:32:25.106687 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 261/494] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:24 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:32:25.112111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:25.120237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:25.135077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.135668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.136489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.146285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.147013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.147711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.368525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.378910 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5432783f-668a-4090-8603-e2ba18c6e305 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1453 microversion: 2.1 time: 0.941455 Oct 12 22:32:25.381408 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 234/495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:24 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1453 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:25.394738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:25.399419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:25.418248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.420747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.426864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.428959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.430776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.432157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.433202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.447126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.449570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.451100 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5bf7a487-42ab-42e8-b15e-a9b03eb615d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 0.343262 Oct 12 22:32:25.460432 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 262/496] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:25 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:25.472895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:25.473918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:25.493251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.497432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.498125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.499412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.500134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.500878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.506214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:25.573491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:32:25.737779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6224f491-a0bb-4c79-a39a-d919062d2c6f tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 204 len: 0 microversion: 2.1 time: 0.275275 Oct 12 22:32:25.739826 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 263/497] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:25 2022] DELETE /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:25.747717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:25.748803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:25.773763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.775340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.776057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.776987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.777634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.778273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.811139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:25.821147 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f362731f-6899-4df9-ad8f-2d4f727ea385 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1266 microversion: 2.1 time: 0.431817 Oct 12 22:32:25.822060 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 235/498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:25 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1266 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:25.827099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:25.827701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:25.847810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.850803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.851856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:25.852962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:25.853729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:25.854302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.311167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.348849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.351561 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57c42ea0-fc5d-4c7c-9f23-a330945bb4cf tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.610179 Oct 12 22:32:26.356716 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 264/499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:25 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:26.358324 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3ddbaa0-d315-4e89-8582-c9665c39fd3f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.535050 Oct 12 22:32:26.364530 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 236/500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:25 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:26.367445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:26.369417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:26.370368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:26.377623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:26.384487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.384966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.392338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.393262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.394048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.394636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.404952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.405589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.406643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.413745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.414313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.416448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.543185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.548215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.548746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.550110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lazy-loading 'fault' on Instance uuid 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:26.584486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:26.606637 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7c17b47-7d7d-4cc3-8dbb-fb50c55cda78 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.240742 Oct 12 22:32:26.613901 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 237/501] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:26 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:26.629469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:26.630441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:26.643111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.643935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.644826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.646071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.647248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.647981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.790945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.801408 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be633e7e-7080-4bcf-b0f6-0ba5fe5b5b5d tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1459 microversion: 2.1 time: 0.442154 Oct 12 22:32:26.822635 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 265/502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:26 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1459 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:26.851252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:26.853281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:26.865662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.866639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.867227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.868475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:26.869133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:26.869739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:26.973243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.982682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.993563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:26.994708 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1d2bdee-cc2a-4c41-bd45-929f3eed217f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 0.378008 Oct 12 22:32:26.995255 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 238/503] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:26 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:27.341489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-68cc412e-9cfa-4aa3-808e-44ae2d498caa req-b122ff71-5150-441f-a76a-e0b99fa470ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c3fadd-3c92-4818-b641-8799d43ed387", "name": "network-vif-plugged", "status": "completed", "tag": "08d5fd64-1e78-4647-b7f5-b975906b2fcb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:27.356962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68cc412e-9cfa-4aa3-808e-44ae2d498caa req-b122ff71-5150-441f-a76a-e0b99fa470ee service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:27.364778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68cc412e-9cfa-4aa3-808e-44ae2d498caa req-b122ff71-5150-441f-a76a-e0b99fa470ee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:27.367305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68cc412e-9cfa-4aa3-808e-44ae2d498caa req-b122ff71-5150-441f-a76a-e0b99fa470ee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:27.374178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:27.395799 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-292e4061-e45c-40c7-b1f9-22108a46a729 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1274 microversion: 2.1 time: 0.537753 Oct 12 22:32:27.407916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 266/504] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:26 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1274 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:27.408177 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-68cc412e-9cfa-4aa3-808e-44ae2d498caa req-b122ff71-5150-441f-a76a-e0b99fa470ee service nova] Creating event network-vif-plugged:08d5fd64-1e78-4647-b7f5-b975906b2fcb for instance 04c3fadd-3c92-4818-b641-8799d43ed387 on n-h1-860864-8 Oct 12 22:32:27.411367 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-68cc412e-9cfa-4aa3-808e-44ae2d498caa req-b122ff71-5150-441f-a76a-e0b99fa470ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073349 Oct 12 22:32:27.412614 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 239/505] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:32:27.412961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:27.413778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:27.425733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:27.428502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:27.436984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:27.438595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:27.439183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:27.439719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:27.449287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:27.450146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:27.479994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:27.496449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:27.497773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:27.502783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:27.504988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:27.506806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.004385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.014047 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42fbb350-b02c-474c-91bf-e081d7765134 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.613417 Oct 12 22:32:28.017831 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 267/506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:27 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:28.023128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:28.025079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:28.036887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.041763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.042759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.044538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.046479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.048300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.194751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.211223 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd1e4a61-9f02-462a-948f-dc8db2022fb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.796358 Oct 12 22:32:28.212354 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 240/507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:27 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:28.222900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:28.224592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:28.263716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.265043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.266186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.268264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.271602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.273445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.285525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:28.325555 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81c041d3-48b7-44cb-a512-c768f03d8e73 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.305022 Oct 12 22:32:28.325665 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 268/508] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:28 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:28.335638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:28.336626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:28.344874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.346514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.347130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.348095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lazy-loading 'fault' on Instance uuid 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:28.351523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.352186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.353007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.354048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.354793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.355808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.728760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.749034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.751951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.753296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1688bc2b-96e2-4fcd-989a-464c1d468c1b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1362 microversion: 2.25 time: 0.426412 Oct 12 22:32:28.767927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 269/509] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:28 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:28.778777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:28.779374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:28.789605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.804323 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3f7c5ee-35e2-4bd3-bae5-09de9d951b0e tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1459 microversion: 2.1 time: 0.589290 Oct 12 22:32:28.805757 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 241/510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:28 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1459 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:28.807945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.808441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.808876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.809949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:28.810415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:28.810838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:28.945994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:28.959119 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0fb74b59-529f-4da2-a368-c1c1d60faaf8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1272 microversion: 2.1 time: 0.203416 Oct 12 22:32:28.962792 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 270/511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:28 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:29.045787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:29.046445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:29.062731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.063788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.068298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.069330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.070012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.071293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.244067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:29.245526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:29.266481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.267403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.268970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.270032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.272282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.273177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.555245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:29.565638 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-723c0f2f-02c3-44cc-8770-85e84439966c tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.524907 Oct 12 22:32:29.584889 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 242/512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:29 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:29.604465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-50f7a990-70f4-46b4-a101-936c111ed401 req-c48ce3a8-06a7-43ac-8df7-3b2fc2f58af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d0e2e2-8bf7-47d7-99b9-c45da17cf378", "name": "network-vif-deleted", "tag": "8c40c9bb-024f-4382-973f-3b6aa11e2aa9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:29.630878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-50f7a990-70f4-46b4-a101-936c111ed401 req-c48ce3a8-06a7-43ac-8df7-3b2fc2f58af4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.631824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-50f7a990-70f4-46b4-a101-936c111ed401 req-c48ce3a8-06a7-43ac-8df7-3b2fc2f58af4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.632591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-50f7a990-70f4-46b4-a101-936c111ed401 req-c48ce3a8-06a7-43ac-8df7-3b2fc2f58af4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.659093 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-50f7a990-70f4-46b4-a101-936c111ed401 req-c48ce3a8-06a7-43ac-8df7-3b2fc2f58af4 service nova] Creating event network-vif-deleted:8c40c9bb-024f-4382-973f-3b6aa11e2aa9 for instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 on n-h2-860864-8 Oct 12 22:32:29.675753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-50f7a990-70f4-46b4-a101-936c111ed401 req-c48ce3a8-06a7-43ac-8df7-3b2fc2f58af4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089280 Oct 12 22:32:29.676940 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 243/513] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:29.685754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:29.686883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:29.700283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.701070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.701773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.704252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.707573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.708437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.891436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:29.900080 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9cf54ae3-df42-4046-a979-4bd98efc4dbb tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1502 microversion: 2.1 time: 0.664058 Oct 12 22:32:29.920759 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 271/514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:29 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1502 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:29.929210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c3c2f6fe-d433-4ade-9242-13ac18a31a55 req-0c0964f1-17e4-4a31-a0c4-206cf0ab3c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b01c019-d599-40ea-8038-0f768d2868ae", "name": "network-vif-plugged", "status": "completed", "tag": "a072eeb6-744d-42c6-bd66-020b75653f91"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:29.966624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c3c2f6fe-d433-4ade-9242-13ac18a31a55 req-0c0964f1-17e4-4a31-a0c4-206cf0ab3c4c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:29.970198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c3c2f6fe-d433-4ade-9242-13ac18a31a55 req-0c0964f1-17e4-4a31-a0c4-206cf0ab3c4c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:29.970651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c3c2f6fe-d433-4ade-9242-13ac18a31a55 req-0c0964f1-17e4-4a31-a0c4-206cf0ab3c4c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:29.986941 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c3c2f6fe-d433-4ade-9242-13ac18a31a55 req-0c0964f1-17e4-4a31-a0c4-206cf0ab3c4c service nova] Creating event network-vif-plugged:a072eeb6-744d-42c6-bd66-020b75653f91 for instance 2b01c019-d599-40ea-8038-0f768d2868ae on n-h1-860864-8 Oct 12 22:32:29.993006 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c3c2f6fe-d433-4ade-9242-13ac18a31a55 req-0c0964f1-17e4-4a31-a0c4-206cf0ab3c4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067235 Oct 12 22:32:29.993977 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 272/515] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:30.000564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:30.001374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:30.008446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.009230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.010232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.011541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.012226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.013417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.138994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:30.185342 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90d6e6c4-3bd9-4753-9e63-442028adbb77 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.506148 Oct 12 22:32:30.188164 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 244/516] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:29 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:30.194121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:30.195091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:30.204582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.205391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.206734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.208290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.209056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.210340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.257881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.258633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.259322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.260093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lazy-loading 'fault' on Instance uuid 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:30.337183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:30.346837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:30.353359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:30.354550 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-48bc9f92-c180-47ca-855d-3acd4f4fa394 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1558 microversion: 2.25 time: 0.359485 Oct 12 22:32:30.377153 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 273/517] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:29 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1558 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:30.382521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:30.384168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:30.400512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.401012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.401445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.402131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.402748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.403308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.414050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46089674b2894f9cb105c4c1232421a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d056c78993473094318bd1c6ff182e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:30.430818 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1430c49a-da0c-4488-b437-9dbaa9d376f7 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 200 len: 1310 microversion: 2.1 time: 0.239975 Oct 12 22:32:30.431781 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 245/518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:30 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 1310 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:30.437591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:30.438361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:30.449688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.453631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.456401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.458517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.458992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.459796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.515183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:30.524958 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25bb6436-4657-424b-8141-e205c77a8d61 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1272 microversion: 2.1 time: 0.146662 Oct 12 22:32:30.528239 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 274/519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:30 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:30.596403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:30.597032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:30.606873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.607363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.607799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.610777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.611238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.612306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.895260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 04c3fadd-3c92-4818-b641-8799d43ed387 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:30.927058 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c83a9579-af3b-47b3-adcb-f1119b4d0fcf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 2051 microversion: 2.25 time: 0.494109 Oct 12 22:32:30.931386 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 246/520] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:30 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 2051 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:30.940301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:30.941224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:30.947400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.948155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.948925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:30.949968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:30.950764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:30.951412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.020644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:31.037468 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cde08186-badb-4b90-bcd6-3b7e8e78d3b1 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1389 microversion: 2.1 time: 0.445291 Oct 12 22:32:31.038793 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 275/521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:30 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1389 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:31.049372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.050450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:31.072393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.073601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.074284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.075444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.076450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.077098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.305804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 04c3fadd-3c92-4818-b641-8799d43ed387 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:31.322600 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-298e6b0e-93e6-4ff9-81be-90a1619e1f35 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 2051 microversion: 2.25 time: 0.282387 Oct 12 22:32:31.324583 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 276/522] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:31 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 2051 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:31.338327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:31.345646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.346400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:31.348603 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc96600f-1e91-4090-a639-914c62ac4d5e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1492 microversion: 2.1 time: 0.414911 Oct 12 22:32:31.350892 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 247/523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:30 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1492 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:31.353520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.354205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.354808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.355653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.356281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.356841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.460869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:31.473895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:31.503059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:31.507174 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86f828ed-2ce4-4d5e-a50a-fa47bafa8c79 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.180967 Oct 12 22:32:31.508559 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 277/524] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:31 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:31.513613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.518396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.520095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.520913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.521919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.522617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.524169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.533422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:31.557786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffefcf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:31.567050 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c36c272d-c5b1-4911-90d3-f4de2bdc8f40 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.057241 Oct 12 22:32:31.575170 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 278/525] 10.222.0.20 () {60 vars in 1217 bytes} [Wed Oct 12 22:32:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:31.583943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c751d4b-6459-46be-8fcb-b708be4f6d27 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '.version_select at 0x7f44ffc88a60>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.587814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c751d4b-6459-46be-8fcb-b708be4f6d27 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.588367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c751d4b-6459-46be-8fcb-b708be4f6d27 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.589088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c751d4b-6459-46be-8fcb-b708be4f6d27 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.599637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c751d4b-6459-46be-8fcb-b708be4f6d27 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.019409 Oct 12 22:32:31.600810 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 279/526] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:32:31 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:31.626751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.627432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:31.640032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.641123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.641829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.642535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.643043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.643518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.682184 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] HTTP exception thrown: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:31.692972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Request method failure captured: Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 HTTP/1.1 Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BBP3an80YTqqmcBGr_pzRWLX70XaNv_y0bqPpzsx4AFyjKRsh8EtnRyZMDdEirHLTOkFVRQF7128r2wQ9zVWTX--AKf78_IPTa12UlYUKf1q1462cRrmpEj2Bi9XeG_TlgFTJJDHAU64PtgbcJmR77Yrfl6xkxNe55BiWWSf8bwpE Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:31.693217 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4d056c78993473094318bd1c6ff182e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}] Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 46089674b2894f9cb105c4c1232421a9 Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:31.694498 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '77d0e2e2-8bf7-47d7-99b9-c45da17cf378'} Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:31.695192 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:31.697305 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:31.698346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Returning 404 to user: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:31.698346 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad4b75f2-09e1-48b6-870e-5d6558e331fa tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 404 len: 111 microversion: 2.1 time: 0.092750 Oct 12 22:32:31.698346 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 280/527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:31 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:31.699797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.700828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.701586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.703023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.703996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.705427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.707941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:31.719261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.723572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.724433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.728301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.728858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.729357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.814413 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eca77dab-c82b-4583-8ab0-c319e167fabb tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017" status: 200 len: 240 microversion: 2.36 time: 0.461346 Oct 12 22:32:31.823745 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 248/528] 10.222.0.20 () {62 vars in 1303 bytes} [Wed Oct 12 22:32:31 2022] PUT /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017 => generated 240 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:31.830976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:31.832753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:31.836009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:31.841491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.842342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.843009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.844076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.845157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.845767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.883693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:31.948968 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3807d63-6729-4c09-8b22-9c124ef983de tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387/action" status: 202 len: 0 microversion: 2.25 time: 0.121081 Oct 12 22:32:31.954282 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 249/529] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:32:31 2022] POST /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:31.958231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:31.962158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.963151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:31.972459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.974824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.976388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.977497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.978765 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b67263c-6461-4748-a487-f856ab736fe3 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.282475 Oct 12 22:32:31.979253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.979928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.981225 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 281/530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:31 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:31.986659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:31.987341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:31.994649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.995447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.996156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:31.997072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:31.997752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:31.998427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.015387 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] HTTP exception thrown: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Request method failure captured: Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 HTTP/1.1 Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BBP3an80YTqqmcBGr_pzRWLX70XaNv_y0bqPpzsx4AFyjKRsh8EtnRyZMDdEirHLTOkFVRQF7128r2wQ9zVWTX--AKf78_IPTa12UlYUKf1q1462cRrmpEj2Bi9XeG_TlgFTJJDHAU64PtgbcJmR77Yrfl6xkxNe55BiWWSf8bwpE Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:32.017302 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4d056c78993473094318bd1c6ff182e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}] Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 46089674b2894f9cb105c4c1232421a9 Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.018590 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '77d0e2e2-8bf7-47d7-99b9-c45da17cf378'} Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:32.019263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.020368 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.024670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Returning 404 to user: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:32.025754 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1493789c-a962-4b38-aa05-5847ed3fc7d3 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 404 len: 111 microversion: 2.1 time: 0.043583 Oct 12 22:32:32.026832 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 282/531] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:31 2022] DELETE /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:32.032188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Calling method '.version_select at 0x7f44ffd5fe50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.292595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.293403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.293911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.294751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.295312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.295755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.321049 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0118cb0c-d268-4c8b-8b6d-3fd13dc1177e tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017/detail" status: 200 len: 672 microversion: 2.36 time: 0.292915 Oct 12 22:32:32.321982 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 283/532] 10.222.0.20 () {60 vars in 1304 bytes} [Wed Oct 12 22:32:32 2022] GET /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017/detail => generated 672 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:32.326355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-958535ef-00ca-4733-9c8a-84a0c6cfe99f req-7ccef120-28df-4444-ba67-6c8e637990a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1303196e-4aff-41e4-bba7-da44a13bd6bc", "tag": "fc389c33-904c-4171-89fd-eed4b0c5df9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:32.338285 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5eddc5c7-658a-4f60-9566-179315a20c8b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1643 microversion: 2.1 time: 0.381652 Oct 12 22:32:32.351682 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 250/533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:31 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1643 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:32.355106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-958535ef-00ca-4733-9c8a-84a0c6cfe99f req-7ccef120-28df-4444-ba67-6c8e637990a4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.357540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-958535ef-00ca-4733-9c8a-84a0c6cfe99f req-7ccef120-28df-4444-ba67-6c8e637990a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.358312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-958535ef-00ca-4733-9c8a-84a0c6cfe99f req-7ccef120-28df-4444-ba67-6c8e637990a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.368243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.368243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:32.375540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.376876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.377608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.379447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.379936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.380827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.419806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-958535ef-00ca-4733-9c8a-84a0c6cfe99f req-7ccef120-28df-4444-ba67-6c8e637990a4 service nova] Creating event network-changed:fc389c33-904c-4171-89fd-eed4b0c5df9f for instance 1303196e-4aff-41e4-bba7-da44a13bd6bc on n-h2-860864-8 Oct 12 22:32:32.428912 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-958535ef-00ca-4733-9c8a-84a0c6cfe99f req-7ccef120-28df-4444-ba67-6c8e637990a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105903 Oct 12 22:32:32.432637 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 284/534] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:32.446508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.448375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: 77d0e2e2-8bf7-47d7-99b9-c45da17cf378] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:32.470505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.471485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.472590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.473625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.475570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.476191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.508000 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] HTTP exception thrown: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Request method failure captured: Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 HTTP/1.1 Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BBP3an80YTqqmcBGr_pzRWLX70XaNv_y0bqPpzsx4AFyjKRsh8EtnRyZMDdEirHLTOkFVRQF7128r2wQ9zVWTX--AKf78_IPTa12UlYUKf1q1462cRrmpEj2Bi9XeG_TlgFTJJDHAU64PtgbcJmR77Yrfl6xkxNe55BiWWSf8bwpE Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:32.509536 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4d056c78993473094318bd1c6ff182e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}] Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 46089674b2894f9cb105c4c1232421a9 Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.511366 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '77d0e2e2-8bf7-47d7-99b9-c45da17cf378'} Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:32.512273 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. Oct 12 22:32:32.513809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.518124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Returning 404 to user: Instance 77d0e2e2-8bf7-47d7-99b9-c45da17cf378 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:32.518974 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-533953d7-ebb9-4c6f-9b82-eaff9dff1fb0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378" status: 404 len: 111 microversion: 2.1 time: 0.081674 Oct 12 22:32:32.522499 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 285/535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:32 2022] GET /compute/v2.1/servers/77d0e2e2-8bf7-47d7-99b9-c45da17cf378 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:32.534233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.535334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:32.542700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.543556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.544281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.545290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.546006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.550135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.735118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:32.744338 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d3573fb-005e-459b-ba82-c62ed29c264d tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1586 microversion: 2.1 time: 0.220442 Oct 12 22:32:32.744927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 286/536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:32 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1586 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:32.750738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.751737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:32.759075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.762473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.762942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.763693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.764222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.771918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.787068 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] HTTP exception thrown: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Request method failure captured: Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f HTTP/1.1 Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BBP3an80YTqqmcBGr_pzRWLX70XaNv_y0bqPpzsx4AFyjKRsh8EtnRyZMDdEirHLTOkFVRQF7128r2wQ9zVWTX--AKf78_IPTa12UlYUKf1q1462cRrmpEj2Bi9XeG_TlgFTJJDHAU64PtgbcJmR77Yrfl6xkxNe55BiWWSf8bwpE Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:32.788785 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4d056c78993473094318bd1c6ff182e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}] Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 46089674b2894f9cb105c4c1232421a9 Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:32.790385 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a23325c7-98a1-4a12-8917-e3a6c87bf88f'} Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:32.794897 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:32.796448 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:32.797864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Returning 404 to user: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:32.797864 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d2af93af-a25a-405b-81f4-21d4bf303eba tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 404 len: 111 microversion: 2.1 time: 0.044376 Oct 12 22:32:32.797864 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 287/537] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:32 2022] DELETE /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:32.804042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:32.804930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:32.813112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.813752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.814290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.815101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:32.815682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:32.816835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:32.901894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:32.922483 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-304e478a-c02a-4b97-b068-195519abcdb7 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.129022 Oct 12 22:32:32.923264 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 288/538] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:32 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:32.927807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1084874420", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "b7ba0f5c-73e2-4094-b8e5-360f49f48593"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:32.982812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] validate_networks() for [('b7ba0f5c-73e2-4094-b8e5-360f49f48593', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:33.110376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 04c3fadd-3c92-4818-b641-8799d43ed387 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:33.124124 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f042a4d1-fd5c-4065-b722-72da8b401e6e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 2056 microversion: 2.25 time: 0.771179 Oct 12 22:32:33.125400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 251/539] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:32 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 2056 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:33.130094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffefcb80>, body: {"quota_set": {"ram": "2048"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:33.341384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.341864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.342296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.343013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.343664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.344113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.371780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:33.372285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:33.372690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:33.373097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:33.373539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:33.378935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.380070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.380510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.381334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.381783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.382372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.383072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.383547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.384012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.384737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.385183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.385610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.402482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:33.409336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for user dd8fdd646f8546a0a3aae53d1b55a8b1 and project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:33.429288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:33.432176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:33.449011 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-481c42bc-09d8-43ec-95df-02f5960bfffc tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017?user_id=669caa75358d48f98c2358e9e7df4a42" status: 200 len: 240 microversion: 2.36 time: 0.322331 Oct 12 22:32:33.456247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 252/540] 10.222.0.20 () {62 vars in 1384 bytes} [Wed Oct 12 22:32:33 2022] PUT /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017?user_id=669caa75358d48f98c2358e9e7df4a42 => generated 240 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:33.461478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:33.462057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:33.468932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.469456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.469893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.470641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.471078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.471502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.481822 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4861c4da-391b-41e9-9733-7fee266c5dac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557504 Oct 12 22:32:33.482465 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 289/541] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:32:33.490479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:33.491428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] [instance: a23325c7-98a1-4a12-8917-e3a6c87bf88f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:33.497950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.498548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.499153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.500739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.501720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.502294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.517861 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] HTTP exception thrown: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Request method failure captured: Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f HTTP/1.1 Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0BBP3an80YTqqmcBGr_pzRWLX70XaNv_y0bqPpzsx4AFyjKRsh8EtnRyZMDdEirHLTOkFVRQF7128r2wQ9zVWTX--AKf78_IPTa12UlYUKf1q1462cRrmpEj2Bi9XeG_TlgFTJJDHAU64PtgbcJmR77Yrfl6xkxNe55BiWWSf8bwpE Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:33.519525 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4d056c78993473094318bd1c6ff182e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4d056c78993473094318bd1c6ff182e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4d056c78993473094318bd1c6ff182e"}]}] Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c4d056c78993473094318bd1c6ff182e Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1184695519 Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 46089674b2894f9cb105c4c1232421a9 Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersAdminTestJSON-1184695519-project Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:33.521075 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a23325c7-98a1-4a12-8917-e3a6c87bf88f'} Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:33.521914 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. Oct 12 22:32:33.523250 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:33.524514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] Returning 404 to user: Instance a23325c7-98a1-4a12-8917-e3a6c87bf88f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:33.525447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c112fc06-f036-4026-bda7-04fbe53589d0 tempest-DeleteServersAdminTestJSON-1184695519 tempest-DeleteServersAdminTestJSON-1184695519-project] 10.222.0.20 "GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f" status: 404 len: 111 microversion: 2.1 time: 0.040037 Oct 12 22:32:33.526280 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 290/542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:33 2022] GET /compute/v2.1/servers/a23325c7-98a1-4a12-8917-e3a6c87bf88f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:33.541564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:33.543551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:33.551566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.552398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.553053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.553991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.554667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.555177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.563465 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f181e3d1-115b-4100-aca5-0a36aa8f07d7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112640 Oct 12 22:32:33.572373 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 253/543] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:32:33 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:33.577436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ada0c4db-5ab9-4899-9fa9-f01455f7d4f6 tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] Calling method '.version_select at 0x7f450406d670>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:33.706213 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ada0c4db-5ab9-4899-9fa9-f01455f7d4f6 tempest-QuotasAdminTestV236-114373232 tempest-QuotasAdminTestV236-114373232-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017?user_id=669caa75358d48f98c2358e9e7df4a42" status: 200 len: 282 microversion: 2.36 time: 0.132049 Oct 12 22:32:33.709066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 254/544] 10.222.0.20 () {60 vars in 1364 bytes} [Wed Oct 12 22:32:33 2022] GET /compute/v2.1/os-quota-sets/83fce89b4c644423b62e989c14e30017?user_id=669caa75358d48f98c2358e9e7df4a42 => generated 282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:32:33.717089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-115602ef-cd9b-4ad5-85c5-50692ce8fcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:33.717715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-115602ef-cd9b-4ad5-85c5-50692ce8fcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:33.748979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:33.758894 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0d35305f-ff31-40b2-84e8-8b6371320528 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.231328 Oct 12 22:32:33.760215 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 291/545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:33 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:33.811562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-115602ef-cd9b-4ad5-85c5-50692ce8fcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:33.820655 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-115602ef-cd9b-4ad5-85c5-50692ce8fcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1211 microversion: 2.1 time: 0.110048 Oct 12 22:32:33.823300 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 255/546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:33 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:33.952753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:33.953914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:33.960945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.962762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.963483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:33.964564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:33.965237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:33.965875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.076121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:34.100524 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b44b3115-e590-4634-b60c-234aa0bd0076 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.153606 Oct 12 22:32:34.103255 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 292/547] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:33 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:34.154741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:34.156797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:34.164895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.166060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.167067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.168742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.169437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.170026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.651461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 04c3fadd-3c92-4818-b641-8799d43ed387 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:34.687466 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-769a879d-6817-4981-898a-a5e206668c73 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 2036 microversion: 2.25 time: 0.537262 Oct 12 22:32:34.693555 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 256/548] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:34 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 2036 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:34.698546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-17e564cf-076b-48b1-9000-fde6886104a4 req-3098da92-3245-4862-adc9-8468c2733f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b8fc85-fc87-4f07-9f8d-3961983e9c10", "tag": "a9c0a074-a316-4749-9953-672b5bba0630"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:34.723715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-17e564cf-076b-48b1-9000-fde6886104a4 req-3098da92-3245-4862-adc9-8468c2733f45 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.724237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-17e564cf-076b-48b1-9000-fde6886104a4 req-3098da92-3245-4862-adc9-8468c2733f45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.724741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-17e564cf-076b-48b1-9000-fde6886104a4 req-3098da92-3245-4862-adc9-8468c2733f45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.737819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-17e564cf-076b-48b1-9000-fde6886104a4 req-3098da92-3245-4862-adc9-8468c2733f45 service nova] Creating event network-changed:a9c0a074-a316-4749-9953-672b5bba0630 for instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 on n-h2-860864-8 Oct 12 22:32:34.744427 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-17e564cf-076b-48b1-9000-fde6886104a4 req-3098da92-3245-4862-adc9-8468c2733f45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049087 Oct 12 22:32:34.745596 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 257/549] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:34.752045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": "auto"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:34.758433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:34.774251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Calling method '.version_select at 0x7f44ffc7de50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:34.775923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.776934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.777422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.778124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.778560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.779623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.790954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.792739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.793442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.794412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.795016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.795615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.811659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'flavor' on Instance uuid 04c3fadd-3c92-4818-b641-8799d43ed387 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:34.827091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120543) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:32:34.850983 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7521e6cf-6ab4-4765-8821-f8c6234e9c39 tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.565989 Oct 12 22:32:34.852903 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 293/550] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Oct 12 22:32:34 2022] GET /compute/v2.1/limits => generated 511 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:34.867973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:34.868838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:34.881290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.882062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.882659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:34.885798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:34.886513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:34.887115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.473265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:35.483257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99f300ef-cc93-404b-8c85-91f4354fbf41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.628299 Oct 12 22:32:35.484911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 294/551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:34 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:35.489574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:35.490175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:35.496662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.497148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.497583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.498273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.498721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.499149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.571479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:35.579506 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4c21911-a763-45c4-a5c5-b3f714f68905 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1269 microversion: 2.1 time: 0.093590 Oct 12 22:32:35.580135 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 295/552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:35 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:35.584827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1553003298", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:35.643266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:35.863305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=43 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:35.867515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Getting quotas for project 5d6a50f6fa1f4a608aba2d746e41f87d. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:35.872669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Getting quotas for user 6c61df3d191f480ab3b90620fbd3d80b and project 5d6a50f6fa1f4a608aba2d746e41f87d. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:35.885126 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Request method failure captured: Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 1752 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CAh-74aiaK2UGU4wOu1Nzl_VgfUSnTwpXdLuncY_pkQrS14CqH75ykzdo-ALDYO0iZjmhoKslKX79Rq1YEp9LYTY3suZd-hQIyDX5mWtYk-4Laj_cu8I6K-rsXHA_ugMfI5NnMg3hCMH3hcaG1ZY4DBCX62CFpAze6-4KiD0w6SC0 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5d6a50f6fa1f4a608aba2d746e41f87d Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1484094619 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6a50f6fa1f4a608aba2d746e41f87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d6a50f6fa1f4a608aba2d746e41f87d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d6a50f6fa1f4a608aba2d746e41f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6a50f6fa1f4a608aba2d746e41f87d"}]}] Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1484094619 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5d6a50f6fa1f4a608aba2d746e41f87d Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1484094619 Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 6c61df3d191f480ab3b90620fbd3d80b Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1553003298", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:35.888159 n-d-860864-8 devstack@n-api.service[120542]: exception: Maximum number of metadata items exceeds 128 Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1553003298', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:35.895081 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9907a06e-9254-42c5-a82a-c33e168464ff tempest-AbsoluteLimitsNegativeTestJSON-1484094619 tempest-AbsoluteLimitsNegativeTestJSON-1484094619-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.308678 Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 296/553] 10.222.0.20 () {60 vars in 1148 bytes} [Wed Oct 12 22:32:35 2022] POST /compute/v2.1/servers => generated 87 bytes in 310 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:35.901199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:35.904340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.904340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.904340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.904340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:35.904869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:35.904869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:35.993691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:36.012541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-185a8920-35d2-40eb-bea9-599806892d4b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1927 microversion: 2.75 time: 0.121133 Oct 12 22:32:36.013172 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 297/554] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:35 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1927 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:36.152672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:36.153425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:36.166577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:36.167484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:36.168393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:36.172130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:36.172856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:36.173574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:36.418669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:36.433298 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25773ec9-7201-4507-b064-514cfb664c31 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1586 microversion: 2.1 time: 0.282761 Oct 12 22:32:36.434120 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 298/555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:36 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1586 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:36.520904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:36.523619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:36.555414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:36.557275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:36.560434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:36.564591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:36.567302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:36.568845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:36.828108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:36.852595 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99450a98-9f70-498e-b2a6-0d972cbfb4c8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.348573 Oct 12 22:32:36.853318 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 299/556] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:36 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:36.879976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:36.880631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:36.904785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:36.905416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:36.906012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:36.909784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:36.910355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:36.910841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:37.240821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:37.257361 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-60a1bbb7-2e85-4c7e-a73c-72ff134cbd68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.402893 Oct 12 22:32:37.263344 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 300/557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:36 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:37.273245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c7eaa3cb-9cb2-429e-b973-088fb1e9782c req-2b704472-e2ad-440a-b12a-1eeefc0c8f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b01c019-d599-40ea-8038-0f768d2868ae", "tag": "a072eeb6-744d-42c6-bd66-020b75653f91"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:37.294103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c7eaa3cb-9cb2-429e-b973-088fb1e9782c req-2b704472-e2ad-440a-b12a-1eeefc0c8f26 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:37.294688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c7eaa3cb-9cb2-429e-b973-088fb1e9782c req-2b704472-e2ad-440a-b12a-1eeefc0c8f26 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:37.295210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c7eaa3cb-9cb2-429e-b973-088fb1e9782c req-2b704472-e2ad-440a-b12a-1eeefc0c8f26 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:37.309874 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c7eaa3cb-9cb2-429e-b973-088fb1e9782c req-2b704472-e2ad-440a-b12a-1eeefc0c8f26 service nova] Creating event network-changed:a072eeb6-744d-42c6-bd66-020b75653f91 for instance 2b01c019-d599-40ea-8038-0f768d2868ae on n-h1-860864-8 Oct 12 22:32:37.316690 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c7eaa3cb-9cb2-429e-b973-088fb1e9782c req-2b704472-e2ad-440a-b12a-1eeefc0c8f26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051677 Oct 12 22:32:37.317697 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 301/558] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:37.323189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:37.324064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:37.331694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:37.332325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:37.332851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:37.334331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:37.334894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:37.335766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:37.366717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:37.434199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:37.458354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c68e1ee-fea9-47a0-8ec2-74c05290f1c8 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1933 microversion: 2.75 time: 0.139325 Oct 12 22:32:37.459111 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 302/559] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:37 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1933 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:37.881687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:37.884438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:37.893550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:37.899120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:37.899787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:37.900767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:37.903076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:37.903731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.338075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:38.351444 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5c4a0a8-a4b0-4e07-96a6-c6068ea0f477 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.477890 Oct 12 22:32:38.352845 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 303/560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:37 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:38.365143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:38.365959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:38.379044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:38.380211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:38.380798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.382063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:38.382660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:38.383230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.769545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:38.777995 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56f9846b-bb52-4afb-b600-16ace5193b1b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.423902 Oct 12 22:32:38.778588 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 304/561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:38 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:38.797435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:38.798050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:38.833968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:38.835677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:38.836323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.839860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:38.841097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:38.841702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:38.991187 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-352b6b50-3eaa-482b-bafb-92d986667717 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387/action" status: 202 len: 0 microversion: 2.25 time: 4.243044 Oct 12 22:32:38.993662 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 258/562] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:32:34 2022] POST /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387/action => generated 0 bytes in 4247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:32:38.998641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:39.000498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9fd5c920-4d0a-460a-9e4b-6079c705d24d req-30f7b644-35e6-4e55-960b-17e590f8e3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1303196e-4aff-41e4-bba7-da44a13bd6bc", "name": "network-vif-plugged", "status": "completed", "tag": "fc389c33-904c-4171-89fd-eed4b0c5df9f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:39.038157 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e731e32-8d69-4a43-8b32-8625c8212961 tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1933 microversion: 2.75 time: 0.258502 Oct 12 22:32:39.042225 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 305/563] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:38 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1933 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:39.047508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:39.052837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:39.065687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.067323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.069666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.070747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.071376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.076561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.081027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9fd5c920-4d0a-460a-9e4b-6079c705d24d req-30f7b644-35e6-4e55-960b-17e590f8e3c5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.082180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9fd5c920-4d0a-460a-9e4b-6079c705d24d req-30f7b644-35e6-4e55-960b-17e590f8e3c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.082890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9fd5c920-4d0a-460a-9e4b-6079c705d24d req-30f7b644-35e6-4e55-960b-17e590f8e3c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.102125 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9fd5c920-4d0a-460a-9e4b-6079c705d24d req-30f7b644-35e6-4e55-960b-17e590f8e3c5 service nova] Creating event network-vif-plugged:fc389c33-904c-4171-89fd-eed4b0c5df9f for instance 1303196e-4aff-41e4-bba7-da44a13bd6bc on n-h2-860864-8 Oct 12 22:32:39.110736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9fd5c920-4d0a-460a-9e4b-6079c705d24d req-30f7b644-35e6-4e55-960b-17e590f8e3c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114474 Oct 12 22:32:39.113360 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 259/564] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:39.360555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2e786db2-2cd3-4f12-b377-7ea3a963fbb0 req-c0ffaac2-940e-48e3-9d10-e0df963ec4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3fa1d46-716f-4398-b632-5f38dbce83cb", "tag": "3c005992-3f1c-4460-9fb1-2094f54865e7"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:39.375052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:39.389363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:39.391810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:39.393418 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65f7289e-4b5c-4721-ac67-28e94a6c90cb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.350040 Oct 12 22:32:39.394237 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 306/565] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:39 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:39.398997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2e786db2-2cd3-4f12-b377-7ea3a963fbb0 req-c0ffaac2-940e-48e3-9d10-e0df963ec4bf service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.399486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2e786db2-2cd3-4f12-b377-7ea3a963fbb0 req-c0ffaac2-940e-48e3-9d10-e0df963ec4bf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.399821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:39.400681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:39.403266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2e786db2-2cd3-4f12-b377-7ea3a963fbb0 req-c0ffaac2-940e-48e3-9d10-e0df963ec4bf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.407289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:39.409220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.410023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.410670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.411659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.412358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.413217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.451709 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2e786db2-2cd3-4f12-b377-7ea3a963fbb0 req-c0ffaac2-940e-48e3-9d10-e0df963ec4bf service nova] Creating event network-changed:3c005992-3f1c-4460-9fb1-2094f54865e7 for instance b3fa1d46-716f-4398-b632-5f38dbce83cb on n-h1-860864-8 Oct 12 22:32:39.466019 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2e786db2-2cd3-4f12-b377-7ea3a963fbb0 req-c0ffaac2-940e-48e3-9d10-e0df963ec4bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112231 Oct 12 22:32:39.472118 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 260/566] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:32:39.705997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:39.717517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a30dbf3-cc4a-47cb-a28e-99855d46bad8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.321933 Oct 12 22:32:39.718332 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 307/567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:39 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:39.809253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:39.809955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:39.817664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.818420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.819072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:39.819953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:39.820558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:39.821133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.077375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:40.080750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:40.090744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.091504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.091960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.093643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.094330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.095081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.204892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] Lazy-loading 'services' on Instance uuid ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:40.232817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bfff33d-8e58-452f-b243-05ae05958b0b tempest-ServersAdmin275Test-397348080 tempest-ServersAdmin275Test-397348080-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1918 microversion: 2.75 time: 0.160930 Oct 12 22:32:40.237830 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 308/568] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:40 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1918 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:40.460242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:40.463097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.464872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.465863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.466957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.467642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.471837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.511503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:40.517385 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b505c9f-502c-46f7-ab4d-6be3588e8872 tempest-AZV2TestJSON-48666041 tempest-AZV2TestJSON-48666041-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.277432 Oct 12 22:32:40.518488 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 309/569] 10.222.0.20 () {58 vars in 1164 bytes} [Wed Oct 12 22:32:40 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:32:40.524404 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-593ae241-7449-497d-a810-2153ff34f552 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.717968 Oct 12 22:32:40.526650 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 261/570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:39 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:40.536567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:40.538498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:40.541199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:40.541836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:40.552400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.552643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.553006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.553258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.553456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.553909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.554605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.555001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.555114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.555547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.555671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.556074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.601545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:32:40.771051 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72b206aa-6bc9-4d27-9af0-0f9fbfb8f468 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 204 len: 0 microversion: 2.75 time: 0.245054 Oct 12 22:32:40.772705 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 310/571] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:32:40 2022] DELETE /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:32:40.918518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:40.927947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:40.930964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:40.933197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a1c21e65-0495-4ea4-856c-94cd0f542f63 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.400798 Oct 12 22:32:40.949361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 262/572] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:40 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:40.962131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:40.963521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:40.972870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.973655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.974858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:40.975774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:40.976456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:40.977086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.182764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.190893 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8659983-dc3c-40bc-abaa-51291e0a2308 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.239462 Oct 12 22:32:41.194641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 263/573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:40 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:41.204502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.208290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:41.220117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.220829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.221557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.222469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.222925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.223356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.295303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61170a0a-aa08-494a-bb50-98a47f61c95a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1948538119", "id": 202606938, "os-flavor-access:is_public": "True"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:41.300625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.310129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.312149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.317382 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-654fc271-d054-4f1d-9ae1-b0c393d8e347 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1443 microversion: 2.75 time: 0.120341 Oct 12 22:32:41.322933 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61170a0a-aa08-494a-bb50-98a47f61c95a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.546937 Oct 12 22:32:41.332630 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 264/574] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1443 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:41.343131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a48bc83b-1dc7-4d5d-9ce5-e95aad99a3ff req-dabc04c1-f3f6-4e60-9598-268442a909fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b8fc85-fc87-4f07-9f8d-3961983e9c10", "name": "network-vif-plugged", "status": "completed", "tag": "a9c0a074-a316-4749-9953-672b5bba0630"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:41.346910 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 311/575] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:40 2022] POST /compute/v2.1/flavors => generated 427 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:41.354041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-375eb87f-9993-4d86-a282-c21921d6c62c req-ffff9e48-eb1a-43b9-b2a5-6895914a2998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c3fadd-3c92-4818-b641-8799d43ed387", "name": "network-vif-unplugged", "status": "completed", "tag": "08d5fd64-1e78-4647-b7f5-b975906b2fcb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:41.355066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a48bc83b-1dc7-4d5d-9ce5-e95aad99a3ff req-dabc04c1-f3f6-4e60-9598-268442a909fc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.355738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a48bc83b-1dc7-4d5d-9ce5-e95aad99a3ff req-dabc04c1-f3f6-4e60-9598-268442a909fc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.356344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a48bc83b-1dc7-4d5d-9ce5-e95aad99a3ff req-dabc04c1-f3f6-4e60-9598-268442a909fc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.368121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-375eb87f-9993-4d86-a282-c21921d6c62c req-ffff9e48-eb1a-43b9-b2a5-6895914a2998 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.368594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-375eb87f-9993-4d86-a282-c21921d6c62c req-ffff9e48-eb1a-43b9-b2a5-6895914a2998 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.369144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-375eb87f-9993-4d86-a282-c21921d6c62c req-ffff9e48-eb1a-43b9-b2a5-6895914a2998 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.370248 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a48bc83b-1dc7-4d5d-9ce5-e95aad99a3ff req-dabc04c1-f3f6-4e60-9598-268442a909fc service nova] Creating event network-vif-plugged:a9c0a074-a316-4749-9953-672b5bba0630 for instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 on n-h2-860864-8 Oct 12 22:32:41.376043 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a48bc83b-1dc7-4d5d-9ce5-e95aad99a3ff req-dabc04c1-f3f6-4e60-9598-268442a909fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042058 Oct 12 22:32:41.376844 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 265/576] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:41.383440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c670fa9-6add-4a0d-b132-03771c4c683a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.390869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-375eb87f-9993-4d86-a282-c21921d6c62c req-ffff9e48-eb1a-43b9-b2a5-6895914a2998 service nova] Creating event network-vif-unplugged:08d5fd64-1e78-4647-b7f5-b975906b2fcb for instance 04c3fadd-3c92-4818-b641-8799d43ed387 on n-h1-860864-8 Oct 12 22:32:41.398320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-375eb87f-9993-4d86-a282-c21921d6c62c req-ffff9e48-eb1a-43b9-b2a5-6895914a2998 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049574 Oct 12 22:32:41.400104 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 312/577] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:41.404955 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c670fa9-6add-4a0d-b132-03771c4c683a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/202606938" status: 202 len: 0 microversion: 2.1 time: 0.026579 Oct 12 22:32:41.408779 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 266/578] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:32:41 2022] DELETE /compute/v2.1/flavors/202606938 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:41.414568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5a275b4-200c-40bf-a92d-2b02e24fd476 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.452492 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5a275b4-200c-40bf-a92d-2b02e24fd476 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.041924 Oct 12 22:32:41.453935 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 313/579] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:41.473325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ec857cc-b8b5-4710-8feb-de2668b9c331 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-397818230", "id": 331459687, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:41.493285 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ec857cc-b8b5-4710-8feb-de2668b9c331 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.023774 Oct 12 22:32:41.494359 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 314/580] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:41 2022] POST /compute/v2.1/flavors => generated 413 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:41.508594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6800a9d9-4c0e-498d-82a6-7fb116219a57 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.535449 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6800a9d9-4c0e-498d-82a6-7fb116219a57 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.032568 Oct 12 22:32:41.537378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 315/581] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:41.551606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.553232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:41.561123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.561721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.562460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.563815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.564309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.564726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.583773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b812ec13-3e9a-43de-8fef-cecc2970b51d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Calling method '.version_select at 0x7f44ffe1b3a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.645090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=49 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:41.654340 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b812ec13-3e9a-43de-8fef-cecc2970b51d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 371 microversion: 2.1 time: 0.237124 Oct 12 22:32:41.654855 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 267/582] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:41.659801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f49cdb93-6486-4631-9ffc-6e93050f1329 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.678928 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f49cdb93-6486-4631-9ffc-6e93050f1329 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/331459687" status: 202 len: 0 microversion: 2.1 time: 0.022389 Oct 12 22:32:41.682760 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 268/583] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:32:41 2022] DELETE /compute/v2.1/flavors/331459687 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:41.684447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffe1b5e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:41.747764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.748274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.748707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.749969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:41.750417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:41.750841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:41.804112 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-169851a6-e4ec-4b79-bf80-f8126b4e4ec7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 328 microversion: 2.1 time: 0.123464 Oct 12 22:32:41.805035 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 269/584] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:32:41 2022] PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:41.814343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63078777-1b3d-4e25-a392-e05940429eae tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.840174 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63078777-1b3d-4e25-a392-e05940429eae tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.030966 Oct 12 22:32:41.842156 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 270/585] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:41.851238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:41.862099 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-215226d2-116d-4904-873a-1aad0cbe8e57 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.315953 Oct 12 22:32:41.862688 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 316/586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:41.868447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5768f323-5301-474c-8cee-298c45a26510 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-997112997", "id": 995735257, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:41.883827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:41.908349 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5768f323-5301-474c-8cee-298c45a26510 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.047667 Oct 12 22:32:41.909623 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 271/587] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:41 2022] POST /compute/v2.1/flavors => generated 425 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:41.921969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a9a4a10-3177-461f-90d8-e2c066d716b6 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:41.942017 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a9a4a10-3177-461f-90d8-e2c066d716b6 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/995735257" status: 202 len: 0 microversion: 2.1 time: 0.023797 Oct 12 22:32:41.942853 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 317/588] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:32:41 2022] DELETE /compute/v2.1/flavors/995735257 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:41.962717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6de225b3-7885-4ed5-b2eb-aa16c20419c5 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.000408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6de225b3-7885-4ed5-b2eb-aa16c20419c5 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.049254 Oct 12 22:32:42.001529 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 272/589] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:42.007286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.008570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:42.015648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.016165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.016746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.017719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.018397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.018883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.074877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1242769170", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:42.136861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:42.259811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:42.280077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:42.283608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:42.285158 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e158112b-1023-4edb-94d2-fa9b9c5ddee1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.282290 Oct 12 22:32:42.285918 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 273/590] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:42.291330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4cd471a1-f765-46c5-a1e5-be1525e14c53 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-36660849", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:42.318784 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4cd471a1-f765-46c5-a1e5-be1525e14c53 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.031898 Oct 12 22:32:42.319824 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 274/591] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:42 2022] POST /compute/v2.1/flavors => generated 505 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:42.326397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.327417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:42.333606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.334205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.334856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.335853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.336429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.337750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.359761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:42.458084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:42.458642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:42.460467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:42.461714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:42.462406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:42.478961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.479441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.479869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.480614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.481062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.481479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.504389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Getting quotas for project 13dfc831044d4535a5e856316eb4e27d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:42.510436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Getting quotas for user 78f7f5e57c9d419aa52149c4841a1bce and project 13dfc831044d4535a5e856316eb4e27d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:42.523171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.utils [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] cores quota exceeded for 13dfc831044d4535a5e856316eb4e27d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120542) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 22:32:42.524070 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Request method failure captured: Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 145 Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CH14ZxnTo5G4GQ3F_ut8eg-6abLPE32xuWR2QfzU4zQoR41q5W121mBGu4ekwghEdj5RUqmhXVylfx4Xv4FChl5QNFfqZqC2XmrriXKms4mf9VGozC66xapqYgdKrJLNG7Km_yv6RU5jLfxohZ4QfL5Te-h0bmG6DYsriEskKbvMY Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}] Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 78f7f5e57c9d419aa52149c4841a1bce Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1242769170", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1242769170', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452'}}} Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:32:42.526900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c082f239-35b3-4a80-982b-70836db75900 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.576939 Oct 12 22:32:42.531098 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 318/592] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:41 2022] POST /compute/v2.1/servers => generated 111 bytes in 578 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:42.536807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a2469a49-b604-4299-92fb-de041be30d0c tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.563597 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a2469a49-b604-4299-92fb-de041be30d0c tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/8ac86e9e-5619-4b7c-ae73-e3e2b437066a" status: 202 len: 0 microversion: 2.1 time: 0.033055 Oct 12 22:32:42.564213 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 319/593] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:42 2022] DELETE /compute/v2.1/flavors/8ac86e9e-5619-4b7c-ae73-e3e2b437066a => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:42.569317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.569925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:42.576996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.577516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.577944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.578641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.579085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.579495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.610912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:42.621340 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b1f255d-70be-4894-8397-7df559015806 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1314 microversion: 2.1 time: 0.299816 Oct 12 22:32:42.622857 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 275/594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:42.637870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffdea1f0>, body: {"quota_set": {"cores": 20}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:42.666731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:42.677481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:42.679353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '783a3886ae0e42d78df6ff0c7c5282bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2e6f32faa4127ba19cc03ec7936a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:42.687688 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3aaa507c-03c9-45ef-b244-293a1ce45de2 tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 200 len: 1443 microversion: 2.75 time: 0.121860 Oct 12 22:32:42.688705 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 320/595] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 1443 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:42.704571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc9cfbe4-0e71-43d8-babc-072ab1c87451 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.745859 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc9cfbe4-0e71-43d8-babc-072ab1c87451 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.055726 Oct 12 22:32:42.756494 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 321/596] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:42.776383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74da0091-d708-4d95-a208-7b0721dac368 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1328133371", "id": "9550047e-19fd-4b66-9a02-d968fd29b419", "os-flavor-access:is_public": "True"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:42.810747 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74da0091-d708-4d95-a208-7b0721dac368 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.038465 Oct 12 22:32:42.811445 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 322/597] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:42 2022] POST /compute/v2.1/flavors => generated 507 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:42.825351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-63864005-6435-47cd-a5f4-179706e59f13 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.849873 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-63864005-6435-47cd-a5f4-179706e59f13 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/9550047e-19fd-4b66-9a02-d968fd29b419" status: 202 len: 0 microversion: 2.1 time: 0.028952 Oct 12 22:32:42.850914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 323/598] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:32:42 2022] DELETE /compute/v2.1/flavors/9550047e-19fd-4b66-9a02-d968fd29b419 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:42.861571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35ab6589-56a6-4a2e-a802-addfd01f139e tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.886487 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35ab6589-56a6-4a2e-a802-addfd01f139e tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.031068 Oct 12 22:32:42.887081 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 324/599] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:42.892289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:42.893082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:42.899156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.899562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.900029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.901744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.902598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.903360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.923257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.924432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.924872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.925604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:42.926057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:42.926480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:42.990976 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7575e20-43ea-4466-a577-237109f6e83d tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 329 microversion: 2.1 time: 0.366821 Oct 12 22:32:42.992143 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 276/600] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:32:42 2022] PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 329 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:42.997320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-929acfc8-7cdf-4388-bc20-d349545f4bd7 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1278356217", "id": 1774086263, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:43.018847 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-929acfc8-7cdf-4388-bc20-d349545f4bd7 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.025374 Oct 12 22:32:43.019921 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 277/601] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:42 2022] POST /compute/v2.1/flavors => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:43.024758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87e1a3dc-4237-4dbe-b207-b6eb6086005f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Calling method '.version_select at 0x7f44ffdc4790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.072981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.082617 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ac935f4-8f4f-4084-acb8-47cbc3181305 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.194366 Oct 12 22:32:43.083190 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 325/602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:42 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:43.087874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90b3c883-38aa-4b6e-80b0-25e014ff396f tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.094614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90b3c883-38aa-4b6e-80b0-25e014ff396f tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1774086263" status: 200 len: 414 microversion: 2.1 time: 0.010339 Oct 12 22:32:43.102400 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 326/603] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:32:43 2022] GET /compute/v2.1/flavors/1774086263 => generated 414 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:43.228471 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87e1a3dc-4237-4dbe-b207-b6eb6086005f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 371 microversion: 2.1 time: 0.207306 Oct 12 22:32:43.229149 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 278/604] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 22:32:43 2022] GET /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:43.242677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffe1b430>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:43.334459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.335165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.335806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.336237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd55cad4-7037-48d5-8eca-f8e41b496b94 tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.336897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.337567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.338292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.366396 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dd55cad4-7037-48d5-8eca-f8e41b496b94 tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.262670 Oct 12 22:32:43.380376 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 327/605] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:43 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:43.387535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.388225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:43.395961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.396542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.397040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.397778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.398519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.398720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.404730 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d261b01-1794-4c91-a595-996d0ad977f7 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 328 microversion: 2.1 time: 0.166571 Oct 12 22:32:43.405951 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 279/606] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:32:43 2022] PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 328 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:43.422549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3800147-5bdb-4c18-baac-428eab0334a2 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.450076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3800147-5bdb-4c18-baac-428eab0334a2 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1774086263" status: 202 len: 0 microversion: 2.1 time: 0.035305 Oct 12 22:32:43.450881 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 280/607] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:43 2022] DELETE /compute/v2.1/flavors/1774086263 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:43.458602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5175f07d-5aab-4419-ac38-f4e4bf5f2ffe req-23298244-2966-4cbb-bfc1-ecc6e6785424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c3fadd-3c92-4818-b641-8799d43ed387", "tag": "08d5fd64-1e78-4647-b7f5-b975906b2fcb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:43.469361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5175f07d-5aab-4419-ac38-f4e4bf5f2ffe req-23298244-2966-4cbb-bfc1-ecc6e6785424 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.469835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5175f07d-5aab-4419-ac38-f4e4bf5f2ffe req-23298244-2966-4cbb-bfc1-ecc6e6785424 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.470333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5175f07d-5aab-4419-ac38-f4e4bf5f2ffe req-23298244-2966-4cbb-bfc1-ecc6e6785424 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.481852 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5175f07d-5aab-4419-ac38-f4e4bf5f2ffe req-23298244-2966-4cbb-bfc1-ecc6e6785424 service nova] Creating event network-changed:08d5fd64-1e78-4647-b7f5-b975906b2fcb for instance 04c3fadd-3c92-4818-b641-8799d43ed387 on n-h1-860864-8 Oct 12 22:32:43.487496 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5175f07d-5aab-4419-ac38-f4e4bf5f2ffe req-23298244-2966-4cbb-bfc1-ecc6e6785424 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032309 Oct 12 22:32:43.488667 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 281/608] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:43.493528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc38b987-ebf9-4b5f-822d-d18cf01ac765 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.534174 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc38b987-ebf9-4b5f-822d-d18cf01ac765 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.044283 Oct 12 22:32:43.534934 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 282/609] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:43 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:43.555980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-189927032", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:43.612736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:43.684092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.713688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.730239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.736825 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ed039d7-bc91-44e2-842b-57c81b41ed6c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.354424 Oct 12 22:32:43.737803 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 328/610] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:43 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:43.764976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b285dc08-959c-4076-889d-a58982c7f992 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1858735699", "id": 9670778, "os-flavor-access:is_public": "False"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:43.800514 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b285dc08-959c-4076-889d-a58982c7f992 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.058724 Oct 12 22:32:43.801387 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 329/611] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:43 2022] POST /compute/v2.1/flavors => generated 421 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:43.806563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.807350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:43.814458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.814943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.815378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.816131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:43.816587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:43.817011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:43.977974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:43.987449 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2913496-86a2-44ec-9bd6-d6eb69c2338a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1464 microversion: 2.1 time: 0.184460 Oct 12 22:32:43.988372 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 330/612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:43 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:43.993444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:43.994319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] [instance: ffef6ed9-2516-49f5-b84b-f8b053d8a3e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.000879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.001625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.002279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.003126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.003693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.004274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.008855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:44.021192 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] HTTP exception thrown: Instance ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 could not be found. Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Request method failure captured: Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 HTTP/1.1 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0A4NsHPwCmP-mqsfRVHof9t5Rsa_uusptqKfwCl6O6fyKd2ORkdHNo06QJAgxr31nJ2VR2T6Z4vLakjKF0sF3hRVvLuNDLlsIQSbzDMwPBuYMYQHBHql3ntS97HaXYX3NCipPTS7R1tba2_KWkQmOQwmr0pS5yFxv7vUi0L7oA_qCI Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.75 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d1b2e6f32faa4127ba19cc03ec7936a3 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdmin275Test-1337363168 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1b2e6f32faa4127ba19cc03ec7936a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1b2e6f32faa4127ba19cc03ec7936a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1b2e6f32faa4127ba19cc03ec7936a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1b2e6f32faa4127ba19cc03ec7936a3"}]}] Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdmin275Test-1337363168 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d1b2e6f32faa4127ba19cc03ec7936a3 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdmin275Test-1337363168 Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdmin275Test-1337363168-project Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 783a3886ae0e42d78df6ff0c7c5282bc Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdmin275Test-1337363168-project Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 could not be found. Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ffef6ed9-2516-49f5-b84b-f8b053d8a3e2'} Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 could not be found. Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 could not be found. Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:44.023542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.028117 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.028117 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:44.028117 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:44.028117 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:44.028117 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:44.028117 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 could not be found. Oct 12 22:32:44.028117 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.029463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] Returning 404 to user: Instance ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:44.030426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3aeb69c4-391e-498a-a87e-659ab4579ddd tempest-ServersAdmin275Test-1337363168 tempest-ServersAdmin275Test-1337363168-project] 10.222.0.20 "GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2" status: 404 len: 111 microversion: 2.75 time: 0.041095 Oct 12 22:32:44.031054 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 331/613] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:43 2022] GET /compute/v2.1/servers/ffef6ed9-2516-49f5-b84b-f8b053d8a3e2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:32:44.036206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae3988bf-e74d-4b42-ab0b-6e7aa8e6b89f tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "9670778"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:44.047373 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ae3988bf-e74d-4b42-ab0b-6e7aa8e6b89f tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] HTTP exception thrown: Flavor 9670778 could not be found. Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae3988bf-e74d-4b42-ab0b-6e7aa8e6b89f tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] Request method failure captured: Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 104 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CHsHlMY845VnxXhyzaDMiuQpT7pPXPYXosZcFfD2AlLhBbcrE3ODiJVzxpKQ-0cZbOdrIUrMst03JawBvqoiTAQc3bVPNGLa_o1S-QWRvtkgQPoMCS1R5_3X_o8cQTVDPmB5-wXcz58e3sHzn1cXHbWJDQbHtDH1o5nrqvtIk3c-g Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8229e2b047204530ad6bb60ae9ca9d1b Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsAdminTestJSON-78292296 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8229e2b047204530ad6bb60ae9ca9d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8229e2b047204530ad6bb60ae9ca9d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8229e2b047204530ad6bb60ae9ca9d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8229e2b047204530ad6bb60ae9ca9d1b"}]}] Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsAdminTestJSON-78292296 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8229e2b047204530ad6bb60ae9ca9d1b Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-78292296 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsAdminTestJSON-78292296-project Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 20b3c643cee64b279c1cbe6aa4722c07 Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsAdminTestJSON-78292296-project Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "test", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "9670778"}} Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: exception: Flavor 9670778 could not be found. Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '9670778'}}} Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9670778 could not be found. Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:44.050120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9670778 could not be found. Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9670778 could not be found. Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae3988bf-e74d-4b42-ab0b-6e7aa8e6b89f tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] Returning 400 to user: Flavor 9670778 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:44.054075 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ae3988bf-e74d-4b42-ab0b-6e7aa8e6b89f tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 78 microversion: 2.1 time: 0.019365 Oct 12 22:32:44.055559 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 332/614] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:44 2022] POST /compute/v2.1/servers => generated 78 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:32:44.064604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.065210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.072046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.072555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.072984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.073904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.074505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.075507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.078891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:44.079314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:44.079811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:44.080236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:44.080639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:44.098218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.098962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.099535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.103756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.104303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.105639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.152125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Getting quotas for project 13dfc831044d4535a5e856316eb4e27d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:44.165731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Getting quotas for user 78f7f5e57c9d419aa52149c4841a1bce and project 13dfc831044d4535a5e856316eb4e27d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:44.190446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.utils [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] instances quota exceeded for 13dfc831044d4535a5e856316eb4e27d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120543) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 22:32:44.191370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Request method failure captured: Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 144 Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0CH14ZxnTo5G4GQ3F_ut8eg-6abLPE32xuWR2QfzU4zQoR41q5W121mBGu4ekwghEdj5RUqmhXVylfx4Xv4FChl5QNFfqZqC2XmrriXKms4mf9VGozC66xapqYgdKrJLNG7Km_yv6RU5jLfxohZ4QfL5Te-h0bmG6DYsriEskKbvMY Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}] Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 78f7f5e57c9d419aa52149c4841a1bce Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-189927032", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-189927032', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452'}}} Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:32:44.195908 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a93ff900-e56a-4335-9d3c-d5fad796c1ec tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.645906 Oct 12 22:32:44.199548 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 283/615] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:43 2022] POST /compute/v2.1/servers => generated 119 bytes in 663 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:44.207070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7623becb-32e4-433c-9e5c-1ace6b0a53b6 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.228104 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7623becb-32e4-433c-9e5c-1ace6b0a53b6 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/9670778" status: 202 len: 0 microversion: 2.1 time: 0.028245 Oct 12 22:32:44.231640 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 284/616] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:32:44 2022] DELETE /compute/v2.1/flavors/9670778 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:44.237789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.238713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.245207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.245839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.246276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.246976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.247662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.247854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.255566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:44.271208 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-852ae411-ddcf-4816-8f02-c4d3d7265889 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1462 microversion: 2.1 time: 0.206957 Oct 12 22:32:44.272105 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 333/617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1462 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:44.287802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffc37dc0>, body: {"quota_set": {"instances": 10}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:44.552844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:44.569943 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36a96422-ff26-4915-a8b8-8bf9b639a8c4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.336971 Oct 12 22:32:44.571131 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 285/618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:44.577226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4316ecfd-00b5-4796-96be-8c5ef20608d9 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.601258 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4316ecfd-00b5-4796-96be-8c5ef20608d9 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.027689 Oct 12 22:32:44.602522 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 286/619] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:44.610288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1549330953", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1303196e-4aff-41e4-bba7-da44a13bd6bc"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:44.630388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.630915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.631336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.632120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.632572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.633025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.660392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:44.689455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:44.722451 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f51b8c39-4c25-4328-9a6e-4a2a4a899c11 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 329 microversion: 2.1 time: 0.443937 Oct 12 22:32:44.723498 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 334/620] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:32:44 2022] PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 329 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:44.739724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ffc0aca-858f-4eca-87c9-a965aa9bfcf2 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-676929205", "id": 1314532536, "os-flavor-access:is_public": "False"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:44.778149 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ffc0aca-858f-4eca-87c9-a965aa9bfcf2 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.052842 Oct 12 22:32:44.779059 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 335/621] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:44.786660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c1e9844-eaf5-47e4-830f-00da80e5c652 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Calling method '.version_select at 0x7f44ffb83c10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.865966 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c1e9844-eaf5-47e4-830f-00da80e5c652 tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 371 microversion: 2.1 time: 0.085626 Oct 12 22:32:44.867109 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 336/622] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:44.872472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:44.873342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:44.880394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.881100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.881765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:44.882650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:44.883308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:44.883719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.076716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:45.093637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:45.095629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:45.097170 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e32dac05-cdbd-421b-80a5-359103642a0d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.228615 Oct 12 22:32:45.102589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 337/623] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:44 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:45.106877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1951cd9c-17ae-44c2-96dc-e159d46a89c8 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1492061412", "id": 1861142647, "os-flavor-access:is_public": "True"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:45.129581 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1951cd9c-17ae-44c2-96dc-e159d46a89c8 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.027405 Oct 12 22:32:45.130504 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 338/624] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:45 2022] POST /compute/v2.1/flavors => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:45.144934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffb83040>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:45.235602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.238083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.238083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.239190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.239707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.240625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.295021 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57386bd7-c540-4a4d-8da5-ba84878518be tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 325 microversion: 2.1 time: 0.161263 Oct 12 22:32:45.295848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 339/625] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:32:45 2022] PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:45.300050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a662ec17-b315-4d8f-9af8-b7582b0828c8 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.321498 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a662ec17-b315-4d8f-9af8-b7582b0828c8 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.022030 Oct 12 22:32:45.321498 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 340/626] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:45.338388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a56c47c-8137-4e43-bdea-83d8d1d625ed tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.345887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:45.346631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:45.347685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:45.348594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:45.349976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:45.352653 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a56c47c-8137-4e43-bdea-83d8d1d625ed tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.020432 Oct 12 22:32:45.361321 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 341/627] 10.222.0.20 () {58 vars in 1177 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:45.376205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.381328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.383648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.384710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.386134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.386925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.388410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e50d3c8-7fb3-4707-8527-9ef3732fd455 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.422745 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e50d3c8-7fb3-4707-8527-9ef3732fd455 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.056920 Oct 12 22:32:45.430899 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 342/628] 10.222.0.20 () {58 vars in 1171 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:45.439033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37b93ac1-96e0-4514-a198-4fdd5347234a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.439770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Getting quotas for project aa1830ddea9a4dd9affc6b62a2bfdf1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:45.446365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Getting quotas for user ca520967e5914fe7b5e982f0bbbb9847 and project aa1830ddea9a4dd9affc6b62a2bfdf1d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:45.465025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:45.467753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:45.477194 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37b93ac1-96e0-4514-a198-4fdd5347234a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.044724 Oct 12 22:32:45.480772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 343/629] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:45.495313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6f3b95a-616d-4704-b596-47205238fbb7 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.506454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:45.559549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1508e080-8052-4c6e-b7e9-7da2cf1512a4 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953244 Oct 12 22:32:45.567841 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 287/630] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:32:45.570912 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6f3b95a-616d-4704-b596-47205238fbb7 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6223 microversion: 2.1 time: 0.081042 Oct 12 22:32:45.571668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-713954544", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:45.572650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 344/631] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:45.583218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a339f3d2-9c0a-4299-812b-e5f212cb9552 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.584083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a339f3d2-9c0a-4299-812b-e5f212cb9552 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:45.663647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a339f3d2-9c0a-4299-812b-e5f212cb9552 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:45.673724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:45.674315 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a339f3d2-9c0a-4299-812b-e5f212cb9552 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1214 microversion: 2.1 time: 0.094575 Oct 12 22:32:45.675597 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 345/632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:45.681074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86ac732a-0d65-4922-af75-2b1403cb1ce5 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.729238 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86ac732a-0d65-4922-af75-2b1403cb1ce5 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6223 microversion: 2.1 time: 0.051593 Oct 12 22:32:45.729919 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 346/633] 10.222.0.20 () {58 vars in 1175 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6223 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:45.735048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:45.739714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:45.762581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.765893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.766348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:45.769792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:45.770362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:45.773050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.022167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:46.036118 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4bc5863-575c-493c-bd8a-30742aeb3a44 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.300584 Oct 12 22:32:46.036902 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 347/634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:45 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.043749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b49e8a5-8a38-4ee5-80f8-a2906b2e4924 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.070183 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b49e8a5-8a38-4ee5-80f8-a2906b2e4924 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6223 microversion: 2.1 time: 0.031842 Oct 12 22:32:46.086495 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 348/635] 10.222.0.20 () {58 vars in 1173 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6223 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.093316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e97297de-a2fd-43b4-86c3-da241f153a82 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.127157 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e97297de-a2fd-43b4-86c3-da241f153a82 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6223 microversion: 2.1 time: 0.038513 Oct 12 22:32:46.141763 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 349/636] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6223 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.153234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.154085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:46.165367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.166582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.167386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.168436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.169173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.170017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.395716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:46.410118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:46.412025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:46.417124 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b08358a4-013f-45f5-ba4c-07ffa617898e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.274082 Oct 12 22:32:46.418941 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 350/637] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:46.448509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-312b641d-f621-4c20-9ac0-5e70540a6510 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.466686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:46.469404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:46.470222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:46.471000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:46.471566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:46.476838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-312b641d-f621-4c20-9ac0-5e70540a6510 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1861142647" status: 202 len: 0 microversion: 2.1 time: 0.057439 Oct 12 22:32:46.477746 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 351/638] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:46 2022] DELETE /compute/v2.1/flavors/1861142647 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:46.485193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.485797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.486337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.486723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65e35416-0c0c-437e-aa7d-15d83c74d64a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.487592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.488187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.488731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.544744 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65e35416-0c0c-437e-aa7d-15d83c74d64a tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.062544 Oct 12 22:32:46.559568 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 352/639] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.559770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Getting quotas for project 13dfc831044d4535a5e856316eb4e27d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:46.559770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Getting quotas for user 78f7f5e57c9d419aa52149c4841a1bce and project 13dfc831044d4535a5e856316eb4e27d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:46.572171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46b0a6ce-36cc-4334-9d28-cfa56627fdc1 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.604357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.utils [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] ram quota exceeded for 13dfc831044d4535a5e856316eb4e27d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120543) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 22:32:46.605021 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Request method failure captured: Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 144 Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0CH14ZxnTo5G4GQ3F_ut8eg-6abLPE32xuWR2QfzU4zQoR41q5W121mBGu4ekwghEdj5RUqmhXVylfx4Xv4FChl5QNFfqZqC2XmrriXKms4mf9VGozC66xapqYgdKrJLNG7Km_yv6RU5jLfxohZ4QfL5Te-h0bmG6DYsriEskKbvMY Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}] Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 78f7f5e57c9d419aa52149c4841a1bce Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-713954544", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-713954544', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452'}}} Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:32:46.607157 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe484230-0fb7-4e4a-9199-bd00e11beb43 tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.047395 Oct 12 22:32:46.612437 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 288/640] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 1049 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:46.634849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Action: 'update', calling method: .version_select at 0x7f44ffe3eb80>, body: {"quota_set": {"ram": 51200}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:46.652042 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46b0a6ce-36cc-4334-9d28-cfa56627fdc1 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1314532536" status: 202 len: 0 microversion: 2.1 time: 0.087809 Oct 12 22:32:46.652877 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 353/641] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:46 2022] DELETE /compute/v2.1/flavors/1314532536 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:32:46.675019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ea8be00-d93e-4ff1-aa6a-3ff394a1e171 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.712269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ea8be00-d93e-4ff1-aa6a-3ff394a1e171 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.051961 Oct 12 22:32:46.713438 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 354/642] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.734124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.740293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:46.753342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.754048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.754723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.755628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:46.757165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:46.757985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:46.879406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:46.891625 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92f592bb-f670-4c4d-b697-677d99d35523 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1266 microversion: 2.1 time: 0.176370 Oct 12 22:32:46.892270 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 355/643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:46.909450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4221a4b4-f5aa-4fef-9f80-29cbab0f426c tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1749580433", "id": 1940902216, "os-flavor-access:is_public": "False"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:46.948240 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4221a4b4-f5aa-4fef-9f80-29cbab0f426c tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.052665 Oct 12 22:32:46.949168 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 356/644] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:46 2022] POST /compute/v2.1/flavors => generated 415 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:46.963223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f841eb1-21e0-4c55-89ee-fe90b48bec7b tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:46.999421 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f841eb1-21e0-4c55-89ee-fe90b48bec7b tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.041565 Oct 12 22:32:47.000576 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 357/645] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:46 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:47.019557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0fe6baef-0a32-4737-9573-fbe1521ca053 tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.077954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0fe6baef-0a32-4737-9573-fbe1521ca053 tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.062528 Oct 12 22:32:47.078571 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 358/646] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:47.096865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.105146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:47.116468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.116973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.117410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.118165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.118560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.118984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.151776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.152596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.153301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.154157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.154710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.157247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.307217 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ec809e6-ca65-40d4-82fc-e2c60723c35f tempest-QuotasAdminNegativeTest-908496834 tempest-QuotasAdminNegativeTest-908496834-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 200 len: 329 microversion: 2.1 time: 0.686447 Oct 12 22:32:47.308609 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 289/647] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:32:46 2022] PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 329 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:47.324507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-016624eb-2a88-4f37-b636-0662cd88b541 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.381096 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-016624eb-2a88-4f37-b636-0662cd88b541 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1940902216" status: 202 len: 0 microversion: 2.1 time: 0.061696 Oct 12 22:32:47.381965 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 290/648] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:47 2022] DELETE /compute/v2.1/flavors/1940902216 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:47.394374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c25844f6-342d-499c-9b9a-195e49126cfa tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Action: 'update', calling method: .version_select at 0x7f44ffe3ec10>, body: {"quota_set": {"ram": 0}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:47.411618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c25844f6-342d-499c-9b9a-195e49126cfa tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '78f7f5e57c9d419aa52149c4841a1bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dfc831044d4535a5e856316eb4e27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c25844f6-342d-499c-9b9a-195e49126cfa tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Request method failure captured: Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d HTTP/1.1 Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 25 Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0CH14ZxnTo5G4GQ3F_ut8eg-6abLPE32xuWR2QfzU4zQoR41q5W121mBGu4ekwghEdj5RUqmhXVylfx4Xv4FChl5QNFfqZqC2XmrriXKms4mf9VGozC66xapqYgdKrJLNG7Km_yv6RU5jLfxohZ4QfL5Te-h0bmG6DYsriEskKbvMY Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13dfc831044d4535a5e856316eb4e27d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13dfc831044d4535a5e856316eb4e27d"}]}] Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 13dfc831044d4535a5e856316eb4e27d Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-578870308 Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 78f7f5e57c9d419aa52149c4841a1bce Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-QuotasAdminNegativeTest-578870308-project Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: {"quota_set": {"ram": 0}} Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '13dfc831044d4535a5e856316eb4e27d', 'body': {'quota_set': {'ram': 0}}} Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:32:47.417948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 22:32:47.422563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:32:47.425191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c25844f6-342d-499c-9b9a-195e49126cfa tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:47.427197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c25844f6-342d-499c-9b9a-195e49126cfa tempest-QuotasAdminNegativeTest-578870308 tempest-QuotasAdminNegativeTest-578870308-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d" status: 403 len: 116 microversion: 2.1 time: 0.041258 Oct 12 22:32:47.429034 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 291/649] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:32:47 2022] PUT /compute/v2.1/os-quota-sets/13dfc831044d4535a5e856316eb4e27d => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:47.449142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:47.463006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d40882d2-2854-456b-83cd-515757388fb8 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.465747 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-020e99c9-266e-410e-b70a-982a82da791c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.372760 Oct 12 22:32:47.467044 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 359/650] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:47.484047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ebb294db-8042-469d-95cb-17dbdfb6ad16 req-8fa697ac-095d-497f-b210-9bdcde6420e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3fa1d46-716f-4398-b632-5f38dbce83cb", "name": "network-vif-plugged", "status": "completed", "tag": "3c005992-3f1c-4460-9fb1-2094f54865e7"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:47.517110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ebb294db-8042-469d-95cb-17dbdfb6ad16 req-8fa697ac-095d-497f-b210-9bdcde6420e9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.517824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ebb294db-8042-469d-95cb-17dbdfb6ad16 req-8fa697ac-095d-497f-b210-9bdcde6420e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.519264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ebb294db-8042-469d-95cb-17dbdfb6ad16 req-8fa697ac-095d-497f-b210-9bdcde6420e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.553125 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ebb294db-8042-469d-95cb-17dbdfb6ad16 req-8fa697ac-095d-497f-b210-9bdcde6420e9 service nova] Creating event network-vif-plugged:3c005992-3f1c-4460-9fb1-2094f54865e7 for instance b3fa1d46-716f-4398-b632-5f38dbce83cb on n-h1-860864-8 Oct 12 22:32:47.555333 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d40882d2-2854-456b-83cd-515757388fb8 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.124814 Oct 12 22:32:47.566693 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ebb294db-8042-469d-95cb-17dbdfb6ad16 req-8fa697ac-095d-497f-b210-9bdcde6420e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096968 Oct 12 22:32:47.580852 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 292/652] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:47.591953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.593175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:47.594967 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 360/652] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:47.618014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a30da454-0e69-4f5b-9230-519a23fac682 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1389670973", "id": 1740155608, "os-flavor-access:is_public": "True"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:47.621281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.624365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.625898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.628065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.629033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.630556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.663916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:47.685901 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a30da454-0e69-4f5b-9230-519a23fac682 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.087862 Oct 12 22:32:47.688755 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 361/653] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:47 2022] POST /compute/v2.1/flavors => generated 414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:47.703805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40d7c22f-3972-4432-bdde-b21c675ff6da tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.772389 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40d7c22f-3972-4432-bdde-b21c675ff6da tempest-FlavorsAdminTestJSON-78292296 tempest-FlavorsAdminTestJSON-78292296-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.074827 Oct 12 22:32:47.775657 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 362/654] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:47.799695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-806b9f48-0f90-4d4c-8a86-b2a8f3871687 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.848140 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-806b9f48-0f90-4d4c-8a86-b2a8f3871687 tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1740155608" status: 202 len: 0 microversion: 2.1 time: 0.055055 Oct 12 22:32:47.852419 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 363/655] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:47 2022] DELETE /compute/v2.1/flavors/1740155608 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:47.864314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d0538c0-4984-44d2-bfb7-e0f9f9e864ee tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.899086 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d0538c0-4984-44d2-bfb7-e0f9f9e864ee tempest-FlavorsAdminTestJSON-470831804 tempest-FlavorsAdminTestJSON-470831804-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.045163 Oct 12 22:32:47.899866 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 364/656] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:47.916721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:47.919065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:47.939392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.940003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.941880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:47.943232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:47.946120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:47.946620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.069700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:48.084669 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3716caf-4a63-4124-be0b-70e70e1bb380 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1272 microversion: 2.1 time: 0.172381 Oct 12 22:32:48.087417 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 365/657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:48.310770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:48.327667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:48.331185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:48.334699 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d1ce6ce-6822-4f71-95e6-029a12a3b901 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.752488 Oct 12 22:32:48.335289 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 293/658] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:47 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:48.492740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:48.493349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:48.507980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:48.508287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:48.508721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.509421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:48.509877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:48.510293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:48.794398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:48.805243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ed95598f-b3ae-484f-a723-ae0c55d0c9e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1311 microversion: 2.1 time: 0.316343 Oct 12 22:32:48.818378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 366/659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:48 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1311 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:49.114884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:49.116004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:49.127470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.128075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.128796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.130210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.130881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.131674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.357616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.377537 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-086c04a2-0337-4593-9ce2-02fd70b5c527 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1272 microversion: 2.1 time: 0.267294 Oct 12 22:32:49.379761 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 294/660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:49.401386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:49.403742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:49.426650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.428927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.429981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.431501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:49.433831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:49.434386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:49.735760 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bad13f76-0d25-4d57-b19d-2fd20532861a tempest-TenantUsagesNegativeTestJSON-963537775 tempest-TenantUsagesNegativeTestJSON-963537775-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T22%3A32%3A49.210994&end=2022-10-13T22%3A32%3A49.210994" status: 404 len: 112 microversion: - time: 0.519996 Oct 12 22:32:49.737275 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 367/661] 10.222.0.20 () {58 vars in 1316 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T22%3A32%3A49.210994&end=2022-10-13T22%3A32%3A49.210994 => generated 112 bytes in 522 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 22:32:49.749411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-476dca22-d079-4851-96f1-ee7ace4a7c5a tempest-TenantUsagesNegativeTestJSON-963537775 tempest-TenantUsagesNegativeTestJSON-963537775-project-admin] Calling method '.version_select at 0x7f44ffb96ee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:49.762751 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-476dca22-d079-4851-96f1-ee7ace4a7c5a tempest-TenantUsagesNegativeTestJSON-963537775 tempest-TenantUsagesNegativeTestJSON-963537775-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-476dca22-d079-4851-96f1-ee7ace4a7c5a tempest-TenantUsagesNegativeTestJSON-963537775 tempest-TenantUsagesNegativeTestJSON-963537775-project-admin] Request method failure captured: Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-simple-tenant-usage/8831107e79cf4618bfebdd3481def8dd?start=2022-10-13T22%3A32%3A49.210994&end=2022-10-11T22%3A32%3A49.210994 HTTP/1.1 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CRFZ_zNXSqvCXIjmYYQs-5gSn6DZnCzheqHif3_Q_hfMIGdNGjvsZcLpLl3Rcb0x4C3PNvyrqwGbnZpKiOt20W2TN5Nsgbbrjrvb69B7zJLMLs7w9kCP55rFJJDonKVt7XGbEp3_HuyvgzkOi7Z4YE0knzFAU4CFga1uHK8D99hVo Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: fb4d4835d94143dd87b3eda826ccfd40 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-963537775 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb4d4835d94143dd87b3eda826ccfd40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb4d4835d94143dd87b3eda826ccfd40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb4d4835d94143dd87b3eda826ccfd40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb4d4835d94143dd87b3eda826ccfd40"}]}] Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-963537775 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: fb4d4835d94143dd87b3eda826ccfd40 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-963537775 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TenantUsagesNegativeTestJSON-963537775-project-admin Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 11b8ef4ed8bf4b3bb62e1a68a4e07d96 Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-963537775-project-admin Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid start time. The start time cannot occur after the end time. Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '8831107e79cf4618bfebdd3481def8dd'} Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 12 22:32:49.772605 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:49.782077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-476dca22-d079-4851-96f1-ee7ace4a7c5a tempest-TenantUsagesNegativeTestJSON-963537775 tempest-TenantUsagesNegativeTestJSON-963537775-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:49.783331 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-476dca22-d079-4851-96f1-ee7ace4a7c5a tempest-TenantUsagesNegativeTestJSON-963537775 tempest-TenantUsagesNegativeTestJSON-963537775-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/8831107e79cf4618bfebdd3481def8dd?start=2022-10-13T22%3A32%3A49.210994&end=2022-10-11T22%3A32%3A49.210994" status: 400 len: 111 microversion: 2.1 time: 0.040049 Oct 12 22:32:49.785001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 368/662] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/os-simple-tenant-usage/8831107e79cf4618bfebdd3481def8dd?start=2022-10-13T22%3A32%3A49.210994&end=2022-10-11T22%3A32%3A49.210994 => generated 111 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:32:49.954417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.977480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.979097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:49.980538 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f79881d7-1bcb-4505-badd-4361a5ad3e57 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.598550 Oct 12 22:32:49.996154 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 295/663] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:50.005088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:50.005966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:50.012403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.013117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.013703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.015126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.015742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.016339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.161476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07aadc1b-c96a-4a31-9499-a4f10eb5fadd tempest-TenantUsagesNegativeTestJSON-662650139 tempest-TenantUsagesNegativeTestJSON-662650139-project] Calling method '.version_select at 0x7f44ffb7b0d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:50.167413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-07aadc1b-c96a-4a31-9499-a4f10eb5fadd tempest-TenantUsagesNegativeTestJSON-662650139 tempest-TenantUsagesNegativeTestJSON-662650139-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '52f89abc85b94505a7a1e7edf0591b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8831107e79cf4618bfebdd3481def8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07aadc1b-c96a-4a31-9499-a4f10eb5fadd tempest-TenantUsagesNegativeTestJSON-662650139 tempest-TenantUsagesNegativeTestJSON-662650139-project] Request method failure captured: Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A32%3A49.210994&end=2022-10-13T22%3A32%3A49.210994&detailed=1 HTTP/1.1 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CQ35-_P8ghjmKyE9JfQOWK7oxpoTkRAEUX0VrvKg8E8HAhkpv6hzGwHh1csqb5uQaGCaoDE4otTWsCXLmxpb3pYaG9fw_099NmyL8exxUH5ne2_QkYYcbKBMBu-ojHOF2y3OlHIq5fbE3NlrCHRZppjiYiqIUn6-ge1OktkztnkeI Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8831107e79cf4618bfebdd3481def8dd Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-662650139 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8831107e79cf4618bfebdd3481def8dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8831107e79cf4618bfebdd3481def8dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8831107e79cf4618bfebdd3481def8dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8831107e79cf4618bfebdd3481def8dd"}]}] Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-662650139 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8831107e79cf4618bfebdd3481def8dd Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-662650139 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TenantUsagesNegativeTestJSON-662650139-project Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 52f89abc85b94505a7a1e7edf0591b68 Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-662650139-project Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:32:50.174867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 22:32:50.179000 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:32:50.181379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07aadc1b-c96a-4a31-9499-a4f10eb5fadd tempest-TenantUsagesNegativeTestJSON-662650139 tempest-TenantUsagesNegativeTestJSON-662650139-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:32:50.185747 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-07aadc1b-c96a-4a31-9499-a4f10eb5fadd tempest-TenantUsagesNegativeTestJSON-662650139 tempest-TenantUsagesNegativeTestJSON-662650139-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A32%3A49.210994&end=2022-10-13T22%3A32%3A49.210994&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.392584 Oct 12 22:32:50.187282 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 369/664] 10.222.0.20 () {58 vars in 1335 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A32%3A49.210994&end=2022-10-13T22%3A32%3A49.210994&detailed=1 => generated 123 bytes in 397 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:32:50.407851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:50.409207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:50.425836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.428287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.431021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.433807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.435780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.438802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.523433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:50.537821 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c4e4b2b-ec7a-4057-913b-240484d43d78 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1493 microversion: 2.1 time: 0.535712 Oct 12 22:32:50.539454 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 296/665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:49 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1493 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:50.565914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:50.567320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:50.582151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.582656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.583099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:50.583814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:50.584540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:50.585170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.067099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:51.087060 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9f8b2c6-a949-4d39-9635-607489b5ba06 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.683982 Oct 12 22:32:51.088102 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 370/666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:50 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:51.094240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:51.095548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:51.103838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.104497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.105188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.106002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.108060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.108897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.319809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:51.332932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:51.335393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:51.336889 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c31a5ba6-a0de-4007-a6bc-53a35ecaa50f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1568 microversion: 2.25 time: 0.247374 Oct 12 22:32:51.337725 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 371/667] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:51 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:51.595793 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-313edce6-5146-43d2-9d99-c8036b6f81d6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1644 microversion: 2.1 time: 1.034662 Oct 12 22:32:51.596988 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 297/668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:50 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1644 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:51.620837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:51.621633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:51.631681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.632439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.633019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.633862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.634453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.635041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.904590 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe938454-04f7-4684-8c95-543171f17ed4 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1644 microversion: 2.1 time: 0.286944 Oct 12 22:32:51.905175 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 372/669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:51 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1644 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:51.929535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:51.934046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.934725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.944566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.945616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:51.946234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:51.946820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:51.991430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afe64b6f-ef2c-41ae-a137-72ce422f6b17 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065456 Oct 12 22:32:51.994119 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 298/670] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:32:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:52.007353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:52.008098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:52.024540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.027337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.028199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:52.029232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.031290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.031865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:52.112135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:52.112976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:52.126213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.132994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.133512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:52.137869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.147335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.147770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:52.213009 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09d6b087-1c71-473d-9297-cdf12cd677f6 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb/action" status: 202 len: 0 microversion: 2.1 time: 0.204661 Oct 12 22:32:52.221441 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 373/671] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:32:52 2022] POST /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:52.227623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:52.230054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:52.249370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.250063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.250673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:52.251860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.253953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.255847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:52.600678 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2f38d9a-c3b1-40f3-99bb-587c5ed86694 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1649 microversion: 2.1 time: 0.377005 Oct 12 22:32:52.604656 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 374/672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:52 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1649 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:52.611569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:52.637197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:52.637896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:52.638718 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b42b4fc8-b7dd-42b3-b65c-2e2d55c8bc1d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.526530 Oct 12 22:32:52.644489 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 299/673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:52 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:32:52.666620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.667167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.667542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:52.668268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:52.672824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:52.674465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.002090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:53.016051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:53.019936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:53.021786 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ac4fca7-3870-43b1-b16f-83255ce39f84 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1543 microversion: 2.25 time: 0.415960 Oct 12 22:32:53.025462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 375/674] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:52 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1543 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:53.050208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7ede670-934d-4f80-b06d-49acde5a2b2c tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '.version_select at 0x7f44ffdc41f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:53.054462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7ede670-934d-4f80-b06d-49acde5a2b2c tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.056857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7ede670-934d-4f80-b06d-49acde5a2b2c tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.057734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7ede670-934d-4f80-b06d-49acde5a2b2c tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.100716 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7ede670-934d-4f80-b06d-49acde5a2b2c tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.054302 Oct 12 22:32:53.109866 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 300/675] 10.222.0.20 () {60 vars in 1184 bytes} [Wed Oct 12 22:32:53 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:53.128231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:53.128851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:53.134918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.135633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.140645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.141407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.141876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.142404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.191871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:53.464805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 04c3fadd-3c92-4818-b641-8799d43ed387 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:53.484363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-af880bb8-d078-426d-8ff4-92f031188815 req-88ea7871-7485-464f-9589-e82d4abb7870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0655ef74-07da-4d4c-9774-7cf77b06fdfe", "tag": "7f679fc0-5d04-40af-9f6a-1b3c5e608fad"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:53.504769 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c0161f3-b0e2-402e-a174-41cf6703fd20 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 2036 microversion: 2.25 time: 0.380461 Oct 12 22:32:53.506125 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 376/676] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:53 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 2036 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:53.510068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-af880bb8-d078-426d-8ff4-92f031188815 req-88ea7871-7485-464f-9589-e82d4abb7870 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.511842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-af880bb8-d078-426d-8ff4-92f031188815 req-88ea7871-7485-464f-9589-e82d4abb7870 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.512568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-af880bb8-d078-426d-8ff4-92f031188815 req-88ea7871-7485-464f-9589-e82d4abb7870 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.550860 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-af880bb8-d078-426d-8ff4-92f031188815 req-88ea7871-7485-464f-9589-e82d4abb7870 service nova] Creating event network-changed:7f679fc0-5d04-40af-9f6a-1b3c5e608fad for instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe on n-h2-860864-8 Oct 12 22:32:53.552873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1684abbe-abbe-4f3a-825e-446fcab0badb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Action: 'create', calling method: .version_select at 0x7f44ffb96700>, body: {"keypair": {"name": "tempest-keypair-12003459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZi5g27iLJ/vuiZ1vA0PT0GRyDEwTBHYNLDiX0o3stbP05cjXDwmiigYHr9rjMNzY7thetb5IK8AtOu2bNooQ8QfkHUAsJ/qTEfmCZ8nSr09Ywjvw3Q9b3+U/SoaZfD8w=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:53.566503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-af880bb8-d078-426d-8ff4-92f031188815 req-88ea7871-7485-464f-9589-e82d4abb7870 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123225 Oct 12 22:32:53.567395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 301/677] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:53.603947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1684abbe-abbe-4f3a-825e-446fcab0badb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for project accb9cc4a17842af84b0002428db16d8. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:53.629186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1684abbe-abbe-4f3a-825e-446fcab0badb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for user 03a180537b9149b1bf4250bc9965bb7b and project accb9cc4a17842af84b0002428db16d8. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:53.632004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:53.633628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:53.646509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.649907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.652323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.654190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.656118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.656565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.701079 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1684abbe-abbe-4f3a-825e-446fcab0badb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.154867 Oct 12 22:32:53.712154 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 377/678] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:32:53 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 22:32:53.725061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:53.725698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:53.746302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.746801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.747239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:53.749159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:53.749621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:53.750051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:54.008988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:54.024148 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f4d6003-0495-4ffc-8353-242604d6e9a1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.310802 Oct 12 22:32:54.040667 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 378/679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:53 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:54.242800 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d0ef3a6-ace7-4b67-9e28-1ab9bc60de47 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1629 microversion: 2.1 time: 0.617366 Oct 12 22:32:54.243401 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 302/680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:53 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1629 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:54.310518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b683a11a-260c-4a40-91f3-06bbebdbb896 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:54.322666 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b683a11a-260c-4a40-91f3-06bbebdbb896 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.280840 Oct 12 22:32:54.332613 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 379/681] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:54.338091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": true, "disk_over_commit": false}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:54.346156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-847048d3-b24e-417f-837e-c28e40ea4ce7 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-857743496", "id": 1535080181, "os-flavor-access:is_public": "False"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:54.352562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:54.371304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:54.374720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:54.376671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:54.378551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:54.380186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:54.380657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:54.381476 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-847048d3-b24e-417f-837e-c28e40ea4ce7 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.136826 Oct 12 22:32:54.383025 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 303/682] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:54.392838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d24efe25-f1f3-48da-a840-83f876763772 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:54.416730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lazy-loading 'flavor' on Instance uuid b3fa1d46-716f-4398-b632-5f38dbce83cb {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:32:54.427623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d24efe25-f1f3-48da-a840-83f876763772 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3080 microversion: 2.1 time: 0.041843 Oct 12 22:32:54.428801 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 304/683] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:32:54 2022] GET /compute/v2.1/flavors => generated 3080 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:54.433693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6cab5ae5-8b8e-46f6-bfff-0db5f3eb7cc4 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "74f44e07a43b48818a35722865904e28"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:54.458123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:32:54.555326 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6cab5ae5-8b8e-46f6-bfff-0db5f3eb7cc4 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1535080181/action" status: 200 len: 97 microversion: 2.1 time: 0.124802 Oct 12 22:32:54.565711 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 305/684] 10.222.0.20 () {60 vars in 1200 bytes} [Wed Oct 12 22:32:54 2022] POST /compute/v2.1/flavors/1535080181/action => generated 97 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:32:54.575775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f62fca18-3ee1-4b2e-abc7-cd5268fa4c6a tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:54.599442 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f62fca18-3ee1-4b2e-abc7-cd5268fa4c6a tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032269 Oct 12 22:32:54.600327 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 306/685] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:54.844224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-237005a6-a785-4838-a271-81f48fd00127 tempest-FlavorsAccessTestJSON-1010955204 tempest-FlavorsAccessTestJSON-1010955204-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:54.923302 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-237005a6-a785-4838-a271-81f48fd00127 tempest-FlavorsAccessTestJSON-1010955204 tempest-FlavorsAccessTestJSON-1010955204-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.1 time: 0.318480 Oct 12 22:32:54.923949 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 307/686] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:54 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:54.958332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-84341e8f-17fa-4e19-a834-659c829847e3 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:54.983394 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-84341e8f-17fa-4e19-a834-659c829847e3 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038423 Oct 12 22:32:54.987666 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 308/687] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:54.994701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6cc82f05-ea1f-4e37-b3d4-f34bd361818c tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "74f44e07a43b48818a35722865904e28"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:55.249295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=15 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:55.625405 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6cc82f05-ea1f-4e37-b3d4-f34bd361818c tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1535080181/action" status: 200 len: 21 microversion: 2.1 time: 0.635437 Oct 12 22:32:55.626267 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 309/688] 10.222.0.20 () {60 vars in 1200 bytes} [Wed Oct 12 22:32:54 2022] POST /compute/v2.1/flavors/1535080181/action => generated 21 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:32:55.632840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb8f3f61-107e-4833-95b8-7fe9b611a093 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:55.668089 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb8f3f61-107e-4833-95b8-7fe9b611a093 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.040053 Oct 12 22:32:55.668470 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 310/689] 10.222.0.20 () {58 vars in 1165 bytes} [Wed Oct 12 22:32:55 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:55.673493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:55.674101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:55.680466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:55.681169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:55.681804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:55.682482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:55.682926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:55.683367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:55.875629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:55.886969 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbed54f8-94bc-48ad-a067-4ed448096b89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.216063 Oct 12 22:32:55.900859 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 311/690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:55 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:56.285921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1306714174", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:56.356686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] validate_networks() for [('0e506d13-15ff-4b8b-9d07-c2653439eccd', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:56.727686 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-631f0026-45b6-437d-a9b9-101ec6cace6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb/action" status: 202 len: 0 microversion: 2.1 time: 2.392332 Oct 12 22:32:56.728414 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 380/691] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:32:54 2022] POST /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb/action => generated 0 bytes in 2395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:56.739132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-741525e9-af41-4eb1-9d51-fc979aa73711 tempest-FlavorsAccessTestJSON-1010955204 tempest-FlavorsAccessTestJSON-1010955204-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:56.788142 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-741525e9-af41-4eb1-9d51-fc979aa73711 tempest-FlavorsAccessTestJSON-1010955204 tempest-FlavorsAccessTestJSON-1010955204-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.053811 Oct 12 22:32:56.796300 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 381/692] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:56 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:56.803386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59c108ae-0e85-4306-ab52-308855d12372 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:56.830979 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59c108ae-0e85-4306-ab52-308855d12372 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033012 Oct 12 22:32:56.831600 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 382/693] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:56.839935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1062733273", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "5db0f38e-eee3-4a98-9554-12cc124c1fa6"}], "security_groups": [{"name": "tempest-securitygroup--993294808"}], "key_name": "tempest-keypair-12003459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:57.062700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] validate_networks() for [('5db0f38e-eee3-4a98-9554-12cc124c1fa6', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:32:57.300575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=53 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:57.644897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:57.645647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:57.647283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:57.647879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:57.663971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:57.682565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.684602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.687542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.694297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.695234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.695665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.711970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=26 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:57.746288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Getting quotas for project 8c15002537994560a842f23b197826b4. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:57.757042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Getting quotas for user c65aeb2c012642dda0626c77018d4b3a and project 8c15002537994560a842f23b197826b4. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:57.778640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:57.781293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:57.809052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:57.865248 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ab10f6a-5256-42dd-af0b-a1d3e664ce21 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.962966 Oct 12 22:32:57.869260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 312/694] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:32:57.881135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:57.882038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:57.899522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:32:57.900456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:32:57.903536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:32:57.904242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:32:57.904956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:32:57.918690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.920873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.924271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.927533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.932656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.933624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.934309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.935001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.937698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.945985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:57.946829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:57.955981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:57.989641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:32:57.999317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for user 03a180537b9149b1bf4250bc9965bb7b and project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:32:58.018067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:32:58.021066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:32:58.097137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a2f44aa7-7e95-4ace-a216-c7b588cb9d22 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.257001 Oct 12 22:32:58.100094 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 383/695] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:32:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:32:58.111091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0a78b19-6442-4536-a975-31df3fbd77dc tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.141970 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0a78b19-6442-4536-a975-31df3fbd77dc tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1535080181" status: 202 len: 0 microversion: 2.1 time: 0.039179 Oct 12 22:32:58.148888 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 384/696] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:58 2022] DELETE /compute/v2.1/flavors/1535080181 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:32:58.153895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34dce640-68f9-4af6-99c9-edd9a0b02b93 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.182002 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34dce640-68f9-4af6-99c9-edd9a0b02b93 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.031968 Oct 12 22:32:58.182964 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 385/697] 10.222.0.20 () {58 vars in 1169 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.189339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.190213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:58.200830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:58.202346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:58.203040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:58.203957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:58.204710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:58.205297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:58.213383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:58.222192 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d222b213-0818-4964-ba3d-418506c46d9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1503 microversion: 2.1 time: 0.351831 Oct 12 22:32:58.225921 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 313/698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:57 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.233530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71090a60-2721-471d-beda-4e7e210b6756 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.234149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71090a60-2721-471d-beda-4e7e210b6756 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:58.344213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71090a60-2721-471d-beda-4e7e210b6756 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:58.356718 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71090a60-2721-471d-beda-4e7e210b6756 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1224 microversion: 2.1 time: 0.129635 Oct 12 22:32:58.368396 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 314/699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1224 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.378251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dfe3ea43-8be6-48e5-89f4-3e96c2263d9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.379168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dfe3ea43-8be6-48e5-89f4-3e96c2263d9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:58.478315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dfe3ea43-8be6-48e5-89f4-3e96c2263d9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:58.490362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dfe3ea43-8be6-48e5-89f4-3e96c2263d9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:58.493044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dfe3ea43-8be6-48e5-89f4-3e96c2263d9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:58.495462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dfe3ea43-8be6-48e5-89f4-3e96c2263d9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1284 microversion: 2.25 time: 0.125982 Oct 12 22:32:58.511028 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 315/700] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:58.525627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7870876a-c932-41e7-af43-edd505c80e59 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.576859 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7870876a-c932-41e7-af43-edd505c80e59 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.064971 Oct 12 22:32:58.577461 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 316/701] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.596754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35ae60c0-8e05-4d78-8b17-612aec042de4 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.618608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35ae60c0-8e05-4d78-8b17-612aec042de4 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032489 Oct 12 22:32:58.619416 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 317/702] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:58.637742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:58.644586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01c3076f-51b4-4e94-8ba8-47b362768a77 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-340279909", "id": 1107885541, "os-flavor-access:is_public": "False"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:58.652988 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d2db31f-846e-443b-8143-6fe4163ca7f7 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.468530 Oct 12 22:32:58.655426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 386/703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.692700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d8756ec-4259-48f5-a19e-d8a57f386a11 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.692902 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01c3076f-51b4-4e94-8ba8-47b362768a77 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.071910 Oct 12 22:32:58.693934 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 318/704] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:32:58 2022] POST /compute/v2.1/flavors => generated 430 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:58.703467 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d8756ec-4259-48f5-a19e-d8a57f386a11 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024832 Oct 12 22:32:58.706259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f16eb093-04f6-478a-a755-31d886055365 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.716356 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 387/705] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:58.722184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e53fbbdc-4791-42ae-9a2d-608a183f6787 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.730416 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f16eb093-04f6-478a-a755-31d886055365 tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1107885541/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.027953 Oct 12 22:32:58.731352 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 319/706] 10.222.0.20 () {58 vars in 1209 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/1107885541/os-flavor-access => generated 21 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:32:58.741358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-033ee0f3-f025-4085-af52-d3914f92676a tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.785487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-033ee0f3-f025-4085-af52-d3914f92676a tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1107885541" status: 202 len: 0 microversion: 2.1 time: 0.047644 Oct 12 22:32:58.792990 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 320/707] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:32:58 2022] DELETE /compute/v2.1/flavors/1107885541 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:32:58.799754 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e53fbbdc-4791-42ae-9a2d-608a183f6787 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.081818 Oct 12 22:32:58.801638 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 388/708] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.813015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-abe577a6-37b0-4012-9b4e-f3b0a8145d6a tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.821652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65921efd-4208-4737-9f58-d36ac1e0059f tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.831341 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65921efd-4208-4737-9f58-d36ac1e0059f tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013958 Oct 12 22:32:58.832384 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 389/709] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:58.845681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8df7d412-f536-4453-9540-326c7b4a3c9e tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:58.848671 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-abe577a6-37b0-4012-9b4e-f3b0a8145d6a tempest-FlavorsAccessTestJSON-1147683777 tempest-FlavorsAccessTestJSON-1147683777-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.051385 Oct 12 22:32:58.854818 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 321/710] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:58.913286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5a4520b5-e788-414f-a058-8129ecd0ca5c req-f70273e4-082e-4e22-9893-602eda2920b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3fa1d46-716f-4398-b632-5f38dbce83cb", "name": "network-vif-unplugged", "status": "completed", "tag": "3c005992-3f1c-4460-9fb1-2094f54865e7"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:32:58.927748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5a4520b5-e788-414f-a058-8129ecd0ca5c req-f70273e4-082e-4e22-9893-602eda2920b4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:58.928567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5a4520b5-e788-414f-a058-8129ecd0ca5c req-f70273e4-082e-4e22-9893-602eda2920b4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:58.928881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5a4520b5-e788-414f-a058-8129ecd0ca5c req-f70273e4-082e-4e22-9893-602eda2920b4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:58.985808 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5a4520b5-e788-414f-a058-8129ecd0ca5c req-f70273e4-082e-4e22-9893-602eda2920b4 service nova] Creating event network-vif-unplugged:3c005992-3f1c-4460-9fb1-2094f54865e7 for instance b3fa1d46-716f-4398-b632-5f38dbce83cb on n-h1-860864-8 Oct 12 22:32:58.996441 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5a4520b5-e788-414f-a058-8129ecd0ca5c req-f70273e4-082e-4e22-9893-602eda2920b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092135 Oct 12 22:32:58.999608 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 322/711] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:32:59.200097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8df7d412-f536-4453-9540-326c7b4a3c9e tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.357747 Oct 12 22:32:59.201616 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 390/712] 10.222.0.20 () {58 vars in 1144 bytes} [Wed Oct 12 22:32:58 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:59.218285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a77b9ba-66f4-445a-b1fc-c7138777fbf6 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.229814 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a77b9ba-66f4-445a-b1fc-c7138777fbf6 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017056 Oct 12 22:32:59.230400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 323/713] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:59.243732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d18df34e-d8e2-44ce-9f2c-a9436c0492ea tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.266996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.269549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:59.310289 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d18df34e-d8e2-44ce-9f2c-a9436c0492ea tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.071028 Oct 12 22:32:59.313187 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 391/714] 10.222.0.20 () {58 vars in 1148 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:59.313670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.314184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.314615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.323594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.328136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.332179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.346169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ed671ac-f430-4243-a683-8f29678dac99 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.377276 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ed671ac-f430-4243-a683-8f29678dac99 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.055783 Oct 12 22:32:59.378019 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 392/715] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:59.392439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.393056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:59.404646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.405143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.405577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.413119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.413942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.414445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.611177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:59.623645 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46b19903-48f6-44e8-9a86-d481195d83df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1276 microversion: 2.1 time: 0.239987 Oct 12 22:32:59.624386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 393/716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:59.646797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:59.657632 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0accd3d-a7b7-44e7-a356-a24b1faf2f68 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1503 microversion: 2.1 time: 0.403830 Oct 12 22:32:59.658228 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 324/717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:59.666119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd2c4840-b48b-4108-b531-103569c8aa74 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.675367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.676074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:59.679932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:32:59.691779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.692229 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd2c4840-b48b-4108-b531-103569c8aa74 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028798 Oct 12 22:32:59.693182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.693827 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 394/718] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:32:59.700264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.701722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.702202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.702625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.710998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.713078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:32:59.736252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.738038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.739122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.740509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:32:59.741259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:32:59.743433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:32:59.820802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:59.836920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:59.840606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:32:59.846430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-07683eb8-17da-4971-a139-b37f8ef436a7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1280 microversion: 2.25 time: 0.184580 Oct 12 22:32:59.847400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 325/719] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:32:59.864156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b11b6128-53af-4869-8a14-e295112824ef tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:32:59.963843 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b11b6128-53af-4869-8a14-e295112824ef tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.114860 Oct 12 22:32:59.964669 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 326/720] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:32:59.982986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13d8c699-bd52-43c6-87eb-2b470858c859 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:00.019370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13d8c699-bd52-43c6-87eb-2b470858c859 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.040580 Oct 12 22:33:00.020290 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 327/721] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:00.032142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:00.037044 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d0d2af5-4c60-484d-b924-392d2e0184d6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.333566 Oct 12 22:33:00.037044 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 395/722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:32:59 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:00.044841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a014c118-f5f3-48d7-98ce-0d3806ccc161 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:00.053960 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a014c118-f5f3-48d7-98ce-0d3806ccc161 tempest-FlavorsV2TestJSON-381701780 tempest-FlavorsV2TestJSON-381701780-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013663 Oct 12 22:33:00.060439 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 328/723] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:33:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:33:00.651103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:00.651718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:00.664984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:00.665750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:00.666371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:00.667245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:00.667847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:00.671002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:00.689891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:00.690396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:00.706206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:00.706997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:00.707925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:00.709109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:00.716218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:00.718345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:00.735235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:00.902869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:00.910789 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d459c6b1-8a03-4848-9d34-f2c2b0cfe0df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1282 microversion: 2.1 time: 0.263815 Oct 12 22:33:00.912017 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 396/724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:00 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:00.917206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:00.924592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:00.932366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:00.938440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:00.939061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:00.939992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:00.940599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:00.941194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:01.104937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:01.121313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:01.123014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:01.128934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38d0185c-16b4-4433-91e3-9f8f359e3743 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1344 microversion: 2.25 time: 0.215311 Oct 12 22:33:01.131435 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 397/725] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:00 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1344 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:01.147328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2fed6777-01b5-461f-b179-3202fb15c301 req-48ec9648-2c13-4df8-b37e-62611907daee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3fa1d46-716f-4398-b632-5f38dbce83cb", "tag": "3c005992-3f1c-4460-9fb1-2094f54865e7"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:01.189674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fed6777-01b5-461f-b179-3202fb15c301 req-48ec9648-2c13-4df8-b37e-62611907daee service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:01.190579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fed6777-01b5-461f-b179-3202fb15c301 req-48ec9648-2c13-4df8-b37e-62611907daee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:01.191365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fed6777-01b5-461f-b179-3202fb15c301 req-48ec9648-2c13-4df8-b37e-62611907daee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:01.220653 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2fed6777-01b5-461f-b179-3202fb15c301 req-48ec9648-2c13-4df8-b37e-62611907daee service nova] Creating event network-changed:3c005992-3f1c-4460-9fb1-2094f54865e7 for instance b3fa1d46-716f-4398-b632-5f38dbce83cb on n-h1-860864-8 Oct 12 22:33:01.228060 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2fed6777-01b5-461f-b179-3202fb15c301 req-48ec9648-2c13-4df8-b37e-62611907daee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094869 Oct 12 22:33:01.231110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 398/726] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:01.244821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:01.245769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:01.258025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:01.259521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:01.260155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:01.261034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:01.261642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:01.262221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:01.673846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:01.678348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:01.692618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5690f796-2b29-4a5f-9396-d2e248988b61 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1503 microversion: 2.1 time: 1.010483 Oct 12 22:33:01.698163 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-161d6e63-4374-46df-886f-46fd0490045d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.464083 Oct 12 22:33:01.698682 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 329/727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:00 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1503 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:01.708739 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 399/728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:01 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:01.940174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:01.943405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:01.959151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:01.959961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:01.960606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:01.961572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:01.962263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:01.962923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:02.137451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:02.152135 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18b4026d-83fa-44fe-91ae-1d4edf4f35b5 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1282 microversion: 2.1 time: 0.218790 Oct 12 22:33:02.156498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:02.157119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:02.170284 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 330/729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:01 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:02.173991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:02.174320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:02.174754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:02.183016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:02.183676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:02.184334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:02.327507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:02.344251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:02.345780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:02.350663 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a095d734-dd5d-405e-b4ac-e737e5bb4f69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1342 microversion: 2.25 time: 0.199914 Oct 12 22:33:02.354052 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 400/730] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:02 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:33:02.722660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:02.723265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:02.724395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:02.725246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:02.733325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:02.734137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:02.746239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:02.746750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:02.747202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:02.747676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:02.748031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:02.748494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:02.748920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:02.750132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:02.750993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:02.751628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:03.272358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:03.282310 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5086c738-2bd4-4ca8-9548-7fe7facbb23c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.563513 Oct 12 22:33:03.286108 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 401/731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:02 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:03.294380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:03.295003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:03.310486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:03.311068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:03.311743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:03.313381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:03.313840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:03.314374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:03.520939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:03.549939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-97fbfb8d-ec3d-4ff1-acca-1809787ed27c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1503 microversion: 2.1 time: 0.830909 Oct 12 22:33:03.552509 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 331/732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:02 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1503 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:03.561490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:03.562491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:03.576465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:03.578861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:03.584164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:03.585160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:03.585788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:03.587704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:03.632081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:03.642691 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50eb7d78-cb93-456c-b48e-d12679d6885c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.355405 Oct 12 22:33:03.655383 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 402/733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:03 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:03.793390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:03.810860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:03.813106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:03.815927 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1342 microversion: 2.25 time: 0.261910 Oct 12 22:33:03.822282 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 332/734] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:03 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:04.075462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-156f976e-4dc4-4289-993b-9414b0ca46a0 req-d448f8d8-7d70-4c8c-ae1d-e3ab61cc1672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0655ef74-07da-4d4c-9774-7cf77b06fdfe", "name": "network-vif-plugged", "status": "completed", "tag": "7f679fc0-5d04-40af-9f6a-1b3c5e608fad"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:04.097597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-156f976e-4dc4-4289-993b-9414b0ca46a0 req-d448f8d8-7d70-4c8c-ae1d-e3ab61cc1672 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:04.099828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-156f976e-4dc4-4289-993b-9414b0ca46a0 req-d448f8d8-7d70-4c8c-ae1d-e3ab61cc1672 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:04.100299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-156f976e-4dc4-4289-993b-9414b0ca46a0 req-d448f8d8-7d70-4c8c-ae1d-e3ab61cc1672 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:04.127679 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-156f976e-4dc4-4289-993b-9414b0ca46a0 req-d448f8d8-7d70-4c8c-ae1d-e3ab61cc1672 service nova] Creating event network-vif-plugged:7f679fc0-5d04-40af-9f6a-1b3c5e608fad for instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe on n-h2-860864-8 Oct 12 22:33:04.142203 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-156f976e-4dc4-4289-993b-9414b0ca46a0 req-d448f8d8-7d70-4c8c-ae1d-e3ab61cc1672 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070517 Oct 12 22:33:04.143008 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 403/735] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:04.237333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:04.238329 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53528dab-bea3-4677-a03a-fac18800e8aa tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001632 Oct 12 22:33:04.239751 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 333/736] 10.222.0.20 () {56 vars in 886 bytes} [Wed Oct 12 22:33:04 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:33:04.307145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:04.307862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:04.325563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:04.329093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:04.329745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:04.330642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:04.332793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:04.333528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:04.581356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:04.583047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:04.596552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:04.602098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:04.602934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:04.606620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:04.607786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:04.610594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:04.820172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:04.833312 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-393b2c79-9b02-4282-a332-42157a41be87 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.527910 Oct 12 22:33:04.836021 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 404/737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:04 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:04.847405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:04.852876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:04.867282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:04.872767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:04.873495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:04.874468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:04.875110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:04.875732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:05.076586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:05.093216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3d6d7e7-c53f-47ef-9bed-2d35cab923f9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1503 microversion: 2.1 time: 0.517125 Oct 12 22:33:05.108454 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 334/738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:04 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1503 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:05.111951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:05.112578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:05.118611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:05.119095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:05.119927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:05.120637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:05.121267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:05.121846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:05.327628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:05.336276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:05.348219 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e05aee78-9be7-4409-914a-509b28bac95f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.506797 Oct 12 22:33:05.350142 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 405/739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:04 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:05.362232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:05.377282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:05.389529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:05.393247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bec17ba7-dd0c-4e98-9e13-4a0f805c71d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.298141 Oct 12 22:33:05.394596 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 335/740] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:05 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:05.859419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:05.860241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:05.906932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:05.907431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:05.908044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:05.916636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:05.917194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:05.917693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:06.088663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-986531a8-1613-4505-b619-8f8963682a44 req-b1e29cfe-453c-4a39-bf5d-59eb25447316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df47842-42b9-4478-9048-bcc1c1649310", "tag": "2927133e-dc79-4969-a068-64aad27efa20"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:06.119642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-986531a8-1613-4505-b619-8f8963682a44 req-b1e29cfe-453c-4a39-bf5d-59eb25447316 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:06.120256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-986531a8-1613-4505-b619-8f8963682a44 req-b1e29cfe-453c-4a39-bf5d-59eb25447316 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:06.120902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-986531a8-1613-4505-b619-8f8963682a44 req-b1e29cfe-453c-4a39-bf5d-59eb25447316 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:06.165073 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-986531a8-1613-4505-b619-8f8963682a44 req-b1e29cfe-453c-4a39-bf5d-59eb25447316 service nova] Creating event network-changed:2927133e-dc79-4969-a068-64aad27efa20 for instance 0df47842-42b9-4478-9048-bcc1c1649310 on n-h1-860864-8 Oct 12 22:33:06.182624 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-986531a8-1613-4505-b619-8f8963682a44 req-b1e29cfe-453c-4a39-bf5d-59eb25447316 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107937 Oct 12 22:33:06.183846 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 336/741] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:06.194600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:06.200228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:06.208070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:06.208884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:06.209524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:06.210420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:06.211035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:06.211778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:06.485897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:06.496239 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d45bb7f9-8cfb-4767-95c0-340a50cd9872 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1314 microversion: 2.1 time: 0.639650 Oct 12 22:33:06.513117 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 406/742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:05 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:06.517911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:06.517911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:06.524258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:06.524782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:06.525220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:06.525934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:06.526389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:06.526809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:07.026105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:07.037415 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-829bb768-8c09-44f2-9b0c-41716ec8d73e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.523942 Oct 12 22:33:07.039308 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 407/743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:06 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:07.067034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:07.067749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:07.076927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:07.079880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:07.080498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:07.082723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:07.084767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:07.085441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:07.219260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:07.236188 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ab1a6978-874c-4062-a6c9-9ebacc7a40b8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1503 microversion: 2.1 time: 1.050085 Oct 12 22:33:07.237110 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 337/744] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:06 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1503 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:07.525653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:07.526263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:07.537415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:07.539340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:07.540757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:07.549432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:07.550162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:07.550757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:07.654593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:07.662800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:07.664829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:07.666128 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-037045c1-55dd-49f8-90e8-a2167a4fb24d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.625671 Oct 12 22:33:07.677084 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 408/745] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:07 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:07.739580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:07.892142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:07.921350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-10d8ca1e-bda3-40de-a3ff-589b8ad869fd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1464 microversion: 2.1 time: 0.399476 Oct 12 22:33:07.923799 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 338/746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:07 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1464 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:07.975535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:08.012553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=39 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:08.065911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:08.066825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:08.075417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:08.076214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:08.076837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:08.078403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:08.079029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:08.080228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:08.501964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:08.591750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:08.597371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Searching by: {'deleted': False, 'project_id': 'c3906d9e8dd843599769c7765d2724d6'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:08.619457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:08.620986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:08.628654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:08.630036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:08.630729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:08.633992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:08.941903 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-454cace7-53f4-4012-a66d-ce29e06c484b tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.996413 Oct 12 22:33:08.942922 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 409/747] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:08.965416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-434273f0-1e68-4f16-8d56-dd2e6ce6b745 req-11144059-7b68-4dbd-b3f5-10a64464149d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa0aaef-a675-4aed-a3e3-93790420d284", "tag": "a581aa07-c5be-4251-bae8-eb700c203ba5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:08.992979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-434273f0-1e68-4f16-8d56-dd2e6ce6b745 req-11144059-7b68-4dbd-b3f5-10a64464149d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:08.993732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-434273f0-1e68-4f16-8d56-dd2e6ce6b745 req-11144059-7b68-4dbd-b3f5-10a64464149d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:08.994317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-434273f0-1e68-4f16-8d56-dd2e6ce6b745 req-11144059-7b68-4dbd-b3f5-10a64464149d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.020056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:09.023238 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-434273f0-1e68-4f16-8d56-dd2e6ce6b745 req-11144059-7b68-4dbd-b3f5-10a64464149d service nova] Creating event network-changed:a581aa07-c5be-4251-bae8-eb700c203ba5 for instance 8fa0aaef-a675-4aed-a3e3-93790420d284 on n-h1-860864-8 Oct 12 22:33:09.034353 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-434273f0-1e68-4f16-8d56-dd2e6ce6b745 req-11144059-7b68-4dbd-b3f5-10a64464149d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088913 Oct 12 22:33:09.035559 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 410/748] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:09.038567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b9388d4-796a-410c-a4e5-e37e3bfeb7fc tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.980361 Oct 12 22:33:09.044757 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 339/749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:08 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:09.050358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:09.057269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:09.066262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:09.067352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.068146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.069004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.070225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.070541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:09.071320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.072273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.087470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.097214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.101126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.102733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.105534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.105534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.465549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:09.475307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19cb11ef-7a74-4b52-a856-bea67f6d2fec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1478 microversion: 2.1 time: 0.437026 Oct 12 22:33:09.479249 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 411/750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:09 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1478 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:09.485775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:09.514756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Searching by: {'deleted': False} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:09.525194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.526241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.528329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.531541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.535986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.536649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.620656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:09.642223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:09.647645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:09.650963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b701cfd-468c-4114-9697-b137db292391 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.601671 Oct 12 22:33:09.653909 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 340/751] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:09 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:09.682874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be4d255b-5d86-4bdb-ab21-9ec8e0a6e5e0 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '.version_select at 0x7f44ffd64160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:09.706509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be4d255b-5d86-4bdb-ab21-9ec8e0a6e5e0 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.708266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be4d255b-5d86-4bdb-ab21-9ec8e0a6e5e0 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.710284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be4d255b-5d86-4bdb-ab21-9ec8e0a6e5e0 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.739061 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be4d255b-5d86-4bdb-ab21-9ec8e0a6e5e0 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.081899 Oct 12 22:33:09.759217 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 341/752] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:33:09 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:09.783654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:09.784607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:09.801019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.804208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.807668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.808780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:09.812406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:09.814163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:09.887275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:33:10.256120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:10.256673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:10.258167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:11.100386 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e9f413c-2317-4b52-9594-b3872a9add25 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16208 microversion: 2.1 time: 1.618014 Oct 12 22:33:11.101770 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 412/753] 10.222.0.20 () {58 vars in 1171 bytes} [Wed Oct 12 22:33:09 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16208 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:33:11.106924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:11.107790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:11.123624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:11.124406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:11.125035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:11.125930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:11.130656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:11.131308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:11.416746 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7b567167-6fb3-42b6-962a-f64014b81150 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1629 microversion: 2.1 time: 1.654628 Oct 12 22:33:11.420031 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 342/754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:09 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1629 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:11.440477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:11.441513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:11.449607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:11.450510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:11.451189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:11.452365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:11.453099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:11.453772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:11.535340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:11.554410 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e964521-2ead-4db0-80db-a3e1887a820f tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.449596 Oct 12 22:33:11.555566 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 413/755] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:11 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:11.732503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:11.748769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:11.754006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:11.755282 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6116d6d5-6b5d-4776-bbf6-aa542991475b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.334043 Oct 12 22:33:11.757562 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 343/756] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:11 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:11.769522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:11.784184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Searching by: {'deleted': False, 'project_id': 'c3906d9e8dd843599769c7765d2724d6'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:11.799925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:11.801942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:11.803091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:11.806445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:11.809640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:11.810333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:11.993761 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-49f4ee0e-2a91-40d3-bed3-6808fa803c97 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=aa1830ddea9a4dd9affc6b62a2bfdf1d" status: 200 len: 15 microversion: 2.1 time: 0.234926 Oct 12 22:33:12.000024 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 344/757] 10.222.0.20 () {58 vars in 1231 bytes} [Wed Oct 12 22:33:11 2022] GET /compute/v2.1/servers/detail?tenant_id=aa1830ddea9a4dd9affc6b62a2bfdf1d => generated 15 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:12.010731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2249c03-2163-47f2-8d06-4dabe036ae9b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Action: 'create', calling method: .version_select at 0x7f44ffdc4dc0>, body: {"keypair": {"name": "tempest-keypair-89062266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbGTvCm9r6xyOMmH7pxErt13vWZZYCWSU0PBKV5xFQ6gRVrpLg8hSeAWl9zcX8Snnk4UsAkkiQN3nDZ9s7Hw1WHXYPr0BuWUPg/vLRJU3no2umPqZJjCLmDY9RvDDAOCg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:12.051095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e2249c03-2163-47f2-8d06-4dabe036ae9b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:12.057746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e2249c03-2163-47f2-8d06-4dabe036ae9b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for user dd8fdd646f8546a0a3aae53d1b55a8b1 and project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:12.107860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffca35e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:12.111245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.114197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.116249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.127833 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2249c03-2163-47f2-8d06-4dabe036ae9b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.130106 Oct 12 22:33:12.138359 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 345/758] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:33:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:12.165246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.170580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.172624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.184105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:12.211940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.212804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.214134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.214411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Searching by: {'tenant_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'deleted': False} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:12.229204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.230131 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fdf1ee7d-8183-488e-a2c9-99298eaf5080 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.673322 Oct 12 22:33:12.230806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.230942 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 414/759] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:12.231302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.241920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.242051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:12.242450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:12.243726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.244531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.253342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.256285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.256754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.257484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.261525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.262251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.315990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:33:12.338371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:33:12.532138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-021801b6-3e77-4150-84ba-d4a6f7823786 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 204 len: 0 microversion: 2.1 time: 0.299826 Oct 12 22:33:12.533187 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 415/760] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:33:12 2022] DELETE /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:33:12.542276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffdbbe50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:12.550697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.551517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.552131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.590701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.592578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.593227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.638559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.640788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.645761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.672571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.675924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3aef560-741e-402c-aeff-eeeaae95729f tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.141342 Oct 12 22:33:12.676716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.677355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.688628 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 416/761] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 12 22:33:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:12.693535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:12.701211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:12.722276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.723240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.724480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.725852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.726512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.727138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.957453 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a57b475-5351-4ca7-8e26-e6710749e069 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=aa1830ddea9a4dd9affc6b62a2bfdf1d" status: 200 len: 4826 microversion: 2.1 time: 0.817876 Oct 12 22:33:12.958520 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 346/762] 10.222.0.20 () {58 vars in 1257 bytes} [Wed Oct 12 22:33:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=aa1830ddea9a4dd9affc6b62a2bfdf1d => generated 4826 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:12.975036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:12.975036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:12.989222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.989888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.990429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:12.995055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:12.995055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:12.995494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.246088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:13.257290 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bee52dab-f5fd-411b-8124-6c9b5286041e tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1711 microversion: 2.1 time: 0.567402 Oct 12 22:33:13.259068 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 417/763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:12 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1711 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:13.277201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffe2fe50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.280940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.281578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.284245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.358145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.358976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.359673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.378685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.380347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.382433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.397884 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2932e4bc-2a35-4fb2-87fb-9d0813748593 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.137361 Oct 12 22:33:13.398635 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 418/764] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:13.408796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.409723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:13.410336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:13.420051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.420720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.421362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.422267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.423293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.423733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.427535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ca0dea6-1700-4800-98ed-06bde3d2d5e9 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.460305 Oct 12 22:33:13.448283 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 347/765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:12 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:13.468859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.488647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Searching by: {'tenant_id': 'c3906d9e8dd843599769c7765d2724d6', 'deleted': False} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:13.506385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.507062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.508950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.510344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.513123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.515532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.591053 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b84656d1-3802-4c76-87c7-15b218074623 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c3906d9e8dd843599769c7765d2724d6" status: 200 len: 15 microversion: 2.1 time: 0.139245 Oct 12 22:33:13.592883 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 348/766] 10.222.0.20 () {58 vars in 1257 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c3906d9e8dd843599769c7765d2724d6 => generated 15 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:13.617427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffe559d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.619252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.619952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.620406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.643349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=94,nova_api:DELETE=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:13.648454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.649608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.650194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.667306 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ee8e75b-9cd3-44de-949b-79fcfe50501d tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.059035 Oct 12 22:33:13.668641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 349/767] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:13.677015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cf3244e-d8e8-4e3c-9ad9-a241488180cd tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.680891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:13.692563 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1cf3244e-d8e8-4e3c-9ad9-a241488180cd tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.022041 Oct 12 22:33:13.696013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:13.703372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:13.704828 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-668c7f9e-a0a4-49dc-8bf5-54acc0b346d1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.301606 Oct 12 22:33:13.710294 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 419/768] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:13.716308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 350/769] 10.222.0.20 () {58 vars in 1189 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:13.720019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3529a45-205b-4f27-bf06-8efc26f5ff69 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffc1ef70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.726039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3529a45-205b-4f27-bf06-8efc26f5ff69 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.728388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3529a45-205b-4f27-bf06-8efc26f5ff69 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.729057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3529a45-205b-4f27-bf06-8efc26f5ff69 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.732441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:13.734887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:13.748807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.749846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.750464 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3529a45-205b-4f27-bf06-8efc26f5ff69 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.036633 Oct 12 22:33:13.750717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.752336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.753123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.753773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.764295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 420/770] 10.222.0.20 () {58 vars in 1179 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:13.768956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffc1e430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.774077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.774745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.775340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.794876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:13.811304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.811795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.812378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.836167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.836900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.837528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.847587 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d796f37a-46ce-473e-822b-4e4caee2f248 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.082048 Oct 12 22:33:13.856828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 421/771] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:13.861624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffc5c040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.863649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.864342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.864931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.871926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:13.882552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.883285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.884126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.891643 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-865ee5b3-e145-4cd7-8fd6-29a25b1b1afd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.033514 Oct 12 22:33:13.892554 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 422/772] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:13.908990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffc1e9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.911024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.911919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.912512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.928484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.929432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.930032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.937932 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a11f5522-fc64-42d1-b97a-6fe8c35ac181 tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.032700 Oct 12 22:33:13.939000 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 423/773] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:13.947876 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5885d5c4-0867-4315-80af-392afe113ffe tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action" status: 202 len: 0 microversion: 2.1 time: 0.220845 Oct 12 22:33:13.953886 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 351/774] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:33:13 2022] POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:33:13.959300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Calling method '.version_select at 0x7f44ffe19b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.964263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:13.964966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.966142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.969063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.979122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:13.982985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:13.989333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.990179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.990828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.998037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:13.998523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:13.999007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:13.999797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.000833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.001485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.007552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.008344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.008990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.039447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21ce68b3-38dc-4262-a32e-8a4a6c3caddd tempest-HypervisorAdminTestJSON-1783000416 tempest-HypervisorAdminTestJSON-1783000416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.087901 Oct 12 22:33:14.040937 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 424/775] 10.222.0.20 () {58 vars in 1173 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:14.213717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:33:14.283637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:14.284401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:14.306557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.307056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.311203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.316669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.319045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.319549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.386628 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ede7a87-97e0-41ac-8f23-6175834af201 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.431344 Oct 12 22:33:14.399650 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 352/776] 10.222.0.20 () {58 vars in 1150 bytes} [Wed Oct 12 22:33:13 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:14.412730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:14.419450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:14.452652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.456579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.457117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.466977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.467471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.467921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.670229 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e12ac08-f626-4009-9b87-b5068d565f4e tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action" status: 202 len: 0 microversion: 2.1 time: 0.269160 Oct 12 22:33:14.671066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 353/777] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:33:14 2022] POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:14.684791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:14.685478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:14.700743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.703434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.703908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:14.704664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:14.705119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:14.705538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.283968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:15.291570 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c25e4ac-3700-42cd-9f3a-9f45330331a4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1711 microversion: 2.1 time: 1.013480 Oct 12 22:33:15.292583 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 425/778] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:14 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1711 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:15.301351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:15.301954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:15.322567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.325988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.328955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.329687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.330288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.337083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.645210 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49d4cb17-9793-4042-b9ff-c611600661d8 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1613 microversion: 2.1 time: 0.350148 Oct 12 22:33:15.661417 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 426/779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:15 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1613 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:15.661513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:15.661607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:15.661607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:15.672307 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3ba6300-7b62-438b-a442-8c23e9cb1abe tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.996935 Oct 12 22:33:15.672843 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 354/780] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:14 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:15.689843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.692057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.692506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.693234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.693691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.695243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.955214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7e7d7f03-0cd5-48d0-b276-a1d23c654639 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Action: 'create', calling method: .version_select at 0x7f4505814040>, body: {"pool": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:15.959411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:15.968997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:15.970452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:15.971786 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-325b8051-35d7-45ac-8044-c5ffe27fe959 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.318350 Oct 12 22:33:15.972871 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 427/781] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:15 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:15.977495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:15.978328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:15.985473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.986218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.986812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:15.988298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:15.988934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:15.989511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.187244 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fcfaf1c0-f052-4d6e-ae2a-a24f9370e7b6 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1613 microversion: 2.1 time: 0.213084 Oct 12 22:33:16.187864 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 428/782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:15 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1613 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:16.194295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8cfe5fd6-6066-4e90-89c8-f4f91b009a92 req-80424a39-b3a2-48d7-b9dd-9074b8fe8275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df47842-42b9-4478-9048-bcc1c1649310", "name": "network-vif-plugged", "status": "completed", "tag": "2927133e-dc79-4969-a068-64aad27efa20"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:16.216879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8cfe5fd6-6066-4e90-89c8-f4f91b009a92 req-80424a39-b3a2-48d7-b9dd-9074b8fe8275 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.218449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8cfe5fd6-6066-4e90-89c8-f4f91b009a92 req-80424a39-b3a2-48d7-b9dd-9074b8fe8275 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.219306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8cfe5fd6-6066-4e90-89c8-f4f91b009a92 req-80424a39-b3a2-48d7-b9dd-9074b8fe8275 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.239756 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8cfe5fd6-6066-4e90-89c8-f4f91b009a92 req-80424a39-b3a2-48d7-b9dd-9074b8fe8275 service nova] Creating event network-vif-plugged:2927133e-dc79-4969-a068-64aad27efa20 for instance 0df47842-42b9-4478-9048-bcc1c1649310 on n-h1-860864-8 Oct 12 22:33:16.246961 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8cfe5fd6-6066-4e90-89c8-f4f91b009a92 req-80424a39-b3a2-48d7-b9dd-9074b8fe8275 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055946 Oct 12 22:33:16.253080 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 429/783] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:16.269220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:16.286305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Searching by: {'host': 'n-h2-860864-8', 'deleted': False} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:16.302942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.303390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.303959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.313887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.314567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.315324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.526724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:33:16.608900 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d0fcc4e-2e11-4d83-b153-654b5f3d7a1d tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h2-860864-8&all_tenants=1" status: 200 len: 2308 microversion: 2.1 time: 0.354095 Oct 12 22:33:16.609754 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 430/784] 10.222.0.20 () {58 vars in 1190 bytes} [Wed Oct 12 22:33:16 2022] GET /compute/v2.1/servers?host=n-h2-860864-8&all_tenants=1 => generated 2308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:16.614309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:16.615040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:16.622061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.622621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.623057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.623956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.624382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.625665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.774604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:16.783752 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a47e988-11a4-4062-bb21-0ce9600c66fc tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1711 microversion: 2.1 time: 0.173266 Oct 12 22:33:16.784708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 431/785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:16 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1711 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:16.789981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:16.795788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:33:16.800994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.801469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.801893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.802681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.803040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.803454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.825473 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3494becd-08c8-45da-bae6-66bd47ad7cdf tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.038958 Oct 12 22:33:16.826207 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 432/786] 10.222.0.20 () {58 vars in 1196 bytes} [Wed Oct 12 22:33:16 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:16.830845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:16.831557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:16.838859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.839277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.839705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.840422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.840860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.841271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.976199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:16.984320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b17860e5-c85a-4e0e-8e17-bdbfcd72aefa tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1324 microversion: 2.1 time: 0.157299 Oct 12 22:33:16.984886 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 433/787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:16 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1324 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:16.989311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:16.991477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:16.997947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:16.998547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:16.998985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:16.999670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.000138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.000566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.112515 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2caabaaf-c525-4a54-8745-ca1412ea7e2c tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action" status: 202 len: 0 microversion: 2.1 time: 0.126173 Oct 12 22:33:17.118715 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 434/788] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:33:16 2022] POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:17.128277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:17.131002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:17.137937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:17.139820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.141304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.141751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.142860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.143306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.143724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.407834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:17.423037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:17.424935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:17.426025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-305a1156-30b2-4cf4-a4ba-4c9f68c42039 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.306165 Oct 12 22:33:17.429743 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 435/789] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:17 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:17.456626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:17.462895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:17.473827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.474314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.476116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.476839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.478430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.479946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.609919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:17.610625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:17.611451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:17.612056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:17.612623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:17.710890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:17.720163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.720660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.721101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.721801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.722260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.722683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.785541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-140124c1-281a-46d5-b42b-874dd9df5e9f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action" status: 202 len: 1066 microversion: 2.1 time: 0.340020 Oct 12 22:33:17.786570 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 436/790] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:33:17 2022] POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action => generated 1066 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:33:17.814799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:17.815540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:17.828530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.829361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.830454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.831422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:17.832133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:17.833015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:17.838500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:18.168031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:18.179002 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e59fbdde-4130-478a-b377-c3c6f5b0b69b tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1470 microversion: 2.1 time: 0.372791 Oct 12 22:33:18.181579 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 437/791] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:17 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:18.191717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:18.192516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:18.223300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:18.224422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:18.226738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:18.227500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:18.229683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:18.230229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:18.344722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9dd6cd5ae4f432b8afc184210820c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a41ac7523f4592ae88851113a895ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:18.354619 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82889115-4dec-4213-9f24-b92d8e1c5d37 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 200 len: 1644 microversion: 2.1 time: 0.170596 Oct 12 22:33:18.365070 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 438/792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:18 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 1644 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:18.384662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:18.386119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:18.406463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:18.407143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:18.407694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:18.408557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:18.409143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:18.415466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:18.821521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:18.856632 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36a97480-5665-42cc-924a-57c76c5a7df1 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1519 microversion: 2.1 time: 0.488784 Oct 12 22:33:18.890557 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 439/793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:18 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1519 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:18.908708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1058090103", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "b7ba0f5c-73e2-4094-b8e5-360f49f48593"}], "security_groups": [{"name": "tempest-securitygroup--1152589976"}], "key_name": "tempest-keypair-89062266", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:19.152764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] validate_networks() for [('b7ba0f5c-73e2-4094-b8e5-360f49f48593', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:33:19.763743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:19.764611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:19.764723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:19.765043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:19.765446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:19.781783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.782946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.786661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.786661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:19.786661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:19.786661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:19.826734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:19.848298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for user dd8fdd646f8546a0a3aae53d1b55a8b1 and project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:19.891363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:33:19.897440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:33:20.066526 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe6fb466-a2c4-4258-baad-8a5f1fdf954b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.173556 Oct 12 22:33:20.071244 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 440/794] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:33:20.083232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ee5f5000-aa16-46a2-89ed-80eed5521e73 req-681b47cc-be67-46bc-84cd-4ebd6d5d9d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa0aaef-a675-4aed-a3e3-93790420d284", "name": "network-vif-plugged", "status": "completed", "tag": "a581aa07-c5be-4251-bae8-eb700c203ba5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:20.119591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ee5f5000-aa16-46a2-89ed-80eed5521e73 req-681b47cc-be67-46bc-84cd-4ebd6d5d9d61 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:20.120417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ee5f5000-aa16-46a2-89ed-80eed5521e73 req-681b47cc-be67-46bc-84cd-4ebd6d5d9d61 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:20.121609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ee5f5000-aa16-46a2-89ed-80eed5521e73 req-681b47cc-be67-46bc-84cd-4ebd6d5d9d61 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:20.150364 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ee5f5000-aa16-46a2-89ed-80eed5521e73 req-681b47cc-be67-46bc-84cd-4ebd6d5d9d61 service nova] Creating event network-vif-plugged:a581aa07-c5be-4251-bae8-eb700c203ba5 for instance 8fa0aaef-a675-4aed-a3e3-93790420d284 on n-h1-860864-8 Oct 12 22:33:20.161976 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ee5f5000-aa16-46a2-89ed-80eed5521e73 req-681b47cc-be67-46bc-84cd-4ebd6d5d9d61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087497 Oct 12 22:33:20.164773 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 441/795] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:20.177661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:20.181313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:20.195496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:20.197190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:20.197632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:20.200064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:20.200715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:20.203176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:20.572622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.581672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.587078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.591824 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc2ed23f-76b9-4d23-9e63-f8dd9132249b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.424352 Oct 12 22:33:20.613203 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 442/796] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:20 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:20.621559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7702780-0444-4429-90ec-61e95730be4b tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1129339919", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7702780-0444-4429-90ec-61e95730be4b tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 243 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1129339919", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1129339919', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '0e506d13-15ff-4b8b-9d07-c2653439eccd'}]}}} Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:20.627309 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:20.631375 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:20.638313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7702780-0444-4429-90ec-61e95730be4b tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:20.639502 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d7702780-0444-4429-90ec-61e95730be4b tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.024390 Oct 12 22:33:20.640565 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 443/797] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:20 2022] POST /compute/v2.1/servers => generated 175 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:20.650149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:20.657319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:20.666393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:20.667303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:20.667885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:20.669410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:20.670040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:20.670611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:20.970964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:20.978997 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d19d3a24-adca-417a-8d2e-238f51e0d9d2 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1470 microversion: 2.1 time: 0.337229 Oct 12 22:33:20.979579 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 444/798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:20 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:20.999498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.001442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.020582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.021083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.021522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.030212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.030837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.031288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.058625 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] HTTP exception thrown: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Request method failure captured: Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae HTTP/1.1 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AHFdsJSJ-DJ3PmjCiT3ev9AAUxr0-ldTQOtMGsd3xodsK-MQV74S1LLGlPxS5O0uKtb4YYrSlQQ21G93NK7A6hlLQKtmbEeypizwYlI3qUcBJqwV2ptDpp22tdtdcyrqU0piXbQn5U8nwLX7wzxE1n29R8-UW0uaCq-6pPlPS5e6Q Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73a41ac7523f4592ae88851113a895ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}] Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d9dd6cd5ae4f432b8afc184210820c10 Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2b01c019-d599-40ea-8038-0f768d2868ae'} Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:21.060746 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Returning 404 to user: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:21.065024 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ce09bbe-f8c3-4063-a7f9-0f60026d8ce3 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 404 len: 111 microversion: 2.1 time: 0.081605 Oct 12 22:33:21.067927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 445/799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:20 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:21.077554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-71560ef0-d93b-488a-ad00-cabf835b165e req-1a99555e-75df-4fff-b310-6404a7c324e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b01c019-d599-40ea-8038-0f768d2868ae", "name": "network-vif-deleted", "tag": "a072eeb6-744d-42c6-bd66-020b75653f91"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:21.102917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-71560ef0-d93b-488a-ad00-cabf835b165e req-1a99555e-75df-4fff-b310-6404a7c324e9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.106421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-71560ef0-d93b-488a-ad00-cabf835b165e req-1a99555e-75df-4fff-b310-6404a7c324e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.107052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-71560ef0-d93b-488a-ad00-cabf835b165e req-1a99555e-75df-4fff-b310-6404a7c324e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.142982 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-71560ef0-d93b-488a-ad00-cabf835b165e req-1a99555e-75df-4fff-b310-6404a7c324e9 service nova] Creating event network-vif-deleted:a072eeb6-744d-42c6-bd66-020b75653f91 for instance 2b01c019-d599-40ea-8038-0f768d2868ae on n-h1-860864-8 Oct 12 22:33:21.151003 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-71560ef0-d93b-488a-ad00-cabf835b165e req-1a99555e-75df-4fff-b310-6404a7c324e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081790 Oct 12 22:33:21.151938 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 446/800] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:21.168567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4ce2013-9eeb-4eac-80a0-87ee990968f2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.170184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4ce2013-9eeb-4eac-80a0-87ee990968f2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.327156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4ce2013-9eeb-4eac-80a0-87ee990968f2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:21.336562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4ce2013-9eeb-4eac-80a0-87ee990968f2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1233 microversion: 2.1 time: 0.180114 Oct 12 22:33:21.338457 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 447/801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:21 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1233 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:21.344468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b382891a-8e75-4b17-9958-84e7bec7784a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.345337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b382891a-8e75-4b17-9958-84e7bec7784a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 7459c492-d4fd-4fe1-a7e0-0cd9b5858217] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.351318 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b382891a-8e75-4b17-9958-84e7bec7784a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] HTTP exception thrown: Instance 7459c492-d4fd-4fe1-a7e0-0cd9b5858217 could not be found. Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b382891a-8e75-4b17-9958-84e7bec7784a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/7459c492-d4fd-4fe1-a7e0-0cd9b5858217/metadata HTTP/1.1 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 7459c492-d4fd-4fe1-a7e0-0cd9b5858217 could not be found. Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': '7459c492-d4fd-4fe1-a7e0-0cd9b5858217'} Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7459c492-d4fd-4fe1-a7e0-0cd9b5858217 could not be found. Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7459c492-d4fd-4fe1-a7e0-0cd9b5858217 could not be found. Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.354220 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.358156 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:21.358156 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:21.358156 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7459c492-d4fd-4fe1-a7e0-0cd9b5858217 could not be found. Oct 12 22:33:21.358156 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.360369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b382891a-8e75-4b17-9958-84e7bec7784a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 404 to user: Instance 7459c492-d4fd-4fe1-a7e0-0cd9b5858217 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:21.361374 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b382891a-8e75-4b17-9958-84e7bec7784a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/7459c492-d4fd-4fe1-a7e0-0cd9b5858217/metadata" status: 404 len: 111 microversion: 2.1 time: 0.021546 Oct 12 22:33:21.362208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 448/802] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:33:21 2022] GET /compute/v2.1/servers/7459c492-d4fd-4fe1-a7e0-0cd9b5858217/metadata => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:21.373561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.374152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.382212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.386540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.387859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.388788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.390622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.391266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.409612 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] HTTP exception thrown: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Request method failure captured: Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 HTTP/1.1 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AHFdsJSJ-DJ3PmjCiT3ev9AAUxr0-ldTQOtMGsd3xodsK-MQV74S1LLGlPxS5O0uKtb4YYrSlQQ21G93NK7A6hlLQKtmbEeypizwYlI3qUcBJqwV2ptDpp22tdtdcyrqU0piXbQn5U8nwLX7wzxE1n29R8-UW0uaCq-6pPlPS5e6Q Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73a41ac7523f4592ae88851113a895ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}] Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d9dd6cd5ae4f432b8afc184210820c10 Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd4b2d603-856b-432d-9eb5-80f56b1f1b66'} Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:21.411153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Returning 404 to user: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:21.415013 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f471b3d7-e0eb-43ed-8ed1-7564b7311dae tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 404 len: 111 microversion: 2.1 time: 0.049157 Oct 12 22:33:21.427668 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 449/803] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:33:21 2022] DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:21.434815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.435490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.454670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.457869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.458455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.461659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.462145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.462579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.485014 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] HTTP exception thrown: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Request method failure captured: Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 HTTP/1.1 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AHFdsJSJ-DJ3PmjCiT3ev9AAUxr0-ldTQOtMGsd3xodsK-MQV74S1LLGlPxS5O0uKtb4YYrSlQQ21G93NK7A6hlLQKtmbEeypizwYlI3qUcBJqwV2ptDpp22tdtdcyrqU0piXbQn5U8nwLX7wzxE1n29R8-UW0uaCq-6pPlPS5e6Q Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73a41ac7523f4592ae88851113a895ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}] Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d9dd6cd5ae4f432b8afc184210820c10 Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd4b2d603-856b-432d-9eb5-80f56b1f1b66'} Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.488480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:21.492678 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.495339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Returning 404 to user: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:21.497119 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0c74892-b13b-45f9-89de-da6c76bf4516 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 404 len: 111 microversion: 2.1 time: 0.067743 Oct 12 22:33:21.501913 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 450/804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:21 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:21.507070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-927ffb5e-7e74-4747-a0c8-95062a0e9db7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '.version_select at 0x7f4504172d30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.545664 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-927ffb5e-7e74-4747-a0c8-95062a0e9db7 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745987402" status: 202 len: 0 microversion: 2.1 time: 0.041712 Oct 12 22:33:21.568705 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 451/805] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745987402 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:21.627340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:21.635927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:21.644667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.646556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.647657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.648819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:21.650950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:21.653413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:21.959262 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7e7d7f03-0cd5-48d0-b276-a1d23c654639 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.283943 Oct 12 22:33:21.960708 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 355/806] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:33:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:21.967225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c29d1d1c-c5d6-4eba-9666-8812ac5c6d2d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1051328940", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c29d1d1c-c5d6-4eba-9666-8812ac5c6d2d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 499 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1051328940", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1051328940', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0e506d13-15ff-4b8b-9d07-c2653439eccd'}]}}} Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:33:21.974972 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:21.981223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:21.984215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c29d1d1c-c5d6-4eba-9666-8812ac5c6d2d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:21.990263 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c29d1d1c-c5d6-4eba-9666-8812ac5c6d2d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.020022 Oct 12 22:33:21.991701 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 356/807] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:21 2022] POST /compute/v2.1/servers => generated 687 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:22.303297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Calling method '.version_select at 0x7f45044ac700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:22.305240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.305718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.306384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.347933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.348718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.349252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.365127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.365722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.365861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.366879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.374581 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2fc1a324-0c06-4372-a55b-f9bd6a55afb8 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.381510 Oct 12 22:33:22.375747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 357/808] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:22.378278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.379751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.380894 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-176ac526-9d0e-4a48-b697-de9f34050141 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1409 microversion: 2.25 time: 0.759920 Oct 12 22:33:22.382225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a07ce953-9d68-478d-bb4e-d326a5b0a34e tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Action: 'create', calling method: .version_select at 0x7f450426c670>, body: {"pool": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:22.385655 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 452/809] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:21 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1409 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:33:22.393747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:22.399020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:22.419740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.420257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.422041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.424332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.428548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.429651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.649532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:22.703071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.714226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9164969-4214-4eac-bab3-716b1b7f825e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1470 microversion: 2.1 time: 0.324491 Oct 12 22:33:22.715664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 453/810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:22 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1470 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:22.724398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00762c1b-bede-4490-b358-7e72680d51df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1597747398", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00762c1b-bede-4490-b358-7e72680d51df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 500 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1597747398", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1597747398', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0e506d13-15ff-4b8b-9d07-c2653439eccd'}]}}} Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:33:22.737393 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:22.740321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:22.749228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00762c1b-bede-4490-b358-7e72680d51df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:22.750331 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00762c1b-bede-4490-b358-7e72680d51df tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.033502 Oct 12 22:33:22.751542 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 454/811] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:22 2022] POST /compute/v2.1/servers => generated 689 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:33:22.758311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:22.759255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:22.781177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.782095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.785323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.786966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:22.788324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:22.788984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:22.901516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:22.922047 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-66fe10fb-a54d-47b9-92d0-f94ea4a002e0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1293 microversion: 2.1 time: 0.165808 Oct 12 22:33:22.936946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 455/812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:22 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:23.121422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d1964bc-a67f-4da5-8f62-b82d3e0e1aff tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Calling method '.version_select at 0x7f44ff862e50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.124113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d1964bc-a67f-4da5-8f62-b82d3e0e1aff tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b258ecdf3e0e4361b20833fd822c5c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed2b84b03114e9186097865d32e3f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d1964bc-a67f-4da5-8f62-b82d3e0e1aff tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Request method failure captured: Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/n-h2-860864-8/search HTTP/1.1 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CwnmgKUaQuQhzaXuGUweihXeeWMjNHlczK68sVeJj3vHhMZqSJVhmvAuJ9Ku46unlasct6lAdvvg3kuAU7LbTwp4LaD2SXBmzqcqTv2B0lr8QQk5xz52h4SmW2gvfMBBLlO4u-e773-OvIrZfZZ2IIkrpxTVY6hoKuueaBq4nMVw4 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 3ed2b84b03114e9186097865d32e3f16 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1854231080 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ed2b84b03114e9186097865d32e3f16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ed2b84b03114e9186097865d32e3f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ed2b84b03114e9186097865d32e3f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ed2b84b03114e9186097865d32e3f16"}]}] Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1854231080 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 3ed2b84b03114e9186097865d32e3f16 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1854231080 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b258ecdf3e0e4361b20833fd822c5c43 Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'n-h2-860864-8'} Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.125949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d1964bc-a67f-4da5-8f62-b82d3e0e1aff tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d1964bc-a67f-4da5-8f62-b82d3e0e1aff tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-860864-8/search" status: 403 len: 117 microversion: 2.1 time: 0.189511 Oct 12 22:33:23.131247 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 456/813] 10.222.0.20 () {58 vars in 1209 bytes} [Wed Oct 12 22:33:22 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-8/search => generated 117 bytes in 191 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:23.133706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b2c207f-eb80-48a0-b641-1dc078787d69 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-417802047", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b2c207f-eb80-48a0-b641-1dc078787d69 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 753 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-417802047", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-417802047', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0e506d13-15ff-4b8b-9d07-c2653439eccd'}]}}} Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:33:23.139400 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:33:23.142384 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:33:23.146166 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.146166 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.147870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b2c207f-eb80-48a0-b641-1dc078787d69 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.149028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b2c207f-eb80-48a0-b641-1dc078787d69 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.019676 Oct 12 22:33:23.150096 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 457/814] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:23 2022] POST /compute/v2.1/servers => generated 1197 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 12 22:33:23.157086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Calling method '.version_select at 0x7f4504127280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.159252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.160016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.161453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.168956 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Request method failure captured: Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CxBWBC29z7b3Y-9mWNEBl-bzW9pAqE7ccz95kQh6A5TU0HE0fb7XvsLLH24uHCHnVepWIE2cjU5LKGB1mZfVcf97ziGAUrjzUL2MbWdJaRU82JTUAEF-_2TbKYrfcHNWIU4xKyZeWzTAFcUrtt73KmSMKeEie8QoCVpV_gdhQe4V0 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 4e89d879b90c45d093bae3a98fdc81f4 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-568728991 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e89d879b90c45d093bae3a98fdc81f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e89d879b90c45d093bae3a98fdc81f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e89d879b90c45d093bae3a98fdc81f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e89d879b90c45d093bae3a98fdc81f4"}]}] Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-568728991 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 4e89d879b90c45d093bae3a98fdc81f4 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-568728991 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 6b9c0b08c918450c8b1bcf241ea4d314 Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 22:33:23.170973 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.175366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.176859 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6321592c-5fe7-40a0-bf22-aefd99afa8be tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025540 Oct 12 22:33:23.178177 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 458/815] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:23.191688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Calling method '.version_select at 0x7f44ffea4670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.197890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.198583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.199044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.224803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.225207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.225636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.236878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.237606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.238025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.244657 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-692cec53-d179-458c-b153-0cf0a09ded67 tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058884 Oct 12 22:33:23.245756 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 459/816] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:23.251766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27dcdcaa-dd3b-4f31-85bd-c21c161845a2 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.283797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27dcdcaa-dd3b-4f31-85bd-c21c161845a2 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1115412368" status: 202 len: 0 microversion: 2.1 time: 0.036752 Oct 12 22:33:23.288755 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 460/817] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:33:23 2022] DELETE /compute/v2.1/flavors/1115412368 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:23.294572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93e0ea20-cc4c-46fb-bdea-b1e55ddac161 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1744306486", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93e0ea20-cc4c-46fb-bdea-b1e55ddac161 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 1266 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1744306486", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0e506d13-15ff-4b8b-9d07-c2653439eccd"}]}} Oct 12 22:33:23.300340 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1744306486', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0e506d13-15ff-4b8b-9d07-c2653439eccd'}]}}} Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.302518 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:33:23.303598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:33:23.307265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:33:23.307265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.307265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93e0ea20-cc4c-46fb-bdea-b1e55ddac161 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.309354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93e0ea20-cc4c-46fb-bdea-b1e55ddac161 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018637 Oct 12 22:33:23.310537 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 461/818] 10.222.0.20 () {60 vars in 1148 bytes} [Wed Oct 12 22:33:23 2022] POST /compute/v2.1/servers => generated 2221 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 12 22:33:23.315457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a05313d-eb70-4300-a2c1-35e0d3bb3699 tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Calling method '.version_select at 0x7f44ffb7b820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.317575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a05313d-eb70-4300-a2c1-35e0d3bb3699 tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b258ecdf3e0e4361b20833fd822c5c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed2b84b03114e9186097865d32e3f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a05313d-eb70-4300-a2c1-35e0d3bb3699 tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Request method failure captured: Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CwnmgKUaQuQhzaXuGUweihXeeWMjNHlczK68sVeJj3vHhMZqSJVhmvAuJ9Ku46unlasct6lAdvvg3kuAU7LbTwp4LaD2SXBmzqcqTv2B0lr8QQk5xz52h4SmW2gvfMBBLlO4u-e773-OvIrZfZZ2IIkrpxTVY6hoKuueaBq4nMVw4 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 3ed2b84b03114e9186097865d32e3f16 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1854231080 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ed2b84b03114e9186097865d32e3f16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ed2b84b03114e9186097865d32e3f16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ed2b84b03114e9186097865d32e3f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ed2b84b03114e9186097865d32e3f16"}]}] Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1854231080 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 3ed2b84b03114e9186097865d32e3f16 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1854231080 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b258ecdf3e0e4361b20833fd822c5c43 Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1'} Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.319626 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.323280 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.323280 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.323280 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.323280 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:33:23.323280 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:33:23.323280 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 22:33:23.323280 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.325687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a05313d-eb70-4300-a2c1-35e0d3bb3699 tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.326753 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a05313d-eb70-4300-a2c1-35e0d3bb3699 tempest-HypervisorAdminNegativeUnderV252Test-1854231080 tempest-HypervisorAdminNegativeUnderV252Test-1854231080-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015037 Oct 12 22:33:23.327371 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 462/819] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:23.333119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e40e527-bdf3-40d4-bd68-d171315eb1b7 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.358582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e40e527-bdf3-40d4-bd68-d171315eb1b7 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.029268 Oct 12 22:33:23.359329 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 463/820] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:23.364445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d38a0e2-af00-451b-952a-0e5759cac609 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.365223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d38a0e2-af00-451b-952a-0e5759cac609 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: d409e633-b884-4167-9704-8b8bd9acb4bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:23.378747 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-4d38a0e2-af00-451b-952a-0e5759cac609 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] HTTP exception thrown: Instance d409e633-b884-4167-9704-8b8bd9acb4bd could not be found. Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d38a0e2-af00-451b-952a-0e5759cac609 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d409e633-b884-4167-9704-8b8bd9acb4bd/metadata/test2 HTTP/1.1 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d409e633-b884-4167-9704-8b8bd9acb4bd could not be found. Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': 'd409e633-b884-4167-9704-8b8bd9acb4bd', 'id': 'test2'} Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d409e633-b884-4167-9704-8b8bd9acb4bd could not be found. Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d409e633-b884-4167-9704-8b8bd9acb4bd could not be found. Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.381328 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.385860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:23.385860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:23.385860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d409e633-b884-4167-9704-8b8bd9acb4bd could not be found. Oct 12 22:33:23.385860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.388576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d38a0e2-af00-451b-952a-0e5759cac609 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 404 to user: Instance d409e633-b884-4167-9704-8b8bd9acb4bd could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.389606 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d38a0e2-af00-451b-952a-0e5759cac609 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/d409e633-b884-4167-9704-8b8bd9acb4bd/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.028903 Oct 12 22:33:23.390179 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 464/821] 10.222.0.20 () {58 vars in 1281 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/servers/d409e633-b884-4167-9704-8b8bd9acb4bd/metadata/test2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:23.399661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Calling method '.version_select at 0x7f44ffbae160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.401808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.402527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.404404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.413710 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] HTTP exception thrown: No hypervisor matching '0f0a3699-f648-4385-9cf3-0d5a8f57400e' could be found. Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Request method failure captured: Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-hypervisors/0f0a3699-f648-4385-9cf3-0d5a8f57400e/servers HTTP/1.1 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CxBWBC29z7b3Y-9mWNEBl-bzW9pAqE7ccz95kQh6A5TU0HE0fb7XvsLLH24uHCHnVepWIE2cjU5LKGB1mZfVcf97ziGAUrjzUL2MbWdJaRU82JTUAEF-_2TbKYrfcHNWIU4xKyZeWzTAFcUrtt73KmSMKeEie8QoCVpV_gdhQe4V0 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 4e89d879b90c45d093bae3a98fdc81f4 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-568728991 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e89d879b90c45d093bae3a98fdc81f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e89d879b90c45d093bae3a98fdc81f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e89d879b90c45d093bae3a98fdc81f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e89d879b90c45d093bae3a98fdc81f4"}]}] Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-568728991 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 4e89d879b90c45d093bae3a98fdc81f4 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-568728991 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 6b9c0b08c918450c8b1bcf241ea4d314 Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: exception: No hypervisor matching '0f0a3699-f648-4385-9cf3-0d5a8f57400e' could be found. Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '0f0a3699-f648-4385-9cf3-0d5a8f57400e'} Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '0f0a3699-f648-4385-9cf3-0d5a8f57400e' could be found. Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '0f0a3699-f648-4385-9cf3-0d5a8f57400e' could be found. Oct 12 22:33:23.415263 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:23.421112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] Returning 404 to user: No hypervisor matching '0f0a3699-f648-4385-9cf3-0d5a8f57400e' could be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:23.422533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a93c54b8-e07b-47ab-820e-a44b4e30460a tempest-HypervisorAdminNegativeUnderV252Test-568728991 tempest-HypervisorAdminNegativeUnderV252Test-568728991-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/0f0a3699-f648-4385-9cf3-0d5a8f57400e/servers" status: 404 len: 123 microversion: 2.1 time: 0.030810 Oct 12 22:33:23.423530 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 465/822] 10.222.0.20 () {58 vars in 1281 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/os-hypervisors/0f0a3699-f648-4385-9cf3-0d5a8f57400e/servers => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:23.430507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0dd5f5aa-5395-4bff-89a8-c70dacab64d0 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.453807 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0dd5f5aa-5395-4bff-89a8-c70dacab64d0 tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1587180701" status: 202 len: 0 microversion: 2.1 time: 0.028914 Oct 12 22:33:23.454455 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 466/823] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:33:23 2022] DELETE /compute/v2.1/flavors/1587180701 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:23.463297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.465714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:23.478801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.479285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.481951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.482699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.483166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.487225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.540336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:33:23.707069 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2ee32459-1533-471f-874a-c27471c14c6c tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 204 len: 0 microversion: 2.1 time: 0.250546 Oct 12 22:33:23.714677 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 467/824] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:33:23 2022] DELETE /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:33:23.726653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.727687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:23.747548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.749136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.750740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.751857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:23.752501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:23.752927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:23.932382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:23.941168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:23.943134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:23.944314 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1b898fc-2352-4e89-8f3c-8c10f002330f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1604 microversion: 2.25 time: 0.226287 Oct 12 22:33:23.945378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 468/825] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:23.961304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0882e65-1cb5-4f2f-b3df-d4180c739d1c tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.991657 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0882e65-1cb5-4f2f-b3df-d4180c739d1c tempest-ServersWithSpecificFlavorTestJSON-692598926 tempest-ServersWithSpecificFlavorTestJSON-692598926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044991 Oct 12 22:33:23.992285 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 469/826] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:23.998067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:23.998682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:24.006271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.006931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.007617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.008619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.009260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.009847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.089249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:24.304831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:24.313613 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-91f40148-78f6-47e9-8889-24fdc949758d tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1525 microversion: 2.1 time: 0.320210 Oct 12 22:33:24.314473 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 470/827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:23 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1525 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:24.319771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:24.330765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:24.343739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.344324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.344832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.345632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.346150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.346649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.392464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:24.620036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:24.633934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f9f1f0c1-5fcf-4def-a9e4-38ed3638f937 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1470 microversion: 2.1 time: 0.318005 Oct 12 22:33:24.634991 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 471/828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:24 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:24.640494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:24.641337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:24.644454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:24.648497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.649265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.649905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.650989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.651638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.652832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.784328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:24.798784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-058f09d5-506e-42d1-838d-f6447bf3ddea tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1291 microversion: 2.1 time: 0.162411 Oct 12 22:33:24.800856 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 472/829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:24 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1291 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:24.823491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:24.825237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:24.831631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.832242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.833651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.834580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.835141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.835666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.950516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c217d2f-4115-4517-bc3e-86a7fc0127b9 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.147726 Oct 12 22:33:24.958285 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 473/830] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 22:33:24 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:33:24.958817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:24.972390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:24.984630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.987933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.989363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:24.990541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:24.991268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:24.992145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.014430 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] HTTP exception thrown: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Request method failure captured: Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae HTTP/1.1 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AHFdsJSJ-DJ3PmjCiT3ev9AAUxr0-ldTQOtMGsd3xodsK-MQV74S1LLGlPxS5O0uKtb4YYrSlQQ21G93NK7A6hlLQKtmbEeypizwYlI3qUcBJqwV2ptDpp22tdtdcyrqU0piXbQn5U8nwLX7wzxE1n29R8-UW0uaCq-6pPlPS5e6Q Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73a41ac7523f4592ae88851113a895ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}] Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d9dd6cd5ae4f432b8afc184210820c10 Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2b01c019-d599-40ea-8038-0f768d2868ae'} Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:25.016203 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Returning 404 to user: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2609d22-952e-47f2-9405-988ae799e0e4 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 404 len: 111 microversion: 2.1 time: 0.066746 Oct 12 22:33:25.020272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 474/831] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:33:24 2022] DELETE /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:25.028029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:25.028746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: 2b01c019-d599-40ea-8038-0f768d2868ae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:25.034779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.035266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.036033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.038233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.038233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.038478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.061631 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] HTTP exception thrown: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Request method failure captured: Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae HTTP/1.1 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AHFdsJSJ-DJ3PmjCiT3ev9AAUxr0-ldTQOtMGsd3xodsK-MQV74S1LLGlPxS5O0uKtb4YYrSlQQ21G93NK7A6hlLQKtmbEeypizwYlI3qUcBJqwV2ptDpp22tdtdcyrqU0piXbQn5U8nwLX7wzxE1n29R8-UW0uaCq-6pPlPS5e6Q Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73a41ac7523f4592ae88851113a895ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}] Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d9dd6cd5ae4f432b8afc184210820c10 Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2b01c019-d599-40ea-8038-0f768d2868ae'} Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.063239 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Returning 404 to user: Instance 2b01c019-d599-40ea-8038-0f768d2868ae could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cb0462e-baae-4fff-a8c1-dcdc5d835504 tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae" status: 404 len: 111 microversion: 2.1 time: 0.041121 Oct 12 22:33:25.069839 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 475/832] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:25 2022] GET /compute/v2.1/servers/2b01c019-d599-40ea-8038-0f768d2868ae => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:25.074683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:25.075362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:25.083726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.084430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.085017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.085902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.086672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.087246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.109178 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] HTTP exception thrown: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Request method failure captured: Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 HTTP/1.1 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AHFdsJSJ-DJ3PmjCiT3ev9AAUxr0-ldTQOtMGsd3xodsK-MQV74S1LLGlPxS5O0uKtb4YYrSlQQ21G93NK7A6hlLQKtmbEeypizwYlI3qUcBJqwV2ptDpp22tdtdcyrqU0piXbQn5U8nwLX7wzxE1n29R8-UW0uaCq-6pPlPS5e6Q Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73a41ac7523f4592ae88851113a895ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}] Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d9dd6cd5ae4f432b8afc184210820c10 Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd4b2d603-856b-432d-9eb5-80f56b1f1b66'} Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:25.111001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Returning 404 to user: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:25.114787 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d635903-69c4-40a7-9bc2-e8a6ba4c691a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 404 len: 111 microversion: 2.1 time: 0.042813 Oct 12 22:33:25.116448 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 476/833] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:33:25 2022] DELETE /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:25.123264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:25.124185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] [instance: d4b2d603-856b-432d-9eb5-80f56b1f1b66] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:25.132940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.133587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.134078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.134847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.136132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.137266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.154702 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] HTTP exception thrown: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Request method failure captured: Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 HTTP/1.1 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AHFdsJSJ-DJ3PmjCiT3ev9AAUxr0-ldTQOtMGsd3xodsK-MQV74S1LLGlPxS5O0uKtb4YYrSlQQ21G93NK7A6hlLQKtmbEeypizwYlI3qUcBJqwV2ptDpp22tdtdcyrqU0piXbQn5U8nwLX7wzxE1n29R8-UW0uaCq-6pPlPS5e6Q Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73a41ac7523f4592ae88851113a895ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73a41ac7523f4592ae88851113a895ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73a41ac7523f4592ae88851113a895ce"}]}] Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 73a41ac7523f4592ae88851113a895ce Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d9dd6cd5ae4f432b8afc184210820c10 Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1310019822-project Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd4b2d603-856b-432d-9eb5-80f56b1f1b66'} Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.156949 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] Returning 404 to user: Instance d4b2d603-856b-432d-9eb5-80f56b1f1b66 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ee6dff8d-81a7-463d-8a49-d02f2ba2a34a tempest-ServersWithSpecificFlavorTestJSON-1310019822 tempest-ServersWithSpecificFlavorTestJSON-1310019822-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66" status: 404 len: 111 microversion: 2.1 time: 0.042052 Oct 12 22:33:25.161457 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 477/834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:25 2022] GET /compute/v2.1/servers/d4b2d603-856b-432d-9eb5-80f56b1f1b66 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:25.352766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:25.359492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:25.388586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.389674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.391472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:25.392361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:25.393095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:25.393638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:26.300665 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a07ce953-9d68-478d-bb4e-d326a5b0a34e tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.922179 Oct 12 22:33:26.301391 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 358/835] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:33:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:26.308540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:26.310892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:26.347414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:26.352696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:26.353664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:26.365081 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36b69463-34be-41fa-acc1-6ca03e99e21a tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1525 microversion: 2.1 time: 1.020355 Oct 12 22:33:26.366108 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 478/836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:25 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1525 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:26.366878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:26.370397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:26.371091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:26.372780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:26.373290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:26.373993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:26.382297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:26.383163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:26.384302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:26.387871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:26.388607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:26.390468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:26.953050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:26.971490 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4643a5f-a92d-4705-9f7a-bcad829542c6 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1470 microversion: 2.1 time: 0.668713 Oct 12 22:33:26.984124 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 359/837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:26 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1470 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:26.994283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00f447fb-27eb-43ce-b816-2d0faef41404 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Action: 'create', calling method: .version_select at 0x7f4505e22e50>, body: {"pool": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:27.048983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:27.065424 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d4905a2-04c1-4d93-b939-cbd91a8f9729 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1359 microversion: 2.1 time: 0.697109 Oct 12 22:33:27.069182 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 479/838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:26 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1359 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:27.080175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-289c84ec-027f-4ddd-a951-2da082e64ceb req-678574b4-8e3e-45cc-8e10-c78e97feb783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df47842-42b9-4478-9048-bcc1c1649310", "name": "network-vif-deleted", "tag": "2927133e-dc79-4969-a068-64aad27efa20"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:27.102828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-289c84ec-027f-4ddd-a951-2da082e64ceb req-678574b4-8e3e-45cc-8e10-c78e97feb783 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:27.104368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-289c84ec-027f-4ddd-a951-2da082e64ceb req-678574b4-8e3e-45cc-8e10-c78e97feb783 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:27.108668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-289c84ec-027f-4ddd-a951-2da082e64ceb req-678574b4-8e3e-45cc-8e10-c78e97feb783 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:27.128336 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-289c84ec-027f-4ddd-a951-2da082e64ceb req-678574b4-8e3e-45cc-8e10-c78e97feb783 service nova] Creating event network-vif-deleted:2927133e-dc79-4969-a068-64aad27efa20 for instance 0df47842-42b9-4478-9048-bcc1c1649310 on n-h1-860864-8 Oct 12 22:33:27.140900 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-289c84ec-027f-4ddd-a951-2da082e64ceb req-678574b4-8e3e-45cc-8e10-c78e97feb783 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070243 Oct 12 22:33:27.141968 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 480/839] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:27.390188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:27.390734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:27.400915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:27.403103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:27.403542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:27.404276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:27.404724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:27.405139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:27.506275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:27.506760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:27.507196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:27.507638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lazy-loading 'fault' on Instance uuid 0df47842-42b9-4478-9048-bcc1c1649310 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:33:27.705868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65aeb2c012642dda0626c77018d4b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c15002537994560a842f23b197826b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:27.718562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-320ab7b4-587a-4988-8676-deb1ba9f17f4 tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 200 len: 1314 microversion: 2.1 time: 0.333599 Oct 12 22:33:27.719413 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 481/840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:27 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:28.060890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6437eb8c-0164-4287-852e-dcc47b86e5a1 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Action: 'create', calling method: .version_select at 0x7f44ff86a280>, body: {"keypair": {"name": "tempest-keypair-2057500955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaZibtlcFs815FpYeI8iSZvEl5R1veMIN/9AbfzdtYXbISXRvRScSgININE3OqE4u3RhZagXWzEyt49lgOR2BamvxZsCmHMgjyN77+ZgxmfMM5gFIhZTjZRDwWGocBOEw=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:28.077066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6437eb8c-0164-4287-852e-dcc47b86e5a1 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Getting quotas for project 5702a6d40c344ba590041353935e1513. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:28.082909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6437eb8c-0164-4287-852e-dcc47b86e5a1 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Getting quotas for user 7395e893da4d45cc920daf0ac1fc4f72 and project 5702a6d40c344ba590041353935e1513. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:28.123138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6437eb8c-0164-4287-852e-dcc47b86e5a1 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328856 Oct 12 22:33:28.123752 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 482/841] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:33:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:28.128280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:28.128890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:28.152986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.153511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.154005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.154841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.155315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.155739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.622965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:28.635626 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b2750a5-1be9-436f-93f0-406482f2b542 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1470 microversion: 2.1 time: 0.510778 Oct 12 22:33:28.640406 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 483/842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:28 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:28.646161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:28.646849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:28.681672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.682291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.682815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:28.684698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:28.685457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:28.686040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:29.216688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:29.226460 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c41481b8-0f75-4ba5-b96c-22f3f4438646 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1359 microversion: 2.1 time: 0.585040 Oct 12 22:33:29.233212 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 484/843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:28 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1359 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:29.248307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:29.249264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] [instance: 0df47842-42b9-4478-9048-bcc1c1649310] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:29.257826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:29.259710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:29.260428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:29.262647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:29.263323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:29.264526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:29.321178 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] HTTP exception thrown: Instance 0df47842-42b9-4478-9048-bcc1c1649310 could not be found. Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Request method failure captured: Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 HTTP/1.1 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CWgirYSXa1ikgfKXJ3IhOMIoQITbFY5gRPfxuQn5IqNQGxktRZ3VVi3FR_qvLbiXD49ILxV-ydxUw6mIpFYL3-YwlkOlicvZW_mUgwzD55RoGkmNdZfLMnLj7tzamP4vmJ05iM3yeRZ_kYCscNqq237veNB_zucXwRCK0eURlgHD0 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c15002537994560a842f23b197826b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c15002537994560a842f23b197826b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c15002537994560a842f23b197826b4"}]}] Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8c15002537994560a842f23b197826b4 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-435769061 Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c65aeb2c012642dda0626c77018d4b3a Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-435769061-project Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 0df47842-42b9-4478-9048-bcc1c1649310 could not be found. Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '0df47842-42b9-4478-9048-bcc1c1649310'} Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df47842-42b9-4478-9048-bcc1c1649310 could not be found. Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df47842-42b9-4478-9048-bcc1c1649310 could not be found. Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:29.329936 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df47842-42b9-4478-9048-bcc1c1649310 could not be found. Oct 12 22:33:29.335114 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:29.342275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] Returning 404 to user: Instance 0df47842-42b9-4478-9048-bcc1c1649310 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:29.350055 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a957768-6018-4824-b28b-abba55dd798e tempest-ServerMetadataNegativeTestJSON-435769061 tempest-ServerMetadataNegativeTestJSON-435769061-project] 10.222.0.20 "GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310" status: 404 len: 111 microversion: 2.1 time: 0.115584 Oct 12 22:33:29.350775 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 485/844] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:29 2022] GET /compute/v2.1/servers/0df47842-42b9-4478-9048-bcc1c1649310 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:29.358689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3e09f5f5-81a1-4546-8ac2-86a520623392 req-5625ae7d-72df-4bfb-9ab9-0fd26891cf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c2dd1a-5106-4a62-bef0-e496ea3e8e49", "tag": "47fb6b3d-e4f4-4930-ae0e-e73ef491584c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:29.386584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3e09f5f5-81a1-4546-8ac2-86a520623392 req-5625ae7d-72df-4bfb-9ab9-0fd26891cf7c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:29.387054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3e09f5f5-81a1-4546-8ac2-86a520623392 req-5625ae7d-72df-4bfb-9ab9-0fd26891cf7c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:29.387477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3e09f5f5-81a1-4546-8ac2-86a520623392 req-5625ae7d-72df-4bfb-9ab9-0fd26891cf7c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:29.411647 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3e09f5f5-81a1-4546-8ac2-86a520623392 req-5625ae7d-72df-4bfb-9ab9-0fd26891cf7c service nova] Creating event network-changed:47fb6b3d-e4f4-4930-ae0e-e73ef491584c for instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 on n-h1-860864-8 Oct 12 22:33:29.428813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3e09f5f5-81a1-4546-8ac2-86a520623392 req-5625ae7d-72df-4bfb-9ab9-0fd26891cf7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076732 Oct 12 22:33:29.429526 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 486/845] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:29.434727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-809ce30c-798b-4e38-8de6-368c2113ce5b req-73f4a21b-bb83-4151-ab82-67def5fdcd34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa0aaef-a675-4aed-a3e3-93790420d284", "tag": "a581aa07-c5be-4251-bae8-eb700c203ba5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:29.457496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-809ce30c-798b-4e38-8de6-368c2113ce5b req-73f4a21b-bb83-4151-ab82-67def5fdcd34 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:29.457907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-809ce30c-798b-4e38-8de6-368c2113ce5b req-73f4a21b-bb83-4151-ab82-67def5fdcd34 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:29.458333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-809ce30c-798b-4e38-8de6-368c2113ce5b req-73f4a21b-bb83-4151-ab82-67def5fdcd34 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:29.472296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-809ce30c-798b-4e38-8de6-368c2113ce5b req-73f4a21b-bb83-4151-ab82-67def5fdcd34 service nova] Creating event network-changed:a581aa07-c5be-4251-bae8-eb700c203ba5 for instance 8fa0aaef-a675-4aed-a3e3-93790420d284 on n-h1-860864-8 Oct 12 22:33:29.499645 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-809ce30c-798b-4e38-8de6-368c2113ce5b req-73f4a21b-bb83-4151-ab82-67def5fdcd34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068568 Oct 12 22:33:29.501409 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 487/846] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:29.664008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:29.665129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:29.689004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:29.693025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:29.694249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:29.696661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:29.698243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:29.700300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:29.803337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:30.727624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:30.743300 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2733199f-314d-4244-a10d-931f2a61b9ff tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1470 microversion: 2.1 time: 1.084116 Oct 12 22:33:30.745423 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 488/847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:29 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1470 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:30.756540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:30.760005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:30.774805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:30.777301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:30.779994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:30.781120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:30.781757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:30.784347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:30.946808 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00f447fb-27eb-43ce-b816-2d0faef41404 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.961981 Oct 12 22:33:30.955298 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 360/848] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:33:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:30.971546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-358a082d-4103-4fda-b606-19296ecba186 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Action: 'create', calling method: .version_select at 0x7f4504679700>, body: {"pool": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:31.644502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:31.653862 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f83cbba-532a-4c00-8ef9-afbc30924a64 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1359 microversion: 2.1 time: 0.904625 Oct 12 22:33:31.655855 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 489/849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:30 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1359 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:32.069859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b620a77-4a80-4e14-bead-c8daa275879d tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] Action: 'create', calling method: .version_select at 0x7f44ff86eaf0>, body: {"security_group": {"name": "tempest-securitygroup-367969659", "description": "tempest-description-2053543770"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:33.204474 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b620a77-4a80-4e14-bead-c8daa275879d tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.547231 Oct 12 22:33:33.216276 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 490/850] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:33:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:33.216276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:33.216276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:33.233885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:33.234374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:33.235926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:33.235926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:33.236155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:33.236390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:33.441380 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-358a082d-4103-4fda-b606-19296ecba186 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.484509 Oct 12 22:33:33.443669 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 361/851] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:33:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:33:33.452148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:33.452758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:33.460174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:33.460874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:33.461310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:33.462577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:33.463058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:33.463604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:33.546730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:33.556888 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c71d1d68-7ef2-430b-a8c3-3a44900eee0e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1476 microversion: 2.1 time: 0.349874 Oct 12 22:33:33.558298 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 491/852] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:33 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:33.565937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1708662110", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "131a249b-daaa-41b4-92ee-cad505e653ba"}], "security_groups": [{"name": "tempest-securitygroup--1784142322"}], "key_name": "tempest-keypair-2057500955", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:33.639300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:33.649690 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbb9754b-0658-41bd-ad58-38ff39845417 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1359 microversion: 2.1 time: 0.202260 Oct 12 22:33:33.651077 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 362/853] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:33 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:33.657682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18591a79-98ca-4c6f-b372-38e6dfd6598d tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] Action: 'create', calling method: .version_select at 0x7f44ffcdd280>, body: {"security_group": {"name": "tempest-securitygroup-477980596", "description": "tempest-description-1020306949"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:33.829461 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18591a79-98ca-4c6f-b372-38e6dfd6598d tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.176169 Oct 12 22:33:33.830787 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 363/854] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:33:33 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:33.844164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe2ffd64-bf53-4ca1-aa2e-300cd03cadfc tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Calling method '.version_select at 0x7f45041cfca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:33.847228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] validate_networks() for [('131a249b-daaa-41b4-92ee-cad505e653ba', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:33:34.045756 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe2ffd64-bf53-4ca1-aa2e-300cd03cadfc tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/6e07fb20-727e-43b0-a131-549fefe57501" status: 200 len: 141 microversion: 2.1 time: 0.214422 Oct 12 22:33:34.046837 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 364/855] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:33:33 2022] GET /compute/v2.1/os-floating-ips/6e07fb20-727e-43b0-a131-549fefe57501 => generated 141 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:34.116443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1dde4b56-03b0-4202-a2e3-7ac2ffc0d92b tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Action: 'create', calling method: .version_select at 0x7f44ffece1f0>, body: {"security_group": {"name": "tempest-securitygroup-2080794231", "description": "tempest-description-1927279661"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:34.430527 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1dde4b56-03b0-4202-a2e3-7ac2ffc0d92b tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.381092 Oct 12 22:33:34.431322 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 365/856] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:33:34 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:34.436668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-727a0a7f-dac6-4c4c-990a-714d77a98b31 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Calling method '.version_select at 0x7f4504106820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:35.323406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:35.324382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:35.324819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:35.325226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:35.325631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:35.345513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:35.346299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:35.346895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:35.347775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:35.348795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:35.349477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:35.402874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Getting quotas for project 5702a6d40c344ba590041353935e1513. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:35.427338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Getting quotas for user 7395e893da4d45cc920daf0ac1fc4f72 and project 5702a6d40c344ba590041353935e1513. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:35.455361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:33:35.463081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:33:35.577356 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-448f319d-cd4e-4eb5-9435-66fd93c82ffc tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.016075 Oct 12 22:33:35.581190 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 492/857] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:33:35.595779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6afd7de-4d85-4503-b1b6-4e5efff3df08 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Action: 'create', calling method: .version_select at 0x7f44ff80c0d0>, body: {"security_group": {"name": "tempest-securitygroup-51589272", "description": "tempest-description-2139841928"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:36.200176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6afd7de-4d85-4503-b1b6-4e5efff3df08 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.616026 Oct 12 22:33:36.202115 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 493/858] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:33:35 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:36.208354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:36.209590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:36.235315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:36.235821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:36.236284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:36.236994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:36.237442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:36.237860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:36.297337 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-727a0a7f-dac6-4c4c-990a-714d77a98b31 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6e07fb20-727e-43b0-a131-549fefe57501" status: 202 len: 0 microversion: 2.1 time: 1.864031 Oct 12 22:33:36.299062 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 366/859] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:33:34 2022] DELETE /compute/v2.1/os-floating-ips/6e07fb20-727e-43b0-a131-549fefe57501 => generated 0 bytes in 1867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:36.305389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:36.306227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:36.326590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:36.330896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:36.331546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:36.332728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:36.338122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:36.338122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:36.578238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:36.590588 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0b0f869-919c-4c9d-8e69-df75deae2c50 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1476 microversion: 2.1 time: 0.387054 Oct 12 22:33:36.592201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 494/860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:36 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:36.608382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fe70cc4c-f9b6-4e7d-a221-03d3ed1c878c req-33d10920-c20b-4995-8cbc-5f66a711d9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1303196e-4aff-41e4-bba7-da44a13bd6bc", "name": "network-vif-unplugged", "status": "completed", "tag": "fc389c33-904c-4171-89fd-eed4b0c5df9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:36.624157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe70cc4c-f9b6-4e7d-a221-03d3ed1c878c req-33d10920-c20b-4995-8cbc-5f66a711d9df service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:36.624940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe70cc4c-f9b6-4e7d-a221-03d3ed1c878c req-33d10920-c20b-4995-8cbc-5f66a711d9df service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:36.625841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe70cc4c-f9b6-4e7d-a221-03d3ed1c878c req-33d10920-c20b-4995-8cbc-5f66a711d9df service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:36.640993 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fe70cc4c-f9b6-4e7d-a221-03d3ed1c878c req-33d10920-c20b-4995-8cbc-5f66a711d9df service nova] Creating event network-vif-unplugged:fc389c33-904c-4171-89fd-eed4b0c5df9f for instance 1303196e-4aff-41e4-bba7-da44a13bd6bc on n-h2-860864-8 Oct 12 22:33:36.647396 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fe70cc4c-f9b6-4e7d-a221-03d3ed1c878c req-33d10920-c20b-4995-8cbc-5f66a711d9df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047982 Oct 12 22:33:36.648832 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 495/861] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:36.655331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:36.656764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:36.667123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:36.667858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:36.668585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:36.669684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:36.670303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:36.672205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:36.716068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:36.728274 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-756adc3d-9ee9-4ea5-883c-e2d8dbe8cbb3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1359 microversion: 2.1 time: 0.426348 Oct 12 22:33:36.729150 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 367/862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:36 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1359 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:36.740165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Calling method '.version_select at 0x7f44ffe559d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:36.830396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:36.848388 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3217e8e7-702c-409e-9687-1692fb499d17 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1246 microversion: 2.1 time: 0.197889 Oct 12 22:33:36.850328 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 496/863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:36 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1246 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:36.895443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-889fad3b-c89e-4c84-9b8b-5b3670c783d3 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Calling method '.version_select at 0x7f44ff7c3dc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:37.263497 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-889fad3b-c89e-4c84-9b8b-5b3670c783d3 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.411693 Oct 12 22:33:37.264266 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 497/864] 10.222.0.20 () {58 vars in 1164 bytes} [Wed Oct 12 22:33:36 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:37.277778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5b80add-1f4f-49dd-862a-54fdbada69e5 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Calling method '.version_select at 0x7f44ff7c3f70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:37.547429 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5b80add-1f4f-49dd-862a-54fdbada69e5 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.273536 Oct 12 22:33:37.548431 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 498/865] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 22:33:37 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:37.565495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72946c1e-0d01-4987-b3ed-516678954fe4 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Calling method '.version_select at 0x7f44ff80c3a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:38.842406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72946c1e-0d01-4987-b3ed-516678954fe4 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/700caa73-57cc-486a-a890-1a08719fe031" status: 202 len: 0 microversion: 2.1 time: 1.281993 Oct 12 22:33:38.843260 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 499/866] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:33:37 2022] DELETE /compute/v2.1/os-floating-ips/700caa73-57cc-486a-a890-1a08719fe031 => generated 0 bytes in 1284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:38.848128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:38.848744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:38.855453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:38.855982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:38.856418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:38.857138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:38.857655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:38.858073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:39.062001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:39.064591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:39.071579 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08174e6f-8d60-4554-ba19-e40fe32924db tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1476 microversion: 2.1 time: 0.227271 Oct 12 22:33:39.072695 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 500/867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:38 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:39.078304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:39.079119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:39.085967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:39.086814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:39.087912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:39.089216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:39.089666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:39.090091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:39.305041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:39.315386 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a7c1924-415e-4226-8950-c6f91293adda tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1359 microversion: 2.1 time: 0.241273 Oct 12 22:33:39.316772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 501/868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:39 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:39.322344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:39.323319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:39.329631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:39.330609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:39.331431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:39.332413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:39.333080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:39.333735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:39.404672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:39.412345 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-07d3fdff-baaa-4aaf-a56f-c4f7e7f9087e tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1300 microversion: 2.1 time: 0.093935 Oct 12 22:33:39.413188 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 502/869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:39 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:39.418399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5cee818c-bb66-4330-afc6-52534e2fe5ff req-cf59b930-4309-4010-892e-b3d5d70d044e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c2dd1a-5106-4a62-bef0-e496ea3e8e49", "name": "network-vif-plugged", "status": "completed", "tag": "47fb6b3d-e4f4-4930-ae0e-e73ef491584c"}, {"server_uuid": "1303196e-4aff-41e4-bba7-da44a13bd6bc", "name": "network-vif-plugged", "status": "completed", "tag": "fc389c33-904c-4171-89fd-eed4b0c5df9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:39.429243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5cee818c-bb66-4330-afc6-52534e2fe5ff req-cf59b930-4309-4010-892e-b3d5d70d044e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:39.429941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5cee818c-bb66-4330-afc6-52534e2fe5ff req-cf59b930-4309-4010-892e-b3d5d70d044e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:39.430371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5cee818c-bb66-4330-afc6-52534e2fe5ff req-cf59b930-4309-4010-892e-b3d5d70d044e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:39.443137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5cee818c-bb66-4330-afc6-52534e2fe5ff req-cf59b930-4309-4010-892e-b3d5d70d044e service nova] Creating event network-vif-plugged:47fb6b3d-e4f4-4930-ae0e-e73ef491584c for instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 on n-h1-860864-8 Oct 12 22:33:39.443763 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5cee818c-bb66-4330-afc6-52534e2fe5ff req-cf59b930-4309-4010-892e-b3d5d70d044e service nova] Creating event network-vif-plugged:fc389c33-904c-4171-89fd-eed4b0c5df9f for instance 1303196e-4aff-41e4-bba7-da44a13bd6bc on n-h2-860864-8 Oct 12 22:33:39.452662 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5cee818c-bb66-4330-afc6-52534e2fe5ff req-cf59b930-4309-4010-892e-b3d5d70d044e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038327 Oct 12 22:33:39.453345 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 503/870] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:39.461925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b0cb5b2-b145-4118-8784-a3b49260737d tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Calling method '.version_select at 0x7f44ff7c2f70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:40.968530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b0cb5b2-b145-4118-8784-a3b49260737d tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/d5614763-aa96-46df-8f75-c53dd2357856" status: 202 len: 0 microversion: 2.1 time: 1.510541 Oct 12 22:33:40.969168 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 504/871] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:33:39 2022] DELETE /compute/v2.1/os-floating-ips/d5614763-aa96-46df-8f75-c53dd2357856 => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:40.974047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:40.975383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:40.983281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:40.983776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:40.984300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:40.985592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:40.986052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:40.986487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:41.173778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b79b3f51-d181-40e7-991c-f133ff7e3b29 does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:33:41.174489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Neutron security group b79b3f51-d181-40e7-991c-f133ff7e3b29 not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:33:41.180531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.security_groups [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Security Group ID b79b3f51-d181-40e7-991c-f133ff7e3b29 does not exist {{(pid=120543) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 12 22:33:41.200762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:41.208651 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71871029-e999-4a89-ae11-5c162a70ad89 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1476 microversion: 2.1 time: 0.238447 Oct 12 22:33:41.237768 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 505/872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:40 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:41.261754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b79b3f51-d181-40e7-991c-f133ff7e3b29 does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:33:41.263044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Neutron security group b79b3f51-d181-40e7-991c-f133ff7e3b29 not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:33:41.263706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.security_groups [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Security Group ID b79b3f51-d181-40e7-991c-f133ff7e3b29 does not exist {{(pid=120543) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 12 22:33:41.408962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-641805795", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": "none"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:41.485645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:41.486280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:41.487130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:41.487130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:41.487761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:41.494463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=21 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:41.497831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:41.498507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:41.499106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:41.499823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:41.500294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:41.500725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:41.518786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Getting quotas for project ec7bc14ca8a440df93351b3704eef0ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:41.525664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Getting quotas for user 6f7bcc4be09942e7acb20cf7e42825ed and project ec7bc14ca8a440df93351b3704eef0ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:41.540847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:33:41.543723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:33:41.601903 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3d620813-1a2f-4a1b-aa89-5dc94a5bf091 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.362675 Oct 12 22:33:41.602758 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 506/873] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:33:41.617149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:41.617497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:41.626343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:41.627748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:41.628586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:41.629110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:41.629919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:41.630685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:41.631455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:41.797555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:41.805755 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9caf2087-f1a1-40fb-b744-e94e3a5c46f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1541 microversion: 2.1 time: 0.201617 Oct 12 22:33:41.806321 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 507/874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:41 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1541 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:41.825893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:41.826467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:41.833262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:41.833674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:41.834105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:41.834801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:41.835261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:41.835671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:41.994716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:42.005284 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00c1250e-3a64-43be-8aff-533d05ed1a50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1368 microversion: 2.1 time: 0.183968 Oct 12 22:33:42.006462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 508/875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:41 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:42.020462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b674682-1a74-4a12-a556-a431aedb7af7 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] Calling method '.version_select at 0x7f44ff7c23a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:42.802870 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b674682-1a74-4a12-a556-a431aedb7af7 tempest-FloatingIPDetailsTestJSON-1401108847 tempest-FloatingIPDetailsTestJSON-1401108847-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/dbd1b92b-f57a-4a64-88ad-dbff860d972b" status: 202 len: 0 microversion: 2.1 time: 0.795035 Oct 12 22:33:42.803456 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 509/876] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:33:42 2022] DELETE /compute/v2.1/os-floating-ips/dbd1b92b-f57a-4a64-88ad-dbff860d972b => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:42.808505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:42.809109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:42.816832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:42.817539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:42.818103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:42.818933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:42.819595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:42.820274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.002852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:43.032710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:43.049501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:43.055919 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bccc155-af68-4fd6-af35-d5601825ed72 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed" status: 200 len: 1329 microversion: 2.47 time: 0.249650 Oct 12 22:33:43.060894 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 510/877] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:42 2022] GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed => generated 1329 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:43.065835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2dbc4970-6f65-405b-9aae-6edda5bd21f8 req-56482849-0e14-4dda-8acc-722fc3ca1094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac10978f-f42f-41b4-964a-48ba3b4e9a0c", "tag": "aeab41ad-531d-4ca9-9c21-bac6f8fd4e29"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:43.087348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2dbc4970-6f65-405b-9aae-6edda5bd21f8 req-56482849-0e14-4dda-8acc-722fc3ca1094 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.087348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2dbc4970-6f65-405b-9aae-6edda5bd21f8 req-56482849-0e14-4dda-8acc-722fc3ca1094 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.087348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2dbc4970-6f65-405b-9aae-6edda5bd21f8 req-56482849-0e14-4dda-8acc-722fc3ca1094 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.111427 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2dbc4970-6f65-405b-9aae-6edda5bd21f8 req-56482849-0e14-4dda-8acc-722fc3ca1094 service nova] Creating event network-changed:aeab41ad-531d-4ca9-9c21-bac6f8fd4e29 for instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c on n-h1-860864-8 Oct 12 22:33:43.132137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2dbc4970-6f65-405b-9aae-6edda5bd21f8 req-56482849-0e14-4dda-8acc-722fc3ca1094 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072126 Oct 12 22:33:43.133306 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 511/878] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:43.143001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:43.145340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:43.162377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.163856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.164695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.165703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.166379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.168275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.298370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cef2c60-6caa-4757-a8b3-8769680115b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163304 Oct 12 22:33:43.298984 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 512/879] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:33:43 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:43.306168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:43.307701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:43.314985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.315820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.316345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.317362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.318185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.318676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.566002 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3cd364b-7086-4e06-9062-6b0fee894798 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13837 microversion: 2.1 time: 6.834950 Oct 12 22:33:43.569108 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 368/880] 10.222.0.20 () {58 vars in 1191 bytes} [Wed Oct 12 22:33:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13837 bytes in 6839 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:33:43.576304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:43.577412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:43.586169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.587070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.587828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.589256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.590013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.591780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.712371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:43.728533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c704e7e0-f222-48e0-bc49-b059a7010ff8 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1462 microversion: 2.1 time: 0.426640 Oct 12 22:33:43.729378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 513/881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:43 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1462 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:43.751182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-513641464", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": "none"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:43.824702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:43.825410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:43.826850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:43.827556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:43.828570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:43.837842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:43.843463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:43.844109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.844537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.844821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.845747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.846158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.846585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:43.863640 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a624bb0d-7773-4ac7-9230-c9677c383c0c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1368 microversion: 2.1 time: 0.292931 Oct 12 22:33:43.875965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Getting quotas for project ec7bc14ca8a440df93351b3704eef0ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:43.875965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Getting quotas for user 6f7bcc4be09942e7acb20cf7e42825ed and project ec7bc14ca8a440df93351b3704eef0ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:43.884458 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 369/882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:43 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:43.892308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6400c97b-7854-456c-892d-56762ab82647 tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] Calling method '.version_select at 0x7f44ffb52ca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:43.906948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:33:43.909734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:33:43.963167 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f102d6e6-77c0-409d-b755-72197a7a77ad tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.217917 Oct 12 22:33:43.971386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 514/883] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:33:43.987931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:43.988716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:43.997817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:43.998372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:43.999489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.000222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.001223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.002012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.330087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:44.342493 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c051e3f0-80ee-49fe-9e2d-7784efca55b5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1462 microversion: 2.1 time: 0.371919 Oct 12 22:33:44.345116 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 515/884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:43 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1462 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:44.357892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-833922ae-78ad-4f2b-ae10-7c3f014fff3d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:44.365746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-833922ae-78ad-4f2b-ae10-7c3f014fff3d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:44.455952 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-833922ae-78ad-4f2b-ae10-7c3f014fff3d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "PUT /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 991 microversion: 2.47 time: 0.109511 Oct 12 22:33:44.456787 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 516/885] 10.222.0.20 () {62 vars in 1297 bytes} [Wed Oct 12 22:33:44 2022] PUT /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:33:44.463072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:44.467006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:44.475019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.475848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.476667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.477742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.478396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.479602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.498363 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6400c97b-7854-456c-892d-56762ab82647 tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.612617 Oct 12 22:33:44.499287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 370/886] 10.222.0.20 () {58 vars in 1191 bytes} [Wed Oct 12 22:33:43 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:44.505309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ad4a152-b948-4f17-a259-8e980e52540a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:44.506836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ad4a152-b948-4f17-a259-8e980e52540a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:44.512767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=22 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:44.596058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ad4a152-b948-4f17-a259-8e980e52540a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:44.607397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ad4a152-b948-4f17-a259-8e980e52540a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:44.610228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ad4a152-b948-4f17-a259-8e980e52540a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:44.612864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ad4a152-b948-4f17-a259-8e980e52540a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1277 microversion: 2.47 time: 0.110997 Oct 12 22:33:44.614091 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 371/887] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:44 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:44.619625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-209b7d8a-efa4-4acd-b0cd-dcba2573afe1 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Calling method '.version_select at 0x7f44ffb52160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:44.636205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:44.636697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:44.637160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:44.637744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:44.638316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:44.743512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:44.752938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.753736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.754416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.755399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.756146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.756782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.797103 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6275099-5a1a-4199-af3f-e94626c54b66 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action" status: 202 len: 1066 microversion: 2.1 time: 0.338180 Oct 12 22:33:44.797103 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 517/888] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:33:44 2022] POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action => generated 1066 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:33:44.836552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:44.837315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:44.855080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.856477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.856785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.859722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.860221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.860679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.927232 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-209b7d8a-efa4-4acd-b0cd-dcba2573afe1 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2df850ea-c2c0-4665-8c70-3a2dbf0819a7" status: 202 len: 0 microversion: 2.1 time: 0.311491 Oct 12 22:33:44.928326 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 372/889] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:33:44 2022] DELETE /compute/v2.1/os-security-groups/2df850ea-c2c0-4665-8c70-3a2dbf0819a7 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:44.935538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:44.936194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:44.964145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.964670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.965136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:44.967992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:44.972751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:44.973348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:45.378798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:45.388895 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f03b3785-269f-460b-902b-12aadb9b2945 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1368 microversion: 2.1 time: 0.459242 Oct 12 22:33:45.391212 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 373/890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:44 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1368 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:45.397303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d537f6d2-1b97-4797-861b-b04cc2b56c36 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] Calling method '.version_select at 0x7f44ffe3e040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.709552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:45.726064 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b9d4f6e5-71bb-4460-820a-9abb06b31925 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.911860 Oct 12 22:33:45.726914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 518/891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:44 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:45.745445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.747834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:45.771740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:45.772954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:45.774584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:45.776277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:45.777102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:45.777846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:45.792499 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d537f6d2-1b97-4797-861b-b04cc2b56c36 tempest-SecurityGroupsTestAdminJSON-1089043357 tempest-SecurityGroupsTestAdminJSON-1089043357-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b4de90dd-5efe-42ed-a735-5e70fa2518d7" status: 202 len: 0 microversion: 2.1 time: 0.399077 Oct 12 22:33:45.793878 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 374/892] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:33:45 2022] DELETE /compute/v2.1/os-security-groups/b4de90dd-5efe-42ed-a735-5e70fa2518d7 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:45.803844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ee1e4b42-8c7a-4e1f-809b-0f5a70d73536 tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] Calling method '.version_select at 0x7f44fff88040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:45.887311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:45.898195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:45.904268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:45.905457 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4d212e5-be69-4af5-a02d-911542ae5e86 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1337 microversion: 2.47 time: 0.177455 Oct 12 22:33:45.906031 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 519/893] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:45 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1337 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:46.052023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ee1e4b42-8c7a-4e1f-809b-0f5a70d73536 tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d4864234-803a-4373-842b-f1641dc52ce6" status: 202 len: 0 microversion: 2.1 time: 0.254231 Oct 12 22:33:46.052616 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 375/894] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:33:45 2022] DELETE /compute/v2.1/os-security-groups/d4864234-803a-4373-842b-f1641dc52ce6 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:46.061770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-761f0b3c-034c-416a-a1e5-be9726622a32 tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] Calling method '.version_select at 0x7f44ff86e040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.290079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-be333bc7-56ad-4018-9b54-f4c62a4e2b59 req-3637fa87-c362-403b-a781-c2915e1d78a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c2dd1a-5106-4a62-bef0-e496ea3e8e49", "tag": "47fb6b3d-e4f4-4930-ae0e-e73ef491584c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:46.303646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-be333bc7-56ad-4018-9b54-f4c62a4e2b59 req-3637fa87-c362-403b-a781-c2915e1d78a2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:46.304160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-be333bc7-56ad-4018-9b54-f4c62a4e2b59 req-3637fa87-c362-403b-a781-c2915e1d78a2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:46.304598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-be333bc7-56ad-4018-9b54-f4c62a4e2b59 req-3637fa87-c362-403b-a781-c2915e1d78a2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:46.327920 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-be333bc7-56ad-4018-9b54-f4c62a4e2b59 req-3637fa87-c362-403b-a781-c2915e1d78a2 service nova] Creating event network-changed:47fb6b3d-e4f4-4930-ae0e-e73ef491584c for instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 on n-h1-860864-8 Oct 12 22:33:46.352079 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-be333bc7-56ad-4018-9b54-f4c62a4e2b59 req-3637fa87-c362-403b-a781-c2915e1d78a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065715 Oct 12 22:33:46.353256 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 376/895] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:33:46.413618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.414603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:46.421977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:46.422689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:46.423350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:46.424285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:46.424949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:46.425385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:46.584258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-761f0b3c-034c-416a-a1e5-be9726622a32 tempest-SecurityGroupsTestAdminJSON-748862618 tempest-SecurityGroupsTestAdminJSON-748862618-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e6062efd-2201-4780-bd0f-709680d8ca72" status: 202 len: 0 microversion: 2.1 time: 0.526843 Oct 12 22:33:46.585154 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 520/896] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:33:46 2022] DELETE /compute/v2.1/os-security-groups/e6062efd-2201-4780-bd0f-709680d8ca72 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:33:46.613934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:46.627359 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ddacc280-ce54-41a2-81d8-a221dda4f53d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1368 microversion: 2.1 time: 0.216568 Oct 12 22:33:46.629417 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 377/897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:46 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:46.756237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.757703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:46.769419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:46.771756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:46.772614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:46.775624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:46.776985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:46.778373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:46.945561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:46.946228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:46.960286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:46.961127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:46.961860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:46.963048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:46.966291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:46.967006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:47.318328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:47.340820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:47.345022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:47.346627 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b6b81c8-118f-4825-86d2-906be33d58bf tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1335 microversion: 2.47 time: 0.414046 Oct 12 22:33:47.348985 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 378/898] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:46 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1335 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:47.424916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:47.433302 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71064e50-1001-4ac2-80a4-45ddceeec247 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.681297 Oct 12 22:33:47.437598 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 521/899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:46 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:47.654077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:47.655131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:47.672064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:47.676260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:47.676970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:47.677918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:47.681136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:47.682031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:47.957453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:47.972069 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c8fa391-4e05-49b1-a0a5-aa6776d9a42a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1368 microversion: 2.1 time: 0.321580 Oct 12 22:33:47.975312 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 379/900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:47 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:48.299416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f87ec7b6-b0e9-4c6a-b313-2a30255df9da req-ffef9853-7a5d-4237-b379-13ce5f08c64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac10978f-f42f-41b4-964a-48ba3b4e9a0c", "name": "network-vif-plugged", "status": "completed", "tag": "aeab41ad-531d-4ca9-9c21-bac6f8fd4e29"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:48.328291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f87ec7b6-b0e9-4c6a-b313-2a30255df9da req-ffef9853-7a5d-4237-b379-13ce5f08c64e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.331446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f87ec7b6-b0e9-4c6a-b313-2a30255df9da req-ffef9853-7a5d-4237-b379-13ce5f08c64e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.332606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f87ec7b6-b0e9-4c6a-b313-2a30255df9da req-ffef9853-7a5d-4237-b379-13ce5f08c64e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.352095 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f87ec7b6-b0e9-4c6a-b313-2a30255df9da req-ffef9853-7a5d-4237-b379-13ce5f08c64e service nova] Creating event network-vif-plugged:aeab41ad-531d-4ca9-9c21-bac6f8fd4e29 for instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c on n-h1-860864-8 Oct 12 22:33:48.360897 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f87ec7b6-b0e9-4c6a-b313-2a30255df9da req-ffef9853-7a5d-4237-b379-13ce5f08c64e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065918 Oct 12 22:33:48.365783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 522/901] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:48.376809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:48.377919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:48.390222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.394399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.395563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.403586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.404316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.404843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.460484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:48.461237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:48.483545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.483545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.483545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.483545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.483545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.483545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.497435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:48.574618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:48.589854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:48.591760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:48.593005 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35aca9f9-ecc1-4bd7-ac99-adb626220286 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1356 microversion: 2.47 time: 0.221455 Oct 12 22:33:48.598920 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 380/902] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:48 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:48.627205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:48.630059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:48.642783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.644047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.644664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.645559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.646166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.646741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.753940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:48.754643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:48.755346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:48.755861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:48.756400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:48.840018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:48.850760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:48.862315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.862965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.863456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.864161 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-247414cf-8754-4bce-a14a-b0d8f998d3a0 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.408595 Oct 12 22:33:48.864975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:48.865538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:48.866051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:48.866191 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 523/903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:48 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:48.941050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2bf10c6-9c42-4245-9cf2-e3de32574495 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "POST /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2/action" status: 202 len: 1078 microversion: 2.47 time: 0.318176 Oct 12 22:33:48.942168 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 381/904] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:33:48 2022] POST /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2/action => generated 1078 bytes in 320 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 12 22:33:48.990007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:48.997692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:48.998302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:49.002701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:49.010736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:49.011017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:49.011449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:49.012172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:49.012621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:49.013042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:49.027219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:49.027730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:49.030141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:49.030902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:49.034596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:49.039728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:49.150235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:49.175117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:49.176840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:49.178334 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d549c64-cefe-4e86-be6f-ff8244325b0c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.213422 Oct 12 22:33:49.179352 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 524/905] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:48 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:49.339634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:49.347805 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77ba1bc3-0aa7-4214-9ae1-fddc7ab83290 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1368 microversion: 2.1 time: 0.354736 Oct 12 22:33:49.356276 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 382/906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:48 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1368 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:49.890325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:49.892511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:49.908923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:49.910772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:49.911433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:49.912641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:49.913477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:49.914112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:50.117141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:50.128223 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3844387e-2817-4be9-a7ac-4bf77962f76f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.242342 Oct 12 22:33:50.129277 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 525/907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:49 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:50.206473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:50.207078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:50.215708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:50.216433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:50.217100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:50.218032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:50.218847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:50.219482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:50.331021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:50.340512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:50.342064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:50.343370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-68204d66-f12d-4224-a618-76c06bd60aba tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.140768 Oct 12 22:33:50.356215 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 383/908] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:50 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:50.375060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:50.375798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:50.383934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:50.386052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:50.386963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:50.387937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:50.388683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:50.389679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:50.614835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:50.624048 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c5a743d-aacd-4880-9cbe-2dc8da5c45e9 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1557 microversion: 2.1 time: 0.255663 Oct 12 22:33:50.640753 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 526/909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:50 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1557 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:50.649738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:50.651474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:50.658382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:50.658882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:50.659680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:50.660024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:50.660686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:50.661135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:50.768507 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c66d9bd2-027e-410e-8d53-ebc59aecc2f7 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122948 Oct 12 22:33:50.769520 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 384/910] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:33:50 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:51.153363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:51.154347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:51.190314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.193715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.195285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.196159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.196624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.197056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.270238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-075de041-2756-4282-bfca-ce79a413080b tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-617953437", "id": 1583037687, "os-flavor-access:is_public": "False"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:51.314570 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-075de041-2756-4282-bfca-ce79a413080b tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.405138 Oct 12 22:33:51.315192 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 527/911] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:50 2022] POST /compute/v2.1/flavors => generated 438 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:51.327954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a6bd18f-15b3-4e13-9ce9-790a646c4a4f tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:51.483962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:51.507685 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a61fc20-1aa5-41fe-b338-72523f36c44c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.358530 Oct 12 22:33:51.508420 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 385/912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:51 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:51.529114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:51.529750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:51.541942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.542432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.542865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.543565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:51.544060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:51.544482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:51.651143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:51.664578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:51.666715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:51.670168 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afc0b8ea-e3e3-475f-8968-b0b5dace13f7 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.160760 Oct 12 22:33:51.673764 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 386/913] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:51 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:52.017337 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a6bd18f-15b3-4e13-9ce9-790a646c4a4f tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1583037687/action" status: 200 len: 97 microversion: 2.1 time: 0.693343 Oct 12 22:33:52.017960 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 528/914] 10.222.0.20 () {60 vars in 1200 bytes} [Wed Oct 12 22:33:51 2022] POST /compute/v2.1/flavors/1583037687/action => generated 97 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:33:52.031470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42b41b58-c354-4892-a03e-0a03c141192a tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:52.280884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1fece70-0ec8-493a-b429-54831a3f0c91 tempest-ListImageFiltersNegativeTestJSON-206651128 tempest-ListImageFiltersNegativeTestJSON-206651128-project] Calling method '.version_select at 0x7f44ff81e670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:52.313137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a1fece70-0ec8-493a-b429-54831a3f0c91 tempest-ListImageFiltersNegativeTestJSON-206651128 tempest-ListImageFiltersNegativeTestJSON-206651128-project] HTTP exception thrown: Image not found. Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1fece70-0ec8-493a-b429-54831a3f0c91 tempest-ListImageFiltersNegativeTestJSON-206651128 tempest-ListImageFiltersNegativeTestJSON-206651128-project] Request method failure captured: Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/images/b3e56d4f-aa59-417b-8924-8ec80bc43dce HTTP/1.1 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DQkdp7Zv4BDw2-3Im2iib8hJQ4dsNU9EUHzMX2z0llzPBmSzNNRIgao-wcLqGd91AQXcMC9bFxEEtfh9Yyk4J8YFi3R2ZKuQqjaf-KyzgxKqTBEPAyBLfdLFQfQRMCGhfpddzESf-1PtplDom6Q-r4kHjSefR7XfGqrOmMhSfSH3k Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 3f7d5fdb679d4c1fa635b874e044f842 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-206651128 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f7d5fdb679d4c1fa635b874e044f842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f7d5fdb679d4c1fa635b874e044f842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f7d5fdb679d4c1fa635b874e044f842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f7d5fdb679d4c1fa635b874e044f842"}]}] Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-206651128 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 3f7d5fdb679d4c1fa635b874e044f842 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-206651128 Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListImageFiltersNegativeTestJSON-206651128-project Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 33fa0b5cf9d84deb97338564db7a8bda Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-206651128-project Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'b3e56d4f-aa59-417b-8924-8ec80bc43dce'} Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b3e56d4f-aa59-417b-8924-8ec80bc43dce Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:33:52.323835 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3e56d4f-aa59-417b-8924-8ec80bc43dce could not be found. Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:33:52.328613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.332554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1fece70-0ec8-493a-b429-54831a3f0c91 tempest-ListImageFiltersNegativeTestJSON-206651128 tempest-ListImageFiltersNegativeTestJSON-206651128-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:52.333471 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1fece70-0ec8-493a-b429-54831a3f0c91 tempest-ListImageFiltersNegativeTestJSON-206651128 tempest-ListImageFiltersNegativeTestJSON-206651128-project] 10.222.0.20 "GET /compute/v2.1/images/b3e56d4f-aa59-417b-8924-8ec80bc43dce" status: 404 len: 62 microversion: 2.1 time: 0.116021 Oct 12 22:33:52.334444 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 529/915] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:33:52 2022] GET /compute/v2.1/images/b3e56d4f-aa59-417b-8924-8ec80bc43dce => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:33:52.434734 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-42b41b58-c354-4892-a03e-0a03c141192a tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project b08ca25245d24500a20a4f5ae5fee8ce combination. Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42b41b58-c354-4892-a03e-0a03c141192a tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Request method failure captured: Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/flavors/1583037687/action HTTP/1.1 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 67 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DOYaaVfZ7VrQ_87QezIvTxh0FtsC_Q2v6br7JciE8Z02CIpZGwFdO89Or1NrYWyE0ROIJNymxVvLo7El7S1XaJuOMadLs6xjF5oxxlWiRolYMQ1BsqFRSCEybHONtUJFt7Jcq92LjgeINXeh7tZvy3f81LbhigVtUE8t-Rxa2ejB8 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fe374032faf0498bb840c63102a444ae Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe374032faf0498bb840c63102a444ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe374032faf0498bb840c63102a444ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe374032faf0498bb840c63102a444ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe374032faf0498bb840c63102a444ae"}]}] Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fe374032faf0498bb840c63102a444ae Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1c681a87d456405bb5e6aa1fa6b86205 Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: {"addTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: exception: Flavor access already exists for flavor 35 and project b08ca25245d24500a20a4f5ae5fee8ce combination. Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '1583037687', 'body': {'addTenantAccess': {'tenant': 'b08ca25245d24500a20a4f5ae5fee8ce'}}} Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-b08ca25245d24500a20a4f5ae5fee8ce' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.467871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:33:52.475957 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-b08ca25245d24500a20a4f5ae5fee8ce' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 22, 33, 52, 429448), 'updated_at': None, 'flavor_id': 35, 'project_id': 'b08ca25245d24500a20a4f5ae5fee8ce'}] Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project b08ca25245d24500a20a4f5ae5fee8ce combination. Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project b08ca25245d24500a20a4f5ae5fee8ce combination. Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project b08ca25245d24500a20a4f5ae5fee8ce combination. Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42b41b58-c354-4892-a03e-0a03c141192a tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project b08ca25245d24500a20a4f5ae5fee8ce combination. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:52.480041 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-42b41b58-c354-4892-a03e-0a03c141192a tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1583037687/action" status: 409 len: 152 microversion: 2.1 time: 0.445277 Oct 12 22:33:52.486667 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 387/916] 10.222.0.20 () {60 vars in 1200 bytes} [Wed Oct 12 22:33:52 2022] POST /compute/v2.1/flavors/1583037687/action => generated 152 bytes in 446 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:33:52.486862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6f7d1b6-f09d-43e9-8dc3-38114f18e1ea tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:52.536448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:52.537824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:52.556329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:52.559317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:52.559792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:52.564627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:52.565608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:52.566051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:52.652220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6f7d1b6-f09d-43e9-8dc3-38114f18e1ea tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1583037687/action" status: 200 len: 21 microversion: 2.1 time: 0.175174 Oct 12 22:33:52.652867 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 530/917] 10.222.0.20 () {60 vars in 1200 bytes} [Wed Oct 12 22:33:52 2022] POST /compute/v2.1/flavors/1583037687/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:52.670512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6329fe6d-db5e-4af5-8458-3589ccb3aabf tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:52.731844 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6329fe6d-db5e-4af5-8458-3589ccb3aabf tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1583037687" status: 202 len: 0 microversion: 2.1 time: 0.068406 Oct 12 22:33:52.737568 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 531/918] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:33:52 2022] DELETE /compute/v2.1/flavors/1583037687 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:52.746604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:52.748277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:52.758258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:52.759388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:52.761016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:52.762028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:52.762893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:52.763549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:52.856466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:52.865731 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d9e3d30-ef6b-4bc0-8c86-2c4ab8c081d5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.337623 Oct 12 22:33:52.866730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:52.885614 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 388/919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:52 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:52.891456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af449bc1-2fcc-49f1-a69c-04df8285aa5d tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:52.892808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:52.894378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:52.895674 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e25227a-fe3e-4447-8e6d-0f068d1938ef tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.156768 Oct 12 22:33:52.905584 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 532/920] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:52 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:52.920000 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af449bc1-2fcc-49f1-a69c-04df8285aa5d tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032836 Oct 12 22:33:52.924854 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 389/921] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:52.950510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-43d28702-7d05-4397-a656-6e738ee9267d req-d5653b35-77cb-401c-993c-ec4d70477683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac10978f-f42f-41b4-964a-48ba3b4e9a0c", "tag": "aeab41ad-531d-4ca9-9c21-bac6f8fd4e29"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:52.955630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f5c553d-dae5-4240-a357-348b89f193cb tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-625344918", "id": 215042508, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:52.978064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-43d28702-7d05-4397-a656-6e738ee9267d req-d5653b35-77cb-401c-993c-ec4d70477683 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:52.979261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-43d28702-7d05-4397-a656-6e738ee9267d req-d5653b35-77cb-401c-993c-ec4d70477683 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:52.979696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-43d28702-7d05-4397-a656-6e738ee9267d req-d5653b35-77cb-401c-993c-ec4d70477683 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:52.997474 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-43d28702-7d05-4397-a656-6e738ee9267d req-d5653b35-77cb-401c-993c-ec4d70477683 service nova] Creating event network-changed:aeab41ad-531d-4ca9-9c21-bac6f8fd4e29 for instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c on n-h1-860864-8 Oct 12 22:33:53.005707 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f5c553d-dae5-4240-a357-348b89f193cb tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.055130 Oct 12 22:33:53.006589 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-43d28702-7d05-4397-a656-6e738ee9267d req-d5653b35-77cb-401c-993c-ec4d70477683 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093401 Oct 12 22:33:53.007169 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 390/922] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:52 2022] POST /compute/v2.1/flavors => generated 434 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:53.007932 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 533/923] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:53.019631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09691245-fced-46ef-8ce9-bd408d21b027 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:53.028133 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-09691245-fced-46ef-8ce9-bd408d21b027 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09691245-fced-46ef-8ce9-bd408d21b027 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Request method failure captured: Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/flavors/215042508/os-flavor-access HTTP/1.1 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DOYaaVfZ7VrQ_87QezIvTxh0FtsC_Q2v6br7JciE8Z02CIpZGwFdO89Or1NrYWyE0ROIJNymxVvLo7El7S1XaJuOMadLs6xjF5oxxlWiRolYMQ1BsqFRSCEybHONtUJFt7Jcq92LjgeINXeh7tZvy3f81LbhigVtUE8t-Rxa2ejB8 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fe374032faf0498bb840c63102a444ae Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe374032faf0498bb840c63102a444ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe374032faf0498bb840c63102a444ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe374032faf0498bb840c63102a444ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe374032faf0498bb840c63102a444ae"}]}] Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fe374032faf0498bb840c63102a444ae Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1c681a87d456405bb5e6aa1fa6b86205 Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: exception: Access list not available for public flavors. Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'flavor_id': '215042508'} Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 12 22:33:53.030252 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:53.035100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09691245-fced-46ef-8ce9-bd408d21b027 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:53.036779 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09691245-fced-46ef-8ce9-bd408d21b027 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/215042508/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.021177 Oct 12 22:33:53.038124 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 391/924] 10.222.0.20 () {58 vars in 1206 bytes} [Wed Oct 12 22:33:53 2022] GET /compute/v2.1/flavors/215042508/os-flavor-access => generated 91 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:33:53.048274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27998357-83d5-438a-90f6-c19378215ff7 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:53.074855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27998357-83d5-438a-90f6-c19378215ff7 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/215042508" status: 202 len: 0 microversion: 2.1 time: 0.030592 Oct 12 22:33:53.087241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6586fab-84fa-4485-8250-cfbdda860c38 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:53.092076 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 534/925] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:33:53 2022] DELETE /compute/v2.1/flavors/215042508 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:53.133444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6586fab-84fa-4485-8250-cfbdda860c38 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051855 Oct 12 22:33:53.148555 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 392/926] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:53.158552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58a46c94-1c9e-40fc-8421-0fb3fe5bf690 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-83799289", "id": 1264944205, "os-flavor-access:is_public": "False"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:53.200840 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58a46c94-1c9e-40fc-8421-0fb3fe5bf690 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.046903 Oct 12 22:33:53.202110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 535/927] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:53 2022] POST /compute/v2.1/flavors => generated 437 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:53.474323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4646eb54-5436-4210-935d-0d0180e9cd27 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:53.480385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4646eb54-5436-4210-935d-0d0180e9cd27 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '4a42e3d9de684df8ade4c285cdc7ac50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08ca25245d24500a20a4f5ae5fee8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4646eb54-5436-4210-935d-0d0180e9cd27 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Request method failure captured: Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/flavors/1264944205/action HTTP/1.1 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 67 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DNB8Wx60SZOjst6xuq0Z0yqRIsR5ce6XpxZCIX8lTAuXq2vaVemuASBlc5d9U4WGb4wjQN5DbTtNdLlHYdAb9QpCyuxyN_4DH5wdZZDih1YrL1iZ1hRSQo_PgEBTT-XKaniLUl2JgZb9ENGwJZkCkvJxGLM2Ehn-Lfrc5kYULVvZk Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: b08ca25245d24500a20a4f5ae5fee8ce Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-726015710 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b08ca25245d24500a20a4f5ae5fee8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b08ca25245d24500a20a4f5ae5fee8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b08ca25245d24500a20a4f5ae5fee8ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b08ca25245d24500a20a4f5ae5fee8ce"}]}] Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-726015710 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: b08ca25245d24500a20a4f5ae5fee8ce Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-726015710 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FlavorsAccessNegativeTestJSON-726015710-project Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4a42e3d9de684df8ade4c285cdc7ac50 Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-726015710-project Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: {"addTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '1264944205', 'body': {'addTenantAccess': {'tenant': 'b08ca25245d24500a20a4f5ae5fee8ce'}}} Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:33:53.482772 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 22:33:53.488056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:33:53.493635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4646eb54-5436-4210-935d-0d0180e9cd27 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:53.496777 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4646eb54-5436-4210-935d-0d0180e9cd27 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] 10.222.0.20 "POST /compute/v2.1/flavors/1264944205/action" status: 403 len: 130 microversion: 2.1 time: 0.285158 Oct 12 22:33:53.501276 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 393/928] 10.222.0.20 () {60 vars in 1200 bytes} [Wed Oct 12 22:33:53 2022] POST /compute/v2.1/flavors/1264944205/action => generated 130 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:53.513439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-513caa77-4e87-4884-80ca-a479b1e43967 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:53.529484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:53.557059 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-513caa77-4e87-4884-80ca-a479b1e43967 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1264944205" status: 202 len: 0 microversion: 2.1 time: 0.047525 Oct 12 22:33:53.560474 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 536/929] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:33:53 2022] DELETE /compute/v2.1/flavors/1264944205 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:53.572713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b5547fe-e583-4290-a2d1-713803161dab tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:53.601068 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b5547fe-e583-4290-a2d1-713803161dab tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035945 Oct 12 22:33:53.602204 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 394/930] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:53.625988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-282069d7-f8ad-47e4-a238-5a289a9cad33 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-217052692", "id": 238136894, "os-flavor-access:is_public": "False"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:53.687317 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-282069d7-f8ad-47e4-a238-5a289a9cad33 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.067513 Oct 12 22:33:53.695402 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 537/931] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:53.701279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7533ecb1-2a1f-4d7e-8e97-73714e68c73c tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:53.898013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:53.898764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:53.902812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:53.903631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=11 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:53.927739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:53.928278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:53.928699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:53.932044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:53.932706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:53.934652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:54.090604 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7533ecb1-2a1f-4d7e-8e97-73714e68c73c tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/238136894/action" status: 200 len: 96 microversion: 2.1 time: 0.394121 Oct 12 22:33:54.097126 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 395/932] 10.222.0.20 () {60 vars in 1197 bytes} [Wed Oct 12 22:33:53 2022] POST /compute/v2.1/flavors/238136894/action => generated 96 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:54.111336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:54.111930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:54.129787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:54.134238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:54.135565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:54.136685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:54.137389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:54.142176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:54.152341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:54.161799 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8f5e7e9-f8a4-4bb4-9c08-891256bd941c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.269320 Oct 12 22:33:54.168434 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 538/933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:53 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:54.185002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8be4a0d-f572-4244-8867-92fd26a3f496 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:54.189251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8be4a0d-f572-4244-8867-92fd26a3f496 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '4a42e3d9de684df8ade4c285cdc7ac50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08ca25245d24500a20a4f5ae5fee8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8be4a0d-f572-4244-8867-92fd26a3f496 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Request method failure captured: Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/flavors/238136894/action HTTP/1.1 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 70 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DNB8Wx60SZOjst6xuq0Z0yqRIsR5ce6XpxZCIX8lTAuXq2vaVemuASBlc5d9U4WGb4wjQN5DbTtNdLlHYdAb9QpCyuxyN_4DH5wdZZDih1YrL1iZ1hRSQo_PgEBTT-XKaniLUl2JgZb9ENGwJZkCkvJxGLM2Ehn-Lfrc5kYULVvZk Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: b08ca25245d24500a20a4f5ae5fee8ce Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-726015710 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b08ca25245d24500a20a4f5ae5fee8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b08ca25245d24500a20a4f5ae5fee8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b08ca25245d24500a20a4f5ae5fee8ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b08ca25245d24500a20a4f5ae5fee8ce"}]}] Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-726015710 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: b08ca25245d24500a20a4f5ae5fee8ce Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-726015710 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsAccessNegativeTestJSON-726015710-project Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4a42e3d9de684df8ade4c285cdc7ac50 Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-726015710-project Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: {"removeTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '238136894', 'body': {'removeTenantAccess': {'tenant': 'b08ca25245d24500a20a4f5ae5fee8ce'}}} Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can( Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 22:33:54.191511 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 22:33:54.195658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:54.200732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8be4a0d-f572-4244-8867-92fd26a3f496 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:54.201578 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8be4a0d-f572-4244-8867-92fd26a3f496 tempest-FlavorsAccessNegativeTestJSON-726015710 tempest-FlavorsAccessNegativeTestJSON-726015710-project] 10.222.0.20 "POST /compute/v2.1/flavors/238136894/action" status: 403 len: 133 microversion: 2.1 time: 0.031970 Oct 12 22:33:54.202134 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 539/934] 10.222.0.20 () {60 vars in 1197 bytes} [Wed Oct 12 22:33:54 2022] POST /compute/v2.1/flavors/238136894/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:54.215084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d46a918-e495-40fe-8877-1b480f821885 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b08ca25245d24500a20a4f5ae5fee8ce"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:54.349345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:54.362031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:54.364097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:54.372048 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4142e40d-7f28-4e64-bc47-94c69fd3e2ae tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.269844 Oct 12 22:33:54.373185 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 396/935] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:54 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:54.583496 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3d46a918-e495-40fe-8877-1b480f821885 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/238136894/action" status: 200 len: 21 microversion: 2.1 time: 0.377061 Oct 12 22:33:54.591547 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 540/936] 10.222.0.20 () {60 vars in 1197 bytes} [Wed Oct 12 22:33:54 2022] POST /compute/v2.1/flavors/238136894/action => generated 21 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:33:54.595867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-31002096-3055-41bc-9538-0182ce5230c2 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:54.605660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:54.617674 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-31002096-3055-41bc-9538-0182ce5230c2 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/238136894" status: 202 len: 0 microversion: 2.1 time: 0.026123 Oct 12 22:33:54.618980 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 397/937] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:33:54 2022] DELETE /compute/v2.1/flavors/238136894 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:33:54.626728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3fb821ef-65ab-412f-8097-2711c4120052 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:54.656257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3fb821ef-65ab-412f-8097-2711c4120052 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033401 Oct 12 22:33:54.670920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 541/938] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:54.676760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d43da68c-1ac4-4bd3-8ca0-ae5406e273ae tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1901272193", "id": 1112441605, "os-flavor-access:is_public": "False"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:54.708329 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d43da68c-1ac4-4bd3-8ca0-ae5406e273ae tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.033168 Oct 12 22:33:54.716132 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 398/939] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:54 2022] POST /compute/v2.1/flavors => generated 439 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:33:54.724387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5060cf48-031d-4e62-af2d-53326ce10393 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e335e935ff824b82bb612c9a7d7193ab"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:55.105854 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5060cf48-031d-4e62-af2d-53326ce10393 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] HTTP exception thrown: Flavor access not found for 39 / e335e935ff824b82bb612c9a7d7193ab combination. Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5060cf48-031d-4e62-af2d-53326ce10393 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Request method failure captured: Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/flavors/1112441605/action HTTP/1.1 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 70 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DOYaaVfZ7VrQ_87QezIvTxh0FtsC_Q2v6br7JciE8Z02CIpZGwFdO89Or1NrYWyE0ROIJNymxVvLo7El7S1XaJuOMadLs6xjF5oxxlWiRolYMQ1BsqFRSCEybHONtUJFt7Jcq92LjgeINXeh7tZvy3f81LbhigVtUE8t-Rxa2ejB8 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: fe374032faf0498bb840c63102a444ae Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe374032faf0498bb840c63102a444ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe374032faf0498bb840c63102a444ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe374032faf0498bb840c63102a444ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe374032faf0498bb840c63102a444ae"}]}] Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: fe374032faf0498bb840c63102a444ae Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-578165630 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1c681a87d456405bb5e6aa1fa6b86205 Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: {"removeTenantAccess": {"tenant": "e335e935ff824b82bb612c9a7d7193ab"}} Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: exception: Flavor access not found for 39 / e335e935ff824b82bb612c9a7d7193ab combination. Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1112441605', 'body': {'removeTenantAccess': {'tenant': 'e335e935ff824b82bb612c9a7d7193ab'}}} Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / e335e935ff824b82bb612c9a7d7193ab combination. Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:33:55.113725 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / e335e935ff824b82bb612c9a7d7193ab combination. Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / e335e935ff824b82bb612c9a7d7193ab combination. Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5060cf48-031d-4e62-af2d-53326ce10393 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Returning 404 to user: Flavor access not found for 39 / e335e935ff824b82bb612c9a7d7193ab combination. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5060cf48-031d-4e62-af2d-53326ce10393 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1112441605/action" status: 404 len: 124 microversion: 2.1 time: 0.394981 Oct 12 22:33:55.117700 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 542/940] 10.222.0.20 () {60 vars in 1200 bytes} [Wed Oct 12 22:33:54 2022] POST /compute/v2.1/flavors/1112441605/action => generated 124 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:33:55.133539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e34068e-9ccd-45bd-9ac4-0e9dbb443b2f tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:55.172276 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e34068e-9ccd-45bd-9ac4-0e9dbb443b2f tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1112441605" status: 202 len: 0 microversion: 2.1 time: 0.045129 Oct 12 22:33:55.173318 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 399/941] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:33:55 2022] DELETE /compute/v2.1/flavors/1112441605 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:33:55.187111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-208b2f45-82c8-4e92-a96c-77d3d9683ab9 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:55.211863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:55.212544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:55.236753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:55.237247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:55.242340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:55.243077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:55.246933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:55.247372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:55.252950 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-208b2f45-82c8-4e92-a96c-77d3d9683ab9 tempest-FlavorsAccessNegativeTestJSON-578165630 tempest-FlavorsAccessNegativeTestJSON-578165630-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071803 Oct 12 22:33:55.255941 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 543/942] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:33:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:55.405143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:55.406254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:55.420687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:55.421178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:55.421611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:55.422308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:55.422833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:55.423430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:55.531100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:55.546816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:55.552219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:55.553637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32f416de-be93-4620-a7d6-ad8d9e72d1ac tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.154551 Oct 12 22:33:55.567984 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 544/943] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:55 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:55.649308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:55.664290 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2bf81a4-9b0e-454d-8e8a-3cfe5e20694f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.470480 Oct 12 22:33:55.665806 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 400/944] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:55 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:56.593054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:56.593959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:56.611913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:56.612691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:56.613742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:56.616770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:56.617649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:56.618296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:56.688814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:56.690988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:56.701697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:56.705723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:56.706890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:56.707637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:56.711726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:56.713549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:56.749032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:33:56.806236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:56.821120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:56.824262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:56.825891 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f4629f5-f2f2-4bca-b9ce-f6494959dc1b tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.242864 Oct 12 22:33:56.853050 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 545/945] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:56 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:57.289010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:57.302473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be9667e9-5d67-433f-9ad9-03684947a14f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.619238 Oct 12 22:33:57.304117 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 401/946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:56 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:33:57.859868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:57.861759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:57.887113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:57.888345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:57.890858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:57.893914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:57.894642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:57.896824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:58.078633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:58.088015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:58.091818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:58.093252 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e79d889e-38fc-41de-97d4-ce24361c2597 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.238084 Oct 12 22:33:58.093829 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 546/947] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:57 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:33:58.108088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1067324873", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d6a10245-cee9-40b0-8da9-7f972e191229"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:33:58.160401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] validate_networks() for [('d6a10245-cee9-40b0-8da9-7f972e191229', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:33:58.329346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:58.330084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:58.340160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:58.341048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:58.341592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:58.342794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:58.343448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:58.344363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:58.586965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:58.595820 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2fc25b2c-ffb4-4e80-9253-986b6043a627 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.270769 Oct 12 22:33:58.596617 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 547/948] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:58 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:59.124507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:59.126948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:59.135065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.135808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.137657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:59.139211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.140521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.141640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:59.191945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:33:59.192484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:33:59.192824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:33:59.193225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:33:59.193633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:33:59.215691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.216612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.216612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:59.217338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.217795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.218210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:59.257342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for project 5b4767aa6972423987ec612b734dcf48. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:33:59.262847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:59.269872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for user 5f91f5085e864c5fbf74eb6eacf504c3 and project 5b4767aa6972423987ec612b734dcf48. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:33:59.275687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:59.281982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:59.283604 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b730a0b7-0af4-4249-bbd6-305c8ecd3f85 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.166901 Oct 12 22:33:59.286927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 548/949] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:59 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:33:59.305025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:33:59.308337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:33:59.424972 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5818740b-aee2-42fc-b082-11be74052c2d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493428 Oct 12 22:33:59.434809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 402/950] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:33:59.439555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47c2a30d-e68c-406f-9458-0dcc6e99bd86 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:59.441122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47c2a30d-e68c-406f-9458-0dcc6e99bd86 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:59.593460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-47c2a30d-e68c-406f-9458-0dcc6e99bd86 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:59.604433 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47c2a30d-e68c-406f-9458-0dcc6e99bd86 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1225 microversion: 2.1 time: 0.168827 Oct 12 22:33:59.615609 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 549/951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:59 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1225 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:59.626132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:59.626825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:59.637504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.637988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.638433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:59.639139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.639588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.644412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:59.816122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:33:59.820013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:33:59.820781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:33:59.826693 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f7e137c-58b5-4831-a176-86c7d95a28d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.208461 Oct 12 22:33:59.827912 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 403/952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:33:59 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:33:59.855431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.856356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.858170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:33:59.860242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:33:59.861247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:33:59.863175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.314805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:00.316217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:00.320585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 8fa0aaef-a675-4aed-a3e3-93790420d284 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:00.328826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.329303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.329970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.331033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.336483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.337708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.350914 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-324ba46f-10da-4560-b8b2-8dbef9180e72 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 2341 microversion: 2.25 time: 0.534539 Oct 12 22:34:00.370123 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 550/953] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:33:59 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 2341 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:00.381045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:00.387203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.388027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.388701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.389681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.390459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.391417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.441356 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-971ff8e3-6f4d-42f8-a549-69afa7b8ac5e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062633 Oct 12 22:34:00.449318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:00.452076 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 551/954] 10.222.0.20 () {60 vars in 1217 bytes} [Wed Oct 12 22:34:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:34:00.466067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:00.467924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:00.469397 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4488d25-3340-41df-ad3c-c6aafff1c20c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.158481 Oct 12 22:34:00.470208 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 404/955] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:00 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:00.629836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:00.630519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:00.640069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.652634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.654439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.655378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.656622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.660668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.856661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:00.857325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:00.859399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:00.866952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.869893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.872165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.873080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:00.873706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:00.875716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:00.973501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:00.986079 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c975d35-304d-4423-980e-8d3ac004b296 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1221 microversion: 2.1 time: 0.360359 Oct 12 22:34:00.988054 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 552/956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:00 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1221 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:01.111682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:01.126780 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1d8e7e5-446e-4a8b-a75b-3c9c15a27e46 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.270878 Oct 12 22:34:01.131418 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 405/957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:00 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:01.229848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Calling method '.version_select at 0x7f44ff86aaf0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:01.232920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:01.234062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:01.234809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:01.260476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:01.261333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:01.262793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:01.289176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:01.289858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:01.290480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:01.299614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d97ff088-4d25-4e8b-9528-5818d3d860a3 tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.309840 Oct 12 22:34:01.300440 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 553/958] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:34:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:34:01.311137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Calling method '.version_select at 0x7f44ff8ca670>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:01.312992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:01.313475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:01.313929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:01.359507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:01.360732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:01.361338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:01.378160 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-976e4f30-e153-46d6-8c2a-21a9fc5ec93d tempest-HypervisorAdminV228Test-2073295306 tempest-HypervisorAdminV228Test-2073295306-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.070636 Oct 12 22:34:01.379347 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 406/959] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 12 22:34:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:34:01.497946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:01.498993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:01.514444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:01.515757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:01.517411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:01.518526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:01.520072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:01.520816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:01.640073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:01.669677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:01.674546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:01.677853 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d75cbdb2-1f01-497f-920e-880c584973fa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.184213 Oct 12 22:34:01.693597 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 554/960] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:01 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:02.016519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:02.017580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:02.038356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:02.041967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:02.044030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:02.046821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:02.049363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:02.050016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:02.156134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:02.157156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:02.171771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:02.172511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:02.176460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:02.179186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:02.179989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:02.180298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:02.356201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:02.367467 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce752aa7-dc0a-4d50-87fa-a8295ac864e4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1283 microversion: 2.1 time: 0.356181 Oct 12 22:34:02.371537 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 407/961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:02 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1283 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:02.711686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:02.712782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:02.726755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:02.731480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:02.733371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:02.734318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:02.735094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:02.735671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:02.878050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:02.889236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:02.891104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:02.892526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd445b37-849e-4298-adb3-800bbf9272bd tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.185706 Oct 12 22:34:02.893285 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 408/962] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:02 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:03.226469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:03.229798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:03.243728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b65a9f17-8cd3-43b4-9a03-c5741f711f7d tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 1.090575 Oct 12 22:34:03.244382 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 555/963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:02 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:03.410087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:03.412715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:03.433312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:03.434410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:03.435141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:03.436120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:03.437275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:03.438159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:03.829385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:03.842966 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dfa0ec3b-fc72-4d61-9ef1-56ffeba99d79 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.444321 Oct 12 22:34:03.843863 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 409/964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:03 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:03.929581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:03.932460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:03.949156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:03.949968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:03.950609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:03.951937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:03.952595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:03.953164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:04.220759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:04.252199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:04.262474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:04.272196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:04.273853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:04.286714 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-55266429-5b99-4f28-8c41-54072d4c72aa tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.368531 Oct 12 22:34:04.288734 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 556/965] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:03 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:04.291005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:04.291490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:04.296809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:04.297767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:04.298387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:04.298981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:04.591331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:04.602280 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-669d049c-2b65-45a9-a91c-b83edcebf92f tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.335447 Oct 12 22:34:04.603225 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 410/966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:04 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:04.868676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:04.869610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:04.880660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:04.881159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:04.881592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:04.882331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:04.882730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:04.884743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:04.917067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e13ed46a-92ca-4656-bc26-22dd19f9cf64", "device": "/dev/xvdb"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:04.920268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:04.928997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:04.929887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:04.930579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:04.932164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:04.932961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:04.934181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:05.133456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:05.153116 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dcd9cb12-c187-4737-90ac-ef5b798a6a3e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.288714 Oct 12 22:34:05.155927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 557/967] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:04 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:05.305709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5b4cb0f4-70f6-404f-ad7f-3535a2625cb2 req-4aa844c5-37a3-4e8a-962f-714447dcb300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19cfc93f-0e2e-4788-ad94-581edf4efc59", "tag": "2e35c26a-e73e-40cc-8714-78c36301ab61"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:05.339472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b4cb0f4-70f6-404f-ad7f-3535a2625cb2 req-4aa844c5-37a3-4e8a-962f-714447dcb300 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:05.340019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b4cb0f4-70f6-404f-ad7f-3535a2625cb2 req-4aa844c5-37a3-4e8a-962f-714447dcb300 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:05.340464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b4cb0f4-70f6-404f-ad7f-3535a2625cb2 req-4aa844c5-37a3-4e8a-962f-714447dcb300 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:05.370011 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5b4cb0f4-70f6-404f-ad7f-3535a2625cb2 req-4aa844c5-37a3-4e8a-962f-714447dcb300 service nova] Creating event network-changed:2e35c26a-e73e-40cc-8714-78c36301ab61 for instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 on n-h1-860864-8 Oct 12 22:34:05.375750 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5b4cb0f4-70f6-404f-ad7f-3535a2625cb2 req-4aa844c5-37a3-4e8a-962f-714447dcb300 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073892 Oct 12 22:34:05.376907 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 558/968] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:05.387998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:05.389117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:05.403050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:05.404318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:05.404766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:05.405484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:05.405942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:05.406367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:05.538664 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2960971-7f0d-4ed6-90e0-5bed852239c1 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "POST /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.628552 Oct 12 22:34:05.539865 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 411/969] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Oct 12 22:34:04 2022] POST /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:34:05.588713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:05.603440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:05.611917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:05.614927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a429332-9395-48f5-bf57-4f7369c57c8d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.236757 Oct 12 22:34:05.619934 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 559/970] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:05 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:05.641719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:05.643042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:05.651639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:05.652378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:05.653015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:05.653943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:05.654588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:05.655433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:05.936058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:05.945605 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1913d62-2c72-41a4-8eda-0d730701613a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.311893 Oct 12 22:34:05.964939 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 412/971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:05 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:06.182196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:06.182923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:06.200269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:06.201038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:06.201668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:06.203019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:06.203650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:06.206019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:06.497406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:06.519007 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-726bccd9-1576-4b31-b65c-6a1e37ae571d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.341327 Oct 12 22:34:06.523176 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 560/972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:06 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:06.646984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:06.648462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:06.666911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:06.667583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:06.669359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:06.671064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:06.672480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:06.674240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:06.847560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:06.856368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:06.860720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:06.864814 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b6a77344-2783-4859-94e0-86db777875f9 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.223073 Oct 12 22:34:06.865514 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 413/973] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:06 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:06.974715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:06.975642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:06.983524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:06.984206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:06.984739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:06.985735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:06.986368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:06.986899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.580640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Calling method '.version_select at 0x7f44ff90da60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:07.587608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.588435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.589269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.610055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.610812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.611469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.704458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.705730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.706375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.732218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:07.737521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.746311 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c3b693d-9871-4d92-9d8b-cb067b43499c tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.774256 Oct 12 22:34:07.748562 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 561/974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:06 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:07.760752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.767559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.774877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:07.775435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:07.789703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.789988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.790429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.791143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.811080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.811460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.837109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.837765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.838297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.863526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d4ab185d-c8ad-4fe1-a9ac-8e75092438e0 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2625 microversion: 2.53 time: 0.560771 Oct 12 22:34:07.865262 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 414/975] 10.222.0.20 () {60 vars in 1243 bytes} [Wed Oct 12 22:34:07 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2625 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:07.887611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Calling method '.version_select at 0x7f44ff90ddc0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:07.895433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.896683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.900844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:07.954818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:07.955580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:07.956303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.041445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.042191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.042806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.060229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.060962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.061566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.063926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:08.109537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.110478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.111603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.123120 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-66b2b063-ce90-44df-bb25-60c4092cf8f3 tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1318 microversion: 2.53 time: 0.240894 Oct 12 22:34:08.124111 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 415/976] 10.222.0.20 () {60 vars in 1222 bytes} [Wed Oct 12 22:34:07 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:08.128061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:08.142699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:08.143741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:08.144830 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1daf8a6-bc32-404d-92dd-1f0e45f98ce1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.391766 Oct 12 22:34:08.148153 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 562/977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:07 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:08.151316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.151801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.152259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.153028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.153402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.153818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.161978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Calling method '.version_select at 0x7f44ff86eaf0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:08.169402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.169911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.175311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.223466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.225664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.227850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.246119 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0bc38f11-970c-41c9-ab4b-144aae94787d tempest-HypervisorAdminV253TestBase-1240572250 tempest-HypervisorAdminV253TestBase-1240572250-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/16c7121c-c945-4ad2-8ae5-0ea2da4ddd85" status: 200 len: 791 microversion: 2.53 time: 0.092325 Oct 12 22:34:08.258218 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 563/978] 10.222.0.20 () {60 vars in 1298 bytes} [Wed Oct 12 22:34:08 2022] GET /compute/v2.1/os-hypervisors/16c7121c-c945-4ad2-8ae5-0ea2da4ddd85 => generated 791 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:34:08.288867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1818847735", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "7b1241eb-4d07-4434-b635-9cae399f27b9"}, {"uuid": "4b0ef47b-2707-4e5c-aff7-8edb8a123dba"}, {"uuid": "7b1241eb-4d07-4434-b635-9cae399f27b9"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:08.296230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:08.311194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:08.312731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:08.313930 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7cdfe7e6-3e5d-4d9d-8b24-4ebace6a9424 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.188572 Oct 12 22:34:08.317212 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 416/979] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:08 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:08.445235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] validate_networks() for [('7b1241eb-4d07-4434-b635-9cae399f27b9', None, None, None, None, None), ('4b0ef47b-2707-4e5c-aff7-8edb8a123dba', None, None, None, None, None), ('7b1241eb-4d07-4434-b635-9cae399f27b9', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:34:08.783478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:08.784789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:08.793884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.794672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.795303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:08.796422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:08.797064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:08.797786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:09.045658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:09.068753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4bd9c90-fb35-4a45-ab5c-93862e1465bb tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.289405 Oct 12 22:34:09.073222 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 417/980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:08 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:09.179841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:09.181353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:09.189096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:09.189959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:09.190580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:09.191468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:09.192141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:09.192723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:09.269606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:09.288439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:09.598351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:09.666706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:09.682952 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12a75066-3f3a-422d-b442-df07c75f788b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.515118 Oct 12 22:34:09.695477 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 418/981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:09 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:09.709524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:09.718118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:09.753784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:09.773887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:09.774795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:09.775575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:09.776077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:09.776509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:09.916950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:09.927109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:09.928624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:09.937963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d3c6edf-42a8-44f2-b715-a31f2c06601a tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.238585 Oct 12 22:34:09.938639 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 419/982] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:09 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:10.094435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:10.095945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:10.107965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.108396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.109010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.109859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.110465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.111037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.226899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:34:10.228018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:34:10.242831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:34:10.245144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:34:10.246134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:34:10.285484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.287011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.290183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.294462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.296449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.300544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.432841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:10.442762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-370ac147-07b9-411d-868c-c4e923248121 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.352008 Oct 12 22:34:10.452179 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 420/983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:10 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:10.466945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Getting quotas for project 25017cd8ac6040bf9ba0e88a3a9659a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:34:10.472614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Getting quotas for user cb2090f18cfb4ea59d153fc62cf208e2 and project 25017cd8ac6040bf9ba0e88a3a9659a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:34:10.531311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:34:10.533766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:34:10.674637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80da973b-3624-4fe2-be0d-daf599d81fe2 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393827 Oct 12 22:34:10.676909 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 564/984] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:34:10.689226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d768da4-9d45-4c68-abd8-7b5bd19b2017 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:10.689777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d768da4-9d45-4c68-abd8-7b5bd19b2017 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:10.713296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:10.714522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:10.724567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.726387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.727191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.730225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.730956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.731582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.822035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d768da4-9d45-4c68-abd8-7b5bd19b2017 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:10.831479 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d768da4-9d45-4c68-abd8-7b5bd19b2017 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1213 microversion: 2.1 time: 0.146647 Oct 12 22:34:10.841463 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 421/985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:10 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:10.970495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:10.972086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:10.988920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.989416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.989857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:10.990564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:10.991014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:10.991435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:11.128411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:11.146112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9bc5a7f-94d6-4849-8eb4-1bcdfa6a6f54 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.436954 Oct 12 22:34:11.160209 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 565/986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:10 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:11.270842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:11.282320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:11.289830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:11.292042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-171eb6c4-802c-4e14-9147-a621f97e604c tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.324973 Oct 12 22:34:11.328359 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 422/987] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:10 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:11.474800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:11.475592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:11.490545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:11.499533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:11.504933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:11.508468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:11.509903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:11.511859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:11.863991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:11.865094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:11.894840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:11.900367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:11.901196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:11.909216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:11.910055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:11.912476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:12.090930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:12.091804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:12.100714 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db9a6194-5e7d-4251-8124-f233fbeccd41 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1471 microversion: 2.1 time: 0.629084 Oct 12 22:34:12.115916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 566/988] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:11 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1471 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:12.116138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f997c870-1b66-4378-b801-94fe1e53b699 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1217 microversion: 2.1 time: 0.245753 Oct 12 22:34:12.116138 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 423/989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:11 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1217 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:12.173489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:12.176837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:12.187096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:12.188586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:12.189114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:12.189893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:12.190416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:12.190841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:12.329468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:12.331272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:12.347915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:12.352600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:12.355173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:12.355919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:12.357632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:12.357767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:12.508577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:12.532973 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c16716d-088d-4d08-ae93-463196cf6275 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.363356 Oct 12 22:34:12.549144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:12.550122 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 567/990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:12 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:12.564261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:12.567301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:12.571561 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-962bb166-dda5-479d-a286-ae1416c25b4e tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.252599 Oct 12 22:34:12.584265 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 424/991] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:12 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:13.128887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:13.129704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:13.130700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:13.131096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:13.144160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.145099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.146753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.151317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.151846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.152608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.153802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.154225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.155838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.155838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.156117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.156249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.353805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:13.376184 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34aaa6d0-bdc2-49c1-a728-0478e07ce602 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1273 microversion: 2.1 time: 0.248484 Oct 12 22:34:13.395468 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 425/992] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:13 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:13.395989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:13.412037 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36980890-bfdf-4890-b96e-22a4d014a597 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1477 microversion: 2.1 time: 0.285647 Oct 12 22:34:13.414708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 568/993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:13 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1477 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:13.562373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:13.562966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:13.575463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.575977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.587149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.588203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.588833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.589422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.606167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:13.606808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:13.622150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.622635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.623067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.623766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.624248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.624661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.777900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:13.796293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:13.811017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:13.816082 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f247ac89-657f-4786-83b8-e046055280d8 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.211672 Oct 12 22:34:13.820580 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 569/994] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:13 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:13.845753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-76bf18f7-2639-47b9-a9a6-431bc082ce9e req-2691a0df-9e92-4903-973f-9161b286e44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cfc93f-0e2e-4788-ad94-581edf4efc59", "name": "network-vif-plugged", "status": "completed", "tag": "2e35c26a-e73e-40cc-8714-78c36301ab61"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:13.871297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76bf18f7-2639-47b9-a9a6-431bc082ce9e req-2691a0df-9e92-4903-973f-9161b286e44f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:13.875936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76bf18f7-2639-47b9-a9a6-431bc082ce9e req-2691a0df-9e92-4903-973f-9161b286e44f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:13.878067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76bf18f7-2639-47b9-a9a6-431bc082ce9e req-2691a0df-9e92-4903-973f-9161b286e44f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:13.911455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-76bf18f7-2639-47b9-a9a6-431bc082ce9e req-2691a0df-9e92-4903-973f-9161b286e44f service nova] Creating event network-vif-plugged:2e35c26a-e73e-40cc-8714-78c36301ab61 for instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 on n-h1-860864-8 Oct 12 22:34:13.917797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:13.926387 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ccdcd83-9567-4b55-9254-a183ad1a8045 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.367774 Oct 12 22:34:13.926990 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 426/995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:13 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:13.939193 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-76bf18f7-2639-47b9-a9a6-431bc082ce9e req-2691a0df-9e92-4903-973f-9161b286e44f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101713 Oct 12 22:34:13.939193 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 570/996] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:14.403827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:14.405622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:14.415575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:14.416387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:14.417124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:14.418021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:14.418646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:14.419077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:14.441239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:14.446556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:14.453404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:14.454160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:14.454801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:14.455731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:14.456426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:14.457050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:14.681010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:14.692812 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-958f2075-d476-484e-bef4-1e3bf7cec160 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1477 microversion: 2.1 time: 0.255847 Oct 12 22:34:14.703165 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 571/997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:14 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:14.850558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:14.883665 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0b031c7-0bbc-4eb1-9612-c238278eb3c0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1313 microversion: 2.1 time: 0.471858 Oct 12 22:34:14.884368 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 427/998] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:14 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:14.901371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:14.901987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:14.912148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:14.912647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:14.913089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:14.913803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:14.914254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:14.914713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:14.920783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-70694535", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:14.952922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:14.994845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:34:15.029496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:15.044185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:15.046401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:15.048979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2bbe445-959c-4295-ab80-6b7152f4a3ea tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1365 microversion: 2.47 time: 0.158778 Oct 12 22:34:15.064584 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 428/999] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:14 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:15.075850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:15.077724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:15.083782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.084642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.085286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:15.085984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.086633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.087215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:15.257904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:34:15.259048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:34:15.259549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:34:15.259975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:34:15.260377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:34:15.269175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.269641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.270336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:15.271051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.271492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.271916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:15.289325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Getting quotas for project c13b67867e874005b2d13c44b9479e52. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:34:15.294904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Getting quotas for user 0a02cde9b33a426e9544b2a823aa4333 and project c13b67867e874005b2d13c44b9479e52. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:34:15.307712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:34:15.310022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:34:15.314871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:15.327206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ef5d4fe-4213-452e-926a-ae61d11ce3b4 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1325 microversion: 2.1 time: 0.260881 Oct 12 22:34:15.329022 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 429/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:15 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1325 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:15.359139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d97175d8-02e5-4cbe-8480-068f31f5f862 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653873 Oct 12 22:34:15.360340 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 572/1001] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:34:15.374085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-353647ac-b067-4fc4-a4a6-bce68e39810c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:15.375090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-353647ac-b067-4fc4-a4a6-bce68e39810c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:15.462421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-353647ac-b067-4fc4-a4a6-bce68e39810c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:15.474519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-353647ac-b067-4fc4-a4a6-bce68e39810c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1221 microversion: 2.1 time: 0.106709 Oct 12 22:34:15.475111 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 430/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:15 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:15.722721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:15.723633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:15.738085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.738829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.739373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:15.740166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.740566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.740998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:15.909075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:15.909707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:15.928284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.928800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.929256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:15.932629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:15.933185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:15.933811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.015795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.023943 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2eeb9225-8f23-4573-9d22-f536954a6045 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1477 microversion: 2.1 time: 0.305492 Oct 12 22:34:16.024540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 573/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:15 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:16.079671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:16.080425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:16.087094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.087674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.088197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.088964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.089480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.089991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.155975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.165278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.166733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.167879 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6558a85f-25a3-4a3d-9834-416f07443409 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1371 microversion: 2.47 time: 0.092170 Oct 12 22:34:16.168502 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 574/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:16 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:16.355809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:16.356440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:16.362258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.362728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.363156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.363835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.364308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.364721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.377738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.379788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:16.386562 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99534466-6f47-4f0d-a3e7-ca8169c555a7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1334 microversion: 2.1 time: 0.482172 Oct 12 22:34:16.387286 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 431/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:15 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1334 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:16.499081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:16.499703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:16.506385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.506718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.507200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.507630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.509064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.509463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.509856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.515214 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52f5717a-9f52-43e8-ae8b-2e7051a05a74 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.163189 Oct 12 22:34:16.528540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 575/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:16 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:16.541698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:16.542304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:16.548611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.549130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.549830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.550643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.551371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.551818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.618479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.631469 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4a86c5c-4d28-49b2-bc6f-f201556586fa tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1225 microversion: 2.1 time: 0.136283 Oct 12 22:34:16.632180 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 432/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:16 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:16.704790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.713886 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1091d567-11c4-4fc4-9481-67342d5c42f2 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.177256 Oct 12 22:34:16.714561 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 576/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:16 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:16.737644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4067edc-4f79-4012-b454-dd3c68f69c57 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1604608066", "metadata": {"": ""}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4067edc-4f79-4012-b454-dd3c68f69c57 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action HTTP/1.1 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 107 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1604608066", "metadata": {"": ""}}} Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '19cfc93f-0e2e-4788-ad94-581edf4efc59', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1604608066', 'metadata': {'': ''}}}} Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'': ''} Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:34:16.742877 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4067edc-4f79-4012-b454-dd3c68f69c57 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4067edc-4f79-4012-b454-dd3c68f69c57 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action" status: 400 len: 170 microversion: 2.1 time: 0.011458 Oct 12 22:34:16.752317 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 433/1009] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Oct 12 22:34:16 2022] POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action => generated 170 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:34:16.757101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:16.757101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:16.764926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.765412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.765837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.767000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:16.767523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:16.768117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:16.969302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:16.979998 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f90151ed-3213-4a46-9085-1a4eb55f77eb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.228583 Oct 12 22:34:16.980643 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 577/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:16 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:17.003066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.003679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.010845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.011331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.011765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.012513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.013128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.013946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.047838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.048576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.055050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.055617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.056210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.056954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.057508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.057939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.199398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.208436 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-785725e8-e0f9-48a6-9c9f-714b07f81cfd tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1477 microversion: 2.1 time: 0.165571 Oct 12 22:34:17.209026 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 578/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:17.216799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.219172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:17.221699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.223611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.228084 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c52f8cd-c5e4-4215-8354-bd3520f11eb0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.228488 Oct 12 22:34:17.229511 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 434/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:16 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:17.231389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.232768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.232768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.233088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.233479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.233899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.257476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e5b6c4e-a1bb-49d6-a29a-2f2d91b92c6e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1294455769", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e5b6c4e-a1bb-49d6-a29a-2f2d91b92c6e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action HTTP/1.1 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 619 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1294455769", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '19cfc93f-0e2e-4788-ad94-581edf4efc59', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1294455769', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:34:17.262930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 22:34:17.265568 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.270555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e5b6c4e-a1bb-49d6-a29a-2f2d91b92c6e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:17.272555 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e5b6c4e-a1bb-49d6-a29a-2f2d91b92c6e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action" status: 400 len: 938 microversion: 2.1 time: 0.020827 Oct 12 22:34:17.274112 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 435/1013] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Oct 12 22:34:17 2022] POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:34:17.295304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.296203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.304535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.306265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.306878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.308581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.308969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.309400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.324416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.333749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.335876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.337267 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e27d9c2-2e5d-473f-bf2b-2c18eef40833 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1371 microversion: 2.47 time: 0.127181 Oct 12 22:34:17.338534 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 579/1014] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:17.409679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.410821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.417304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.417873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.418396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.419440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.420016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.420870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.567578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.575952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.576374 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2e00664-b053-46b1-9e7d-11f7bc3ee74e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.297415 Oct 12 22:34:17.577122 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 436/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:17.584250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e30596a2-b0ba-4246-8c10-b296c793b885 req-e906b761-b11d-4bb8-91bd-32d6626d111e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1303196e-4aff-41e4-bba7-da44a13bd6bc", "name": "network-vif-plugged", "status": "completed", "tag": "fc389c33-904c-4171-89fd-eed4b0c5df9f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:17.584557 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b120535-3c2d-419b-bbbe-79b676c33d5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.178662 Oct 12 22:34:17.595952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e30596a2-b0ba-4246-8c10-b296c793b885 req-e906b761-b11d-4bb8-91bd-32d6626d111e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.596516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e30596a2-b0ba-4246-8c10-b296c793b885 req-e906b761-b11d-4bb8-91bd-32d6626d111e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.596981 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 580/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:17.597597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e30596a2-b0ba-4246-8c10-b296c793b885 req-e906b761-b11d-4bb8-91bd-32d6626d111e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.606192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.606992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.612950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.613437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.613872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.614563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.614680 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e30596a2-b0ba-4246-8c10-b296c793b885 req-e906b761-b11d-4bb8-91bd-32d6626d111e service nova] Creating event network-vif-plugged:fc389c33-904c-4171-89fd-eed4b0c5df9f for instance 1303196e-4aff-41e4-bba7-da44a13bd6bc on n-h2-860864-8 Oct 12 22:34:17.615008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.615423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.621486 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e30596a2-b0ba-4246-8c10-b296c793b885 req-e906b761-b11d-4bb8-91bd-32d6626d111e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042923 Oct 12 22:34:17.622086 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 437/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:17.661800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3a58f4e0-aff7-416e-bac9-0b332cf1161f req-a65726cb-77e9-47e1-b8b6-c8b5286592fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "tag": "c3fd8c82-2713-464c-ba92-6fdb6748689a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:17.675558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a58f4e0-aff7-416e-bac9-0b332cf1161f req-a65726cb-77e9-47e1-b8b6-c8b5286592fe service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.676685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a58f4e0-aff7-416e-bac9-0b332cf1161f req-a65726cb-77e9-47e1-b8b6-c8b5286592fe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.677174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a58f4e0-aff7-416e-bac9-0b332cf1161f req-a65726cb-77e9-47e1-b8b6-c8b5286592fe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.690407 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3a58f4e0-aff7-416e-bac9-0b332cf1161f req-a65726cb-77e9-47e1-b8b6-c8b5286592fe service nova] Creating event network-changed:c3fd8c82-2713-464c-ba92-6fdb6748689a for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:17.695315 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3a58f4e0-aff7-416e-bac9-0b332cf1161f req-a65726cb-77e9-47e1-b8b6-c8b5286592fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038413 Oct 12 22:34:17.696495 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 438/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:17.701665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.702673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.709547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.710219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.710839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.711541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.712088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.712885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.802138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.813279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:17.813817 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1958818e-47de-4a83-a855-5256ef04e23e tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1273 microversion: 2.1 time: 0.115188 Oct 12 22:34:17.814452 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 439/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:17.829641 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f051f8cc-4ead-40c0-bebf-977260d8ce39 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.231119 Oct 12 22:34:17.830525 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 581/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:17.853749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7897c28f-bbb2-4dcd-95fa-97b53cf1b906 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7897c28f-bbb2-4dcd-95fa-97b53cf1b906 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action HTTP/1.1 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 285 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '19cfc93f-0e2e-4788-ad94-581edf4efc59', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.858590 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 22:34:17.862012 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:17.865971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7897c28f-bbb2-4dcd-95fa-97b53cf1b906 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:17.867157 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7897c28f-bbb2-4dcd-95fa-97b53cf1b906 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action" status: 400 len: 619 microversion: 2.1 time: 0.018459 Oct 12 22:34:17.868451 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 440/1021] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Oct 12 22:34:17 2022] POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:34:17.876353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:17.876971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:17.883470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.884000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.884846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:17.885786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:17.886462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:17.887109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.233409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:18.234023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:18.241325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.241817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.242932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.243933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.244548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.245128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.253744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.268330 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bbb06b80-e02f-4fd9-b7d0-e1d50bd6289e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.395697 Oct 12 22:34:18.270483 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 582/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:17 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:18.293673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:18.294285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:18.300228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.300706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.301137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.301833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.302279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.302697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.440904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.448822 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03636af5-44aa-4bda-9683-efbdb36ca5bf tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.159625 Oct 12 22:34:18.449409 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 583/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:18 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:18.462638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:18.462638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:18.462638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.462638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.462638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.462638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.463109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.463482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.480448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.488616 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-346abe69-12b0-44ab-b4a8-298ba3e80a3e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1477 microversion: 2.1 time: 0.259665 Oct 12 22:34:18.489405 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 441/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:18 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:18.495479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-244796143"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:18.499706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:18.509267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.509750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.510179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.512708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.513728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.514445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.540731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.553373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.555788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.557236 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-147bec9f-b851-43aa-b98c-fa7820bab96d tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1356 microversion: 2.47 time: 0.106749 Oct 12 22:34:18.558060 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 584/1025] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:18 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:18.583167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:18.588208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.589078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Searching by: {'deleted': False, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:34:18.595794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.596303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.596740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.597471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.597922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.598535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.729462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:34:18.772576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1af9d62f-b24a-45df-a7f4-a830ff949e30 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action" status: 202 len: 0 microversion: 2.1 time: 0.281679 Oct 12 22:34:18.774089 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 442/1026] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:34:18 2022] POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:34:18.779299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:18.780439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:18.792113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.792701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.793127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.794082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.794765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.795345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.833784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.843754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.844310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.844898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.857469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.858909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:18.894069 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d236dd40-8d4d-46d2-a806-a46a0c99a215 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.314685 Oct 12 22:34:18.894730 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 585/1027] 10.222.0.20 () {60 vars in 1187 bytes} [Wed Oct 12 22:34:18 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:18.900156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1106018373"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:18.903000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:18.909129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.909605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.910165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.911383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.912046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.912841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.947138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Cannot 'createImage' instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 while it is in task_state image_snapshot Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action HTTP/1.1 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 85 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1106018373"}} Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'createImage' instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 while it is in task_state image_snapshot Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '19cfc93f-0e2e-4788-ad94-581edf4efc59', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1106018373'}}} Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:34:18.948827 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 while it is in task_state image_snapshot Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 while it is in task_state image_snapshot Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 409 to user: Cannot 'createImage' instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 while it is in task_state image_snapshot {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:18.953733 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62081f98-e914-4532-a461-872f2f32d4d3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action" status: 409 len: 159 microversion: 2.1 time: 0.055258 Oct 12 22:34:18.955284 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 586/1028] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:34:18 2022] POST /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59/action => generated 159 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:34:18.961668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:18.961668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:18.967738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.968250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.968681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:18.969370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:18.969861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:18.970270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.050586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:19.061261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f7c3270a-4a84-4ef8-9737-10974e9ce0d8 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1273 microversion: 2.1 time: 0.104774 Oct 12 22:34:19.062317 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 587/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:18 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:19.071519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:19.072964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:19.073786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:19.079219 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6afa2584-a20b-4e8a-807c-12663933b4c6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.303701 Oct 12 22:34:19.079803 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 443/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:18 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:19.081958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.082736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.083389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.084432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.085815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.087036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.089505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef5f251d-6f8a-4044-97fe-4aecd695231f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '.version_select at 0x7f44ff87fa60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:19.116390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:19.281600 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24bf0c2f-a2ef-49fb-a4d1-4d62facd9020 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 204 len: 0 microversion: 2.47 time: 0.217051 Oct 12 22:34:19.282640 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 588/1031] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:34:19 2022] DELETE /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:34:19.286447 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef5f251d-6f8a-4044-97fe-4aecd695231f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/images/0b3cfefa-d603-4db8-8d82-e1f0dc782e85" status: 204 len: 0 microversion: 2.1 time: 0.204884 Oct 12 22:34:19.287020 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 444/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:19 2022] DELETE /compute/v2.1/images/0b3cfefa-d603-4db8-8d82-e1f0dc782e85 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:19.303195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:19.303195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:19.303730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:19.303730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:19.303929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.303929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.303929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.306523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.307139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.307643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.308608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.309191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.309750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.315259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.315753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.316288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.693409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:19.703147 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-915f01f3-4ec8-4eea-bb36-1d5527ab8803 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1533 microversion: 2.1 time: 0.411937 Oct 12 22:34:19.703719 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 445/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:19 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1533 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:19.709476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:19.710937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:19.719799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.720543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.721171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.722118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.722762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.723581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.730892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:19.733523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:19.750230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:19.751836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:19.756868 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-649904ba-3111-4025-8979-9b23dd9c8567 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1362 microversion: 2.47 time: 0.469709 Oct 12 22:34:19.757774 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 589/1034] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:19 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:19.766607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-40eb82bb-d71c-4575-984c-a83f85e5c7c5 req-b7137911-013d-4fc0-a995-d21331e0dcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "tag": "45b1365c-5d9c-4f44-b0b7-8a3a3a408872"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:19.782343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-40eb82bb-d71c-4575-984c-a83f85e5c7c5 req-b7137911-013d-4fc0-a995-d21331e0dcc7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:19.782821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-40eb82bb-d71c-4575-984c-a83f85e5c7c5 req-b7137911-013d-4fc0-a995-d21331e0dcc7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:19.783250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-40eb82bb-d71c-4575-984c-a83f85e5c7c5 req-b7137911-013d-4fc0-a995-d21331e0dcc7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:19.795717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-40eb82bb-d71c-4575-984c-a83f85e5c7c5 req-b7137911-013d-4fc0-a995-d21331e0dcc7 service nova] Creating event network-changed:45b1365c-5d9c-4f44-b0b7-8a3a3a408872 for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:19.801052 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-40eb82bb-d71c-4575-984c-a83f85e5c7c5 req-b7137911-013d-4fc0-a995-d21331e0dcc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Oct 12 22:34:19.801988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 590/1035] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:20.005838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:20.015265 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd39427c-a38b-48e6-b53b-438c25acb51e tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1462 microversion: 2.1 time: 0.310099 Oct 12 22:34:20.028321 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 446/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:19 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1462 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:20.047916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:20.050213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.057606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.058091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.058528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.059222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.059862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.060323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.085777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:20.086803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.095624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.096146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.096765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.097967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.098735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.099349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.143317 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-63bae927-01c5-4b62-9d97-d80c16950ef9 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action" status: 202 len: 0 microversion: 2.1 time: 0.099340 Oct 12 22:34:20.144103 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 591/1037] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:34:20 2022] POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:34:20.151819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:20.152467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.160797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.161635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.162296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.163224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.164896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.165324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.177631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:20.188375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36f11d97-99d9-44ae-897a-716ecf1a89f6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1279 microversion: 2.1 time: 0.106900 Oct 12 22:34:20.188981 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 447/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:20 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:20.195320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:20.196307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.203881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.204392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.204829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.205520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.205968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.206383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.237707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.238202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.238621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.239069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lazy-loading 'fault' on Instance uuid 1303196e-4aff-41e4-bba7-da44a13bd6bc {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:20.350667 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3907d54d-61f4-401c-9c15-e52916c58905 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1596 microversion: 2.1 time: 0.158995 Oct 12 22:34:20.351564 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 448/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:20 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1596 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:20.375359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:20.377688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.383783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.384440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.384930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.385629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.386107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.386528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.428108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:20.436591 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a352fc80-6741-4f78-b1b6-0bdefdffcf6e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.288483 Oct 12 22:34:20.437262 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 592/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:20 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:20.468505 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ccf71c75-2911-4514-abff-95c8e9f7e692 tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action" status: 202 len: 0 microversion: 2.1 time: 0.096729 Oct 12 22:34:20.472209 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 449/1041] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:34:20 2022] POST /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:34:20.478328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:20.478939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.484947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.485431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.485863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.486555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.487005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.487424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.731115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:20.732036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.739228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:20.744312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.745180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.745804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.747113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.747768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.749401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.764266 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5740e04-dc80-40d9-9a98-8cbaca23aaaa tempest-ServersAdminTestJSON-660726852 tempest-ServersAdminTestJSON-660726852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1613 microversion: 2.1 time: 0.290538 Oct 12 22:34:20.780661 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 593/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:20 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1613 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:20.792937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:20.798418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.807357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.807858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.808333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.809051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.809501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.809920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.933987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:20.940997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:20.944332 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e87bbd7-7b18-48f9-94ae-843fbe4ffc24 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1539 microversion: 2.1 time: 0.218061 Oct 12 22:34:20.945426 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 450/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:20 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1539 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:20.950323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:20.951131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:20.957936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.958426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.958927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.959624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:20.960105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:20.960606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:20.968523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:20.970587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:20.972632 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6a823ba-20a6-481d-826b-289818603ede tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1362 microversion: 2.47 time: 0.189964 Oct 12 22:34:20.973926 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 594/1044] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:20 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:20.990163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:21.019956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:21.082541 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9426946f-b919-4185-8d7f-358025eb22ed tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 204 len: 0 microversion: 2.1 time: 0.135729 Oct 12 22:34:21.083366 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 451/1045] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:20 2022] DELETE /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:21.092534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:21.093248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:21.099880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.100473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.100988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.101797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.102316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.102828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.216167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:21.216866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:21.222733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.223153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.223586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.224305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.224757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.225177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.307948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:21.315533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-116e7e51-8ebe-4f55-807f-db654d560805 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1470 microversion: 2.1 time: 0.227373 Oct 12 22:34:21.316193 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 595/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:21 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:21.377546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:21.387276 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-49302603-c288-4bdd-b08d-b9b6c903178d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.175713 Oct 12 22:34:21.388082 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 452/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:21 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:21.459994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:21.460926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:21.467848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.468325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.468851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.469637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.470206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.470877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.688533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:21.697053 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-580a4735-0c84-4a41-9186-88737cd09d18 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.241503 Oct 12 22:34:21.697827 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 596/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:21 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:21.744690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7cd8160a-a1b7-4424-9c93-901089fd9adf req-61eff202-c86b-4e6d-a529-4b9c813f9e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5860a1e4-b8b5-4816-a077-2580289c916f", "tag": "f9820734-ed9e-4e4b-ab78-e7d6035ebcd6"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:21.756308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7cd8160a-a1b7-4424-9c93-901089fd9adf req-61eff202-c86b-4e6d-a529-4b9c813f9e3f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.757114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7cd8160a-a1b7-4424-9c93-901089fd9adf req-61eff202-c86b-4e6d-a529-4b9c813f9e3f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.757813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7cd8160a-a1b7-4424-9c93-901089fd9adf req-61eff202-c86b-4e6d-a529-4b9c813f9e3f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.775832 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7cd8160a-a1b7-4424-9c93-901089fd9adf req-61eff202-c86b-4e6d-a529-4b9c813f9e3f service nova] Creating event network-changed:f9820734-ed9e-4e4b-ab78-e7d6035ebcd6 for instance 5860a1e4-b8b5-4816-a077-2580289c916f on n-h2-860864-8 Oct 12 22:34:21.782343 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7cd8160a-a1b7-4424-9c93-901089fd9adf req-61eff202-c86b-4e6d-a529-4b9c813f9e3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042321 Oct 12 22:34:21.783597 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 453/1049] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:34:21.828609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d498848d-f093-466d-8b4d-f65b833ff67b req-73c3d4d9-29d4-431d-919a-c3c3bc89da7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "tag": "dcd702e6-e5ca-4581-b92c-d775c1983aa5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:21.844148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d498848d-f093-466d-8b4d-f65b833ff67b req-73c3d4d9-29d4-431d-919a-c3c3bc89da7a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.844687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d498848d-f093-466d-8b4d-f65b833ff67b req-73c3d4d9-29d4-431d-919a-c3c3bc89da7a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.845865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d498848d-f093-466d-8b4d-f65b833ff67b req-73c3d4d9-29d4-431d-919a-c3c3bc89da7a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.872813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d498848d-f093-466d-8b4d-f65b833ff67b req-73c3d4d9-29d4-431d-919a-c3c3bc89da7a service nova] Creating event network-changed:dcd702e6-e5ca-4581-b92c-d775c1983aa5 for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:21.878139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d498848d-f093-466d-8b4d-f65b833ff67b req-73c3d4d9-29d4-431d-919a-c3c3bc89da7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058787 Oct 12 22:34:21.882028 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 597/1050] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:34:21.975554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:21.977965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:21.984674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.985649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.986081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:21.986854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:21.987476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:21.988315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.003143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:22.003844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:22.012127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.016253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.016747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.020748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.021182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.021618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.073655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.074474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.075108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.075732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lazy-loading 'fault' on Instance uuid f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:22.156234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:22.165650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:22.166937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:22.169896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:22.172199 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ced212ab-e0ee-4176-ae91-c99fb11e2dcc tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 200 len: 1367 microversion: 2.47 time: 0.173609 Oct 12 22:34:22.173824 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 598/1051] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:21 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:22.175327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e081e413-cc7d-48f2-b591-577687dcbdcc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1539 microversion: 2.1 time: 0.205229 Oct 12 22:34:22.176040 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 454/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:21 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:22.340964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:22.341578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:22.347574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.348104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.348542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.349242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.349922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.350105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.411062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:22.412945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:22.420845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.421868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.422584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.423458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.424067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.424577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.621231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:22.629303 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d5bcf8b-1be3-4039-9b5e-4c6181f82358 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1470 microversion: 2.1 time: 0.292140 Oct 12 22:34:22.644304 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 599/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:22 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:22.650396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:22.651015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:22.657151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.657632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.658068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.658781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.659535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.659993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.723993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:22.734321 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47cb4546-ec2f-4763-99e9-b00d6aef5a10 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.327394 Oct 12 22:34:22.735008 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 455/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:22 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:22.741394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:22.742296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:22.751710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.752656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.753306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.754327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.754909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.755647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.917096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 8fa0aaef-a675-4aed-a3e3-93790420d284 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:22.940771 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-02ff9eec-5cc6-45cf-a04f-4d79b5ff1196 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 2419 microversion: 2.25 time: 0.294920 Oct 12 22:34:22.941652 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 600/1055] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:22 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 2419 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:22.970674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": "auto"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:22.973548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:22.983215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.984085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.984748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:22.985722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:22.986387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:22.987044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.018011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:23.018908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'flavor' on Instance uuid 8fa0aaef-a675-4aed-a3e3-93790420d284 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:23.026295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-42a721e2-152e-40e6-9430-1fc75cf65a5c tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.289779 Oct 12 22:34:23.033495 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 456/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:22 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:23.036452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:34:23.203140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:23.205322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:23.219423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.220005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.220445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.221376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.223857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.224317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.243059 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] HTTP exception thrown: Instance f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 could not be found. Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Request method failure captured: Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 HTTP/1.1 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DE_frnOuanbLLFMZGOm8KhmPIEGxgosUFf9oVQm8tn8llQ0CAhUx3pV-jXyy9D5rgBVA-dEuW8PeHB-fKh4Z0zs0O3XFsadnIFa5vursEnL9-KgLKns-jO5wCD_FyBiAS5pauIlrcmAyMuEente6XGIEnY51MozlAiuWIHRBD1cy4 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ec7bc14ca8a440df93351b3704eef0ea Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerShowV247Test-1150763749 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec7bc14ca8a440df93351b3704eef0ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ec7bc14ca8a440df93351b3704eef0ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ec7bc14ca8a440df93351b3704eef0ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec7bc14ca8a440df93351b3704eef0ea"}]}] Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerShowV247Test-1150763749 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ec7bc14ca8a440df93351b3704eef0ea Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerShowV247Test-1150763749 Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerShowV247Test-1150763749-project Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6f7bcc4be09942e7acb20cf7e42825ed Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerShowV247Test-1150763749-project Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 could not be found. Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2'} Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 could not be found. Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 could not be found. Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:23.245729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:23.250454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:23.250454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:23.250454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:23.250454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:23.250454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:23.250454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 could not be found. Oct 12 22:34:23.250454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:23.253069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Returning 404 to user: Instance f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:23.254231 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89dc3c1d-69e8-4455-919b-814d00093217 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2" status: 404 len: 111 microversion: 2.47 time: 0.058050 Oct 12 22:34:23.255389 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 457/1057] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:23 2022] GET /compute/v2.1/servers/f3a6dffa-a537-4fb8-a21f-49ad3f00bbd2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:34:23.262079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:23.262958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:23.270643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.272442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.273078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.274422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.274873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.275291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.540912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:23.550986 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ee2ea934-3f6e-4818-9fab-27e2c9886318 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1521 microversion: 2.1 time: 0.294376 Oct 12 22:34:23.551563 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 458/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:23 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:23.584050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:23.585518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:23.601544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.602035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.602466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.606270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.629502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.633445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.693280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:23.839238 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9bb03f23-9da0-4fa4-b8ee-299d95bb705f tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed" status: 204 len: 0 microversion: 2.47 time: 0.286275 Oct 12 22:34:23.840185 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 459/1059] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:34:23 2022] DELETE /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:34:23.846576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:23.847586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:23.854392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.855098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.855687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:23.856698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:23.857567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:23.858142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.150435 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb840b9c-1bab-486b-9ad2-c4794bc94843 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1810 microversion: 2.1 time: 0.307990 Oct 12 22:34:24.164317 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 460/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:23 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:24.164317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:24.164317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:24.166193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.166910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.167606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.168454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.169153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.169649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.200410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:24.274968 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d3dcceb-3659-4c5c-84d9-3239e066b0ba tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 204 len: 0 microversion: 2.1 time: 0.121825 Oct 12 22:34:24.275633 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 461/1061] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:24 2022] DELETE /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:24.280537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:24.281225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:24.286865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.287341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.287775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.288482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.289558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.289966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.321191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.321654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.322076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.322505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lazy-loading 'fault' on Instance uuid 0655ef74-07da-4d4c-9774-7cf77b06fdfe {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:24.363216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:24.370905 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ada5fc45-4fb6-471a-8f89-676c27e320e5 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 200 len: 1304 microversion: 2.1 time: 0.094189 Oct 12 22:34:24.371476 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 462/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:24 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:24.375914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:24.376511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:24.382113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.382637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.383145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.383956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.384406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.384826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.514827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:24.522387 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b1c1218-213e-4a74-af5e-f18f0d2bed37 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.149946 Oct 12 22:34:24.522946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 463/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:24 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:24.528140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8d3a4fb3-a4b9-4e62-bd97-f6ba59cd61b1 req-add1e0bc-bb4f-4142-8d00-93851e432491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cfc93f-0e2e-4788-ad94-581edf4efc59", "name": "network-vif-plugged", "status": "completed", "tag": "2e35c26a-e73e-40cc-8714-78c36301ab61"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:24.537334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d3a4fb3-a4b9-4e62-bd97-f6ba59cd61b1 req-add1e0bc-bb4f-4142-8d00-93851e432491 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.537800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d3a4fb3-a4b9-4e62-bd97-f6ba59cd61b1 req-add1e0bc-bb4f-4142-8d00-93851e432491 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.538218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d3a4fb3-a4b9-4e62-bd97-f6ba59cd61b1 req-add1e0bc-bb4f-4142-8d00-93851e432491 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.548883 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8d3a4fb3-a4b9-4e62-bd97-f6ba59cd61b1 req-add1e0bc-bb4f-4142-8d00-93851e432491 service nova] Creating event network-vif-plugged:2e35c26a-e73e-40cc-8714-78c36301ab61 for instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 on n-h1-860864-8 Oct 12 22:34:24.553743 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8d3a4fb3-a4b9-4e62-bd97-f6ba59cd61b1 req-add1e0bc-bb4f-4142-8d00-93851e432491 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028975 Oct 12 22:34:24.554322 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 464/1064] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:24.559086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:24.559766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:24.566496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.566969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.567397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.568106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.568553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.568970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.630787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:24.634789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:24.640333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:24.641769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:24.643078 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cedfff31-08dd-4fb0-a13c-a87056c74e66 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed" status: 200 len: 1362 microversion: 2.47 time: 0.087653 Oct 12 22:34:24.643633 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 465/1065] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:24 2022] GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed => generated 1362 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:24.649047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-436a5d1b-95a3-41ec-9356-522dcd708ca4 req-cf3d79a5-7f37-43bd-b4b1-52b8f3d0c80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0655ef74-07da-4d4c-9774-7cf77b06fdfe", "name": "network-vif-deleted", "tag": "7f679fc0-5d04-40af-9f6a-1b3c5e608fad"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:24.658608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-436a5d1b-95a3-41ec-9356-522dcd708ca4 req-cf3d79a5-7f37-43bd-b4b1-52b8f3d0c80d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.659081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-436a5d1b-95a3-41ec-9356-522dcd708ca4 req-cf3d79a5-7f37-43bd-b4b1-52b8f3d0c80d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.659500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-436a5d1b-95a3-41ec-9356-522dcd708ca4 req-cf3d79a5-7f37-43bd-b4b1-52b8f3d0c80d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.670167 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-436a5d1b-95a3-41ec-9356-522dcd708ca4 req-cf3d79a5-7f37-43bd-b4b1-52b8f3d0c80d service nova] Creating event network-vif-deleted:7f679fc0-5d04-40af-9f6a-1b3c5e608fad for instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe on n-h2-860864-8 Oct 12 22:34:24.674986 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-436a5d1b-95a3-41ec-9356-522dcd708ca4 req-cf3d79a5-7f37-43bd-b4b1-52b8f3d0c80d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030258 Oct 12 22:34:24.675540 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 466/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:24.680393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:24.681080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:24.686880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.687346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.687775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.688468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.688912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.689323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.837381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:24.845392 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c06aa38e-5ee8-43e8-90b2-95ed5e213aae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.168708 Oct 12 22:34:24.845956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 467/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:24 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:24.850252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:24.853870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.854341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.854770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.855474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.855935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.856354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.879068 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dcd704b7-399b-4e3c-b048-a81188f16851 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.032177 Oct 12 22:34:24.879619 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 468/1068] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:34:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:24.884380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:24.885095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:24.891389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.891846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.892297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:24.892969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:24.893412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:24.893828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.046782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:25.056046 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8915bf38-0374-439e-9001-8d53aec1f7af tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1527 microversion: 2.1 time: 0.175385 Oct 12 22:34:25.072625 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 469/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:24 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1527 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:25.393920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.394614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 0655ef74-07da-4d4c-9774-7cf77b06fdfe] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.400782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.401265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.401704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.402397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.402850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.403275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.417181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] HTTP exception thrown: Instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe could not be found. Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Request method failure captured: Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe HTTP/1.1 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0B0PzRpbYIaVmp_KXm1vsftP--AF8N-s4SL2yDfkIUb_xk-_5-CcH92FFiczhqfgadYDjLSt5uCbiMr_2CMSdXqtsnkzS05zFeac4Gd2Lm5Nte2aKNT72Ywb84LKtCOtOXvWVIPaJ-k3FNJH-OZIkbPZaVsEc4nahiUQHjup3RvWkQ Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: aa1830ddea9a4dd9affc6b62a2bfdf1d Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}] Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: aa1830ddea9a4dd9affc6b62a2bfdf1d Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersAdminTestJSON-646191257-project Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: ca520967e5914fe7b5e982f0bbbb9847 Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersAdminTestJSON-646191257-project Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe could not be found. Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '0655ef74-07da-4d4c-9774-7cf77b06fdfe'} Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe could not be found. Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe could not be found. Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:25.418811 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe could not be found. Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Returning 404 to user: Instance 0655ef74-07da-4d4c-9774-7cf77b06fdfe could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dcc8043-97ac-416a-aa28-3ebab8072cf1 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe" status: 404 len: 111 microversion: 2.1 time: 0.030214 Oct 12 22:34:25.423419 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 470/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/0655ef74-07da-4d4c-9774-7cf77b06fdfe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:34:25.428255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.428752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.435289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.435849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.436228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.436917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.437373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.437796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.472794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:25.474851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:25.556507 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09d53c69-2dc4-4fb9-8dc8-e01fe74bf1d9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 204 len: 0 microversion: 2.1 time: 0.131402 Oct 12 22:34:25.558318 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 471/1071] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:25 2022] DELETE /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:34:25.564273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.565106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.571755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.572414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.573007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.573814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.574330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.574815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.706832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:25.715050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-72d347a7-ec69-4ab8-b840-216810341026 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.155689 Oct 12 22:34:25.715552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 472/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:25.731568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.732199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.737980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.738446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.738871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.739569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.740019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.740438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.875787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:25.883841 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a12399b-ac8d-4df2-b8b3-3ce61866eebe tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 200 len: 1470 microversion: 2.1 time: 0.167229 Oct 12 22:34:25.884501 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 473/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:25.896127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.896127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.896127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.896127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.896945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.897225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.897842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.898946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.966918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:25.975674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:25.978021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:25.979805 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1196539d-6662-4d2b-820d-0dab54aac470 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed" status: 200 len: 1362 microversion: 2.47 time: 0.094172 Oct 12 22:34:25.980831 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 474/1074] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed => generated 1362 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:25.986492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:25.987143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:25.993977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.994885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.995609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:25.996509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:25.997025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:25.997523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:26.146511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:26.155550 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1b2d450-1433-4256-9246-1336c69640f7 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.173150 Oct 12 22:34:26.156368 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 475/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:25 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:26.161213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:26.161807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:26.167475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:26.167998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:26.168412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:26.169083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:26.169524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:26.169942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:26.298319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:26.306356 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29b48663-3c5d-4191-bab9-02032ce78f4d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1527 microversion: 2.1 time: 0.149004 Oct 12 22:34:26.306915 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 476/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:26 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1527 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:26.378646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c719740-98ef-4df5-bfbd-e6ad74cb81f5", "device": "/dev/xvdb"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:26.381082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:26.386852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:26.387325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:26.387750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:26.388446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:26.388884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:26.389297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:28.523400 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5be1781f-3e96-4ea2-91fc-a9f9e390b95a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "POST /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.147917 Oct 12 22:34:28.532215 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 477/1077] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 22:34:26 2022] POST /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 194 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:34:28.543179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:28.545258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:28.555368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:28.555368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:28.555746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:28.556624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:28.557236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:28.557768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:28.647777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:28.827965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=14 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:29.136875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:29.144870 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4cf1815-ded0-4738-a028-8c03a11b859d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.610306 Oct 12 22:34:29.148938 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 478/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:28 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:29.156235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:29.159040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: b6b8fc85-fc87-4f07-9f8d-3961983e9c10] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:29.174428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.175171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.175790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.176680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.179787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.180425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.206723 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] HTTP exception thrown: Instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 could not be found. Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Request method failure captured: Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 HTTP/1.1 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0B0PzRpbYIaVmp_KXm1vsftP--AF8N-s4SL2yDfkIUb_xk-_5-CcH92FFiczhqfgadYDjLSt5uCbiMr_2CMSdXqtsnkzS05zFeac4Gd2Lm5Nte2aKNT72Ywb84LKtCOtOXvWVIPaJ-k3FNJH-OZIkbPZaVsEc4nahiUQHjup3RvWkQ Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: aa1830ddea9a4dd9affc6b62a2bfdf1d Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}] Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: aa1830ddea9a4dd9affc6b62a2bfdf1d Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersAdminTestJSON-646191257-project Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: ca520967e5914fe7b5e982f0bbbb9847 Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersAdminTestJSON-646191257-project Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 could not be found. Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'b6b8fc85-fc87-4f07-9f8d-3961983e9c10'} Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 could not be found. Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 could not be found. Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:29.212821 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:29.217458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:29.217458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:29.217458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:29.217458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:29.217458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:29.217458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 could not be found. Oct 12 22:34:29.217458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:29.228818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Returning 404 to user: Instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:29.229937 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90e8ad4b-cb7d-4ceb-9181-c57f3cdebaaf tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10" status: 404 len: 111 microversion: 2.1 time: 0.079730 Oct 12 22:34:29.234003 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 479/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:29 2022] GET /compute/v2.1/servers/b6b8fc85-fc87-4f07-9f8d-3961983e9c10 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:29.238948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:29.239837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:29.253998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.254953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.255551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.256942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.261695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.262334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.330364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.331239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.332592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.333202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lazy-loading 'fault' on Instance uuid 6380ac19-342e-4801-92a2-aed301ac2aed {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:29.419544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:29.427795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:29.429321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f7bcc4be09942e7acb20cf7e42825ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7bc14ca8a440df93351b3704eef0ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:29.430512 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-077bbed9-f5bf-4c5a-bff7-2866b0fe51df tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed" status: 200 len: 1367 microversion: 2.47 time: 0.195327 Oct 12 22:34:29.431054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 480/1080] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:29 2022] GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:29.459130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:29.459748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:29.466361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.466851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.467288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.468027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.468483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.468904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.831424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:29.838598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:29.846930 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f2251bc-5eee-4569-8f33-33aa5c6214ae tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.391126 Oct 12 22:34:29.848191 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 481/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:29 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:29.854687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:29.856098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:29.865240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.866300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.867250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:29.868268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:29.869828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:29.870601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.004648 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf4c18ff-dbf3-459c-82db-cdbce6d07f98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/action" status: 202 len: 0 microversion: 2.25 time: 7.037636 Oct 12 22:34:30.006248 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 601/1082] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:34:22 2022] POST /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/action => generated 0 bytes in 7040 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:30.013281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ddf1e3ac-6292-4591-81a9-0b05b03ffbb1 req-95cf7ef2-1983-4c6b-8bde-029b7164c905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b8fc85-fc87-4f07-9f8d-3961983e9c10", "name": "network-vif-deleted", "tag": "a9c0a074-a316-4749-9953-672b5bba0630"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:30.040628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ddf1e3ac-6292-4591-81a9-0b05b03ffbb1 req-95cf7ef2-1983-4c6b-8bde-029b7164c905 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.041191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ddf1e3ac-6292-4591-81a9-0b05b03ffbb1 req-95cf7ef2-1983-4c6b-8bde-029b7164c905 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.041627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ddf1e3ac-6292-4591-81a9-0b05b03ffbb1 req-95cf7ef2-1983-4c6b-8bde-029b7164c905 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.056152 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ddf1e3ac-6292-4591-81a9-0b05b03ffbb1 req-95cf7ef2-1983-4c6b-8bde-029b7164c905 service nova] Creating event network-vif-deleted:a9c0a074-a316-4749-9953-672b5bba0630 for instance b6b8fc85-fc87-4f07-9f8d-3961983e9c10 on n-h2-860864-8 Oct 12 22:34:30.084687 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ddf1e3ac-6292-4591-81a9-0b05b03ffbb1 req-95cf7ef2-1983-4c6b-8bde-029b7164c905 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075693 Oct 12 22:34:30.087731 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 602/1083] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:30.094725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6b1348ef-bfe0-4f6b-b7ab-bc605443da15 req-25ebd2c0-5c39-4d71-82e1-7447bd1b0ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cfc93f-0e2e-4788-ad94-581edf4efc59", "name": "network-vif-unplugged", "status": "completed", "tag": "2e35c26a-e73e-40cc-8714-78c36301ab61"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:30.140727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6b1348ef-bfe0-4f6b-b7ab-bc605443da15 req-25ebd2c0-5c39-4d71-82e1-7447bd1b0ae2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.141311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6b1348ef-bfe0-4f6b-b7ab-bc605443da15 req-25ebd2c0-5c39-4d71-82e1-7447bd1b0ae2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.143956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6b1348ef-bfe0-4f6b-b7ab-bc605443da15 req-25ebd2c0-5c39-4d71-82e1-7447bd1b0ae2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.165690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:30.176586 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-931e96aa-5a85-4066-95a0-2a5783f73d35 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 200 len: 1310 microversion: 2.1 time: 0.326126 Oct 12 22:34:30.180601 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 482/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:29 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 1310 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:30.182843 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6b1348ef-bfe0-4f6b-b7ab-bc605443da15 req-25ebd2c0-5c39-4d71-82e1-7447bd1b0ae2 service nova] Creating event network-vif-unplugged:2e35c26a-e73e-40cc-8714-78c36301ab61 for instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 on n-h1-860864-8 Oct 12 22:34:30.192302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.200598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6b1348ef-bfe0-4f6b-b7ab-bc605443da15 req-25ebd2c0-5c39-4d71-82e1-7447bd1b0ae2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110574 Oct 12 22:34:30.201240 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 603/1085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:30.210331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.211046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.211462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.229185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.229674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.230113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.230823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.231296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.231701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.238954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.239840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.240519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.244364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.245130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.246611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.311202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:30.414835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:30.423476 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ab2166fa-4e2b-4476-85ba-637f4912d12a tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 204 len: 0 microversion: 2.1 time: 0.236792 Oct 12 22:34:30.424302 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 483/1086] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:30 2022] DELETE /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:30.430272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.431129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.439229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.439750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.440254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.441211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.441668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.442164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.504919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:30.515356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:30.519543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:30.521030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:30.522408 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2245f699-4951-4e9a-ab4d-0581800e6b47 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.319850 Oct 12 22:34:30.523560 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 604/1087] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:30 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:30.528865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.529790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.536832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.537596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.538750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.539747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.540987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.541577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.613686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:30.622040 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5809d1c5-39c8-41c7-8332-6b9cc2479a61 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.196359 Oct 12 22:34:30.632162 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 484/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:30 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:30.632162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.632162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] [instance: 6380ac19-342e-4801-92a2-aed301ac2aed] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.638433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.638433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.638433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.638433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.638433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.638433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.651210 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] HTTP exception thrown: Instance 6380ac19-342e-4801-92a2-aed301ac2aed could not be found. Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Request method failure captured: Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed HTTP/1.1 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DE_frnOuanbLLFMZGOm8KhmPIEGxgosUFf9oVQm8tn8llQ0CAhUx3pV-jXyy9D5rgBVA-dEuW8PeHB-fKh4Z0zs0O3XFsadnIFa5vursEnL9-KgLKns-jO5wCD_FyBiAS5pauIlrcmAyMuEente6XGIEnY51MozlAiuWIHRBD1cy4 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ec7bc14ca8a440df93351b3704eef0ea Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerShowV247Test-1150763749 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec7bc14ca8a440df93351b3704eef0ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ec7bc14ca8a440df93351b3704eef0ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ec7bc14ca8a440df93351b3704eef0ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ec7bc14ca8a440df93351b3704eef0ea"}]}] Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerShowV247Test-1150763749 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ec7bc14ca8a440df93351b3704eef0ea Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerShowV247Test-1150763749 Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerShowV247Test-1150763749-project Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6f7bcc4be09942e7acb20cf7e42825ed Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerShowV247Test-1150763749-project Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 6380ac19-342e-4801-92a2-aed301ac2aed could not be found. Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '6380ac19-342e-4801-92a2-aed301ac2aed'} Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6380ac19-342e-4801-92a2-aed301ac2aed could not be found. Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6380ac19-342e-4801-92a2-aed301ac2aed could not be found. Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:30.653081 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6380ac19-342e-4801-92a2-aed301ac2aed could not be found. Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] Returning 404 to user: Instance 6380ac19-342e-4801-92a2-aed301ac2aed could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d17751aa-9a4f-4a23-b901-e49a12b4d2e3 tempest-ServerShowV247Test-1150763749 tempest-ServerShowV247Test-1150763749-project] 10.222.0.20 "GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed" status: 404 len: 111 microversion: 2.47 time: 0.030957 Oct 12 22:34:30.657884 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 485/1089] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:30 2022] GET /compute/v2.1/servers/6380ac19-342e-4801-92a2-aed301ac2aed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:34:30.714471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:30.722715 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-16528b88-194d-4bce-8ded-d0c2bc477842 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1468 microversion: 2.1 time: 0.198187 Oct 12 22:34:30.723299 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 605/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:30 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:30.873563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:30.874574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:30.881821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.882438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.882936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:30.883710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:30.884286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:30.884841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:31.060974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:31.070329 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13e01bd5-a370-41a3-80c0-13e978f84ed6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.200560 Oct 12 22:34:31.070900 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 486/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:30 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:31.205800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:31.206760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:31.214781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:31.215388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:31.215985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:31.219661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:31.219661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:31.219661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:31.234575 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 HTTP/1.1 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '19cfc93f-0e2e-4788-ad94-581edf4efc59'} Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:31.236798 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:31.240743 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-760c5d55-da9e-45cd-8bab-3af97de3d159 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 404 len: 111 microversion: 2.1 time: 0.036975 Oct 12 22:34:31.246293 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 606/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:31 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:31.250636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-20f6a740-6063-45d0-a66f-351c92263aa3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'create', calling method: .version_select at 0x7f44ff742d30>, body: {"keypair": {"name": "tempest-keypair-1337551350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh4AXi5ZycWiR5fNbLZFHLzVBsfx1giZd1M627V52KpJXH0/QMnCChe+sSajQPpydi7cqVhxN/2C6dG1B2gs2S6p1WQOwRXk+8AalPfTgOJD7diEtDdBFiuj/hZ11TUnA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:31.269274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-20f6a740-6063-45d0-a66f-351c92263aa3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for project 5b4767aa6972423987ec612b734dcf48. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:34:31.275109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-20f6a740-6063-45d0-a66f-351c92263aa3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for user 5f91f5085e864c5fbf74eb6eacf504c3 and project 5b4767aa6972423987ec612b734dcf48. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:34:31.299526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-20f6a740-6063-45d0-a66f-351c92263aa3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052629 Oct 12 22:34:31.306606 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 487/1093] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:34:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:31.558801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:31.559746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:31.592383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:31.593288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:31.594480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:31.597227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:31.597918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:31.598763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:31.648741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:31.649457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:31.657097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:31.657932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:31.658440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:31.659218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:31.663551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:31.664683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.134220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:32.137714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:32.169614 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ece98ca8-4b43-443c-a336-879325eb65ee tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.523962 Oct 12 22:34:32.170635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:32.186182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 488/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:31 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:32.193652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:32.202827 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ed03eb1c-d2e7-4db3-8d0e-d4396b31b2b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.654065 Oct 12 22:34:32.204099 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 607/1095] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:31 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:32.208227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:32.209095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:32.218822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:32.221072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:32.230321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.230843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.234978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.235741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.236237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.236662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.250989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.255344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.257578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.259992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.260467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.260896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.519549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:32.535850 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-235ac530-493a-4236-884f-19bc0f2964fc tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.329127 Oct 12 22:34:32.537582 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 608/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:32 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:32.548246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f124a665-6ef6-4901-940a-81bd331551e4 req-a2c0eba7-e064-4f0d-aa5c-3846ce4a9e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cfc93f-0e2e-4788-ad94-581edf4efc59", "name": "network-vif-deleted", "tag": "2e35c26a-e73e-40cc-8714-78c36301ab61"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:32.558645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:32.574091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f124a665-6ef6-4901-940a-81bd331551e4 req-a2c0eba7-e064-4f0d-aa5c-3846ce4a9e17 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.575745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f124a665-6ef6-4901-940a-81bd331551e4 req-a2c0eba7-e064-4f0d-aa5c-3846ce4a9e17 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.579660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f124a665-6ef6-4901-940a-81bd331551e4 req-a2c0eba7-e064-4f0d-aa5c-3846ce4a9e17 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.609958 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f124a665-6ef6-4901-940a-81bd331551e4 req-a2c0eba7-e064-4f0d-aa5c-3846ce4a9e17 service nova] Creating event network-vif-deleted:2e35c26a-e73e-40cc-8714-78c36301ab61 for instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 on n-h1-860864-8 Oct 12 22:34:32.624320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f124a665-6ef6-4901-940a-81bd331551e4 req-a2c0eba7-e064-4f0d-aa5c-3846ce4a9e17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082177 Oct 12 22:34:32.631708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 609/1097] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:32.650249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5860a1e4-b8b5-4816-a077-2580289c916f", "name": "network-vif-plugged", "status": "completed", "tag": "f9820734-ed9e-4e4b-ab78-e7d6035ebcd6"}, {"server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "name": "network-vif-plugged", "status": "completed", "tag": "c3fd8c82-2713-464c-ba92-6fdb6748689a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:32.670014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:32.670950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:32.671629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:32.687674 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] Creating event network-vif-plugged:f9820734-ed9e-4e4b-ab78-e7d6035ebcd6 for instance 5860a1e4-b8b5-4816-a077-2580289c916f on n-h2-860864-8 Oct 12 22:34:32.688642 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] Creating event network-vif-plugged:c3fd8c82-2713-464c-ba92-6fdb6748689a for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:32.693661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:32.699852 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065005 Oct 12 22:34:32.701479 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 610/1098] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:32.702904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:32.704184 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2ac21544-fafd-4ea9-95b9-0a8d44ead9d2 req-e138a799-ca8a-42f1-b328-bf44231bf593 service nova] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001618 Oct 12 22:34:32.705572 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 611/1099] 10.222.0.20 () {56 vars in 886 bytes} [Wed Oct 12 22:34:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:34:32.715751 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71b51190-b9c1-454b-b0f4-a1c7d4d7b8ad tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1468 microversion: 2.1 time: 0.513293 Oct 12 22:34:32.718029 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 489/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:32 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1468 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:33.193757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-19128f9e-a362-4315-9a26-126bdb94b130 req-e66a3c0e-a49a-441e-bf98-82117cf5b6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1303196e-4aff-41e4-bba7-da44a13bd6bc", "name": "network-vif-deleted", "tag": "fc389c33-904c-4171-89fd-eed4b0c5df9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:33.197218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:33.198436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:33.215018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.215797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.216646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.217539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.218749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.219368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.228718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-19128f9e-a362-4315-9a26-126bdb94b130 req-e66a3c0e-a49a-441e-bf98-82117cf5b6ed service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.229250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-19128f9e-a362-4315-9a26-126bdb94b130 req-e66a3c0e-a49a-441e-bf98-82117cf5b6ed service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.229650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-19128f9e-a362-4315-9a26-126bdb94b130 req-e66a3c0e-a49a-441e-bf98-82117cf5b6ed service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.260468 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-19128f9e-a362-4315-9a26-126bdb94b130 req-e66a3c0e-a49a-441e-bf98-82117cf5b6ed service nova] Creating event network-vif-deleted:fc389c33-904c-4171-89fd-eed4b0c5df9f for instance 1303196e-4aff-41e4-bba7-da44a13bd6bc on n-h2-860864-8 Oct 12 22:34:33.267721 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-19128f9e-a362-4315-9a26-126bdb94b130 req-e66a3c0e-a49a-441e-bf98-82117cf5b6ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082391 Oct 12 22:34:33.269795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 612/1101] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:33.277934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:33.279841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:33.289231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.290529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.291264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.292516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.293455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.294125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.559852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:33.588498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:33.592310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:33.594312 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ef605bb-4f2b-432c-b4e2-838996b2d291 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.322730 Oct 12 22:34:33.595630 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 613/1102] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:33 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:33.604834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:33.606686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:33.616163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.617600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.618287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.619537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.621276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.622531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.630878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:33.639263 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19e32414-9d07-4177-844e-724a138b0ff6 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1321 microversion: 2.1 time: 0.446284 Oct 12 22:34:33.639880 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 490/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:33 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:33.742662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:33.743383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:33.755269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.756075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.757523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.761041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.761682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.763768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.844491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:33.844983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:33.845606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:33.845865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lazy-loading 'fault' on Instance uuid 1303196e-4aff-41e4-bba7-da44a13bd6bc {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:33.897091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:33.906226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7fc394ce-57a5-4dc2-87e4-c4689e407599 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.309152 Oct 12 22:34:33.906879 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 614/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:33 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:33.937083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca520967e5914fe7b5e982f0bbbb9847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1830ddea9a4dd9affc6b62a2bfdf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:33.945742 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ee484647-173c-48b7-bd3f-4d1b7c2c29a9 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 200 len: 1304 microversion: 2.1 time: 0.207945 Oct 12 22:34:33.946401 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 491/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:33 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:34.561779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-321742654", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:34.625591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:34.626969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:34.636292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:34.637152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:34.638277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:34.639267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:34.639950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:34.640546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:34.824166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:34.834091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:34.835580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:34.837020 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-616d64f6-ae37-49c6-b012-e9d402d4b26b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.217512 Oct 12 22:34:34.848531 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 492/1106] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:34 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:34.860467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:34.861093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:34.863082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:34.866993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] validate_networks() for [('d6a10245-cee9-40b0-8da9-7f972e191229', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:34:34.871363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:34.872082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:34.872928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:34.873818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:34.874468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:34.875078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.040901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:35.049138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6887a9f-f986-4110-93b7-ec75f5bb944d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1470 microversion: 2.1 time: 0.199511 Oct 12 22:34:35.050068 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 493/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:34 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:35.073061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0afe467e-9fba-4385-a254-dd85d27cfc60 req-581cd778-01f9-4519-b033-3c9be57d7062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "name": "network-vif-plugged", "status": "completed", "tag": "dcd702e6-e5ca-4581-b92c-d775c1983aa5"}, {"server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "name": "network-vif-plugged", "status": "completed", "tag": "45b1365c-5d9c-4f44-b0b7-8a3a3a408872"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:35.086333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0afe467e-9fba-4385-a254-dd85d27cfc60 req-581cd778-01f9-4519-b033-3c9be57d7062 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.087077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0afe467e-9fba-4385-a254-dd85d27cfc60 req-581cd778-01f9-4519-b033-3c9be57d7062 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.087685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0afe467e-9fba-4385-a254-dd85d27cfc60 req-581cd778-01f9-4519-b033-3c9be57d7062 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.101235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0afe467e-9fba-4385-a254-dd85d27cfc60 req-581cd778-01f9-4519-b033-3c9be57d7062 service nova] Creating event network-vif-plugged:dcd702e6-e5ca-4581-b92c-d775c1983aa5 for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:35.102042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0afe467e-9fba-4385-a254-dd85d27cfc60 req-581cd778-01f9-4519-b033-3c9be57d7062 service nova] Creating event network-vif-plugged:45b1365c-5d9c-4f44-b0b7-8a3a3a408872 for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:35.109371 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0afe467e-9fba-4385-a254-dd85d27cfc60 req-581cd778-01f9-4519-b033-3c9be57d7062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042843 Oct 12 22:34:35.110545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 494/1108] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:35.119635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.120895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:35.127785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.128302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.128926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.129787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.130396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.131094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.384026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:34:35.384647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:34:35.385229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:34:35.385712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:34:35.386353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:34:35.396200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.397866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.398675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.399658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.400197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.400769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.421459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for project 5b4767aa6972423987ec612b734dcf48. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:34:35.428287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for user 5f91f5085e864c5fbf74eb6eacf504c3 and project 5b4767aa6972423987ec612b734dcf48. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:34:35.443303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:34:35.445842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:34:35.450476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:35.463783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b782eac8-3b17-414c-bf54-a2508e6b0571 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.350015 Oct 12 22:34:35.465786 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 495/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:35 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:35.472338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.473412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] [instance: 1303196e-4aff-41e4-bba7-da44a13bd6bc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:35.483928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.485071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.485828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.486759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.487265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.488010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.505373 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] HTTP exception thrown: Instance 1303196e-4aff-41e4-bba7-da44a13bd6bc could not be found. Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Request method failure captured: Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc HTTP/1.1 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0B0PzRpbYIaVmp_KXm1vsftP--AF8N-s4SL2yDfkIUb_xk-_5-CcH92FFiczhqfgadYDjLSt5uCbiMr_2CMSdXqtsnkzS05zFeac4Gd2Lm5Nte2aKNT72Ywb84LKtCOtOXvWVIPaJ-k3FNJH-OZIkbPZaVsEc4nahiUQHjup3RvWkQ Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: aa1830ddea9a4dd9affc6b62a2bfdf1d Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa1830ddea9a4dd9affc6b62a2bfdf1d"}]}] Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: aa1830ddea9a4dd9affc6b62a2bfdf1d Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersAdminTestJSON-646191257 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersAdminTestJSON-646191257-project Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: ca520967e5914fe7b5e982f0bbbb9847 Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersAdminTestJSON-646191257-project Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 1303196e-4aff-41e4-bba7-da44a13bd6bc could not be found. Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '1303196e-4aff-41e4-bba7-da44a13bd6bc'} Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1303196e-4aff-41e4-bba7-da44a13bd6bc could not be found. Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1303196e-4aff-41e4-bba7-da44a13bd6bc could not be found. Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:35.507484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.512455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:35.512455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:35.512455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:35.512455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:35.512455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:35.512455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1303196e-4aff-41e4-bba7-da44a13bd6bc could not be found. Oct 12 22:34:35.512455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.512907 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22488304-62b1-4cba-9381-753eeaf0261d tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.957273 Oct 12 22:34:35.512907 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 615/1110] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:34:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:34:35.519823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.520444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] Returning 404 to user: Instance 1303196e-4aff-41e4-bba7-da44a13bd6bc could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:35.520575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:35.522758 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a41b7cf-4957-48d6-b4dc-9f588e478f83 tempest-ServersAdminTestJSON-646191257 tempest-ServersAdminTestJSON-646191257-project] 10.222.0.20 "GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc" status: 404 len: 111 microversion: 2.1 time: 0.055063 Oct 12 22:34:35.526291 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 496/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:35 2022] GET /compute/v2.1/servers/1303196e-4aff-41e4-bba7-da44a13bd6bc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:35.533541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.534108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.534634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.535665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.536202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.536840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.538793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32b0a1ca-5fea-463b-ab35-4c307b2ab646 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.542411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32b0a1ca-5fea-463b-ab35-4c307b2ab646 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:35.572128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Request method failure captured: Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f/diagnostics HTTP/1.1 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DlcsJjBqRmaa2TGBhcgqzbrOHczaKbUj5JpmZmcKYLsGVLs5bTnYWehCU8cDlvy6b5KwLrGVhkZhc9Afx15MS_YU9QDMCQZ-6lvt7v2-2k0feoyIWKT_JzCTRrIQR0_RS4FcbzIOJy0mzaHwIfUYmMHjFi0EqTMTfTzWsa_kMkU6A Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c13b67867e874005b2d13c44b9479e52 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2109213034 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c13b67867e874005b2d13c44b9479e52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c13b67867e874005b2d13c44b9479e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c13b67867e874005b2d13c44b9479e52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c13b67867e874005b2d13c44b9479e52"}]}] Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2109213034 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c13b67867e874005b2d13c44b9479e52 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2109213034 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerDiagnosticsNegativeTest-2109213034-project Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0a02cde9b33a426e9544b2a823aa4333 Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2109213034-project Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': '5860a1e4-b8b5-4816-a077-2580289c916f'} Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.574245 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90b3b97e-6881-4203-bbd3-c17e45e32b5f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.062361 Oct 12 22:34:35.579126 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 616/1112] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:34:35 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f/diagnostics => generated 117 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:35.590882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.592475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:35.601234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.602089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.602751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.603818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.604498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.605248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.617692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32b0a1ca-5fea-463b-ab35-4c307b2ab646 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:35.629104 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32b0a1ca-5fea-463b-ab35-4c307b2ab646 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1224 microversion: 2.1 time: 0.100493 Oct 12 22:34:35.650415 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 497/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:35 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:35.661221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:35.846252 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef7f16ad-67d2-496c-937e-9e7b554d1f0c tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 204 len: 0 microversion: 2.1 time: 0.259087 Oct 12 22:34:35.849954 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 617/1114] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:35 2022] DELETE /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:35.866931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.867557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:35.871776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:35.872553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:35.886370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.886742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.887188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.887917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.888392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.888832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.894774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.895280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.895719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:35.896453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:35.908591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:35.909394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:36.230938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:36.243455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:36.249860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:36.251317 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f194b6f-aea7-4c4b-b9e2-ba386ed1873d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.388463 Oct 12 22:34:36.252632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:36.255285 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 618/1115] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:35 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:36.269338 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4200609f-80e6-4e1c-b77c-80773fee339f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1476 microversion: 2.1 time: 0.407815 Oct 12 22:34:36.270144 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 498/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:35 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1476 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:36.488502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:36.489567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:36.502597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:36.504762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:36.505503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:36.507618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:36.509629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:36.510239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:36.596993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5865d78d-cf56-471a-9212-940359799891 tempest-ComputeTenantNetworksTest-700152322 tempest-ComputeTenantNetworksTest-700152322-project] Calling method '.version_select at 0x7f44ff5fb280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:36.855945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:36.869240 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3443398-ea84-4b82-9757-f9b7b3e49bca tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1355 microversion: 2.1 time: 0.384998 Oct 12 22:34:36.871037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 499/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:36 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1355 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:36.898890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:36.899586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:36.930996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:36.931787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:36.932250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:36.933079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:36.933532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:36.933954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:36.965151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:37.086670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:37.104689 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71c6991c-c8df-45d4-8173-e4ff33b09317 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1276 microversion: 2.1 time: 0.232123 Oct 12 22:34:37.112560 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 500/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:36 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:37.141026 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5865d78d-cf56-471a-9212-940359799891 tempest-ComputeTenantNetworksTest-700152322 tempest-ComputeTenantNetworksTest-700152322-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.695254 Oct 12 22:34:37.142006 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 619/1119] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:34:36 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:37.153147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34b0f332-999a-4e69-b6a3-68e10413a24e tempest-ComputeTenantNetworksTest-700152322 tempest-ComputeTenantNetworksTest-700152322-project] Calling method '.version_select at 0x7f44ff7b7ca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:37.296528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:37.297748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:37.319627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:37.320588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:37.322703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:37.326321 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34b0f332-999a-4e69-b6a3-68e10413a24e tempest-ComputeTenantNetworksTest-700152322 tempest-ComputeTenantNetworksTest-700152322-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/a01214d9-67eb-4ccc-a9dd-2f80bffeaa0b" status: 200 len: 139 microversion: 2.1 time: 0.176936 Oct 12 22:34:37.326657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:37.327257 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 501/1120] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:34:37 2022] GET /compute/v2.1/os-tenant-networks/a01214d9-67eb-4ccc-a9dd-2f80bffeaa0b => generated 139 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:37.327718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:37.328643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:37.344616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:37.345245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:37.369682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:37.370224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:37.370681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:37.371415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:37.371868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:37.372335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:37.742355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:37.761058 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5f69a7e4-7b40-4753-8bd5-fb30e4dcdd4f tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1476 microversion: 2.1 time: 0.467503 Oct 12 22:34:37.763386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 620/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:37 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:37.791591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:37.801889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:37.807757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:37.820694 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8bdbb554-162a-4d29-8783-3c787712e668 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.492224 Oct 12 22:34:37.822410 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 502/1122] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:37 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:37.919062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:37.919692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:37.950321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:37.953738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:37.955565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:37.957413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:37.961081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:37.967701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.142812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:38.143436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:38.164638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.167028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.167531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.170233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.174817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.177766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.387526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:38.396948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:38.404779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80ead724-db3a-4493-a5bc-1be5bc0cc0f9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1803 microversion: 2.1 time: 0.511156 Oct 12 22:34:38.424622 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac039de7-10f5-4d26-ae1f-434ce10d17be tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1282 microversion: 2.1 time: 0.290015 Oct 12 22:34:38.426045 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 503/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:38 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1282 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:38.429288 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 621/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:37 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1803 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:38.447676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:38.448649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:38.468018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.474428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.483315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.485546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.486318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.486781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.534267 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef0f03bb-c7e5-4b93-b606-5917cf552429 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102/ips" status: 200 len: 216 microversion: 2.1 time: 0.091704 Oct 12 22:34:38.544952 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 504/1125] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:34:38 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102/ips => generated 216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:38.549400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:38.549905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:38.565471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.568616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.569765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.572816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.574549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.575193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.577262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7c9c9cab-0ff0-4297-a085-a4bd4cbf1506 req-a4c38213-6a1b-472b-b7a6-be635a3e28d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5860a1e4-b8b5-4816-a077-2580289c916f", "name": "network-vif-deleted", "tag": "f9820734-ed9e-4e4b-ab78-e7d6035ebcd6"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:38.619626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7c9c9cab-0ff0-4297-a085-a4bd4cbf1506 req-a4c38213-6a1b-472b-b7a6-be635a3e28d2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.619626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7c9c9cab-0ff0-4297-a085-a4bd4cbf1506 req-a4c38213-6a1b-472b-b7a6-be635a3e28d2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.632437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7c9c9cab-0ff0-4297-a085-a4bd4cbf1506 req-a4c38213-6a1b-472b-b7a6-be635a3e28d2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.647826 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7c9c9cab-0ff0-4297-a085-a4bd4cbf1506 req-a4c38213-6a1b-472b-b7a6-be635a3e28d2 service nova] Creating event network-vif-deleted:f9820734-ed9e-4e4b-ab78-e7d6035ebcd6 for instance 5860a1e4-b8b5-4816-a077-2580289c916f on n-h2-860864-8 Oct 12 22:34:38.668165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:34:38.675169 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7c9c9cab-0ff0-4297-a085-a4bd4cbf1506 req-a4c38213-6a1b-472b-b7a6-be635a3e28d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103699 Oct 12 22:34:38.677744 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 505/1126] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:38.789138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:38.790411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:38.803788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.804329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.805056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.805873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.806325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.806741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.876582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21cb5104-8e76-4f70-973a-c70e63ddd5cd tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 204 len: 0 microversion: 2.1 time: 0.331967 Oct 12 22:34:38.883920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 622/1127] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:34:38 2022] DELETE /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:38.902496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:38.903260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:38.934941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.936990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.937781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.941836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.943647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.945095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.947830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:38.963334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:38.967330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:38.968781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lazy-loading 'fault' on Instance uuid 5860a1e4-b8b5-4816-a077-2580289c916f {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:39.172969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cde9b33a426e9544b2a823aa4333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13b67867e874005b2d13c44b9479e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:39.185977 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-813e6be3-41c3-4c8e-99de-aadb8ce17cd1 tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 200 len: 1311 microversion: 2.1 time: 0.402702 Oct 12 22:34:39.187950 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 506/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:38 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 1311 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:39.195668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:39.197077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:39.205899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:39.210165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:39.216202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:39.217732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:39.219462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:39.219872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:39.220747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:39.221749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:39.223122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:39.223288 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af7d90a2-00b2-4023-8637-34a75cea5a0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.338058 Oct 12 22:34:39.224381 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 623/1129] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:38 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:39.225003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:39.266284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9ec0b96-00fa-48dc-ba9b-2273ebf6e3ca"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:39.283862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:39.294550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:39.295087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:39.295528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:39.306708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:39.307202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:39.310823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:39.572541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:39.586910 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5844f41d-9e21-4e5a-83b2-4d754e6b8820 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1809 microversion: 2.1 time: 0.397549 Oct 12 22:34:39.587587 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 507/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:39 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1809 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:39.605801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:39.606629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:39.623795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:39.625937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:39.626582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:39.627496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:39.630270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:39.630910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:39.860234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:39.870178 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b180e24d-99a1-4c8d-a0ae-a6135aa5b6b6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 0.281066 Oct 12 22:34:39.871472 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 508/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:39 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:40.217529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:40.218682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] [instance: 5860a1e4-b8b5-4816-a077-2580289c916f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:40.232220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:40.233683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:40.234311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:40.235559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:40.237352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:40.238012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:40.265637 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] HTTP exception thrown: Instance 5860a1e4-b8b5-4816-a077-2580289c916f could not be found. Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Request method failure captured: Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f HTTP/1.1 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DlcsJjBqRmaa2TGBhcgqzbrOHczaKbUj5JpmZmcKYLsGVLs5bTnYWehCU8cDlvy6b5KwLrGVhkZhc9Afx15MS_YU9QDMCQZ-6lvt7v2-2k0feoyIWKT_JzCTRrIQR0_RS4FcbzIOJy0mzaHwIfUYmMHjFi0EqTMTfTzWsa_kMkU6A Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c13b67867e874005b2d13c44b9479e52 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2109213034 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c13b67867e874005b2d13c44b9479e52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c13b67867e874005b2d13c44b9479e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c13b67867e874005b2d13c44b9479e52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c13b67867e874005b2d13c44b9479e52"}]}] Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2109213034 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c13b67867e874005b2d13c44b9479e52 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2109213034 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerDiagnosticsNegativeTest-2109213034-project Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0a02cde9b33a426e9544b2a823aa4333 Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2109213034-project Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 5860a1e4-b8b5-4816-a077-2580289c916f could not be found. Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5860a1e4-b8b5-4816-a077-2580289c916f'} Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5860a1e4-b8b5-4816-a077-2580289c916f could not be found. Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5860a1e4-b8b5-4816-a077-2580289c916f could not be found. Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:40.268818 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5860a1e4-b8b5-4816-a077-2580289c916f could not be found. Oct 12 22:34:40.272873 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:40.275728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] Returning 404 to user: Instance 5860a1e4-b8b5-4816-a077-2580289c916f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:40.280094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19c70c3a-c941-4f65-a93f-20da5aa4621d tempest-ServerDiagnosticsNegativeTest-2109213034 tempest-ServerDiagnosticsNegativeTest-2109213034-project] 10.222.0.20 "GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f" status: 404 len: 111 microversion: 2.1 time: 0.069004 Oct 12 22:34:40.281381 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 509/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:40 2022] GET /compute/v2.1/servers/5860a1e4-b8b5-4816-a077-2580289c916f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:34:40.287037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:40.290789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:40.300111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:40.301072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:40.302011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:40.303088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:40.304491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:40.305228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:40.617261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e1cd10ca-9551-4906-8d97-dfd604367b50 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "POST /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.386921 Oct 12 22:34:40.619931 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 624/1133] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 22:34:39 2022] POST /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 194 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:40.635563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:40.637112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:40.655064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:40.656937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:40.660657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:40.661861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:40.663825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:40.665067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:41.186798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:41.198872 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17f34c85-212c-4c83-aac5-966b3c172a51 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1809 microversion: 2.1 time: 0.577454 Oct 12 22:34:41.199818 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 625/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:40 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1809 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:41.201365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:41.216779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:41.225070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:41.225818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:41.228643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:41.230764 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b26d687e-6869-4760-8ba8-e4f008f76298 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.946088 Oct 12 22:34:41.231437 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 510/1135] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:40 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:41.255525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:41.256096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:41.257266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:41.258276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:41.258738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:41.259454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:41.964094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:41.977768 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96d396e3-438f-4793-8ba8-08fb518c817e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 0.756266 Oct 12 22:34:41.979044 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 626/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:41 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:42.229827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:42.231179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:42.252486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.263739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.264414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.265332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:42.265992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:42.268821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.270444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.274219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.277691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.280068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.280531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.283568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.285878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.286358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.653735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:42.669401 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8aed42f2-520b-41d2-ac5f-f71cbe2f8a84 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1788 microversion: 2.1 time: 0.444306 Oct 12 22:34:42.679750 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 511/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:42 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1788 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:42.685725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a9055090-7a1f-46d5-b568-f61fca96beb6 req-192c16bb-a48a-45c1-bc67-a607fc6a490b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "name": "network-vif-deleted", "tag": "45b1365c-5d9c-4f44-b0b7-8a3a3a408872"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:42.702633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a9055090-7a1f-46d5-b568-f61fca96beb6 req-192c16bb-a48a-45c1-bc67-a607fc6a490b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.703490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a9055090-7a1f-46d5-b568-f61fca96beb6 req-192c16bb-a48a-45c1-bc67-a607fc6a490b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.704214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a9055090-7a1f-46d5-b568-f61fca96beb6 req-192c16bb-a48a-45c1-bc67-a607fc6a490b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.719808 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a9055090-7a1f-46d5-b568-f61fca96beb6 req-192c16bb-a48a-45c1-bc67-a607fc6a490b service nova] Creating event network-vif-deleted:45b1365c-5d9c-4f44-b0b7-8a3a3a408872 for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:42.727751 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a9055090-7a1f-46d5-b568-f61fca96beb6 req-192c16bb-a48a-45c1-bc67-a607fc6a490b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045823 Oct 12 22:34:42.729220 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 512/1138] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:42.736196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-cffb4b21-b7a5-4b57-9634-1f6b5e875e0f req-7ae5986a-3bc6-4a6d-8db3-18e08fb374bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8904c6fa-e66b-4ef6-9f3e-441eefa9880f", "tag": "d2d9fdd4-5e26-483d-9d61-f0d195e064bb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:42.748318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cffb4b21-b7a5-4b57-9634-1f6b5e875e0f req-7ae5986a-3bc6-4a6d-8db3-18e08fb374bb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:42.749145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cffb4b21-b7a5-4b57-9634-1f6b5e875e0f req-7ae5986a-3bc6-4a6d-8db3-18e08fb374bb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:42.750157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cffb4b21-b7a5-4b57-9634-1f6b5e875e0f req-7ae5986a-3bc6-4a6d-8db3-18e08fb374bb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:42.765424 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-cffb4b21-b7a5-4b57-9634-1f6b5e875e0f req-7ae5986a-3bc6-4a6d-8db3-18e08fb374bb service nova] Creating event network-changed:d2d9fdd4-5e26-483d-9d61-f0d195e064bb for instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f on n-h1-860864-8 Oct 12 22:34:42.775806 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-cffb4b21-b7a5-4b57-9634-1f6b5e875e0f req-7ae5986a-3bc6-4a6d-8db3-18e08fb374bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043822 Oct 12 22:34:42.776365 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 513/1139] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:43.005532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:43.005952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:43.022911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:43.023407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:43.023847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:43.024588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:43.030994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:43.031628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:43.344990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:43.362990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:43.371161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:43.374371 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e2be72f-d069-4351-b2b4-b511f3d225a6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 1.115406 Oct 12 22:34:43.375913 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 627/1140] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:42 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:43.541225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:43.560901 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6b5085a2-857a-4a13-91d2-bc011df83cb9 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 0.560493 Oct 12 22:34:43.569243 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 514/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:42 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:43.705827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:43.706907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:43.719058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:43.723760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:43.727567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:43.731441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:43.732462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:43.733134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:44.356305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:44.374170 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-66c57f15-ee84-404b-928b-7ebd78bb613e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1631 microversion: 2.1 time: 0.673378 Oct 12 22:34:44.376478 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 628/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:43 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1631 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:44.406972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:44.407587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:44.431424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:44.434141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:44.436868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:44.437804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:44.442081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:44.443232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:44.490852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:44.491857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:44.502433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:44.502941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:44.503383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:44.506675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:44.506876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:44.508433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:44.958477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:44.965521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7504e9e3-24f5-4236-a484-5fb9e69737e5 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1856 microversion: 2.1 time: 0.479227 Oct 12 22:34:44.986423 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 629/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:44 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1856 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:44.986674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:44.993454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:44.999807 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f902a76e-d83a-4967-b787-30eb1ee563a8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.596823 Oct 12 22:34:45.002295 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 515/1144] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:44 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:45.008390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": true, "disk_over_commit": false}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:45.008750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:45.009663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:45.011577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:45.019945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:45.027087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:45.027617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:45.028039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:45.028753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:45.029639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:45.030079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:45.030582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:45.032324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:45.034933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:45.035603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:45.036246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:45.090620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lazy-loading 'flavor' on Instance uuid 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:45.121844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120543) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:34:45.409936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:45.435354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:45.623444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:46.017269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:46.027809 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b05a066d-ec0b-4585-b61c-2b0192faa9b7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 1.042354 Oct 12 22:34:46.032420 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 630/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:44 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:46.046350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0cb5e24d-27cd-48f4-89c7-d9d72e38d94f req-57d7df30-254a-4062-8994-4836c3a47bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "name": "network-vif-deleted", "tag": "c3fd8c82-2713-464c-ba92-6fdb6748689a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:46.073666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0cb5e24d-27cd-48f4-89c7-d9d72e38d94f req-57d7df30-254a-4062-8994-4836c3a47bbc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:46.075219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0cb5e24d-27cd-48f4-89c7-d9d72e38d94f req-57d7df30-254a-4062-8994-4836c3a47bbc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:46.075658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0cb5e24d-27cd-48f4-89c7-d9d72e38d94f req-57d7df30-254a-4062-8994-4836c3a47bbc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:46.137139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0cb5e24d-27cd-48f4-89c7-d9d72e38d94f req-57d7df30-254a-4062-8994-4836c3a47bbc service nova] Creating event network-vif-deleted:c3fd8c82-2713-464c-ba92-6fdb6748689a for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:46.146377 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0cb5e24d-27cd-48f4-89c7-d9d72e38d94f req-57d7df30-254a-4062-8994-4836c3a47bbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112382 Oct 12 22:34:46.148121 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 631/1146] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:46.161870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:46.163327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:46.178713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:46.179211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:46.179652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:46.181746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:46.182212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:46.182643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:46.656060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:46.672391 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef2d55a3-64b9-4859-b33d-fac6fdea0901 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1610 microversion: 2.1 time: 0.517640 Oct 12 22:34:46.673412 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 632/1147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:46 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1610 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:46.684108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:46.684848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:46.700283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:46.705109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:46.705568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:46.706350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:46.706961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:46.707395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.167964 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c2843a2-d822-4533-8576-0d4f86ccef6b tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/action" status: 202 len: 0 microversion: 2.1 time: 2.164257 Oct 12 22:34:47.168680 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 516/1148] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:34:45 2022] POST /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/action => generated 0 bytes in 2166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:34:47.174016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e03db7e6-5950-4340-8d8b-498f270132f2 req-63337b0b-d3bd-4f92-a525-21ad5a20ec5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "name": "network-vif-unplugged", "status": "completed", "tag": "dcd702e6-e5ca-4581-b92c-d775c1983aa5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:47.206530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e03db7e6-5950-4340-8d8b-498f270132f2 req-63337b0b-d3bd-4f92-a525-21ad5a20ec5a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.206972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e03db7e6-5950-4340-8d8b-498f270132f2 req-63337b0b-d3bd-4f92-a525-21ad5a20ec5a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.207579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e03db7e6-5950-4340-8d8b-498f270132f2 req-63337b0b-d3bd-4f92-a525-21ad5a20ec5a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.227976 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e03db7e6-5950-4340-8d8b-498f270132f2 req-63337b0b-d3bd-4f92-a525-21ad5a20ec5a service nova] Creating event network-vif-unplugged:dcd702e6-e5ca-4581-b92c-d775c1983aa5 for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:47.240911 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e03db7e6-5950-4340-8d8b-498f270132f2 req-63337b0b-d3bd-4f92-a525-21ad5a20ec5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068548 Oct 12 22:34:47.246821 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 517/1149] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:47.259245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:47.261748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:47.271307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.272679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.273327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.274218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.274852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.275460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.457646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:47.475380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:47.487208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:47.488700 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad903048-3210-438c-a56b-9c744619bda8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.814231 Oct 12 22:34:47.489737 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 633/1150] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:46 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:47.507364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:47.509656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:47.541762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.545473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.552314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.553205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.560969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.564150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.842516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:47.853174 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb997f51-ce61-4d0a-9a09-f5d78060a409 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 0.604235 Oct 12 22:34:47.863166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 518/1151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:47 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:47.876968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:47.877791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:47.891216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.893806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.895424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.898771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.899755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.902427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.940867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:47.970702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:47.971524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:47.972213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:47.972888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lazy-loading 'fault' on Instance uuid 4423daf1-1a36-44cd-9667-e2ed77444102 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:48.002027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:48.015438 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dbfe57db-dbed-4484-a591-298e91255dd8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.524360 Oct 12 22:34:48.018230 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 634/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:47 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:48.020996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:48.030656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-085c645b-9858-447e-acf7-1148d37a7698 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 200 len: 1303 microversion: 2.1 time: 0.157948 Oct 12 22:34:48.045102 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 519/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:47 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:48.189829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-82bdeb53-0531-486e-8848-536477b9a2ac req-f2bac0f3-74fc-45fa-b152-fc3dacaa1731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4423daf1-1a36-44cd-9667-e2ed77444102", "name": "network-vif-deleted", "tag": "dcd702e6-e5ca-4581-b92c-d775c1983aa5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:48.217479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-82bdeb53-0531-486e-8848-536477b9a2ac req-f2bac0f3-74fc-45fa-b152-fc3dacaa1731 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.220644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-82bdeb53-0531-486e-8848-536477b9a2ac req-f2bac0f3-74fc-45fa-b152-fc3dacaa1731 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.222567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-82bdeb53-0531-486e-8848-536477b9a2ac req-f2bac0f3-74fc-45fa-b152-fc3dacaa1731 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.248472 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-82bdeb53-0531-486e-8848-536477b9a2ac req-f2bac0f3-74fc-45fa-b152-fc3dacaa1731 service nova] Creating event network-vif-deleted:dcd702e6-e5ca-4581-b92c-d775c1983aa5 for instance 4423daf1-1a36-44cd-9667-e2ed77444102 on n-h1-860864-8 Oct 12 22:34:48.260759 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-82bdeb53-0531-486e-8848-536477b9a2ac req-f2bac0f3-74fc-45fa-b152-fc3dacaa1731 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076214 Oct 12 22:34:48.269833 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 520/1154] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:48.490685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1801076587", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:48.519886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:48.520731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:48.541335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.542782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.543466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.545521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.546191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.546815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.604444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:34:48.811023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:48.821078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:48.822843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:48.824228 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-85d4764e-8d94-4e9d-a485-883e6b1539b8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.310605 Oct 12 22:34:48.825319 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 521/1155] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:48 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:48.880373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:48.882210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:48.898730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.899221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.899654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.906350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.906829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.907265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.925802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:34:48.926416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:34:48.927027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:34:48.928160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:34:48.928754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:34:48.946021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.946684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.947268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.953308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:48.954134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:48.955292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:48.981292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Getting quotas for project a8a75809068d4169a784eb08bd381461. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:34:48.989335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Getting quotas for user 7fc3edb53917493a8c2ba2449a91d9d9 and project a8a75809068d4169a784eb08bd381461. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:34:49.005246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:34:49.009924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:34:49.068892 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e79cfc96-7815-4465-af30-afb3cf04ec2f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046563 Oct 12 22:34:49.070019 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 635/1156] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:34:49.075975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:49.076851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:49.084601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:49.085368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:49.085959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:49.086823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:49.087429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:49.088072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:49.262735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:49.275691 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0c3d69d-e1ff-4512-96b1-096ba02a1a51 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 0.400024 Oct 12 22:34:49.278864 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 522/1157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:48 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:49.290925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:49.292087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:49.306678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:49.319544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:49.324719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:49.325358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:49.331096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:49.332013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:49.332602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:49.333675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:49.344318 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b56b4ed4-38c1-410d-b2b0-7c8639be570a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.272699 Oct 12 22:34:49.346256 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 636/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:49 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:49.364486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e98d5633-14c5-4bc3-a291-2d0723b20342 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:49.365982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e98d5633-14c5-4bc3-a291-2d0723b20342 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:49.385482 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] HTTP exception thrown: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Request method failure captured: Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 HTTP/1.1 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Dck4md07l112sxtiRz-z8-kKGObcxM8goJRgR4-UuDMvZ0_4Zduzc6BneJKCpMyE0Z-i6Thx_MQnGnK3Q3Ly09b60DGmoC_a85rOpff2avWAfePuyX_qRjDRN9laTBoMYOpgFKhOkkfzsTIAoNYEd5C4B0nfLKTv4pLZCJ0A8vmgw Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}] Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestMultiNic-1683000353 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb2090f18cfb4ea59d153fc62cf208e2 Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '4423daf1-1a36-44cd-9667-e2ed77444102'} Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:49.388287 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:49.393566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:49.393566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:49.393566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:49.393566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:49.393566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:49.393566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:34:49.393566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:49.394961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Returning 404 to user: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:49.395993 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ee02a9f-80be-45f3-9323-8971cbe82022 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 404 len: 111 microversion: 2.1 time: 0.115978 Oct 12 22:34:49.396826 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 523/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:49 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:34:49.514545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e98d5633-14c5-4bc3-a291-2d0723b20342 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:49.540395 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e98d5633-14c5-4bc3-a291-2d0723b20342 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1214 microversion: 2.1 time: 0.192780 Oct 12 22:34:49.540991 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 637/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:49 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:49.851810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:49.853312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:49.868076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:49.870490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:49.871600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:49.876063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:49.876880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:49.886271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:50.305322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:50.306108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:50.317723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:50.321326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:50.322132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:50.322821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:50.324991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:50.326608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:50.330331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:50.331950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:50.333846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:50.336481 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-774a032c-2369-4a31-a487-dccb4b391a51 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.488682 Oct 12 22:34:50.339667 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 524/1161] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:49 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:50.370534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:50.371280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:50.391681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:50.392215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:50.392656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:50.395664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:50.396680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:50.397309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:50.620258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:50.638152 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36fde8e3-bbc4-43e6-8705-24b901a76fea tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 0.337406 Oct 12 22:34:50.640863 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 638/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:50 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:50.666848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:50.671096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:50.690217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:50.697546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:50.698000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:50.698724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:50.699182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:50.699610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:50.810531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:50.825400 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a0c04ef-72c0-488f-98e2-ecff3a72a018 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1210 microversion: 2.1 time: 0.180676 Oct 12 22:34:50.826339 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 639/1163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:50 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1210 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:50.992598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-16b73774-4732-4ffa-8149-a3cf46308c94 req-a96b2403-7c82-4cb0-b7ad-6578be44bdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8904c6fa-e66b-4ef6-9f3e-441eefa9880f", "name": "network-vif-plugged", "status": "completed", "tag": "d2d9fdd4-5e26-483d-9d61-f0d195e064bb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:51.011166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:51.014748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-16b73774-4732-4ffa-8149-a3cf46308c94 req-a96b2403-7c82-4cb0-b7ad-6578be44bdd3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:51.015802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-16b73774-4732-4ffa-8149-a3cf46308c94 req-a96b2403-7c82-4cb0-b7ad-6578be44bdd3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:51.016438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-16b73774-4732-4ffa-8149-a3cf46308c94 req-a96b2403-7c82-4cb0-b7ad-6578be44bdd3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:51.061806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-16b73774-4732-4ffa-8149-a3cf46308c94 req-a96b2403-7c82-4cb0-b7ad-6578be44bdd3 service nova] Creating event network-vif-plugged:d2d9fdd4-5e26-483d-9d61-f0d195e064bb for instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f on n-h1-860864-8 Oct 12 22:34:51.082439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-16b73774-4732-4ffa-8149-a3cf46308c94 req-a96b2403-7c82-4cb0-b7ad-6578be44bdd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095317 Oct 12 22:34:51.085521 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 640/1164] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:34:51.314536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:51.327725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e95dd58a-30f7-4ada-bbe4-d0e9c46cb8be tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.960790 Oct 12 22:34:51.332274 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 525/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:50 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:51.368827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:51.369940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:51.388920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:51.389847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:51.390459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:51.391824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:51.392490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:51.393106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:51.663763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:51.664657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:51.677005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:51.677803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:51.679512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:51.683022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:51.686051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:51.686691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:51.869226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:51.881603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:51.887250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:51.888783 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b02f6bf7-ba58-4644-a924-4cbc1d412520 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.525099 Oct 12 22:34:51.889525 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 641/1166] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:51 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:51.919212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:51.920215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:51.930557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:51.931519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:51.932145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:51.933055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:51.933661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:51.934235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:51.939382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:52.036037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:52.054476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-414bb3f5-30b2-41e4-857f-f180e627d287 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1272 microversion: 2.1 time: 0.146484 Oct 12 22:34:52.062156 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 642/1167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:51 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:52.214903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:52.247679 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9033f625-8591-4d0d-a1fc-19504dfbddb3 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1324 microversion: 2.1 time: 0.587616 Oct 12 22:34:52.249252 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 526/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:51 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:52.360652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:52.361503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:52.379123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:52.383164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:52.383939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:52.384923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:52.385705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:52.386413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:52.536273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5ed4cba2-2519-4e6e-94a5-3bcb383c4f6d req-495744ac-4332-4dcf-88b4-8d7efda60219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa0aaef-a675-4aed-a3e3-93790420d284", "name": "network-vif-unplugged", "status": "completed", "tag": "a581aa07-c5be-4251-bae8-eb700c203ba5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:52.571282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5ed4cba2-2519-4e6e-94a5-3bcb383c4f6d req-495744ac-4332-4dcf-88b4-8d7efda60219 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:52.571763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5ed4cba2-2519-4e6e-94a5-3bcb383c4f6d req-495744ac-4332-4dcf-88b4-8d7efda60219 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:52.572412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5ed4cba2-2519-4e6e-94a5-3bcb383c4f6d req-495744ac-4332-4dcf-88b4-8d7efda60219 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:52.596839 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5ed4cba2-2519-4e6e-94a5-3bcb383c4f6d req-495744ac-4332-4dcf-88b4-8d7efda60219 service nova] Creating event network-vif-unplugged:a581aa07-c5be-4251-bae8-eb700c203ba5 for instance 8fa0aaef-a675-4aed-a3e3-93790420d284 on n-h1-860864-8 Oct 12 22:34:52.611032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5ed4cba2-2519-4e6e-94a5-3bcb383c4f6d req-495744ac-4332-4dcf-88b4-8d7efda60219 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080904 Oct 12 22:34:52.615260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 527/1169] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:52.919707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:52.920608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:52.929946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:52.931153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:52.931830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:52.932798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:52.933814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:52.934691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:53.121416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:53.130885 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-412ef104-dbd9-450b-987f-4072fe0d4025 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.777539 Oct 12 22:34:53.138751 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 643/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:52 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:53.146808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:53.147583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:53.159752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:53.160463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:53.161066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:53.162230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:53.162846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:53.163431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:53.271658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:53.285423 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0fe2339-7e94-4659-8270-c9281caa5bb6 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1272 microversion: 2.1 time: 0.144699 Oct 12 22:34:53.286353 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 644/1171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:53 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:53.292671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:53.293516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:53.301683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:53.303723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:53.304503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:53.305421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:53.306076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:53.306698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:53.398490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:53.413560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:53.416734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:53.427154 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8d0ce4ad-51d7-42ae-9fbf-ed4c9d030b82 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.507104 Oct 12 22:34:53.428508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 528/1172] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:52 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:34:53.692266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:53.702071 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fea343ec-dfe0-4479-aa33-e007594b447f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1520 microversion: 2.1 time: 0.414383 Oct 12 22:34:53.705696 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 645/1173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:53 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:53.731017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:53.731809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:53.749002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:53.749553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:53.753665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:53.754548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:53.754964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:53.763463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:54.161304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:54.161957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:54.169086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:54.169577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:54.170002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:54.170712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:54.171162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:54.171582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:54.433560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:54.445116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f71e381-3da0-4650-ba86-b012a2f1b864 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1520 microversion: 2.1 time: 0.718054 Oct 12 22:34:54.445705 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 529/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:53 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1520 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:54.467523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:54.468189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:54.482900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:54.483403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:54.488896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:54.497191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:54.497691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:54.498126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:54.523788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:54.537254 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b6de2f16-3007-45c5-9b47-c0965ef7dd04 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.380499 Oct 12 22:34:54.538861 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 646/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:54 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:34:54.552070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:54.552741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:54.579447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:54.579950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:54.580573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:54.581430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:54.584562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:54.585264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:55.042956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:55.071196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:55.083696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:55.097621 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d1078c4-73b5-4c7f-b43d-376dadc590b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.555849 Oct 12 22:34:55.103575 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 647/1176] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:54 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:55.134279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-765290681"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:55.148117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:55.154182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:55.158081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:55.159267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:55.167792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:55.169540 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afe4bd3f-98a1-4593-89c7-0582c8161705 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.722719 Oct 12 22:34:55.172950 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 530/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:54 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:55.174493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:55.174994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:55.175424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:55.187639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-48893d52-f651-473a-8917-fd5cf55186de req-0bc3ee19-fedb-4e10-8dcf-5e093a6e8b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa0aaef-a675-4aed-a3e3-93790420d284", "tag": "a581aa07-c5be-4251-bae8-eb700c203ba5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:55.201602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-48893d52-f651-473a-8917-fd5cf55186de req-0bc3ee19-fedb-4e10-8dcf-5e093a6e8b76 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:55.206492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-48893d52-f651-473a-8917-fd5cf55186de req-0bc3ee19-fedb-4e10-8dcf-5e093a6e8b76 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:55.207199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-48893d52-f651-473a-8917-fd5cf55186de req-0bc3ee19-fedb-4e10-8dcf-5e093a6e8b76 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:55.231116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-48893d52-f651-473a-8917-fd5cf55186de req-0bc3ee19-fedb-4e10-8dcf-5e093a6e8b76 service nova] Creating event network-changed:a581aa07-c5be-4251-bae8-eb700c203ba5 for instance 8fa0aaef-a675-4aed-a3e3-93790420d284 on n-h1-860864-8 Oct 12 22:34:55.245762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-48893d52-f651-473a-8917-fd5cf55186de req-0bc3ee19-fedb-4e10-8dcf-5e093a6e8b76 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070848 Oct 12 22:34:55.248592 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 531/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:55.699465 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db6f2994-5a28-400d-a729-a01a95c0f43a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f/action" status: 202 len: 0 microversion: 2.1 time: 0.588801 Oct 12 22:34:55.708048 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 648/1179] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:34:55 2022] POST /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:34:55.740862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:55.745558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:55.780379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:55.780885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:55.781320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:55.787808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:55.788581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:55.789129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:55.927412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1679002982", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4c3491cd-4fc1-4799-8217-febe742dd336"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:56.036390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] validate_networks() for [('4c3491cd-4fc1-4799-8217-febe742dd336', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:34:56.405345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:56.422674 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc05b15d-861a-4aac-be91-ae3124383af7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.709620 Oct 12 22:34:56.424292 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 649/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:55 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:56.441204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82e88e52-6224-461c-beaf-9274187bab7e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '.version_select at 0x7f44ff73eb80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:56.673803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82e88e52-6224-461c-beaf-9274187bab7e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2" status: 204 len: 0 microversion: 2.1 time: 0.245863 Oct 12 22:34:56.674390 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 650/1181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:56 2022] DELETE /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:34:56.683831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e3e1b868-8bc8-4162-9b64-098842927a6f req-d6554414-5312-4d63-ba19-42cb39ec2dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5523ce-f7f7-43b3-877d-4aecccd87edc", "tag": "85291d33-cf08-45ca-b322-88538a2ebe3c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:56.709297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e3e1b868-8bc8-4162-9b64-098842927a6f req-d6554414-5312-4d63-ba19-42cb39ec2dc4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:56.709814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e3e1b868-8bc8-4162-9b64-098842927a6f req-d6554414-5312-4d63-ba19-42cb39ec2dc4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:56.710265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e3e1b868-8bc8-4162-9b64-098842927a6f req-d6554414-5312-4d63-ba19-42cb39ec2dc4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:56.732594 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e3e1b868-8bc8-4162-9b64-098842927a6f req-d6554414-5312-4d63-ba19-42cb39ec2dc4 service nova] Creating event network-changed:85291d33-cf08-45ca-b322-88538a2ebe3c for instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc on n-h2-860864-8 Oct 12 22:34:56.738681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e3e1b868-8bc8-4162-9b64-098842927a6f req-d6554414-5312-4d63-ba19-42cb39ec2dc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059489 Oct 12 22:34:56.740354 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 651/1182] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:56.749048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:56.750277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:56.761712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:56.762749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:56.764154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:56.765653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:56.766388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:56.767068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:57.149342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:34:57.149857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:34:57.150216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:34:57.150966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:34:57.151532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:34:57.164875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:57.165848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:57.166753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:57.167696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:57.168408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:57.169140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:57.192325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Getting quotas for project 84e58572633e42409a75c58f484b4d66. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:34:57.204935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Getting quotas for user a9d084d9f8b2417ab66fee6c29ee592d and project 84e58572633e42409a75c58f484b4d66. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:34:57.222667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:34:57.226494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:34:57.288439 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58e05b8d-873d-45aa-9887-b488dcf4a34c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.996001 Oct 12 22:34:57.296566 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 532/1183] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:34:57.303846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:57.304744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:57.312292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:57.313247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:57.313954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:57.314875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:57.315569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:57.316469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:57.425449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:57.445244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:57.462019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:57.467686 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e04530b1-f70f-4626-9b5d-9425aaa56999 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.721267 Oct 12 22:34:57.474831 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 652/1184] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:56 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:57.495436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23ee5244-ac43-4e02-b3f1-e46caa44606f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '.version_select at 0x7f44ffc7d9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:57.527221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:57.538230 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4da4fcc4-7c87-41ee-9f47-7c229373ed54 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.239737 Oct 12 22:34:57.547990 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 533/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:57 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:57.567108 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-23ee5244-ac43-4e02-b3f1-e46caa44606f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Image not found. Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23ee5244-ac43-4e02-b3f1-e46caa44606f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2 HTTP/1.1 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a7609ee7-d0cc-42e9-a49b-f351a768c7f2'} Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a7609ee7-d0cc-42e9-a49b-f351a768c7f2 Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:34:57.569911 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7609ee7-d0cc-42e9-a49b-f351a768c7f2 could not be found. Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23ee5244-ac43-4e02-b3f1-e46caa44606f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23ee5244-ac43-4e02-b3f1-e46caa44606f tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2" status: 404 len: 62 microversion: 2.1 time: 0.092173 Oct 12 22:34:57.574024 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 653/1186] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:34:57 2022] GET /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:34:57.580479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5dbc2d1d-f5c6-49e7-aecf-5edd21bc9b10 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:57.592336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5dbc2d1d-f5c6-49e7-aecf-5edd21bc9b10 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:57.753784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5dbc2d1d-f5c6-49e7-aecf-5edd21bc9b10 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:57.770519 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5dbc2d1d-f5c6-49e7-aecf-5edd21bc9b10 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1218 microversion: 2.1 time: 0.197437 Oct 12 22:34:57.796325 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 654/1187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:57 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:57.806398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:57.807020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:57.828819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:57.829320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:57.829761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:57.830480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:57.830934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:57.831356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.028841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:34:58.032004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:58.056474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.060340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.061053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.062054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.062726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.066085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.343567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] HTTP exception thrown: Volume 0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb could not be found. Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Request method failure captured: Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments/a9ec0b96-00fa-48dc-ba9b-2273ebf6e3ca HTTP/1.1 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 74 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0C3taMPaTzjgm-kZNZ7OxKavAdlcsmNoQRDdFGAXvBbSwGcn1NO4ZoC6lReNWkERpKjcwrJReEAEFGqi2PHIjYDavhX4cpJmOthAvFHatk7cbd7O4GEADPX1rt2Ps07JWaNbSNNi5ouytoifDoNSmI3bsruhP6IiKiMI8UW2E9LC7A Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: cd0a0d67b7fd434f879315295c577cdc Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesAdminNegativeTest-818724905 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd0a0d67b7fd434f879315295c577cdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cd0a0d67b7fd434f879315295c577cdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cd0a0d67b7fd434f879315295c577cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd0a0d67b7fd434f879315295c577cdc"}]}] Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesAdminNegativeTest-818724905 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: cd0a0d67b7fd434f879315295c577cdc Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-818724905 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesAdminNegativeTest-818724905-project-admin Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: f889f96edb6345baa1e926bd884ca1a0 Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesAdminNegativeTest-818724905-project-admin Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: {"volumeAttachment": {"volumeId": "0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb"}} Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: exception: Volume 0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb could not be found. Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': 'ac10978f-f42f-41b4-964a-48ba3b4e9a0c', 'id': 'a9ec0b96-00fa-48dc-ba9b-2273ebf6e3ca', 'body': {'volumeAttachment': {'volumeId': '0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb'}}} Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb could not be found. (HTTP 404) (Request-ID: req-82a201b4-6cc0-4aae-8a4d-f7d47265be8b) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:34:58.351464 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb could not be found. Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb could not be found. Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb could not be found. Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:34:58.356192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Returning 400 to user: Volume 0e1f9aed-4ed1-4fc5-9e04-9fc461ca0abb could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:34:58.362878 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1aae57f-626e-4ca5-8429-860f84ee4c21 tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments/a9ec0b96-00fa-48dc-ba9b-2273ebf6e3ca" status: 400 len: 107 microversion: 2.1 time: 0.813462 Oct 12 22:34:58.362878 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 534/1188] 10.222.0.20 () {60 vars in 1433 bytes} [Wed Oct 12 22:34:57 2022] PUT /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments/a9ec0b96-00fa-48dc-ba9b-2273ebf6e3ca => generated 107 bytes in 817 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:34:58.382056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:58.383094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:58.410512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:58.421758 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f998029-719d-4181-808a-086ccc413970 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.624228 Oct 12 22:34:58.422007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.422884 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 655/1189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:57 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:58.425465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.425917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.426669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.427694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.437176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.474482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:58.475863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:58.496638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.507786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.508619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.509525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.510129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.510628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.707587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:58.722240 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fcc0290e-cc0d-42a3-b65c-34ced8211c6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1538 microversion: 2.1 time: 0.361517 Oct 12 22:34:58.723758 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 535/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:58 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1538 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:58.735588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:58.739575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:58.753452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.766255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lazy-loading 'services' on Instance uuid ac10978f-f42f-41b4-964a-48ba3b4e9a0c {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:34:58.769656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.770360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.772086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:58.780893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:58.781740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:58.969494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:34:59.074378 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f9355efa-57b2-4f23-b7ff-a6a2678372eb tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments/a9ec0b96-00fa-48dc-ba9b-2273ebf6e3ca" status: 202 len: 0 microversion: 2.1 time: 0.604818 Oct 12 22:34:59.074981 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 656/1191] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 22:34:58 2022] DELETE /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments/a9ec0b96-00fa-48dc-ba9b-2273ebf6e3ca => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:34:59.083671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:59.089551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:59.096764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.097490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.098190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.100738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.101430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.102017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.133424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:59.151750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:59.155940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:59.160712 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21ebe027-df1e-4748-818a-6a7fd741527e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.431164 Oct 12 22:34:59.175145 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 536/1192] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:34:58 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:34:59.175145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:59.182069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:59.195810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.196426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.196936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.197722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.198872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.204548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.400790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:59.409937 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-de014c15-3e04-4068-bc16-922f709af9e9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1270 microversion: 2.1 time: 0.246307 Oct 12 22:34:59.418524 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 537/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:59 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1270 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:59.434642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:59.445577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:59.470145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.478138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.479665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.486552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.488490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.490693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.503337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:34:59.522352 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-64dc0adc-24cb-4d5f-8592-efbffd526dbd tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.440700 Oct 12 22:34:59.525781 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 657/1194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:59 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:34:59.560776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:59.564671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:59.584148 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f29e9dd9-5d30-4fcf-a20d-a6910fbcc5e5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163416 Oct 12 22:34:59.586457 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 538/1195] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:34:59 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:34:59.591062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.591677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.594977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.595842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.596239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.596683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.750243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:34:59.751165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:34:59.764034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.764764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.765374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.766971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:34:59.767591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:34:59.768245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:34:59.815748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:00.052779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:00.063251 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-73cf78a6-d42f-43fc-af4f-29f349fec5df tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.535964 Oct 12 22:35:00.067166 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 658/1196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:59 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:00.140081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:00.149486 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3155ead3-6621-44f5-ac6c-4b76d60a2e70 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1533 microversion: 2.1 time: 0.404138 Oct 12 22:35:00.153946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 539/1197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:34:59 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1533 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:00.190517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:00.191297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:00.202812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:00.207026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:00.207907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:00.213152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:00.214026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:00.216983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:00.445143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:00.445747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:00.457283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:00.458640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:00.462575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:00.463543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:00.464198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:00.464857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:00.624628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:00.637489 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b469ef1-1756-41ec-97d6-13e0d7d4d89d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1276 microversion: 2.1 time: 0.193982 Oct 12 22:35:00.638493 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 540/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:00 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:00.646811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1320267481", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "9033cc81-c056-4078-9a32-50ad08bff4cb"}, {"uuid": "136c94a2-99fc-4418-a995-4e83a204e10c"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:00.759374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] validate_networks() for [('9033cc81-c056-4078-9a32-50ad08bff4cb', None, None, None, None, None), ('136c94a2-99fc-4418-a995-4e83a204e10c', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:35:01.149086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:01.164839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:01.167267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:01.170322 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f01ab7ed-425c-4beb-9c0a-ca287f22471d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.983558 Oct 12 22:35:01.196989 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 659/1199] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:00 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:01.202854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:01.213042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:01.227633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:01.229682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:01.230139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:01.234869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:01.234869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:01.234869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:01.282971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:01.684819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:01.704739 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5294b5e6-f577-4ae4-aad7-094caa4275af tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.505115 Oct 12 22:35:01.708535 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 660/1200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:01 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:01.714002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:01.716603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:01.735798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:01.736326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:01.736744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:01.740489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:01.740953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:01.741396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:01.818360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-91ee4753-7b87-4879-a7c1-7d36fc11aab6 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107910 Oct 12 22:35:01.818971 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 661/1201] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:35:01 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:01.842664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:01.843575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:01.850272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:01.851055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:01.851679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:01.852814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:01.853459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:01.854126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:01.996244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:35:01.997498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:35:01.998273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:35:01.998941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:35:01.999531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:35:02.014133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.019584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.020301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.021462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.022226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.022987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.067501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Getting quotas for project 25017cd8ac6040bf9ba0e88a3a9659a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:35:02.077109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Getting quotas for user cb2090f18cfb4ea59d153fc62cf208e2 and project 25017cd8ac6040bf9ba0e88a3a9659a8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:35:02.107575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:35:02.111226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:35:02.170280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:02.181382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ccbca60b-2491-457a-b17f-1f2281a23ff0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.352232 Oct 12 22:35:02.182005 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 662/1202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:01 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:02.186798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:02.191685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:02.221876 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c81784d9-eef1-4c53-a758-d486a828cbe6 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580949 Oct 12 22:35:02.225067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.227287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.227983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.230464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.231116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.232153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.242945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 541/1203] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:35:02.247808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:02.248461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:02.254912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.255464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.264059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.265004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.265496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.265944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.612606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:02.621235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3bc8faa2-1865-4838-9309-2434ae741446 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1318 microversion: 2.1 time: 0.383323 Oct 12 22:35:02.621817 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 542/1204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:02 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:02.632765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:02.636821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:02.669194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.670951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.671866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.675280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:02.676665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:02.677502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:02.710164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:02.730940 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6122a7d-ac53-413b-9101-ff59e9bc0762 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1520 microversion: 2.1 time: 0.542698 Oct 12 22:35:02.749098 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 663/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:02 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1520 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:02.790076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26ed13c1-5399-499d-8e19-845fbe37a591 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:02.793116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26ed13c1-5399-499d-8e19-845fbe37a591 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:02.984619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:03.009052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:03.016536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:03.024195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23eb559d-c018-4b41-aae8-88c93d2ab56a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.390353 Oct 12 22:35:03.025079 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 543/1206] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:02 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:03.039105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:03.039999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:03.049632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.056593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.057942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.059197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.059827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.060648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.062960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26ed13c1-5399-499d-8e19-845fbe37a591 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:03.070950 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26ed13c1-5399-499d-8e19-845fbe37a591 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1213 microversion: 2.1 time: 0.320384 Oct 12 22:35:03.080916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 664/1207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:02 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:03.096006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:03.096906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:03.107393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.108124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.108777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.120852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.121494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.122106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.168629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:35:03.314966 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35ab7a68-c19f-4a26-a004-c587f0a2bdcb tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 204 len: 0 microversion: 2.1 time: 0.230734 Oct 12 22:35:03.319934 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 665/1208] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:03 2022] DELETE /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:35:03.334861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:03.338906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:03.354111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.357874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.358451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.359302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.360702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.361385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.409538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:03.420093 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-476a0547-2c20-4ccf-bfba-1e9181922b1d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.393679 Oct 12 22:35:03.427586 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 544/1209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:03 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:03.443117 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6371b139-26ea-4007-8ebc-e5296e3c5762 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119625 Oct 12 22:35:03.444015 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 666/1210] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:35:03 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:03.449498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:03.452304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:03.460915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:03.461963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:03.473173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.476755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.477531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.482560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.483373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.484042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.485062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.485436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.485870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.491107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.491770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.492418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.756128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:03.768459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1559304-b3d2-43cd-829a-a331d392a7cd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.336010 Oct 12 22:35:03.772677 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 545/1211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:03 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:03.783603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:03.789464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:03.799915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.805497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.806170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:03.807304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:03.808057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:03.808662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.007026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:04.018378 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b26fbb7b-9733-4a41-a069-4ed5fd4c1939 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1526 microversion: 2.1 time: 0.572961 Oct 12 22:35:04.022175 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 667/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:03 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1526 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:04.051341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:04.052265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:04.063855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.064596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:04.065887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.067107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.068078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.070157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.070778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.073807 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d730e806-4264-40e0-8588-a04139e21731 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1318 microversion: 2.1 time: 0.299806 Oct 12 22:35:04.074875 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 546/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:03 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:04.105361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:04.105984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:04.116221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.116952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.118242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.119287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.120485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.121096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.200325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:04.211519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5c983ed-a9ea-406a-bafe-6d3b0a9686c8 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1265 microversion: 2.1 time: 0.110581 Oct 12 22:35:04.213874 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 547/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:04 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:04.359409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:04.382949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:04.388300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:04.391476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bec89eef-c574-4d9b-af53-4a98a0daeef7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.342918 Oct 12 22:35:04.393640 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 668/1215] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:04 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:35:04.456956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:04.460164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:04.462736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:04.463646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:04.480526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.485251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.486638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.487255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.488246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.488928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.489589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.493018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.493724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.494647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.499636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.503185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.574435 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-179ede05-5255-4086-a1e0-fb932d8acbe3 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121387 Oct 12 22:35:04.578041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 669/1216] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:35:04 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:35:04.583423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d905466c-56ef-440d-bb9a-8fec76697d02 req-31a0d9df-6c45-4e5d-927e-725efb6efb90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd4c8b5-b976-46b1-9c2b-ba296eab2a87", "tag": "d11d2d5a-f1cf-44db-b83d-c0f85b0fb062"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:04.594373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d905466c-56ef-440d-bb9a-8fec76697d02 req-31a0d9df-6c45-4e5d-927e-725efb6efb90 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.595127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d905466c-56ef-440d-bb9a-8fec76697d02 req-31a0d9df-6c45-4e5d-927e-725efb6efb90 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.595741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d905466c-56ef-440d-bb9a-8fec76697d02 req-31a0d9df-6c45-4e5d-927e-725efb6efb90 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.613496 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d905466c-56ef-440d-bb9a-8fec76697d02 req-31a0d9df-6c45-4e5d-927e-725efb6efb90 service nova] Creating event network-changed:d11d2d5a-f1cf-44db-b83d-c0f85b0fb062 for instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 on n-h1-860864-8 Oct 12 22:35:04.620672 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d905466c-56ef-440d-bb9a-8fec76697d02 req-31a0d9df-6c45-4e5d-927e-725efb6efb90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041160 Oct 12 22:35:04.621834 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 670/1217] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:04.796706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:04.797639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:04.815426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.818215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.819034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:04.821628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:04.822330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:04.826379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.024491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:05.038941 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d581e489-3a76-40f4-8a35-4761947fae3e tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.589117 Oct 12 22:35:05.040140 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 548/1218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:04 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:05.053495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:05.056641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:05.074689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.075284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.075628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.076380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.076837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.077267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.407987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:05.421014 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82bbe659-31a5-4448-87af-20656058d38d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.629084 Oct 12 22:35:05.430426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 671/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:04 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:05.438535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:05.440431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:05.449534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.457355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.458973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.459944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.460560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.461167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.511327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:05.520708 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f656fc0-4a97-4202-b39c-abe5ff0c3884 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1526 microversion: 2.1 time: 0.475039 Oct 12 22:35:05.522183 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 549/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:05 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1526 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:05.528180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:05.529311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:05.545608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.546323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.546939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.547660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.548163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.548595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.648724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:05.657251 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8e6e7f17-5bfd-458f-b568-2d9ae9da9655 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1271 microversion: 2.1 time: 0.133224 Oct 12 22:35:05.657849 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 550/1221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:05 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:05.677030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-119d34fc-be07-40ad-8251-e1ac9e6ef808 req-6626c167-3ca0-4461-9b83-7a36d721edbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8904c6fa-e66b-4ef6-9f3e-441eefa9880f", "name": "network-vif-plugged", "status": "completed", "tag": "d2d9fdd4-5e26-483d-9d61-f0d195e064bb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:05.697757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-119d34fc-be07-40ad-8251-e1ac9e6ef808 req-6626c167-3ca0-4461-9b83-7a36d721edbb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.698241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-119d34fc-be07-40ad-8251-e1ac9e6ef808 req-6626c167-3ca0-4461-9b83-7a36d721edbb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.703778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-119d34fc-be07-40ad-8251-e1ac9e6ef808 req-6626c167-3ca0-4461-9b83-7a36d721edbb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.731922 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-119d34fc-be07-40ad-8251-e1ac9e6ef808 req-6626c167-3ca0-4461-9b83-7a36d721edbb service nova] Creating event network-vif-plugged:d2d9fdd4-5e26-483d-9d61-f0d195e064bb for instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f on n-h1-860864-8 Oct 12 22:35:05.780994 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-119d34fc-be07-40ad-8251-e1ac9e6ef808 req-6626c167-3ca0-4461-9b83-7a36d721edbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101281 Oct 12 22:35:05.781876 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 551/1222] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:05.787842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:05.791161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:05.807091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.807610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.808100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:05.808824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:05.809290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:05.809764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.187436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:06.203329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:06.207477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:06.225815 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9218772d-9c8f-4b2f-b03f-9c1f74333852 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.438540 Oct 12 22:35:06.230985 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 552/1223] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:05 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:06.238582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:06.243077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:06.251817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.253152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.253742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.254851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.255645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.256343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.288097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:06.296940 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-421ea0fe-c059-4916-be7d-824257d846c5 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1318 microversion: 2.1 time: 0.865131 Oct 12 22:35:06.297540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 672/1224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:05 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1318 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:06.307509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:06.312044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:06.327868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.328749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.329527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.333451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.339317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.340078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.367364 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ed007ea-567d-4977-89ff-726977f45f9f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134513 Oct 12 22:35:06.368724 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 553/1225] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:35:06 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:06.461313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:06.462295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:06.469771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.470684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.471312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.473700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.474355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.477313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.753362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:06.780391 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-083c0411-c646-47f3-b07e-6e3190f91e61 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.478018 Oct 12 22:35:06.786639 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 673/1226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:06 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:06.795690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1f7adfdf-1f49-43c3-88a3-c4504bc4e862 req-3e6b5691-59c5-4c35-8543-facdbe20c3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8904c6fa-e66b-4ef6-9f3e-441eefa9880f", "name": "network-vif-deleted", "tag": "d2d9fdd4-5e26-483d-9d61-f0d195e064bb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:06.803774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:06.816583 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd8f7ad1-a299-475e-81fc-f146b1a9b179 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.365915 Oct 12 22:35:06.817832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 554/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:06 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:06.824995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1f7adfdf-1f49-43c3-88a3-c4504bc4e862 req-3e6b5691-59c5-4c35-8543-facdbe20c3cd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.825560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1f7adfdf-1f49-43c3-88a3-c4504bc4e862 req-3e6b5691-59c5-4c35-8543-facdbe20c3cd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.825928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:06.826143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1f7adfdf-1f49-43c3-88a3-c4504bc4e862 req-3e6b5691-59c5-4c35-8543-facdbe20c3cd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.827007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:06.837538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.838288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.838901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.840322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.841418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.842017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.849082 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1f7adfdf-1f49-43c3-88a3-c4504bc4e862 req-3e6b5691-59c5-4c35-8543-facdbe20c3cd service nova] Creating event network-vif-deleted:d2d9fdd4-5e26-483d-9d61-f0d195e064bb for instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f on n-h1-860864-8 Oct 12 22:35:06.862647 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1f7adfdf-1f49-43c3-88a3-c4504bc4e862 req-3e6b5691-59c5-4c35-8543-facdbe20c3cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069875 Oct 12 22:35:06.866314 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 674/1228] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:06.884372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:06.885452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:06.907128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.909384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.911734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.914595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.915296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.918869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.948105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:06.948792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:06.949789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:06.951365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lazy-loading 'fault' on Instance uuid 8904c6fa-e66b-4ef6-9f3e-441eefa9880f {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:35:07.048557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:07.071451 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec6b9afd-b83c-4899-8e02-1077646748fc tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1314 microversion: 2.1 time: 0.251141 Oct 12 22:35:07.072457 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 555/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:06 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:07.252619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:07.253268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:07.267433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.267960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.268400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.269108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.274394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.274900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.586577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:07.601592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:07.603571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:07.605943 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f041cbe4-fd44-41a5-83d0-f2141c2dd729 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.357319 Oct 12 22:35:07.607041 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 556/1230] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:07 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:07.615283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:07.628471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:07.647430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.659850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.662803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.666032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.666703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.670550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.677692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:07.683396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:07.705357 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-adad9399-9739-4139-b698-13a156ad6c76 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1313 microversion: 2.1 time: 0.836689 Oct 12 22:35:07.710208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 675/1231] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:06 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:07.715710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:07.719062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:07.726801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.727423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.727998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.728997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.729964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.730647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.784860 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-15e81a78-04d6-4129-9adc-2e09e37423a2 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073298 Oct 12 22:35:07.786838 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 676/1232] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:35:07 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:07.809218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:07.809762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:07.824460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.825009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.825466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.826185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.826642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.827070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.902173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:07.910350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35143ee1-b7b2-44ac-a981-00c8fb102e16 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1318 microversion: 2.1 time: 0.301976 Oct 12 22:35:07.912185 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 557/1233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:07 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:07.917189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e9d2ec3b-f303-4613-922c-d1634efd6b6d req-162d0164-8665-4bd8-b5f7-6372994ae208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5523ce-f7f7-43b3-877d-4aecccd87edc", "name": "network-vif-plugged", "status": "completed", "tag": "85291d33-cf08-45ca-b322-88538a2ebe3c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:07.925993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:07.935245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9d2ec3b-f303-4613-922c-d1634efd6b6d req-162d0164-8665-4bd8-b5f7-6372994ae208 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.936163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9d2ec3b-f303-4613-922c-d1634efd6b6d req-162d0164-8665-4bd8-b5f7-6372994ae208 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.936790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9d2ec3b-f303-4613-922c-d1634efd6b6d req-162d0164-8665-4bd8-b5f7-6372994ae208 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.955475 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e9d2ec3b-f303-4613-922c-d1634efd6b6d req-162d0164-8665-4bd8-b5f7-6372994ae208 service nova] Creating event network-vif-plugged:85291d33-cf08-45ca-b322-88538a2ebe3c for instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc on n-h2-860864-8 Oct 12 22:35:07.961069 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e9d2ec3b-f303-4613-922c-d1634efd6b6d req-162d0164-8665-4bd8-b5f7-6372994ae208 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Oct 12 22:35:07.962183 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 558/1234] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:07.967557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:07.968706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:07.976336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.976830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.977268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:07.979707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:07.980216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:07.980631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.181199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.187810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:08.194963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-471a8855-9cf5-4edc-8551-a3988a159ad9 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.385020 Oct 12 22:35:08.209599 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 677/1235] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:07 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:08.218688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:08.220361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:08.227111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.227802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.228443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.229312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.229930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.230532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.272911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.274068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.274918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.275536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lazy-loading 'fault' on Instance uuid 8904c6fa-e66b-4ef6-9f3e-441eefa9880f {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:35:08.407090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.420114 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53130321-5a69-4669-9089-f43482468991 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.456673 Oct 12 22:35:08.424123 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 559/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:07 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:08.514272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.521693 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-717f0d1a-56a6-42f7-bf2f-06df554b89a1 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 200 len: 1314 microversion: 2.1 time: 0.310355 Oct 12 22:35:08.522860 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 678/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:08 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:08.637316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:08.637976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:08.665941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.668670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.669193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.670302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.671583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.672175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.732882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:08.733666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:08.745337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.745975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.746536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.747996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.751503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.752005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.918298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.930397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.933841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.935224 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f1b9101-4bb7-4d8d-8cff-91a117054711 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.303376 Oct 12 22:35:08.936557 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 560/1238] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:08 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:08.951706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:08.953493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:08.955904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:08.962045 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9cf368d9-5cfa-4388-977a-9dbab644b2c1 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.233194 Oct 12 22:35:08.962949 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 679/1239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:08 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:08.975488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.976160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.976437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.977135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.977577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.977994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:08.986874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:08.987491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:08.998248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:08.999301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:08.999976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.000905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.001412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.002027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.035566 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54a4d6a9-0001-4141-988b-9c3e04911d6c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097689 Oct 12 22:35:09.036683 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 561/1240] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:35:08 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:35:09.229463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:09.230321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:09.241971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.242909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.244642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.247453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:09.251859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.252385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.252831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.255824 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11f19117-57c1-4f3f-9d1b-f2f267875afd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1318 microversion: 2.1 time: 0.285471 Oct 12 22:35:09.256633 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 680/1241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:08 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:09.277320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1906208602", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "131a249b-daaa-41b4-92ee-cad505e653ba"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:09.355998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] validate_networks() for [('131a249b-daaa-41b4-92ee-cad505e653ba', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:35:09.451542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:09.463646 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f41d0d7-515a-4832-8e67-50937ff1dfbc tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1314 microversion: 2.1 time: 0.244863 Oct 12 22:35:09.479785 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 562/1242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:09 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:09.484589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:09.485504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:09.493980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.494763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.495431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.496366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.496976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.497574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.675871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:09.685871 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c244309-39f7-4e0e-be70-748b55d14a9c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.210359 Oct 12 22:35:09.686479 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 563/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:09 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:09.691434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:09.692668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:09.698999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.699490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.700006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.701049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:09.701667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:09.702403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:09.720954 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f HTTP/1.1 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '8904c6fa-e66b-4ef6-9f3e-441eefa9880f'} Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:09.723140 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:09.727575 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:09.730462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:09.731831 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-67be8f44-376d-4c06-9c17-3673e183d588 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 404 len: 111 microversion: 2.1 time: 0.044109 Oct 12 22:35:09.735934 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 564/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:09 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:09.859329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1317793628", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:09.928741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] validate_networks() for [('d6a10245-cee9-40b0-8da9-7f972e191229', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:35:10.501349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:35:10.502720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:35:10.503361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:35:10.503958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:35:10.504570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:35:10.518940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:10.523151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:10.523808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:10.524787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:10.525450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:10.526258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:10.551753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for project 5b4767aa6972423987ec612b734dcf48. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:35:10.557859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Getting quotas for user 5f91f5085e864c5fbf74eb6eacf504c3 and project 5b4767aa6972423987ec612b734dcf48. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:35:10.572639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:35:10.575388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:35:10.655174 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2de77fa6-2783-49bf-b9ed-f1a1513340b8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.799853 Oct 12 22:35:10.659069 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 565/1245] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:35:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:35:10.670962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:10.671867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:10.689802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:10.692695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:10.693441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:10.694685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:10.699318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:10.700184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:10.993729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:35:10.994702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:35:10.995555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:35:10.996007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:10.996208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:35:10.996934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:35:11.010341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.014585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:11.016596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:11.018662 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-010c24f6-b38b-4b0b-8ffa-e4fa19a5fa62 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.354887 Oct 12 22:35:11.020520 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 566/1246] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:10 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:11.022985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.024409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.026444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.028180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.028696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.043522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:11.044611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:11.062840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Getting quotas for project 5702a6d40c344ba590041353935e1513. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:35:11.071227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Getting quotas for user 7395e893da4d45cc920daf0ac1fc4f72 and project 5702a6d40c344ba590041353935e1513. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:35:11.086672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:11.088861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:35:11.091604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:35:11.095309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.099568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.110932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.113474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.115668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.133521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.150936 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22e58eab-80fb-4c6b-be89-fd3146c59eab tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.877731 Oct 12 22:35:11.151933 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 681/1247] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:35:11.162939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:11.163800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:11.170350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.171086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.171678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.172566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.173170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.173752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.426475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:11.436621 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e58bfa30-6f00-4bc3-98eb-e973ee6e6933 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.414689 Oct 12 22:35:11.437790 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 567/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:11 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:11.444305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:11.445556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:11.455502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.455668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.456582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.457872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.460503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.461013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.759096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:11.774225 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d8ea6b3-ddf5-4597-835d-8173ef1c2adb tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1463 microversion: 2.1 time: 0.335013 Oct 12 22:35:11.774825 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 568/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:11 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1463 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:11.780552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:11.784403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:11.799182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.802571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.803657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.807197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.807978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.808394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.892144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:11.902885 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-144c414b-f641-431f-878c-d5195608da5e tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1221 microversion: 2.1 time: 0.126721 Oct 12 22:35:11.903551 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 569/1250] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:11 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.919361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:11.930048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:11.952368 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21f0cb1a-8b04-485b-81b6-4961cf48e1f7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1318 microversion: 2.1 time: 0.799301 Oct 12 22:35:11.969205 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 682/1251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:11 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:11.971502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:11.972164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:11.996365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:11.997116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:11.997813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.002371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.002956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.003396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.100084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:12.116928 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-20167780-b80e-4cf2-91d9-99a6a8a073e8 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1222 microversion: 2.1 time: 0.157228 Oct 12 22:35:12.118001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 683/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:11 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:12.134154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4d17d148-7384-4fa7-b008-b74fd8dba30c req-5f831227-77e8-4a55-b10d-a134cfeb10ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee8ff3b-dbb3-4948-914f-43780e1f29a1", "tag": "553c1090-566b-4ada-ab2f-a45852d67b80"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:12.163486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d17d148-7384-4fa7-b008-b74fd8dba30c req-5f831227-77e8-4a55-b10d-a134cfeb10ba service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.164758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d17d148-7384-4fa7-b008-b74fd8dba30c req-5f831227-77e8-4a55-b10d-a134cfeb10ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.165900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d17d148-7384-4fa7-b008-b74fd8dba30c req-5f831227-77e8-4a55-b10d-a134cfeb10ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.184348 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4d17d148-7384-4fa7-b008-b74fd8dba30c req-5f831227-77e8-4a55-b10d-a134cfeb10ba service nova] Creating event network-changed:553c1090-566b-4ada-ab2f-a45852d67b80 for instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 on n-h2-860864-8 Oct 12 22:35:12.218435 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4d17d148-7384-4fa7-b008-b74fd8dba30c req-5f831227-77e8-4a55-b10d-a134cfeb10ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098683 Oct 12 22:35:12.220013 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 684/1253] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:12.264070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:12.277433 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70c1e69c-5f3b-4e3f-9bca-83ee73815fae tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.372609 Oct 12 22:35:12.278039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 570/1254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:11 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:12.301558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:12.302194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:12.308913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.309647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.310259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.311134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.311749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.312354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.559537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:12.574891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:12.576593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:12.578224 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75f2182b-defe-4a18-9347-4e42457f924d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.297045 Oct 12 22:35:12.582745 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 571/1255] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:12 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:12.599953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-77b03528-2039-4486-9e72-95244d3650d5 req-2bebd84e-47ec-4aaf-a414-f120b4b6c12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd4c8b5-b976-46b1-9c2b-ba296eab2a87", "name": "network-vif-plugged", "status": "completed", "tag": "d11d2d5a-f1cf-44db-b83d-c0f85b0fb062"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:12.614774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-77b03528-2039-4486-9e72-95244d3650d5 req-2bebd84e-47ec-4aaf-a414-f120b4b6c12e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.618362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-77b03528-2039-4486-9e72-95244d3650d5 req-2bebd84e-47ec-4aaf-a414-f120b4b6c12e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.618999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-77b03528-2039-4486-9e72-95244d3650d5 req-2bebd84e-47ec-4aaf-a414-f120b4b6c12e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.650064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-77b03528-2039-4486-9e72-95244d3650d5 req-2bebd84e-47ec-4aaf-a414-f120b4b6c12e service nova] Creating event network-vif-plugged:d11d2d5a-f1cf-44db-b83d-c0f85b0fb062 for instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 on n-h1-860864-8 Oct 12 22:35:12.655574 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-77b03528-2039-4486-9e72-95244d3650d5 req-2bebd84e-47ec-4aaf-a414-f120b4b6c12e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071636 Oct 12 22:35:12.656912 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 572/1256] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:12.664106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:12.670568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:12.671328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Calling method '.version_select at 0x7f44ff769b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:12.687133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.687937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.688652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.689570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.690187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.691199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.692094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.692792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.693436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.715747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.716260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.716735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.742074 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-521e0d5c-9ccd-4618-aa0e-5cd7a076375b tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/a8a75809068d4169a784eb08bd381461?start=2022-10-11T22%3A35%3A11.793369&end=2022-10-13T22%3A35%3A11.793369" status: 200 len: 647 microversion: 2.1 time: 0.517315 Oct 12 22:35:12.752570 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 685/1257] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Oct 12 22:35:12 2022] GET /compute/v2.1/os-simple-tenant-usage/a8a75809068d4169a784eb08bd381461?start=2022-10-11T22%3A35%3A11.793369&end=2022-10-13T22%3A35%3A11.793369 => generated 647 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:12.765368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '.version_select at 0x7f44ff5645e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:12.792527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.793468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.795614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.815180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.817141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.818753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.858963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25d66b74-0807-4862-8c0e-f2770544795f tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/a8a75809068d4169a784eb08bd381461?start=2022-10-11T22%3A35%3A11.793369&end=2022-10-13T22%3A35%3A11.793369" status: 200 len: 695 microversion: 2.1 time: 0.099529 Oct 12 22:35:12.870594 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 686/1258] 10.222.0.20 () {58 vars in 1412 bytes} [Wed Oct 12 22:35:12 2022] GET /compute/v2.1/os-simple-tenant-usage/a8a75809068d4169a784eb08bd381461?start=2022-10-11T22%3A35%3A11.793369&end=2022-10-13T22%3A35%3A11.793369 => generated 695 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:35:12.879552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Calling method '.version_select at 0x7f44ff500790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:12.887350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.887832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.888370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.911743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:12.912343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:12.912846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:12.975466 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92bff3d4-feb6-41c1-b2ce-6df7529a4a18 tempest-TenantUsagesTestJSON-269478074 tempest-TenantUsagesTestJSON-269478074-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A35%3A11.793369&end=2022-10-13T22%3A35%3A11.793369&detailed=1" status: 200 len: 14699 microversion: 2.1 time: 0.103552 Oct 12 22:35:12.990275 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 687/1259] 10.222.0.20 () {58 vars in 1335 bytes} [Wed Oct 12 22:35:12 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T22%3A35%3A11.793369&end=2022-10-13T22%3A35%3A11.793369&detailed=1 => generated 14699 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:13.005277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:13.006265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:13.013897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.014501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.015043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.015882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.017126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.017126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.150718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:13.167823 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-109aaae6-ba1f-43d4-abf3-e7c4ec3fc2ad tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1283 microversion: 2.1 time: 0.174500 Oct 12 22:35:13.168445 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 688/1260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:12 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:13.182358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:13.183998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:13.194603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.195453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.197875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.198896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.199521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.200235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.541576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:13.555225 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9575c57a-c8cd-47cb-a66f-20e4ecfda3fb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.896865 Oct 12 22:35:13.555825 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 573/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:12 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:13.571224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:13.572318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:13.585801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.586306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.586751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.587465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.587964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.588399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.637530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:13.654658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:35:13.656077 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6b5cb62-f865-4d50-92b4-1d214db27ee1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1318 microversion: 2.1 time: 0.484882 Oct 12 22:35:13.660202 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 689/1262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:13 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:13.677334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:13.678113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:13.685569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.686204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.687177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.689540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.690241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.691031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.766123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:13.801573 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3776e3c6-4cb3-4371-9969-42967bcfe12d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 204 len: 0 microversion: 2.1 time: 0.244246 Oct 12 22:35:13.802170 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 574/1263] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:13 2022] DELETE /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:35:13.812073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:13.813027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:13.822752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.823731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.824618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.825741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.826442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.827039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.856629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:13.865935 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23153a5d-5327-4c7d-bae4-77546145aa9d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1288 microversion: 2.1 time: 0.203908 Oct 12 22:35:13.869100 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 690/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:13 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1288 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:13.880484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:13.881297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:13.891864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.892689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.893044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:13.893847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:13.894333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:13.896886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.104490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:14.121927 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-20f478da-087d-4368-92b0-059593197cc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.314792 Oct 12 22:35:14.130852 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 575/1265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:13 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:14.143690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:14.145882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:14.155699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.157593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.158531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.159507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.160251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.160879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.161295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:14.173181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:14.174631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:14.175842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b945e210-2612-4e6f-92a9-72a5403cfbb2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.305665 Oct 12 22:35:14.176449 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 691/1266] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:13 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:14.202318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:14.202816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:14.212679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.213523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.214097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.215429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.216032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.216558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.302486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:14.319937 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-288b7849-6d99-4bd3-9a77-605a31632383 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1283 microversion: 2.1 time: 0.113832 Oct 12 22:35:14.321127 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 692/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:14 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1283 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:14.325861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e22ee908-c6a1-4198-98b8-e48d1faf0baa req-45e4c540-1dac-4f12-9ce4-396e0616ed09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee8ff3b-dbb3-4948-914f-43780e1f29a1", "tag": "11be4c93-1c82-4a91-92b9-fdd4f5ba2a7b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:14.336413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e22ee908-c6a1-4198-98b8-e48d1faf0baa req-45e4c540-1dac-4f12-9ce4-396e0616ed09 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.337144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e22ee908-c6a1-4198-98b8-e48d1faf0baa req-45e4c540-1dac-4f12-9ce4-396e0616ed09 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.337746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e22ee908-c6a1-4198-98b8-e48d1faf0baa req-45e4c540-1dac-4f12-9ce4-396e0616ed09 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.349662 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e22ee908-c6a1-4198-98b8-e48d1faf0baa req-45e4c540-1dac-4f12-9ce4-396e0616ed09 service nova] Creating event network-changed:11be4c93-1c82-4a91-92b9-fdd4f5ba2a7b for instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 on n-h2-860864-8 Oct 12 22:35:14.355661 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e22ee908-c6a1-4198-98b8-e48d1faf0baa req-45e4c540-1dac-4f12-9ce4-396e0616ed09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033179 Oct 12 22:35:14.356632 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 693/1268] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:14.435005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:14.444806 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6bc96b89-7bed-4d2b-8e79-57553162a69b tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1469 microversion: 2.1 time: 0.311673 Oct 12 22:35:14.461566 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 576/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:14 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1469 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:14.582794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:14.583860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:14.598085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.598734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.599273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.604834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.605685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.606594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.683349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:14.684114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:14.693371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.695444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.698670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:14.699703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:14.700460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:14.704120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.042965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:15.060334 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-df662a5a-0ef4-4d4d-90ce-b5463dc3d90f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.482092 Oct 12 22:35:15.061553 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 694/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:14 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:15.070286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:15.071561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:15.093322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.094656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.095472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.097277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.099132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.099754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.220767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:15.233289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cee41657-beeb-4031-9ccb-61bc3f8665f1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1507 microversion: 2.1 time: 0.553768 Oct 12 22:35:15.234481 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 577/1271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:14 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:15.246936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:15.247850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:15.275459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.275839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.277477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.280230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.280781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.281438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.841243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:15.854425 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7ae277e5-2c53-44e1-a2ce-e07bba7f5e20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.617141 Oct 12 22:35:15.855248 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 578/1272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:15 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:15.861148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:15.862317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:15.870139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.870889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.872448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.873395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.873861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.874531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:15.966194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:15.981335 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f26c685-aa09-4bd2-a049-769b33ca0223 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.918275 Oct 12 22:35:15.982280 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 695/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:15 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:15.989339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:15.990200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:15.997359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:15.998151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:15.999112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.000128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.000947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.001680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.325554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.344527 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a40ad8d6-0a98-415a-a668-d51e0d0ac1f8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1507 microversion: 2.1 time: 0.359783 Oct 12 22:35:16.360379 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 696/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:15 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:16.366991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:16.367844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:16.375081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.376079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.376680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.377701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.378308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.379431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.414273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.426807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.429343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.433241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-912600ae-d4b2-448f-b540-725304ed03b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1810 microversion: 2.25 time: 0.576778 Oct 12 22:35:16.435241 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 579/1275] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:15 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1810 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:16.447228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:16.447849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:16.463376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.463835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.464310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.465008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.465664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.466094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.693220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.702272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-68c7353e-bc08-4065-ae83-e7edae50b3d7 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.340528 Oct 12 22:35:16.705714 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 697/1276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:16 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:16.710583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:16.711384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:16.717885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.718541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.719134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.720051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.720660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.721271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.725987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:16.900258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.921129 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ea83270-0977-4abc-a4cb-f0a4e84d88ab tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.214132 Oct 12 22:35:16.924868 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 698/1277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:16 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:16.936820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:16.940377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:16.945090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:16.957478 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-009356ff-d4ef-4564-b2b3-1c277dbc3e7d tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1469 microversion: 2.1 time: 0.519408 Oct 12 22:35:16.974642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.975223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.975400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 580/1278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:16 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1469 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:16.975569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:16.976323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:16.976962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:16.977585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.001602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:17.003253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:17.018633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.020653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.021437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.022445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.024170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.025423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.145254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:35:17.145684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:35:17.146160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:35:17.148407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:35:17.148856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:35:17.255098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:17.266797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.267868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.269901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.271284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.271980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.273369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.322270 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dbf54b98-69a0-445b-a90a-6ad721f7296e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "POST /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87/action" status: 202 len: 1109 microversion: 2.1 time: 0.394584 Oct 12 22:35:17.332387 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 699/1279] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:35:16 2022] POST /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87/action => generated 1109 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:35:17.332387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:17.332387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:17.340671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.340671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.340671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.340671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.340671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.340671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.490904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:17.513455 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c831d38-271a-4d2e-bc61-8f9f5c3a40b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.533718 Oct 12 22:35:17.526034 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 581/1280] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:16 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:17.544871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c773068f-7124-4f89-bf18-b449d0baf8fe req-ca82b6ca-baac-4e4d-b2f4-262ef2673447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5523ce-f7f7-43b3-877d-4aecccd87edc", "name": "network-vif-deleted", "tag": "85291d33-cf08-45ca-b322-88538a2ebe3c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:17.569862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c773068f-7124-4f89-bf18-b449d0baf8fe req-ca82b6ca-baac-4e4d-b2f4-262ef2673447 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.570414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c773068f-7124-4f89-bf18-b449d0baf8fe req-ca82b6ca-baac-4e4d-b2f4-262ef2673447 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.571123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c773068f-7124-4f89-bf18-b449d0baf8fe req-ca82b6ca-baac-4e4d-b2f4-262ef2673447 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.589459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c773068f-7124-4f89-bf18-b449d0baf8fe req-ca82b6ca-baac-4e4d-b2f4-262ef2673447 service nova] Creating event network-vif-deleted:85291d33-cf08-45ca-b322-88538a2ebe3c for instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc on n-h2-860864-8 Oct 12 22:35:17.597028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c773068f-7124-4f89-bf18-b449d0baf8fe req-ca82b6ca-baac-4e4d-b2f4-262ef2673447 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069139 Oct 12 22:35:17.598575 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 582/1281] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:17.604522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f9ed4f55-390f-4f31-b747-07153b8663f8 req-eab63ec4-9681-4e8b-b28e-3716d2989ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc150508-8e7e-4cf2-ba44-53f4895b7bd4", "tag": "3837cff2-a3bc-4610-8fba-c4e0645e3a54"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:17.618379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f9ed4f55-390f-4f31-b747-07153b8663f8 req-eab63ec4-9681-4e8b-b28e-3716d2989ae3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.618884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f9ed4f55-390f-4f31-b747-07153b8663f8 req-eab63ec4-9681-4e8b-b28e-3716d2989ae3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.619385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f9ed4f55-390f-4f31-b747-07153b8663f8 req-eab63ec4-9681-4e8b-b28e-3716d2989ae3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.654109 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f9ed4f55-390f-4f31-b747-07153b8663f8 req-eab63ec4-9681-4e8b-b28e-3716d2989ae3 service nova] Creating event network-changed:3837cff2-a3bc-4610-8fba-c4e0645e3a54 for instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 on n-h1-860864-8 Oct 12 22:35:17.661852 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f9ed4f55-390f-4f31-b747-07153b8663f8 req-eab63ec4-9681-4e8b-b28e-3716d2989ae3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060622 Oct 12 22:35:17.662717 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 583/1282] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:17.671066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:17.671715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:17.680198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.683513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.683513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.683513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.683513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.683513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.726724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:17.745673 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e3886542-a91e-40e9-a0bb-1c0dc2ad8c9a tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.421402 Oct 12 22:35:17.746354 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 700/1283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:17 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:17.752332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:17.752958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:17.773857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.774447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.774956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:17.775740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:17.776501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:17.777729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.036622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.045533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.048034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.048964 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-406be8f2-f48b-4ba2-b692-abccc9de4d1c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1800 microversion: 2.25 time: 0.301544 Oct 12 22:35:18.049731 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 701/1284] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:17 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1800 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:18.070825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.071449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.077885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.078372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.078828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.079989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.080446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.080872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.085598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.093395 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0f084ebf-ecc1-416c-9018-7679697ee7fd tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.429315 Oct 12 22:35:18.093977 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 584/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:17 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:18.104075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.105122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.111639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.112152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.112584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.113853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.114298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.114747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.336168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.346637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e3256bf-b4e4-48d3-8392-5c1a1e04eb80 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.283727 Oct 12 22:35:18.347226 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 702/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:18.373058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.374358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.390963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.392263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.393048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.394029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.394915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.395829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.457619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.458145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.458587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.459045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lazy-loading 'fault' on Instance uuid 1b5523ce-f7f7-43b3-877d-4aecccd87edc {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:35:18.479475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.494310 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3184cb09-b5a9-417c-b7e5-2b86f124b76e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.396803 Oct 12 22:35:18.495702 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 585/1287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:18.508277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc3edb53917493a8c2ba2449a91d9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a75809068d4169a784eb08bd381461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.514144 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6072a66c-c6f2-4a1f-8149-beb10fe90a92 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 200 len: 1304 microversion: 2.1 time: 0.150800 Oct 12 22:35:18.514828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 703/1288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:18.517577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c45a5a0-a81f-49d4-9d8d-84b66a79ac69 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '.version_select at 0x7f44ff6e73a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.521140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c45a5a0-a81f-49d4-9d8d-84b66a79ac69 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.521614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c45a5a0-a81f-49d4-9d8d-84b66a79ac69 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.522039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c45a5a0-a81f-49d4-9d8d-84b66a79ac69 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.533491 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c45a5a0-a81f-49d4-9d8d-84b66a79ac69 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3023 microversion: 2.25 time: 0.022478 Oct 12 22:35:18.534004 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 586/1289] 10.222.0.20 () {60 vars in 1184 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/os-migrations => generated 3023 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:35:18.550231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.551404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.555376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.556186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.557636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.558119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.558917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.559789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.560273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.560693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.562331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.562907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.563447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.564445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.564950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.565736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.703379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 8fa0aaef-a675-4aed-a3e3-93790420d284 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:35:18.716726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.716858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b014df5-c037-451d-bee5-a585e8c93502 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 2419 microversion: 2.25 time: 0.170286 Oct 12 22:35:18.717551 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 704/1290] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 2419 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:35:18.744440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e60cd76-6e58-40cd-85a4-281ab2d298c5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.194032 Oct 12 22:35:18.745549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.746249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.752326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.753079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.753371 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 587/1291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:18.753526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.754256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.754703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.755123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.772565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:18.773342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:18.780878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.781566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.782521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.783979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:18.784555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:18.785540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:18.900478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid 8fa0aaef-a675-4aed-a3e3-93790420d284 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:35:18.915335 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af3b2c6a-3612-43ba-a087-15a2f66ba27e tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 2419 microversion: 2.25 time: 0.173743 Oct 12 22:35:18.916168 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 705/1292] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 2419 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:35:18.937814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:18.946835 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65c87b7b-217d-45a1-90a8-65df5def6d52 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.180077 Oct 12 22:35:18.947745 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 588/1293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:18 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:19.001730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.002224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.009165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.009834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.010505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.011251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.011697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.012173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.102314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lazy-loading 'services' on Instance uuid 8fa0aaef-a675-4aed-a3e3-93790420d284 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:35:19.116509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.117232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.124230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.124787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.125296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.126063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.126601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.127378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.193728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3ac9ed4-442f-4080-ae1b-4b19d683f237 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments/e13ed46a-92ca-4656-bc26-22dd19f9cf64" status: 202 len: 0 microversion: 2.25 time: 0.196516 Oct 12 22:35:19.195691 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 706/1294] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Oct 12 22:35:18 2022] DELETE /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments/e13ed46a-92ca-4656-bc26-22dd19f9cf64 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:35:19.207236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.209684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.216658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.217138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.217562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.218249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.218686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.219098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.255257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c415e267-a055-4e7d-a89a-acc479805c69 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053407 Oct 12 22:35:19.256108 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 707/1295] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:19.270043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:19.300153 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-670d3438-83e5-46fa-a8c0-73f5ef541a46 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.175555 Oct 12 22:35:19.300868 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 589/1296] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:19.374508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.375121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.385696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.390008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.390739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.391565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.392055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.392684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.523237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.524424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.541723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.544388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.544849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.551326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.552007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.554025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.583764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:19.592385 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6d66de1-924e-4188-bd24-92613d9c8a6a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.221517 Oct 12 22:35:19.594460 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 708/1297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:19.600816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.602258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] [instance: 1b5523ce-f7f7-43b3-877d-4aecccd87edc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.610063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.610931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.611371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.612099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.612722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.613684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.630538 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] HTTP exception thrown: Instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc could not be found. Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Request method failure captured: Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc HTTP/1.1 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0EG2tPZq1-xcU8U3FbEhnkaq_choPv7k98GEjgp-mFh_Q-arxSewQG3DRCSp6v6OQJO7yKAS0I38v9EkjVK0bprtbfR3SkCvxKzQh-6f9V1lCWh0FD7wTKTY7NsaJX9PpdUeP-2OGN5ylW4fFBk8nxnQ2B45HTwNp1JmOE8pD788Ac Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a8a75809068d4169a784eb08bd381461 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TenantUsagesTestJSON-426377978 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8a75809068d4169a784eb08bd381461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8a75809068d4169a784eb08bd381461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8a75809068d4169a784eb08bd381461"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8a75809068d4169a784eb08bd381461"}]}] Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TenantUsagesTestJSON-426377978 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a8a75809068d4169a784eb08bd381461 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TenantUsagesTestJSON-426377978 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TenantUsagesTestJSON-426377978-project Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7fc3edb53917493a8c2ba2449a91d9d9 Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TenantUsagesTestJSON-426377978-project Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc could not be found. Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1b5523ce-f7f7-43b3-877d-4aecccd87edc'} Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc could not be found. Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc could not be found. Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:19.632526 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:19.637363 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:19.637363 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:19.637363 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:19.637363 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:19.637363 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:19.637363 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc could not be found. Oct 12 22:35:19.637363 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:19.638623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] Returning 404 to user: Instance 1b5523ce-f7f7-43b3-877d-4aecccd87edc could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:19.640336 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fec92187-2498-4a2c-8932-ad30f5c1d476 tempest-TenantUsagesTestJSON-426377978 tempest-TenantUsagesTestJSON-426377978-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc" status: 404 len: 111 microversion: 2.1 time: 0.044491 Oct 12 22:35:19.640909 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 709/1298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/1b5523ce-f7f7-43b3-877d-4aecccd87edc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:19.645741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1d8611c1-9741-4ecf-bb95-7c5a8bfedadc req-e54464c0-9a52-44de-b4aa-5e388a157268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c1a0ae-6d5a-4429-b332-507b6ca574d1", "tag": "afdd5fd3-0e2c-4ec4-85ea-0b10d15dabc5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:19.656691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1d8611c1-9741-4ecf-bb95-7c5a8bfedadc req-e54464c0-9a52-44de-b4aa-5e388a157268 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.657457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1d8611c1-9741-4ecf-bb95-7c5a8bfedadc req-e54464c0-9a52-44de-b4aa-5e388a157268 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.658323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1d8611c1-9741-4ecf-bb95-7c5a8bfedadc req-e54464c0-9a52-44de-b4aa-5e388a157268 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.673420 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1d8611c1-9741-4ecf-bb95-7c5a8bfedadc req-e54464c0-9a52-44de-b4aa-5e388a157268 service nova] Creating event network-changed:afdd5fd3-0e2c-4ec4-85ea-0b10d15dabc5 for instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 on n-h1-860864-8 Oct 12 22:35:19.680816 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1d8611c1-9741-4ecf-bb95-7c5a8bfedadc req-e54464c0-9a52-44de-b4aa-5e388a157268 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037803 Oct 12 22:35:19.681920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 710/1299] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:19.773307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.774523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.785355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.785866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.786291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.787154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.787271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:19.787854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.788499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.797223 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-11dd6abb-d1e6-4952-8faf-d907990dcb92 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.279663 Oct 12 22:35:19.804090 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 590/1300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:19.936381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:19.944689 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b2c44e3-1b88-4a35-b17b-16ba401468d4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.181161 Oct 12 22:35:19.945470 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 711/1301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:19.973952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:19.975069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:19.990309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.990792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.991361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:19.992016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:19.992468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:19.992887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.139060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:20.152574 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9948f700-0a35-4105-925d-65412bdbbb07 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.185758 Oct 12 22:35:20.153144 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 591/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:19 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:20.268812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:20.272847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:20.283678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.285320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.286050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.288859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.289591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.291126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.318009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:20.327682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:20.328594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:20.344563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.345062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.348398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.349139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.349600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.350021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.358984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12abcf7c-6c69-43d2-8f8e-faa24bae5abd tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094585 Oct 12 22:35:20.368494 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 712/1303] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:20 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:20.541899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:20.567159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=18 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:20.621261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:20.622710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:20.635484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.637248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.638561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.639940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.641036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.641671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.843007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:20.854946 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-147e1d8c-47f2-482e-8b51-ed1cc40e9cc1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.532044 Oct 12 22:35:20.856064 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 592/1304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:20 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:20.860889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:20.873188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:20.880664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.885000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.885579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.886471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:20.887040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:20.889182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:20.931556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:21.025277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:21.036418 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-625b52dd-6619-4e35-a0c6-560255858697 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.419083 Oct 12 22:35:21.037270 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 713/1305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:20 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:21.055756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:21.056786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:21.062882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.063366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.064023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:21.064535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.064978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.065404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:21.101456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=18 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:21.309075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:21.320325 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c069ee22-e77a-4ede-be49-088e573309cb tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.462877 Oct 12 22:35:21.322149 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 593/1306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:20 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:21.339350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:21.340178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:21.349151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.352473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.352981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:21.354341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.356652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.357531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:21.390565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:21.408594 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-237a426f-2f39-4a46-a484-bc2c483a132d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.369399 Oct 12 22:35:21.410118 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 714/1307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:21 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:21.420247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:21.425148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:21.436858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.437664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.438798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:21.440224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.441881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.442555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:21.494608 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81fb579d-f951-455f-b419-0a2fa378ef8d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082862 Oct 12 22:35:21.498753 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 715/1308] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:21 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:21.881896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:21.883087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:21.897067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.899161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.900626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:21.902860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:21.904864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:21.906007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.062359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:22.078170 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30f438a7-a059-4e1a-81cc-f0700d9f9067 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.754629 Oct 12 22:35:22.080569 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 594/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:21 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:22.092703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:22.093325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:22.108870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.109370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.109812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.110525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.110977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.111402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.402340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:22.418436 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d5965ee-ea81-4b8d-b1ae-45766ca37646 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.543855 Oct 12 22:35:22.433407 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 716/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:21 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:22.438342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:22.438970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:22.465857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.466613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.467207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.468139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.468750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.469328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.625301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:22.634003 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6b1e5e4e-db46-45f1-984c-41b044777253 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.549965 Oct 12 22:35:22.656456 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 595/1311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:22 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:22.663143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:22.663764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:22.670747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.671241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.671680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.672486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.673114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.673697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.838503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:22.853009 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8bfacb1a-a1f9-4d31-8d56-3f4d4a668c1a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.417896 Oct 12 22:35:22.854901 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 717/1312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:22 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:22.860452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:22.864470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:22.872307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.873120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.874324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.875693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:22.876564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:22.877341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:22.921479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:22.939673 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95afc84d-5258-4894-9039-cb9d43e75b91 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082894 Oct 12 22:35:22.942206 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 718/1313] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:22 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:23.103288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:23.104453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:23.104834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:23.116740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:23.120185 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f09daba5-2f0e-4eea-aaf1-9c7874a961e5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.462379 Oct 12 22:35:23.120839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:23.123057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:23.124113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:23.126462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:23.127820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:23.135991 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 596/1314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:22 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:23.431439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:23.446965 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cc2c1c6-fc6f-4629-a761-ac6d9fe5c23f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.347088 Oct 12 22:35:23.450462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 719/1315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:23 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:23.452822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:23.453540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:23.466960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:23.467454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:23.467963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:23.468660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:23.469111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:23.469536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:23.670442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:23.671447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:23.688117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:23.691143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:23.691863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:23.692826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:23.695836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:23.697188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:23.941110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:23.952694 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-232b171f-a546-49e6-8b69-fba3807d9262 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.287704 Oct 12 22:35:23.956965 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 720/1316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:23 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:23.980215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:23.991072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:23.991072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:23.993698 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2dfc0332-bf4f-4729-9e80-5b0b565fc9e0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.536409 Oct 12 22:35:23.997415 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 597/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:23 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:24.008706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:24.018375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:24.026130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.031494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.031986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.037654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.039113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.039555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.040172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.040609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.041230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.042593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.045106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.048006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.178979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d8bf929-2755-42a3-8ecc-58f9b171b28a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.180369 Oct 12 22:35:24.181609 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 598/1318] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:23 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:24.194156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:24.194940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:24.196906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:24.234613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.235412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.235874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.236679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.237141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.237609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.397780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:24.410817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ab57278-751b-45b7-a0d2-1ee203575cda tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.449307 Oct 12 22:35:24.414541 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 721/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:23 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:24.475589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:24.477127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:24.487834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.488823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.493787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.496583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:24.497093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:24.498837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:24.531108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:24.544558 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c25f75a-93d0-444f-a616-3b395e17b197 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.359663 Oct 12 22:35:24.555916 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 599/1320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:24 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:24.694635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:24.705418 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6eebb544-95ee-41d8-a050-3ba713821e72 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.234654 Oct 12 22:35:24.707649 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 722/1321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:24 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:24.996952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:24.997579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:25.004404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.005201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.005977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.007296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.008254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.008954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.018032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:25.019277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:25.025859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.026611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.027299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.028256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.028926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.029565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.200223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:25.212162 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-940e9246-05ac-47d2-9380-6a4f77a223fe tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.219088 Oct 12 22:35:25.218054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 600/1322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:24 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:25.252974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:25.263643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:25.287669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.291027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.291502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.294348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.300986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.301921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.352764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:25.359833 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-863981c1-9bc9-40e2-9ebe-211f9e09752b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138289 Oct 12 22:35:25.365232 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b75d645-d1aa-496e-9ce4-8ea08f30891b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.352892 Oct 12 22:35:25.368292 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 723/1323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:25 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:25.368662 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 601/1324] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:25 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:25.432327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-63f173a5-5aba-4196-bdcb-c2ed82dbc911 req-450c11e7-6a82-48f9-add1-d71bbdd1a5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c1a0ae-6d5a-4429-b332-507b6ca574d1", "name": "network-vif-plugged", "status": "completed", "tag": "afdd5fd3-0e2c-4ec4-85ea-0b10d15dabc5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:25.439062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:25.441333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:25.452355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.455199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.457669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-63f173a5-5aba-4196-bdcb-c2ed82dbc911 req-450c11e7-6a82-48f9-add1-d71bbdd1a5f3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.457969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.460580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-63f173a5-5aba-4196-bdcb-c2ed82dbc911 req-450c11e7-6a82-48f9-add1-d71bbdd1a5f3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.461207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-63f173a5-5aba-4196-bdcb-c2ed82dbc911 req-450c11e7-6a82-48f9-add1-d71bbdd1a5f3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.461550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.463354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.476222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.496291 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-63f173a5-5aba-4196-bdcb-c2ed82dbc911 req-450c11e7-6a82-48f9-add1-d71bbdd1a5f3 service nova] Creating event network-vif-plugged:afdd5fd3-0e2c-4ec4-85ea-0b10d15dabc5 for instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 on n-h1-860864-8 Oct 12 22:35:25.506207 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-63f173a5-5aba-4196-bdcb-c2ed82dbc911 req-450c11e7-6a82-48f9-add1-d71bbdd1a5f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082655 Oct 12 22:35:25.507394 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 724/1325] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:25.574226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:25.575120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:25.596152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.599225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.600494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.602173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:25.606893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:25.607630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:25.952250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:25.978086 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3def8d18-3b75-4db7-be24-5ce49f0001d7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.400719 Oct 12 22:35:26.002258 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 725/1326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:25 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:26.011601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:26.012591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:26.017148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:26.023523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:26.024912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.025740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.026945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.028164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.028916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.029556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.034227 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ea5a60d-bc53-453f-b227-c5195174c076 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.601983 Oct 12 22:35:26.036736 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 602/1327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:25 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:26.237519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:26.238143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:26.245829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.246325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.246861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.247567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.248049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.255225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.477888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:26.502953 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2602e13-21a4-43e8-bcc3-a050ef108628 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.495747 Oct 12 22:35:26.508522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:26.512883 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 726/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:26 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:26.537626 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5969c7e3-0ee2-490a-b358-e8dfe3008d7a tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1325 microversion: 2.1 time: 0.304080 Oct 12 22:35:26.539685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:26.539917 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 603/1329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:26 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:26.543729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:26.545475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:26.546479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:26.555495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.556356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.557023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.557974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.565336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.565991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.566515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.567328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:26.567989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.571756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.574326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:26.575059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:26.649020 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca2d24e6-4327-45e2-acfc-f90080e4ea80 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117735 Oct 12 22:35:26.650146 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 727/1330] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:26 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:35:27.007588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:27.008540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:27.011979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:27.022455 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d4a6bc3-7122-4bf8-9770-5a03b5cbd0b1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.481280 Oct 12 22:35:27.023366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.026731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.029026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.031885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.046573 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 604/1331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:26 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:27.049646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.053742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.061389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:27.064226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:27.090609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.091507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.094798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.098073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.100013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.102066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.447028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:27.457280 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-414891eb-1641-40c7-87f2-fa5b6efeea5b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.454487 Oct 12 22:35:27.458745 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 728/1332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:27 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:27.540601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:27.541991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:27.550650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.551388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.551928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.553054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.553914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.558724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.663160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:27.671529 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b79d0ec3-e590-4e24-99ee-3fc101491460 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.616339 Oct 12 22:35:27.672134 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 605/1333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:27 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:27.682047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:27.688707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:27.704652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.708781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.709229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.709950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.710397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.710816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.726196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:27.730278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:27.738598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8797e9f8-9ece-4eeb-9961-8a159609af08 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.202271 Oct 12 22:35:27.739203 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 729/1334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:27 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:27.755736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee8ff3b-dbb3-4948-914f-43780e1f29a1", "name": "network-vif-plugged", "status": "completed", "tag": "553c1090-566b-4ada-ab2f-a45852d67b80"}, {"server_uuid": "dc150508-8e7e-4cf2-ba44-53f4895b7bd4", "name": "network-vif-plugged", "status": "completed", "tag": "3837cff2-a3bc-4610-8fba-c4e0645e3a54"}, {"server_uuid": "cee8ff3b-dbb3-4948-914f-43780e1f29a1", "name": "network-vif-plugged", "status": "completed", "tag": "11be4c93-1c82-4a91-92b9-fdd4f5ba2a7b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:27.790900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.792786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.793634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.815559 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] Creating event network-vif-plugged:553c1090-566b-4ada-ab2f-a45852d67b80 for instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 on n-h2-860864-8 Oct 12 22:35:27.816421 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] Creating event network-vif-plugged:3837cff2-a3bc-4610-8fba-c4e0645e3a54 for instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 on n-h1-860864-8 Oct 12 22:35:27.817113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] Creating event network-vif-plugged:11be4c93-1c82-4a91-92b9-fdd4f5ba2a7b for instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 on n-h2-860864-8 Oct 12 22:35:27.831842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6e183b7d-66cd-47cc-b2f8-614c7416415a req-3ae96195-f49f-4045-97cc-62a866dd4ebb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087322 Oct 12 22:35:27.832975 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 730/1335] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:27.839749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:27.852679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:27.870808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.873130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.874000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.874943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:27.876483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:27.878415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:27.960350 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62adcf36-a915-4569-89c9-a4c3b80a4cee tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.124136 Oct 12 22:35:27.962291 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 731/1336] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 22:35:27 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:28.058135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:28.059040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:28.067925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.069614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.069614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.070373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.070732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.072180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.205900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:28.218758 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e72e3432-6e0e-4980-be25-a2df2d383187 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1521 microversion: 2.1 time: 0.541848 Oct 12 22:35:28.230393 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 606/1337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:27 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:28.264006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:28.264818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:28.291168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.291769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.295464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.296323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.296797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.297243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.341389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:35:28.385512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:28.394354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd1b6cf4-5059-4d1e-a440-ef4bedbc55a9 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.343537 Oct 12 22:35:28.395506 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 732/1338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:28 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:28.482195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:28.482834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:28.509984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.526620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.527078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.527825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.545201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.545799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.586228 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f6c0771-eea6-40ac-8050-dc29f7ff06c6 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 204 len: 0 microversion: 2.1 time: 0.327500 Oct 12 22:35:28.586851 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 607/1339] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:28 2022] DELETE /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:35:28.607627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:28.608642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:28.625363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.626080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.626698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.637175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.637848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.638456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.669932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:28.784947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:28.795336 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59e7bf2c-1e48-495c-a2d8-6fc117499dec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.317573 Oct 12 22:35:28.805287 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 733/1340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:28 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:28.817375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:28.818778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:28.836168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.837083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.838033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.839139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:28.839905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:28.841025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:28.984062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:28.993365 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-337a5b16-e5ad-4911-85c8-6a53223235a0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1527 microversion: 2.1 time: 0.402098 Oct 12 22:35:28.993958 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 608/1341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:28 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1527 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:29.004903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:29.010434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:29.033796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:29.034557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:29.035403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:29.037093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:29.037732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:29.038326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:29.096848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:29.105595 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2eb1106-381f-458a-96d3-b8db45812a4d tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1334 microversion: 2.1 time: 0.298156 Oct 12 22:35:29.110530 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 734/1342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:28 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1334 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:29.383930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:29.397850 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a346faf5-f510-4a6f-a12c-ff5adb654423 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.400383 Oct 12 22:35:29.418407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:29.419355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:29.420956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 609/1343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:28 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:29.436910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:29.438996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:29.439979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:29.445993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:29.447594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:29.448739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:29.702446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:29.711867 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b1de1acc-5bb9-4225-8e7b-cfe4a8f68624 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.297987 Oct 12 22:35:29.712774 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 735/1344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:29 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:29.819010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:29.819918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:29.834260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:29.834844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:29.835334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:29.838118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:29.838592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:29.839024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.016699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:30.017650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:30.029548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.035018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.035677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.038462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.039094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.045273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.322686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:30.334517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b848b5e6-471a-4d53-8dfd-ba7687eb39f8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1527 microversion: 2.1 time: 0.321531 Oct 12 22:35:30.335449 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 736/1345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:30 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1527 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:30.344247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:30.350501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:30.381576 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:35:30.382053 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 22:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 (ip 10.222.0.20) !!! Oct 12 22:35:30.384910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.385654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.386308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.387234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.387940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.388582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.636707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:30.654169 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-942dd009-bfa7-42cc-abde-a80054c249e7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.837219 Oct 12 22:35:30.656455 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 610/1346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:29 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:30.667758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:30.669178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:30.700849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.705468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.711843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.715221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.716942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.719428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.829358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:30.848289 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1bda52b4-13a1-4eb7-a5c1-a5c78c8ff0ba tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1669 microversion: 2.1 time: 0.507570 Oct 12 22:35:30.855763 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 737/1347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:30 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1669 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:30.870519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:30.873243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:30.898035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.898898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.899919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:30.903952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:30.904725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:30.905741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.204595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:31.215667 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1261beb2-6eef-44e0-8318-e11c19610606 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.357109 Oct 12 22:35:31.216650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 738/1348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:30 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:31.222062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:31.222558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:31.229234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.229942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.231750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.236425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.237342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.237491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.278454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc15c25a-c35a-40f2-a67a-ef1dc15fc892 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1/ips" status: 200 len: 179 microversion: 2.1 time: 0.060376 Oct 12 22:35:31.279037 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 739/1349] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:35:31 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1/ips => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:31.297050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:31.301968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:31.329974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.339393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.341533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.347097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.349701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.351325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.387500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:35:31.465296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:31.478569 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-911ddf45-e3cf-4519-8e96-cedddbfb686c tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1318 microversion: 2.1 time: 0.820040 Oct 12 22:35:31.479158 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 611/1350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:30 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:31.499730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:31.500566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:31.507380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.508125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.508728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.509219 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8f2963b-aab9-4ff9-98e7-ca498bf4db4e tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 204 len: 0 microversion: 2.1 time: 0.220188 Oct 12 22:35:31.509929 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 740/1351] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:31 2022] DELETE /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:35:31.510137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.510733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.511317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.522518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:31.523549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:31.530238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.530663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.531799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.532548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.533266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.534053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.740518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:31.748625 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ffbe3c6-9626-4c4d-bc1e-f49c1503c9b0 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1675 microversion: 2.1 time: 0.233335 Oct 12 22:35:31.749644 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 741/1352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:31 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:31.755262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:31.756003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:31.762905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.763562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.764121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.765087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:31.765760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:31.766406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:31.992509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:32.005269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7fabe0c2-ad6b-4ae0-821a-c7f6b47bc495 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.254378 Oct 12 22:35:32.006349 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 742/1353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:31 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:32.128446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:32.138726 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d94a4d45-4607-4d33-8ad0-a9b0a9e491b5 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1527 microversion: 2.1 time: 0.656759 Oct 12 22:35:32.139329 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 612/1354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:31 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1527 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:32.251284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:32.252451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:32.263221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:32.264730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:32.265488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:32.266506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:32.267023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:32.271941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:32.394308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e1a97e2d-f563-4227-9ac1-068772521864 req-b6494e8a-73f5-467a-8403-4267f5e3732d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c1a0ae-6d5a-4429-b332-507b6ca574d1", "name": "network-vif-deleted", "tag": "afdd5fd3-0e2c-4ec4-85ea-0b10d15dabc5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:32.427328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e1a97e2d-f563-4227-9ac1-068772521864 req-b6494e8a-73f5-467a-8403-4267f5e3732d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:32.427854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e1a97e2d-f563-4227-9ac1-068772521864 req-b6494e8a-73f5-467a-8403-4267f5e3732d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:32.428319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e1a97e2d-f563-4227-9ac1-068772521864 req-b6494e8a-73f5-467a-8403-4267f5e3732d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:32.475233 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e1a97e2d-f563-4227-9ac1-068772521864 req-b6494e8a-73f5-467a-8403-4267f5e3732d service nova] Creating event network-vif-deleted:afdd5fd3-0e2c-4ec4-85ea-0b10d15dabc5 for instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 on n-h1-860864-8 Oct 12 22:35:32.493113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e1a97e2d-f563-4227-9ac1-068772521864 req-b6494e8a-73f5-467a-8403-4267f5e3732d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105315 Oct 12 22:35:32.494340 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 613/1355] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:32.508950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:32.510061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:32.544112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:32.548529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:32.549343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:32.550309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:32.550942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:32.551544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:32.634771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:32.650771 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-528fa00a-a4ed-429e-8139-411418be0359 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.411489 Oct 12 22:35:32.654675 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 743/1356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:32 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:32.778995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:32.779964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:32.794265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:32.795610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:32.796749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:32.797959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:32.799782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:32.801216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:32.806703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:32.833454 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-61e5e1ae-dca1-402e-897e-88e4dd94ba45 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1507 microversion: 2.1 time: 0.326052 Oct 12 22:35:32.834127 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 614/1357] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:32 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:33.036658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:33.037191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:33.055516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:33.060813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:33.062830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:33.070105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:33.070911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:33.073408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:33.276652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:33.288893 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b76ac5f1-00d6-4f71-9241-dc3e80458264 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1675 microversion: 2.1 time: 0.514664 Oct 12 22:35:33.290133 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 744/1358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:32 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1675 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:33.298024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:33.298955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:33.322166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:33.322832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:33.323296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:33.324726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:33.330490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:33.330490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:33.449199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:33.449804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:33.450342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:33.450909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lazy-loading 'fault' on Instance uuid 00c1a0ae-6d5a-4429-b332-507b6ca574d1 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:35:33.459750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:33.553577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f91f5085e864c5fbf74eb6eacf504c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4767aa6972423987ec612b734dcf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:33.561045 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb647947-a118-41fa-928c-f72c180e7ae8 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 200 len: 1315 microversion: 2.1 time: 0.268244 Oct 12 22:35:33.568668 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 745/1359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:33 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:33.679236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:33.680010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:33.697013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:33.699695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:33.702952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:33.710237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:33.711815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:33.712602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:33.882354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:33.890773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-02fb1442-2ea2-45d0-b972-f377ad13d0b6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.860985 Oct 12 22:35:33.895371 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 615/1360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:33 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:34.169856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:34.178175 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b1c06ee7-2531-4be0-90a0-7aba3f6ed88f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.503206 Oct 12 22:35:34.182723 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 746/1361] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:33 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:34.325281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:34.325913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:34.348754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.349619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.350418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.352643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.356085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.362870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.596300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:34.596912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 00c1a0ae-6d5a-4429-b332-507b6ca574d1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:34.610930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.611434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.612443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.613166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.613621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.614044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.653817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 could not be found. Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 HTTP/1.1 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 could not be found. Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '00c1a0ae-6d5a-4429-b332-507b6ca574d1'} Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 could not be found. Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 could not be found. Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.655655 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 could not be found. Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Instance 00c1a0ae-6d5a-4429-b332-507b6ca574d1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:34.662252 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f533095d-f011-4ace-8d00-f92ba62a3482 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1" status: 404 len: 111 microversion: 2.1 time: 0.064928 Oct 12 22:35:34.668272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 747/1362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:34 2022] GET /compute/v2.1/servers/00c1a0ae-6d5a-4429-b332-507b6ca574d1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:34.673226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f706f48e-888d-4733-bd4d-831949696f8b req-e4377e1c-af5f-4e1f-a5db-6f7a6042f840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee8ff3b-dbb3-4948-914f-43780e1f29a1", "name": "network-vif-deleted", "tag": "553c1090-566b-4ada-ab2f-a45852d67b80"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:34.702127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f706f48e-888d-4733-bd4d-831949696f8b req-e4377e1c-af5f-4e1f-a5db-6f7a6042f840 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.702648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f706f48e-888d-4733-bd4d-831949696f8b req-e4377e1c-af5f-4e1f-a5db-6f7a6042f840 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.703091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f706f48e-888d-4733-bd4d-831949696f8b req-e4377e1c-af5f-4e1f-a5db-6f7a6042f840 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.731691 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f706f48e-888d-4733-bd4d-831949696f8b req-e4377e1c-af5f-4e1f-a5db-6f7a6042f840 service nova] Creating event network-vif-deleted:553c1090-566b-4ada-ab2f-a45852d67b80 for instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 on n-h2-860864-8 Oct 12 22:35:34.745738 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f706f48e-888d-4733-bd4d-831949696f8b req-e4377e1c-af5f-4e1f-a5db-6f7a6042f840 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076070 Oct 12 22:35:34.746358 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 748/1363] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:34.751488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-edc17c1e-1afb-4fde-96e0-b8486ba72885 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '.version_select at 0x7f44ff4fd940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:34.798292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-edc17c1e-1afb-4fde-96e0-b8486ba72885 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Image not found. Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-edc17c1e-1afb-4fde-96e0-b8486ba72885 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2 HTTP/1.1 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a7609ee7-d0cc-42e9-a49b-f351a768c7f2'} Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a7609ee7-d0cc-42e9-a49b-f351a768c7f2 to delete Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7609ee7-d0cc-42e9-a49b-f351a768c7f2 could not be found. Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.800966 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:35:34.806312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.809048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-edc17c1e-1afb-4fde-96e0-b8486ba72885 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:34.810811 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-edc17c1e-1afb-4fde-96e0-b8486ba72885 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2" status: 404 len: 62 microversion: 2.1 time: 0.063025 Oct 12 22:35:34.811536 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 749/1364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:34 2022] DELETE /compute/v2.1/images/a7609ee7-d0cc-42e9-a49b-f351a768c7f2 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:35:34.820386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:34.824386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:34.840433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.841214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.841827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.848848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.849508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.850104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.870517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:34.876418 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.880932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d221e907-45cc-41c2-a63f-a33ce6e69352 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1654 microversion: 2.1 time: 0.566958 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f HTTP/1.1 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '8904c6fa-e66b-4ef6-9f3e-441eefa9880f'} Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:34.882900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.887076 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.887996 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 616/1365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:34 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1654 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:34.891275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:34.892846 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-428f63d4-f546-4e04-a8fe-8f7fe923df66 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 404 len: 111 microversion: 2.1 time: 0.076596 Oct 12 22:35:34.898621 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 750/1366] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:34 2022] DELETE /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:35:34.907091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:34.908060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 8904c6fa-e66b-4ef6-9f3e-441eefa9880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:34.918068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:34.918996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:34.930223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.931639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.932389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.941293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.941903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.942572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.943534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.944492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:34.945186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.945847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:34.946495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.947117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:34.982592 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f HTTP/1.1 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '8904c6fa-e66b-4ef6-9f3e-441eefa9880f'} Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.985563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Instance 8904c6fa-e66b-4ef6-9f3e-441eefa9880f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:34.992571 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d9c4c5e-5e7b-44fb-ab4f-3411d322758c tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f" status: 404 len: 111 microversion: 2.1 time: 0.087667 Oct 12 22:35:34.996274 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 617/1367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:34 2022] GET /compute/v2.1/servers/8904c6fa-e66b-4ef6-9f3e-441eefa9880f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:35.009809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ff5bac4-827d-4e27-8b84-da3ac55ef50b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '.version_select at 0x7f44ff651160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:35.079829 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ff5bac4-827d-4e27-8b84-da3ac55ef50b tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337551350" status: 202 len: 0 microversion: 2.1 time: 0.072880 Oct 12 22:35:35.083244 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 618/1368] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337551350 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:35:35.208352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:35.208352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:35.218650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:35.219098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:35.219535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:35.224407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:35.226290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:35.227523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:35.413938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:35.442538 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c0ca7659-e629-4120-b59e-00a22712e80a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.527528 Oct 12 22:35:35.444584 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 751/1369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:34 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:35.761207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:35.778692 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d5cd22d-87ff-47d1-8864-8878ae0462b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.577710 Oct 12 22:35:35.788396 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 619/1370] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:35 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:35.911529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:35.913445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:35.932310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:35.942946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e6487e51-ecfd-45fb-baad-8fe044c18e20"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:35.946467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:35.952039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:35.953302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:35.954036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:35.954528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:35.954953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:35.955281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:35.956691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:35.957546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:35.958075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:35.961748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:35.969200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:36.154934 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] HTTP exception thrown: Volume 57b38f35-3616-4bc6-bdca-4a6bd1cddacc could not be found. Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Request method failure captured: Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4/os-volume_attachments/57b38f35-3616-4bc6-bdca-4a6bd1cddacc HTTP/1.1 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 74 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0C3taMPaTzjgm-kZNZ7OxKavAdlcsmNoQRDdFGAXvBbSwGcn1NO4ZoC6lReNWkERpKjcwrJReEAEFGqi2PHIjYDavhX4cpJmOthAvFHatk7cbd7O4GEADPX1rt2Ps07JWaNbSNNi5ouytoifDoNSmI3bsruhP6IiKiMI8UW2E9LC7A Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: cd0a0d67b7fd434f879315295c577cdc Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesAdminNegativeTest-818724905 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd0a0d67b7fd434f879315295c577cdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cd0a0d67b7fd434f879315295c577cdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cd0a0d67b7fd434f879315295c577cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd0a0d67b7fd434f879315295c577cdc"}]}] Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesAdminNegativeTest-818724905 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: cd0a0d67b7fd434f879315295c577cdc Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-818724905 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesAdminNegativeTest-818724905-project-admin Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: f889f96edb6345baa1e926bd884ca1a0 Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesAdminNegativeTest-818724905-project-admin Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: {"volumeAttachment": {"volumeId": "e6487e51-ecfd-45fb-baad-8fe044c18e20"}} Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: exception: Volume 57b38f35-3616-4bc6-bdca-4a6bd1cddacc could not be found. Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': 'dc150508-8e7e-4cf2-ba44-53f4895b7bd4', 'id': '57b38f35-3616-4bc6-bdca-4a6bd1cddacc', 'body': {'volumeAttachment': {'volumeId': 'e6487e51-ecfd-45fb-baad-8fe044c18e20'}}} Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57b38f35-3616-4bc6-bdca-4a6bd1cddacc could not be found. (HTTP 404) (Request-ID: req-f2098eb6-4237-4e7c-9c43-eec0a03a7630) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:35:36.157720 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57b38f35-3616-4bc6-bdca-4a6bd1cddacc could not be found. Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 57b38f35-3616-4bc6-bdca-4a6bd1cddacc could not be found. Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57b38f35-3616-4bc6-bdca-4a6bd1cddacc could not be found. Oct 12 22:35:36.162760 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:36.168604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] Returning 404 to user: Volume 57b38f35-3616-4bc6-bdca-4a6bd1cddacc could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:36.169667 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-167f26d3-c908-4111-a0db-574957a622ea tempest-VolumesAdminNegativeTest-818724905 tempest-VolumesAdminNegativeTest-818724905-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4/os-volume_attachments/57b38f35-3616-4bc6-bdca-4a6bd1cddacc" status: 404 len: 109 microversion: 2.1 time: 0.231188 Oct 12 22:35:36.170795 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 620/1371] 10.222.0.20 () {60 vars in 1433 bytes} [Wed Oct 12 22:35:35 2022] PUT /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4/os-volume_attachments/57b38f35-3616-4bc6-bdca-4a6bd1cddacc => generated 109 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:35:36.468928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:36.469544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:36.486448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:36.487863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:36.489207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:36.491298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:36.491877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:36.493905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:36.905517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2090f18cfb4ea59d153fc62cf208e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25017cd8ac6040bf9ba0e88a3a9659a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:36.949560 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5575d784-b053-492c-8d26-7f5352dee6b9 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 200 len: 1455 microversion: 2.1 time: 1.047261 Oct 12 22:35:36.961473 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 752/1372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:35 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 1455 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:36.968112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:36.971762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:36.985042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:36.990837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:36.991681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:36.992609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:36.993816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:36.994458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:37.108861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:37.118752 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ed59fc8-d1a3-4504-93a2-6fe65e7bee34 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.655636 Oct 12 22:35:37.132711 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 621/1373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:36 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:37.144417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9302a351-244e-4ecf-a966-e9febedaeab2 req-2b519f73-83a2-4525-b411-97cb7792d657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee8ff3b-dbb3-4948-914f-43780e1f29a1", "name": "network-vif-deleted", "tag": "11be4c93-1c82-4a91-92b9-fdd4f5ba2a7b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:37.177192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9302a351-244e-4ecf-a966-e9febedaeab2 req-2b519f73-83a2-4525-b411-97cb7792d657 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:37.177885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9302a351-244e-4ecf-a966-e9febedaeab2 req-2b519f73-83a2-4525-b411-97cb7792d657 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:37.178473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9302a351-244e-4ecf-a966-e9febedaeab2 req-2b519f73-83a2-4525-b411-97cb7792d657 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:37.202484 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9302a351-244e-4ecf-a966-e9febedaeab2 req-2b519f73-83a2-4525-b411-97cb7792d657 service nova] Creating event network-vif-deleted:11be4c93-1c82-4a91-92b9-fdd4f5ba2a7b for instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 on n-h2-860864-8 Oct 12 22:35:37.215008 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9302a351-244e-4ecf-a966-e9febedaeab2 req-2b519f73-83a2-4525-b411-97cb7792d657 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081166 Oct 12 22:35:37.224272 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 622/1374] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:37.230656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c129caa-6c72-4a24-9884-012551945393 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '.version_select at 0x7f44ff6515e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:37.301111 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5c129caa-6c72-4a24-9884-012551945393 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Image not found. Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c129caa-6c72-4a24-9884-012551945393 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/images/0b3cfefa-d603-4db8-8d82-e1f0dc782e85 HTTP/1.1 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '0b3cfefa-d603-4db8-8d82-e1f0dc782e85'} Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0b3cfefa-d603-4db8-8d82-e1f0dc782e85 to delete Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0b3cfefa-d603-4db8-8d82-e1f0dc782e85 could not be found. Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:37.304832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c129caa-6c72-4a24-9884-012551945393 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c129caa-6c72-4a24-9884-012551945393 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/images/0b3cfefa-d603-4db8-8d82-e1f0dc782e85" status: 404 len: 62 microversion: 2.1 time: 0.079799 Oct 12 22:35:37.308979 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 623/1375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:37 2022] DELETE /compute/v2.1/images/0b3cfefa-d603-4db8-8d82-e1f0dc782e85 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:35:37.315388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:37.316034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:37.334394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:37.337358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:37.337821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:37.338565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:37.339024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:37.339446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:37.368535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 HTTP/1.1 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '19cfc93f-0e2e-4788-ad94-581edf4efc59'} Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:37.376481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.383034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:37.384975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53fb5b8c-e7a0-4f14-8804-332fd22d2a07 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "DELETE /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 404 len: 111 microversion: 2.1 time: 0.071295 Oct 12 22:35:37.408428 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 624/1376] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:37 2022] DELETE /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:37.434775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:37.435831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] [instance: 19cfc93f-0e2e-4788-ad94-581edf4efc59] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:37.445722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:37.446267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:37.447144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:37.448601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:37.450096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:37.450758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:37.575621 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] HTTP exception thrown: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Request method failure captured: Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 HTTP/1.1 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0DVpI6MzL03Dz1ZPXoWhICjXWEVj26f7LqCk2ElsPkgg10u65WHfu9IY70nbEiIRMGy7yk40Wq8BryYo1tkiy-t6HUOmgQOQ4xs_Ch5Qc4z_a8JVpWeRCPYSA60i4WYauKj7YQj2TwRYE2NqKK1Pb9_YgEjZsrR98TkmfafsFfgyws Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b4767aa6972423987ec612b734dcf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b4767aa6972423987ec612b734dcf48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b4767aa6972423987ec612b734dcf48"}]}] Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5b4767aa6972423987ec612b734dcf48 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-841602056 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5f91f5085e864c5fbf74eb6eacf504c3 Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-841602056-project Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '19cfc93f-0e2e-4788-ad94-581edf4efc59'} Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.592302 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:37.597286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] Returning 404 to user: Instance 19cfc93f-0e2e-4788-ad94-581edf4efc59 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:37.600350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c082a48-d8ba-497c-a2ac-c964252322e0 tempest-ImagesOneServerNegativeTestJSON-841602056 tempest-ImagesOneServerNegativeTestJSON-841602056-project] 10.222.0.20 "GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59" status: 404 len: 111 microversion: 2.1 time: 0.187343 Oct 12 22:35:37.603936 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 625/1377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:37 2022] GET /compute/v2.1/servers/19cfc93f-0e2e-4788-ad94-581edf4efc59 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:37.655372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:37.664985 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cadd6a43-1fde-4ba2-931d-ac720d04c29b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.702330 Oct 12 22:35:37.672201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 753/1378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:36 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:37.976364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:37.977605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:37.985065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:37.987830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:37.988479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:37.989668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:37.990285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:37.991825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:38.047426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] HTTP exception thrown: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Request method failure captured: Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 HTTP/1.1 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Dck4md07l112sxtiRz-z8-kKGObcxM8goJRgR4-UuDMvZ0_4Zduzc6BneJKCpMyE0Z-i6Thx_MQnGnK3Q3Ly09b60DGmoC_a85rOpff2avWAfePuyX_qRjDRN9laTBoMYOpgFKhOkkfzsTIAoNYEd5C4B0nfLKTv4pLZCJ0A8vmgw Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}] Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb2090f18cfb4ea59d153fc62cf208e2 Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'cee8ff3b-dbb3-4948-914f-43780e1f29a1'} Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:38.049953 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Returning 404 to user: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:38.055042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91e23b93-485b-4f49-86a6-a51d581e1c3a tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 404 len: 111 microversion: 2.1 time: 0.079552 Oct 12 22:35:38.068162 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 626/1379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:37 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:38.148579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:38.149373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:38.181208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:38.181714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:38.182157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:38.182882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:38.183334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:38.183757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:38.907038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:38.922703 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f107868-55c5-4d8f-aa63-251c5bd39eef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.778917 Oct 12 22:35:38.934587 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 754/1380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:38 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:38.934587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:38.934587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:38.973055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-737957331", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "25f09190-2cdc-41b9-9952-f833573da6b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:38.975013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:38.975973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:38.977576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:38.983076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:38.983831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:38.984459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:39.135459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] validate_networks() for [('25f09190-2cdc-41b9-9952-f833573da6b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:35:39.699716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:39.719008 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e78e4df-3a6f-427b-ac28-176562405436 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.789208 Oct 12 22:35:39.732590 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 755/1381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:38 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:39.958374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:39.958926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:39.974176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:39.979332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:39.980161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:39.982405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:39.985117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:39.990288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:40.462460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:40.474156 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82b44f84-fb51-4ef4-8508-65ea60423323 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.527385 Oct 12 22:35:40.487503 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 756/1382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:39 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:40.754534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:40.773922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:40.793880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:40.796168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:40.797500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:40.799150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:40.801340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:40.802550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:41.451932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:41.464637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9439a42-b432-4721-b408-37462b0d25c6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.714001 Oct 12 22:35:41.482885 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 757/1383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:40 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:41.503000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:41.503952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:41.521983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:41.523682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:41.524402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:41.525904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:41.531825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:41.534275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:42.054641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:42.071172 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc4cfa98-a72d-4912-be20-a1a6eca54249 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.573152 Oct 12 22:35:42.082137 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 758/1384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:41 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:42.172725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:42.176928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:42.211199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:42.211696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:42.217576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:42.223118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:42.228548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:42.229225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:42.321997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:35:42.553227 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc433414-e0ee-4883-864b-2d381da1d797 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 204 len: 0 microversion: 2.1 time: 0.384441 Oct 12 22:35:42.554749 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 759/1385] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:42 2022] DELETE /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:35:42.567467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:42.571655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:42.590346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:42.592193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:42.593899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:42.595171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:42.595913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:42.596500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:42.933802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:35:42.934531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:35:42.935749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:35:42.936200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:35:42.936621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:35:42.939045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:42.952580 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19b3f8f1-7e29-4d12-a868-7a152c3d963c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 0.396428 Oct 12 22:35:42.956378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 760/1386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:42 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:42.972932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:42.975342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:42.986028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:42.987063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:42.987500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:42.994688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:42.995342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:42.997170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:42.997777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:42.998234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:42.998728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:43.065430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:43.071288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:43.072309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:43.116628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:35:43.122573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for user 080644f7502346ed8ff64a026ac9d15b and project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:35:43.145498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:35:43.148814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:35:43.290513 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ddd59c3-beeb-4073-abc1-08633f804805 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.761782 Oct 12 22:35:43.292007 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 627/1387] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:35:43.297077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:43.297967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:43.305718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:43.306383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:43.306960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:43.307834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:43.308502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:43.309207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:43.311117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:43.321181 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c654914f-e393-4899-9eff-b1048a816acf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1513 microversion: 2.1 time: 0.363571 Oct 12 22:35:43.330076 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 761/1388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:42 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:43.351067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2ca58ca2-ab2c-43a7-8706-44e7a6d7031b req-a752db63-e918-4234-ad34-d1c0ab16d3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c2dd1a-5106-4a62-bef0-e496ea3e8e49", "name": "network-vif-unplugged", "status": "completed", "tag": "47fb6b3d-e4f4-4930-ae0e-e73ef491584c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:43.378492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ca58ca2-ab2c-43a7-8706-44e7a6d7031b req-a752db63-e918-4234-ad34-d1c0ab16d3a4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:43.379226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ca58ca2-ab2c-43a7-8706-44e7a6d7031b req-a752db63-e918-4234-ad34-d1c0ab16d3a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:43.379814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2ca58ca2-ab2c-43a7-8706-44e7a6d7031b req-a752db63-e918-4234-ad34-d1c0ab16d3a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:43.417546 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2ca58ca2-ab2c-43a7-8706-44e7a6d7031b req-a752db63-e918-4234-ad34-d1c0ab16d3a4 service nova] Creating event network-vif-unplugged:47fb6b3d-e4f4-4930-ae0e-e73ef491584c for instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 on n-h1-860864-8 Oct 12 22:35:43.438978 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2ca58ca2-ab2c-43a7-8706-44e7a6d7031b req-a752db63-e918-4234-ad34-d1c0ab16d3a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106609 Oct 12 22:35:43.442215 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 762/1389] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:43.455240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36835e70-43fa-46ea-90f3-d56886c6bb21 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:43.458574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36835e70-43fa-46ea-90f3-d56886c6bb21 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:43.619165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36835e70-43fa-46ea-90f3-d56886c6bb21 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:43.641756 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36835e70-43fa-46ea-90f3-d56886c6bb21 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1207 microversion: 2.1 time: 0.188711 Oct 12 22:35:43.646332 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 763/1390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:43 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1207 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:43.981437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:43.982063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:43.996161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:44.002602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:44.003248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:44.004040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:44.008554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:44.010973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:44.260708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:44.279262 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-554571bd-1ab3-4280-83cb-c36c4e544cb7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.985925 Oct 12 22:35:44.284215 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 628/1391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:43 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:44.360764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:44.362476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:44.375158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:44.375944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:44.383619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:44.390154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:44.391337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:44.393650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:45.049704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:45.065633 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f65a994-b5ed-4504-8f6d-fe3135083143 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1513 microversion: 2.1 time: 0.705343 Oct 12 22:35:45.073832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 629/1392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:44 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1513 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:45.110016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:45.115395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:45.141862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:45.148844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:45.149315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:45.154613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:45.160691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:45.163851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:45.220977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:45.230092 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-baf0950d-21a2-4494-bfa2-d1b41cd19c99 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1514 microversion: 2.1 time: 1.252603 Oct 12 22:35:45.233604 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 764/1393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:43 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1514 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:45.307587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:45.308615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:45.317793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:45.320684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:45.323221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:45.324070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:45.324542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:45.324976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:45.342107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:45.870515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:45.884895 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-551068e9-4fb4-43a6-bd88-45e16449bce0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1211 microversion: 2.1 time: 0.809410 Oct 12 22:35:45.886084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 630/1394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:45 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1211 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:46.091051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:46.092194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:46.100409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:46.100903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:46.101350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:46.105018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:46.105865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:46.106525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:46.138882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:46.151517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a037efe4-1bd3-4c79-8ee9-8e829715ebef tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.847994 Oct 12 22:35:46.171492 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 765/1395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:45 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:46.178531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c93bf931-bf29-4d5e-b765-ae0db41b64b7 req-8068ca83-ec65-4ac2-84ce-8f4a35fd7bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c2dd1a-5106-4a62-bef0-e496ea3e8e49", "tag": "47fb6b3d-e4f4-4930-ae0e-e73ef491584c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:46.203719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c93bf931-bf29-4d5e-b765-ae0db41b64b7 req-8068ca83-ec65-4ac2-84ce-8f4a35fd7bb9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:46.205464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c93bf931-bf29-4d5e-b765-ae0db41b64b7 req-8068ca83-ec65-4ac2-84ce-8f4a35fd7bb9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:46.206341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c93bf931-bf29-4d5e-b765-ae0db41b64b7 req-8068ca83-ec65-4ac2-84ce-8f4a35fd7bb9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:46.229977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c93bf931-bf29-4d5e-b765-ae0db41b64b7 req-8068ca83-ec65-4ac2-84ce-8f4a35fd7bb9 service nova] Creating event network-changed:47fb6b3d-e4f4-4930-ae0e-e73ef491584c for instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 on n-h1-860864-8 Oct 12 22:35:46.244339 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c93bf931-bf29-4d5e-b765-ae0db41b64b7 req-8068ca83-ec65-4ac2-84ce-8f4a35fd7bb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071532 Oct 12 22:35:46.246010 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 766/1396] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:46.259608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:46.262537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:46.278149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:46.280672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:46.281325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:46.283781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:46.287983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:46.288754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:46.849596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:46.859806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c05c8d0-fffe-4571-b1dc-522a0e7130cb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1520 microversion: 2.1 time: 0.604844 Oct 12 22:35:46.864026 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 767/1397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:46 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1520 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:46.910953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:46.912139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:46.927395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:46.929207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:46.930159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:46.933953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:46.934697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:46.938238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:47.148791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:47.159036 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4dcc928b-db37-4ea7-8da4-587a00553fd5 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1513 microversion: 2.1 time: 1.072936 Oct 12 22:35:47.163772 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 631/1398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:46 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1513 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:47.178892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:47.179823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:47.194738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:47.196290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:47.197533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:47.198407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:47.200119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:47.201350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:47.213450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:47.223345 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89a58158-43d4-42fb-a510-9152209daaae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1265 microversion: 2.1 time: 0.318596 Oct 12 22:35:47.228972 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 768/1399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:46 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:47.263743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:47.886900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:47.887514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:47.893955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:47.895762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:47.896273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:47.896767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:47.897475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:47.897913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:47.898330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.068009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:48.084124 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e723e58-889d-42bc-858d-931f56fa5674 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1520 microversion: 2.1 time: 0.199311 Oct 12 22:35:48.100512 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 769/1400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:47 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:48.100618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:48.111577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37dd7e13-2373-484f-ae52-1485cc998c96 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.936793 Oct 12 22:35:48.112210 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 632/1401] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:47 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:48.186016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:48.186636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:48.188702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:48.189414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:48.193379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.193867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.194305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.195008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.195464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.195910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.199939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.200454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.200896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.204034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.205188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.205641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.230492 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] HTTP exception thrown: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Request method failure captured: Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 HTTP/1.1 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Dck4md07l112sxtiRz-z8-kKGObcxM8goJRgR4-UuDMvZ0_4Zduzc6BneJKCpMyE0Z-i6Thx_MQnGnK3Q3Ly09b60DGmoC_a85rOpff2avWAfePuyX_qRjDRN9laTBoMYOpgFKhOkkfzsTIAoNYEd5C4B0nfLKTv4pLZCJ0A8vmgw Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}] Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb2090f18cfb4ea59d153fc62cf208e2 Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'cee8ff3b-dbb3-4948-914f-43780e1f29a1'} Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:48.232679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Returning 404 to user: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-02792a00-2e0a-414d-8481-f0f5a8d0a488 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 404 len: 111 microversion: 2.1 time: 0.050381 Oct 12 22:35:48.236717 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 633/1402] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:48 2022] DELETE /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:48.244880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:48.245651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: cee8ff3b-dbb3-4948-914f-43780e1f29a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:48.253069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.253789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.254329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.255132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.255701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.256256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.279696 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] HTTP exception thrown: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Request method failure captured: Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 HTTP/1.1 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Dck4md07l112sxtiRz-z8-kKGObcxM8goJRgR4-UuDMvZ0_4Zduzc6BneJKCpMyE0Z-i6Thx_MQnGnK3Q3Ly09b60DGmoC_a85rOpff2avWAfePuyX_qRjDRN9laTBoMYOpgFKhOkkfzsTIAoNYEd5C4B0nfLKTv4pLZCJ0A8vmgw Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}] Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb2090f18cfb4ea59d153fc62cf208e2 Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'cee8ff3b-dbb3-4948-914f-43780e1f29a1'} Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.281392 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Returning 404 to user: Instance cee8ff3b-dbb3-4948-914f-43780e1f29a1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0169dac7-25f1-4d10-b9c3-1d9e52ad146f tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1" status: 404 len: 111 microversion: 2.1 time: 0.043619 Oct 12 22:35:48.286339 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 634/1403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:48 2022] GET /compute/v2.1/servers/cee8ff3b-dbb3-4948-914f-43780e1f29a1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:48.294422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:48.295166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:48.303173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.304286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.305120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.306114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.306798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.307591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.317271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:48.325710 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-542992b0-f4b3-4da3-8dab-69efa9272d6f tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 200 len: 1471 microversion: 2.1 time: 0.143712 Oct 12 22:35:48.326295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 770/1404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:48 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 1471 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:48.347679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:48.350492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:48.361700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.362646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.363540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.367681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.368423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.369369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.396591 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] HTTP exception thrown: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Request method failure captured: Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 HTTP/1.1 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Dck4md07l112sxtiRz-z8-kKGObcxM8goJRgR4-UuDMvZ0_4Zduzc6BneJKCpMyE0Z-i6Thx_MQnGnK3Q3Ly09b60DGmoC_a85rOpff2avWAfePuyX_qRjDRN9laTBoMYOpgFKhOkkfzsTIAoNYEd5C4B0nfLKTv4pLZCJ0A8vmgw Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}] Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb2090f18cfb4ea59d153fc62cf208e2 Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4423daf1-1a36-44cd-9667-e2ed77444102'} Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:48.398649 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Returning 404 to user: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67690bd6-6e68-4a68-a415-70a951fdff25 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 404 len: 111 microversion: 2.1 time: 0.072841 Oct 12 22:35:48.402927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 771/1405] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:48 2022] DELETE /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:48.410846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:48.411487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] [instance: 4423daf1-1a36-44cd-9667-e2ed77444102] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:48.418499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.418986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.419415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.420133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.420719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.420972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.455926 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] HTTP exception thrown: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Request method failure captured: Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 HTTP/1.1 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Dck4md07l112sxtiRz-z8-kKGObcxM8goJRgR4-UuDMvZ0_4Zduzc6BneJKCpMyE0Z-i6Thx_MQnGnK3Q3Ly09b60DGmoC_a85rOpff2avWAfePuyX_qRjDRN9laTBoMYOpgFKhOkkfzsTIAoNYEd5C4B0nfLKTv4pLZCJ0A8vmgw Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25017cd8ac6040bf9ba0e88a3a9659a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25017cd8ac6040bf9ba0e88a3a9659a8"}]}] Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 25017cd8ac6040bf9ba0e88a3a9659a8 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestMultiNic-1683000353 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb2090f18cfb4ea59d153fc62cf208e2 Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestMultiNic-1683000353-project Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4423daf1-1a36-44cd-9667-e2ed77444102'} Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:48.459377 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] Returning 404 to user: Instance 4423daf1-1a36-44cd-9667-e2ed77444102 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:48.463515 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4351baa-f7dd-4210-9e8d-d063d1140e09 tempest-ServersTestMultiNic-1683000353 tempest-ServersTestMultiNic-1683000353-project] 10.222.0.20 "GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102" status: 404 len: 111 microversion: 2.1 time: 0.056222 Oct 12 22:35:48.465414 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 772/1406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:48 2022] GET /compute/v2.1/servers/4423daf1-1a36-44cd-9667-e2ed77444102 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:48.472298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:48.480675 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d387e03-4c78-463d-b7b1-becc0e928952 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1265 microversion: 2.1 time: 0.192076 Oct 12 22:35:48.501004 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 635/1407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:48 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:48.578057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1d50263b-2af5-44ad-9a3e-5c0913e81ce2 req-b769cd68-fafa-4431-9fcb-dba8dad2b2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc150508-8e7e-4cf2-ba44-53f4895b7bd4", "name": "network-vif-deleted", "tag": "3837cff2-a3bc-4610-8fba-c4e0645e3a54"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:48.595750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1d50263b-2af5-44ad-9a3e-5c0913e81ce2 req-b769cd68-fafa-4431-9fcb-dba8dad2b2ef service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:48.596302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1d50263b-2af5-44ad-9a3e-5c0913e81ce2 req-b769cd68-fafa-4431-9fcb-dba8dad2b2ef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:48.596748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1d50263b-2af5-44ad-9a3e-5c0913e81ce2 req-b769cd68-fafa-4431-9fcb-dba8dad2b2ef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:48.619559 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1d50263b-2af5-44ad-9a3e-5c0913e81ce2 req-b769cd68-fafa-4431-9fcb-dba8dad2b2ef service nova] Creating event network-vif-deleted:3837cff2-a3bc-4610-8fba-c4e0645e3a54 for instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 on n-h1-860864-8 Oct 12 22:35:48.652428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1d50263b-2af5-44ad-9a3e-5c0913e81ce2 req-b769cd68-fafa-4431-9fcb-dba8dad2b2ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077910 Oct 12 22:35:48.665782 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 773/1408] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:49.109261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:49.109876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:49.124909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.125727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.127261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.128251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.128858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.144694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.146539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:49.147276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:49.165969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.166319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.166766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.167483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.167965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.170711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.520366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:49.541440 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5939bf1-399d-4347-9c15-01c6676c7740 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.397170 Oct 12 22:35:49.543841 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 774/1409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:49 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:49.558633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2d7dd06b-e6fa-4b41-a58c-fc0a2cfb6ec1 req-8b2a47d5-c6b6-4ac8-8404-6d739adaf6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd4c8b5-b976-46b1-9c2b-ba296eab2a87", "name": "network-vif-unplugged", "status": "completed", "tag": "d11d2d5a-f1cf-44db-b83d-c0f85b0fb062"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:49.594974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2d7dd06b-e6fa-4b41-a58c-fc0a2cfb6ec1 req-8b2a47d5-c6b6-4ac8-8404-6d739adaf6a3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.597656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2d7dd06b-e6fa-4b41-a58c-fc0a2cfb6ec1 req-8b2a47d5-c6b6-4ac8-8404-6d739adaf6a3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.599183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2d7dd06b-e6fa-4b41-a58c-fc0a2cfb6ec1 req-8b2a47d5-c6b6-4ac8-8404-6d739adaf6a3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.644153 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2d7dd06b-e6fa-4b41-a58c-fc0a2cfb6ec1 req-8b2a47d5-c6b6-4ac8-8404-6d739adaf6a3 service nova] Creating event network-vif-unplugged:d11d2d5a-f1cf-44db-b83d-c0f85b0fb062 for instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 on n-h1-860864-8 Oct 12 22:35:49.657344 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2d7dd06b-e6fa-4b41-a58c-fc0a2cfb6ec1 req-8b2a47d5-c6b6-4ac8-8404-6d739adaf6a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109710 Oct 12 22:35:49.663632 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 775/1410] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:49.677934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:49.678985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: dc150508-8e7e-4cf2-ba44-53f4895b7bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:49.693672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.694947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.695831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.697046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.697954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.698617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] HTTP exception thrown: Instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 could not be found. Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Request method failure captured: Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 HTTP/1.1 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CljnyxR8lWEZrkBGXwx6mf5Jaafa9fqz96RDq0xpLqXfu2-kwbetcXRo4QMxByqcrq1rxtWbTc26CEPPo9JzcLw__ttb3TqLoV7OcvhDKziyj033zLys3Ig6809qUOf61ClR93Q9KYWTxPe3mj2PT6n_DL3WDOVGw_nmR9dgDcMlc Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5702a6d40c344ba590041353935e1513 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesAdminNegativeTest-756596115 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5702a6d40c344ba590041353935e1513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5702a6d40c344ba590041353935e1513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5702a6d40c344ba590041353935e1513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5702a6d40c344ba590041353935e1513"}]}] Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesAdminNegativeTest-756596115 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5702a6d40c344ba590041353935e1513 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-756596115 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesAdminNegativeTest-756596115-project Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7395e893da4d45cc920daf0ac1fc4f72 Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesAdminNegativeTest-756596115-project Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 could not be found. Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'dc150508-8e7e-4cf2-ba44-53f4895b7bd4'} Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 could not be found. Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:35:49.732265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 could not be found. Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 could not be found. Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Returning 404 to user: Instance dc150508-8e7e-4cf2-ba44-53f4895b7bd4 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ef63912-f4d3-49da-beb9-f2024ddc28ec tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4" status: 404 len: 111 microversion: 2.1 time: 0.061686 Oct 12 22:35:49.738574 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 776/1411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:49 2022] GET /compute/v2.1/servers/dc150508-8e7e-4cf2-ba44-53f4895b7bd4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:35:49.758515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:49.760696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:49.773332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.775908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.776874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.778122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:49.779533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:49.781285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:49.916725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:49.932953 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc1d692a-ebae-4a59-b693-486ff9c0b35e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1520 microversion: 2.1 time: 0.827493 Oct 12 22:35:49.935336 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 636/1412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:49 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1520 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:50.239577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:50.250090 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3178108a-6610-4704-ab9c-4d1e34be8b3e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 0.500036 Oct 12 22:35:50.251838 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 777/1413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:49 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:50.567755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:50.568509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:50.591997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:50.597623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:50.598240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:50.601579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:50.602238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:50.602751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:50.958567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:50.959877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:50.974410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:50.976131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:50.977873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:50.980965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:50.983930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:50.984396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:51.268830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:51.279165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4fd3f38c-45a4-4586-acc4-e6156848295b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.715768 Oct 12 22:35:51.311924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 637/1414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:50 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:51.311924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:51.311924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:51.336001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:51.336601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:51.337045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:51.337759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:51.341728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:51.344792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:51.779936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:51.799571 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a23d81c-d2c8-46d8-9c21-5525c9c5f6d2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1520 microversion: 2.1 time: 0.843373 Oct 12 22:35:51.801010 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 778/1415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:50 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1520 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:51.836707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ff03b374-35e1-4e06-916c-76646d5dab15 req-c53b6a40-4fc2-4411-9c84-65c3ebbdefc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd4c8b5-b976-46b1-9c2b-ba296eab2a87", "name": "network-vif-plugged", "status": "completed", "tag": "d11d2d5a-f1cf-44db-b83d-c0f85b0fb062"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:51.865619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ff03b374-35e1-4e06-916c-76646d5dab15 req-c53b6a40-4fc2-4411-9c84-65c3ebbdefc6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:51.866111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ff03b374-35e1-4e06-916c-76646d5dab15 req-c53b6a40-4fc2-4411-9c84-65c3ebbdefc6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:51.866525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ff03b374-35e1-4e06-916c-76646d5dab15 req-c53b6a40-4fc2-4411-9c84-65c3ebbdefc6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:51.895364 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ff03b374-35e1-4e06-916c-76646d5dab15 req-c53b6a40-4fc2-4411-9c84-65c3ebbdefc6 service nova] Creating event network-vif-plugged:d11d2d5a-f1cf-44db-b83d-c0f85b0fb062 for instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 on n-h1-860864-8 Oct 12 22:35:51.905508 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ff03b374-35e1-4e06-916c-76646d5dab15 req-c53b6a40-4fc2-4411-9c84-65c3ebbdefc6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103065 Oct 12 22:35:51.907429 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 779/1416] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:52.332481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:52.333186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:52.343300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:52.343777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:52.366693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:52.367495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:52.368008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:52.368447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:52.889450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:52.900428 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d52d5a37-9ef6-41d4-b780-5387e0db22b3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 1.597665 Oct 12 22:35:52.901425 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 638/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:51 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:52.914849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:52.915765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:52.953797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:52.958305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:52.961175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:52.961848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:52.962780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:52.964658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:52.965210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:53.106944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:53.132934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:53.499768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:53.514095 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8bc72559-5611-4eb9-88d9-65b4da5774e6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 1.186992 Oct 12 22:35:53.535390 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 780/1418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:52 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:53.630750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:53.696180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:53.705704 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-28f4ef2c-9f9f-4443-8755-a2ddaf5909a1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1520 microversion: 2.1 time: 0.802491 Oct 12 22:35:53.706285 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 639/1419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:52 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1520 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:53.745033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-420d8c96-070a-489e-b616-32d2d6b2b9b5 req-9b2d12a0-1654-4d55-a4e8-7573f1e22544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7f70c3-9232-4994-b238-9556a5739b11", "tag": "7d427587-2e7a-42dd-8652-a6e2f4d05bcc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:53.770500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-420d8c96-070a-489e-b616-32d2d6b2b9b5 req-9b2d12a0-1654-4d55-a4e8-7573f1e22544 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:53.771166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-420d8c96-070a-489e-b616-32d2d6b2b9b5 req-9b2d12a0-1654-4d55-a4e8-7573f1e22544 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:53.771743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-420d8c96-070a-489e-b616-32d2d6b2b9b5 req-9b2d12a0-1654-4d55-a4e8-7573f1e22544 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:53.791836 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-420d8c96-070a-489e-b616-32d2d6b2b9b5 req-9b2d12a0-1654-4d55-a4e8-7573f1e22544 service nova] Creating event network-changed:7d427587-2e7a-42dd-8652-a6e2f4d05bcc for instance 7d7f70c3-9232-4994-b238-9556a5739b11 on n-h2-860864-8 Oct 12 22:35:53.812516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-420d8c96-070a-489e-b616-32d2d6b2b9b5 req-9b2d12a0-1654-4d55-a4e8-7573f1e22544 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275272 Oct 12 22:35:53.813414 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 781/1420] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:53.886337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56268d40-2452-45a4-b6cd-fd0c0e44fa91 tempest-ListImagesTestJSON-915742742 tempest-ListImagesTestJSON-915742742-project] Calling method '.version_select at 0x7f44ff60b280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:53.931830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:53.932661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:53.952435 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56268d40-2452-45a4-b6cd-fd0c0e44fa91 tempest-ListImagesTestJSON-915742742 tempest-ListImagesTestJSON-915742742-project] 10.222.0.20 "GET /compute/v2.1/images/d8a76847-f2a3-4e2c-96d3-13bb62ec0d50" status: 200 len: 784 microversion: 2.1 time: 0.233505 Oct 12 22:35:53.952999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:53.954055 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 640/1421] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:35:53 2022] GET /compute/v2.1/images/d8a76847-f2a3-4e2c-96d3-13bb62ec0d50 => generated 784 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:53.957278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:53.957998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:53.960390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:53.961024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:53.962321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:53.975739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ee86938-7c71-4c46-90fd-4cdee7f1eb5f tempest-ListImagesTestJSON-915742742 tempest-ListImagesTestJSON-915742742-project] Calling method '.version_select at 0x7f44ff64b3a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:54.144121 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ee86938-7c71-4c46-90fd-4cdee7f1eb5f tempest-ListImagesTestJSON-915742742 tempest-ListImagesTestJSON-915742742-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.178838 Oct 12 22:35:54.146223 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 641/1422] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Oct 12 22:35:53 2022] GET /compute/v2.1/images => generated 445 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:35:54.158757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b36ea6a6-eb14-4340-8923-2c33e0e39f14 tempest-ListImagesTestJSON-915742742 tempest-ListImagesTestJSON-915742742-project] Calling method '.version_select at 0x7f44ff64b790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:54.233667 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b36ea6a6-eb14-4340-8923-2c33e0e39f14 tempest-ListImagesTestJSON-915742742 tempest-ListImagesTestJSON-915742742-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.079855 Oct 12 22:35:54.243864 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 642/1423] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:35:54 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:35:54.321052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:54.331265 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e2c4998-cfe3-46df-b757-29aa247df575 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 0.401783 Oct 12 22:35:54.331942 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 782/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:53 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:54.541741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:54.542280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:54.556705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:54.557206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:54.557646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:54.558367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:54.558815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:54.569611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:54.730829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:54.732267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:54.752565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:54.753256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:54.754035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:54.764302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:54.771471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:54.772238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:55.273403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:55.286459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62769fa9-d838-4ad0-b356-47770b8f839f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.746336 Oct 12 22:35:55.293010 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 643/1425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:54 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:55.361789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:55.362997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:55.372816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:55.377322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:55.378107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:55.379088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:55.379761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:55.380457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:55.886618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:55.895030 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5426420c-df46-4c1a-a928-8d296c9e0904 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 0.540735 Oct 12 22:35:55.898458 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 644/1426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:55 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:56.064278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:56.077208 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f8688ed-c3f2-4bad-9693-1383c3859db4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1505 microversion: 2.1 time: 1.351148 Oct 12 22:35:56.082945 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 783/1427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:54 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1505 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:56.111724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:56.112915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:56.132225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:56.133841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:56.140223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:56.142693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:56.149038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:56.150872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:56.319370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:56.320260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:56.328731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:56.329555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:56.330165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:56.331230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:56.331919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:56.332602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:56.592905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:56.613713 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a60c1a13-8d8b-4544-8ca5-750374582496 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.295576 Oct 12 22:35:56.617000 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 784/1428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:56 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:35:56.790882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:56.791553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:56.817428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:56.819691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:56.820486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:56.822177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:56.824613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:56.825707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:56.927582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:35:57.074528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:35:57.176607 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85513a23-060a-487a-bf45-11b2afea5845 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 204 len: 0 microversion: 2.1 time: 0.390215 Oct 12 22:35:57.177201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 785/1429] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:56 2022] DELETE /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:35:57.182873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:57.186010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:57.202140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.204080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.205413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.208474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.208942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.209371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.497845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:57.505136 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad34d068-b17c-49e7-9667-29f1360a33db tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 0.326100 Oct 12 22:35:57.505780 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 786/1430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:57 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:57.537264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:57.538487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:57.549525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.552419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.554137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.555336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.556164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.556798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.587278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:57.603418 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b06fbbe0-767c-4a41-b8f5-88bb18e8387d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 200 len: 1505 microversion: 2.1 time: 1.496323 Oct 12 22:35:57.605996 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 645/1431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:56 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 1505 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:57.633285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:57.636630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:57.652272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.655283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.656135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.663377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.664208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.665900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.729787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:35:57.792314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:57.803321 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-51db0396-2a04-4b99-ab38-632cdac2d396 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1681 microversion: 2.1 time: 0.277805 Oct 12 22:35:57.804840 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 787/1432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:57 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:57.810598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:57.811507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:57.821225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.822055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.823203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.824341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:57.825188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:57.826262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:57.930939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-587dd885-19b9-4d29-8a05-356d068996e8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 204 len: 0 microversion: 2.1 time: 0.305164 Oct 12 22:35:57.932537 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 646/1433] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:35:57 2022] DELETE /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:35:58.115987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:58.126035 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b6fe0ed-5808-4b25-a1df-655a2d9c224e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.319736 Oct 12 22:35:58.127326 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 788/1434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:57 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:58.176908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1182351406", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4c3491cd-4fc1-4799-8217-febe742dd336"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:35:58.280671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] validate_networks() for [('4c3491cd-4fc1-4799-8217-febe742dd336', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:35:58.542334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:58.544731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:58.564774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:58.565433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:58.567610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:58.569630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:58.572087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:58.572935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:59.063119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:59.075541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4cf47a30-571c-485a-b081-a3c5fc661b34 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 0.542164 Oct 12 22:35:59.096718 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 789/1435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:58 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:59.116260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:59.120677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:59.134582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:59.135483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:59.136308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:59.138132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:59.140456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:59.141562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:59.433375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:59.443432 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4fca164-867e-4751-a291-ff5339720e0d tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1681 microversion: 2.1 time: 0.345558 Oct 12 22:35:59.444060 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 790/1436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:59 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1681 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:35:59.462346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:35:59.462959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:35:59.471673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:59.472234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:59.472662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:59.473362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:35:59.484643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:35:59.485131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:35:59.919161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:35:59.934863 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e4ab736-c465-4b96-a43f-77904fab32f1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.489768 Oct 12 22:35:59.935814 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 791/1437] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:35:59 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:00.103874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:00.104785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:00.120569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:00.121691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:00.122406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:00.123290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:00.123935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:00.124520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:00.182003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:00.182522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:00.183297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:00.183814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:00.184373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:00.215777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:00.216490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:00.217972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:00.218986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:00.220240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:00.221699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:00.258165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Getting quotas for project 84e58572633e42409a75c58f484b4d66. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:36:00.263992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Getting quotas for user a9d084d9f8b2417ab66fee6c29ee592d and project 84e58572633e42409a75c58f484b4d66. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:36:00.295006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:36:00.298039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:00.400087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4906250f-ec60-40f7-bf87-c82a389b856f tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227989 Oct 12 22:36:00.401339 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 647/1438] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:36:00.414873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b28b2959-11a3-49b4-8665-3401617e318a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:00.415497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b28b2959-11a3-49b4-8665-3401617e318a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:00.704577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:00.716579 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4be05ed-c69c-40f6-8c69-df3bbc53092f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 0.616432 Oct 12 22:36:00.717213 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 792/1439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:00 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:00.726336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:00.727627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:00.749837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:00.751638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:00.752276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:00.771118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:00.774846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:00.775728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:01.269549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:01.281106 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-419c1256-86bc-41c0-a34c-57393ea66dcf tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1681 microversion: 2.1 time: 0.562243 Oct 12 22:36:01.283021 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 793/1440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:00 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1681 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:01.288592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8f39bf99-1aa3-4fcf-bc4c-2bdc390f8820 req-52ecc89b-55d3-48d9-a691-6fe7d765b615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7f70c3-9232-4994-b238-9556a5739b11", "name": "network-vif-plugged", "status": "completed", "tag": "7d427587-2e7a-42dd-8652-a6e2f4d05bcc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:01.299527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8f39bf99-1aa3-4fcf-bc4c-2bdc390f8820 req-52ecc89b-55d3-48d9-a691-6fe7d765b615 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:01.301321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8f39bf99-1aa3-4fcf-bc4c-2bdc390f8820 req-52ecc89b-55d3-48d9-a691-6fe7d765b615 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:01.301967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8f39bf99-1aa3-4fcf-bc4c-2bdc390f8820 req-52ecc89b-55d3-48d9-a691-6fe7d765b615 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:01.338188 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8f39bf99-1aa3-4fcf-bc4c-2bdc390f8820 req-52ecc89b-55d3-48d9-a691-6fe7d765b615 service nova] Creating event network-vif-plugged:7d427587-2e7a-42dd-8652-a6e2f4d05bcc for instance 7d7f70c3-9232-4994-b238-9556a5739b11 on n-h2-860864-8 Oct 12 22:36:01.352493 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8f39bf99-1aa3-4fcf-bc4c-2bdc390f8820 req-52ecc89b-55d3-48d9-a691-6fe7d765b615 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066371 Oct 12 22:36:01.353521 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 794/1441] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:01.385895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:01.386837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:01.397830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:01.399571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:01.400480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:01.402157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:01.403020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:01.405469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:01.536170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b28b2959-11a3-49b4-8665-3401617e318a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:01.550613 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b28b2959-11a3-49b4-8665-3401617e318a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1218 microversion: 2.1 time: 1.141721 Oct 12 22:36:01.553801 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 648/1442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:00 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1218 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:01.742682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:01.743985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:01.770692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:01.771690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:01.772571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:01.774727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:01.775368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:01.776028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:02.072175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:02.122525 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-751a789a-318e-4bc6-8d90-239f0c3d5ec3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.743881 Oct 12 22:36:02.130458 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 795/1443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:01 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:02.227673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:02.244411 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d03537d3-59a3-4020-8ee3-08ba847d734d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1307 microversion: 2.1 time: 0.506756 Oct 12 22:36:02.245411 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 649/1444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:01 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1307 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:02.309033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:02.310571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:02.324192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:02.327770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:02.329132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:02.330191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:02.331034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:02.332020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:02.499667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:02.519283 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-15726b1e-3e73-4001-bb4f-645c0df0d3d0 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1613 microversion: 2.1 time: 0.208618 Oct 12 22:36:02.519283 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 796/1445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:02 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1613 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:02.580585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:02.581561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:02.594791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:02.598810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:02.600350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:02.603257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:02.607197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:02.608846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:02.909896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:02.925871 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-83ac6568-7a61-4645-8f5a-fa30c7b9d435 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1288 microversion: 2.1 time: 0.344209 Oct 12 22:36:02.926655 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 650/1446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:02 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1288 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:02.945663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4d4a78da-9677-4adc-a82f-9e471013801a req-51b632f3-79e2-4290-83b5-1b78148d1b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd4c8b5-b976-46b1-9c2b-ba296eab2a87", "name": "network-vif-deleted", "tag": "d11d2d5a-f1cf-44db-b83d-c0f85b0fb062"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:03.004867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d4a78da-9677-4adc-a82f-9e471013801a req-51b632f3-79e2-4290-83b5-1b78148d1b8a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.012002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d4a78da-9677-4adc-a82f-9e471013801a req-51b632f3-79e2-4290-83b5-1b78148d1b8a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.014261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d4a78da-9677-4adc-a82f-9e471013801a req-51b632f3-79e2-4290-83b5-1b78148d1b8a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.096572 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4d4a78da-9677-4adc-a82f-9e471013801a req-51b632f3-79e2-4290-83b5-1b78148d1b8a service nova] Creating event network-vif-deleted:d11d2d5a-f1cf-44db-b83d-c0f85b0fb062 for instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 on n-h1-860864-8 Oct 12 22:36:03.119737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4d4a78da-9677-4adc-a82f-9e471013801a req-51b632f3-79e2-4290-83b5-1b78148d1b8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174816 Oct 12 22:36:03.126214 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 797/1447] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:03.154944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:03.155771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:03.169525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.183734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.184516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.185518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.191040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.191582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.269884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:03.270558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:03.280680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.288633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.289460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.290509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.291074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.291605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.659042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:03.673262 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8191b4a3-a4c7-47fb-8f55-a272ca77411c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.522287 Oct 12 22:36:03.673873 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 651/1448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:03 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:03.681636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-bb8d200d-ae7d-4f5a-86c5-cd13f57cc782 req-4b084bec-f727-44ca-83ce-2437987b2302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac10978f-f42f-41b4-964a-48ba3b4e9a0c", "name": "network-vif-deleted", "tag": "aeab41ad-531d-4ca9-9c21-bac6f8fd4e29"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:03.705337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bb8d200d-ae7d-4f5a-86c5-cd13f57cc782 req-4b084bec-f727-44ca-83ce-2437987b2302 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.707339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bb8d200d-ae7d-4f5a-86c5-cd13f57cc782 req-4b084bec-f727-44ca-83ce-2437987b2302 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.707958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bb8d200d-ae7d-4f5a-86c5-cd13f57cc782 req-4b084bec-f727-44ca-83ce-2437987b2302 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.736345 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-bb8d200d-ae7d-4f5a-86c5-cd13f57cc782 req-4b084bec-f727-44ca-83ce-2437987b2302 service nova] Creating event network-vif-deleted:aeab41ad-531d-4ca9-9c21-bac6f8fd4e29 for instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c on n-h1-860864-8 Oct 12 22:36:03.747799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-bb8d200d-ae7d-4f5a-86c5-cd13f57cc782 req-4b084bec-f727-44ca-83ce-2437987b2302 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072504 Oct 12 22:36:03.752977 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 652/1449] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:03.771244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:03.775483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:03.793927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.794672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.795491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.803418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.803945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.804888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.857301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:03.858172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:03.858816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:03.859445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lazy-loading 'fault' on Instance uuid ac10978f-f42f-41b4-964a-48ba3b4e9a0c {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:36:03.865615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:04.059583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7395e893da4d45cc920daf0ac1fc4f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702a6d40c344ba590041353935e1513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:04.071430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4341a762-e40f-42c0-9d8a-d5f7fcd7e988 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 200 len: 1332 microversion: 2.1 time: 0.307684 Oct 12 22:36:04.073579 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 653/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:03 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 1332 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:04.092743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:04.093654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:04.102336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:04.108062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.109785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.110776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.111883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.113248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.113929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.117327 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8710a6cf-d9f3-48ad-9a62-8df2623e45ad tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1487 microversion: 2.1 time: 0.851280 Oct 12 22:36:04.120402 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 798/1451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:03 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1487 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:04.146566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:04.148079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:04.159364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.160251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.161110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.162199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.162796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.163424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.305426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebdeeed6-4d45-41b8-b196-2e2e266c265f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11/action" status: 202 len: 0 microversion: 2.1 time: 0.165808 Oct 12 22:36:04.307571 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 799/1452] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:36:04 2022] POST /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:36:04.337866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:04.339796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:04.374245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.375156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.378490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.381510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.383527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.384537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.519933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:04.542357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ed9c5d3-2e0d-4c6d-9a53-e6b48170a812 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1276 microversion: 2.1 time: 0.467359 Oct 12 22:36:04.568263 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 654/1453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:04 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1276 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:04.705179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:04.707066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:04.726605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.728668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.729846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.749115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:04.752555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:04.753629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:04.979465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:04.992784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ecdfdf27-a301-4d6f-a10c-4fc8405db412 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1492 microversion: 2.1 time: 0.679740 Oct 12 22:36:04.994357 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 800/1454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:04 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1492 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:05.097472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:05.098310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] [instance: ac10978f-f42f-41b4-964a-48ba3b4e9a0c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:05.112261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:05.112887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:05.113224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:05.113970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:05.114429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:05.114855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:05.155938 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] HTTP exception thrown: Instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c could not be found. Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Request method failure captured: Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c HTTP/1.1 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0CljnyxR8lWEZrkBGXwx6mf5Jaafa9fqz96RDq0xpLqXfu2-kwbetcXRo4QMxByqcrq1rxtWbTc26CEPPo9JzcLw__ttb3TqLoV7OcvhDKziyj033zLys3Ig6809qUOf61ClR93Q9KYWTxPe3mj2PT6n_DL3WDOVGw_nmR9dgDcMlc Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5702a6d40c344ba590041353935e1513 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesAdminNegativeTest-756596115 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5702a6d40c344ba590041353935e1513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5702a6d40c344ba590041353935e1513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5702a6d40c344ba590041353935e1513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5702a6d40c344ba590041353935e1513"}]}] Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesAdminNegativeTest-756596115 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5702a6d40c344ba590041353935e1513 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-756596115 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesAdminNegativeTest-756596115-project Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7395e893da4d45cc920daf0ac1fc4f72 Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesAdminNegativeTest-756596115-project Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c could not be found. Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ac10978f-f42f-41b4-964a-48ba3b4e9a0c'} Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c could not be found. Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c could not be found. Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:05.160259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c could not be found. Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Returning 404 to user: Instance ac10978f-f42f-41b4-964a-48ba3b4e9a0c could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:05.164781 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c7525e00-ce81-41ea-b9be-15a727a0eb48 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c" status: 404 len: 111 microversion: 2.1 time: 0.069491 Oct 12 22:36:05.166205 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 801/1455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:05 2022] GET /compute/v2.1/servers/ac10978f-f42f-41b4-964a-48ba3b4e9a0c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:36:05.180606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-932e0b5f-ea00-49a1-8ac6-0644c828e225 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] Calling method '.version_select at 0x7f44ffbae040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:05.193728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:05.207681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d9d9ded-d606-4a2f-a2fd-1f6756283baf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1715 microversion: 2.1 time: 0.509599 Oct 12 22:36:05.211658 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 655/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:04 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1715 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:05.245857 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-932e0b5f-ea00-49a1-8ac6-0644c828e225 tempest-VolumesAdminNegativeTest-756596115 tempest-VolumesAdminNegativeTest-756596115-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057500955" status: 202 len: 0 microversion: 2.1 time: 0.078095 Oct 12 22:36:05.247577 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 802/1457] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:36:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057500955 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:05.411278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1207126382", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5db0f38e-eee3-4a98-9554-12cc124c1fa6"}], "block_device_mapping_v2": [{"uuid": "47a4f9c1-940c-4cab-b5bd-52ddbb70c6f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:05.537613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] validate_networks() for [('5db0f38e-eee3-4a98-9554-12cc124c1fa6', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:36:05.574678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:05.575729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:05.589461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:05.590215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:05.590848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:05.591777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:05.592248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:05.592656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:06.664431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:06.674801 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f00840a4-580a-4a5f-b9fe-e83deb64df7d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 1.103973 Oct 12 22:36:06.689022 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 803/1458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:05 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:06.712932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:06.714126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:06.730000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:06.733579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:06.734251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:06.735180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:06.736422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:06.738028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:06.750612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:07.694522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:07.710627 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74a3c281-bc46-4cd2-9b0c-5c79c52bfc99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 200 len: 1472 microversion: 2.1 time: 1.020111 Oct 12 22:36:07.716077 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 804/1459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:06 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 1472 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:07.732348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:07.736473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:07.760199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:07.760697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:07.761135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:07.761846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:07.762299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:07.762726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.277719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:08.289233 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47202872-1566-470d-861e-f12ea5389286 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1705 microversion: 2.1 time: 0.565507 Oct 12 22:36:08.292999 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 805/1460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:07 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1705 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:08.317290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:08.319873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:08.328027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:08.329317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:08.329969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.330756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:08.331313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:08.332492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.444666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:08.445201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:08.445738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:08.446273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:08.447139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:08.463463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:08.464282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:08.464801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.468306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:08.469841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:08.470546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.524345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:36:08.532699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Getting quotas for user 03a180537b9149b1bf4250bc9965bb7b and project accb9cc4a17842af84b0002428db16d8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:36:08.657196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:36:08.659320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47a4f9c1-940c-4cab-b5bd-52ddbb70c6f5',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:08.860331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:08.873570 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f743f112-cf57-414b-ba2d-a6ad8f366f47 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.578792 Oct 12 22:36:08.874443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 806/1461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:08 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:08.887639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-157294050"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:08.893920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:08.911480 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f937710-094f-4b7b-bd25-db65f15da36d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.503518 Oct 12 22:36:08.914145 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 656/1462] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:36:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3508 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:36:08.928153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-804d014e-f8d1-4b66-a533-d5f4a9495c9e tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '.version_select at 0x7f44ffefc280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:08.928742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:08.929358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:08.929917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.942704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:08.948682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d014e-f8d1-4b66-a533-d5f4a9495c9e tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:08.949256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:08.951197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.958292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d014e-f8d1-4b66-a533-d5f4a9495c9e tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:08.959261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-804d014e-f8d1-4b66-a533-d5f4a9495c9e tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:08.982865 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-804d014e-f8d1-4b66-a533-d5f4a9495c9e tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2320 microversion: 2.1 time: 0.059437 Oct 12 22:36:08.986545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 657/1463] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:36:08 2022] GET /compute/v2.1/os-migrations => generated 2320 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:09.000836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b37d0c05-a840-4dc5-b6ab-ebb57227a93c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:09.003226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b37d0c05-a840-4dc5-b6ab-ebb57227a93c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:09.192171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b37d0c05-a840-4dc5-b6ab-ebb57227a93c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:09.210786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b37d0c05-a840-4dc5-b6ab-ebb57227a93c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:09.225144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b37d0c05-a840-4dc5-b6ab-ebb57227a93c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:09.239492 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b37d0c05-a840-4dc5-b6ab-ebb57227a93c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1104 microversion: 2.25 time: 0.236777 Oct 12 22:36:09.243525 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 658/1464] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:08 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1104 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:09.275775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:09.276635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:09.302011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:09.303650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:09.304426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:09.307560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:09.321465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:09.325306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:09.442951 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-705d2983-481b-4e57-9aff-f52f1ffc8e70 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11/action" status: 202 len: 0 microversion: 2.1 time: 0.557448 Oct 12 22:36:09.444272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 807/1465] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:36:08 2022] POST /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:36:09.454002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fb597a35-232f-4bd4-b9ee-dc13f4ac7f05 req-78de9fc1-fb59-4225-9ba0-5249f912568a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c64bc5-a5d4-40b0-924c-87e882136445", "tag": "1efd6f5c-18bf-4caa-8ca3-34c24ab3d040"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:09.509014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fb597a35-232f-4bd4-b9ee-dc13f4ac7f05 req-78de9fc1-fb59-4225-9ba0-5249f912568a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:09.509490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fb597a35-232f-4bd4-b9ee-dc13f4ac7f05 req-78de9fc1-fb59-4225-9ba0-5249f912568a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:09.514969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fb597a35-232f-4bd4-b9ee-dc13f4ac7f05 req-78de9fc1-fb59-4225-9ba0-5249f912568a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:09.553542 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fb597a35-232f-4bd4-b9ee-dc13f4ac7f05 req-78de9fc1-fb59-4225-9ba0-5249f912568a service nova] Creating event network-changed:1efd6f5c-18bf-4caa-8ca3-34c24ab3d040 for instance 28c64bc5-a5d4-40b0-924c-87e882136445 on n-h1-860864-8 Oct 12 22:36:09.568386 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fb597a35-232f-4bd4-b9ee-dc13f4ac7f05 req-78de9fc1-fb59-4225-9ba0-5249f912568a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122446 Oct 12 22:36:09.572581 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 808/1466] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:09.585307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52b2e9a7-3e80-4bcb-af73-a1f16d2cfb35 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4809d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:09.656565 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52b2e9a7-3e80-4bcb-af73-a1f16d2cfb35 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.082041 Oct 12 22:36:09.661134 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 809/1467] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:09 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:09.736452 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8b4402e-6a6f-4041-8467-bff7abdc1363 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1856 microversion: 2.1 time: 0.470316 Oct 12 22:36:09.738808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 659/1468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:09 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1856 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:09.761901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:09.763532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:09.775342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:09.776347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:09.777016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:09.777982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:09.778704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:09.779393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:09.897270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:09.900301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:09.935222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:09.938404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:09.940670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:09.942027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:09.948328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:09.949697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:10.172715 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4b0061c-113b-4ce8-9a30-7081e63a017f tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1856 microversion: 2.1 time: 0.407593 Oct 12 22:36:10.174186 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 810/1469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:09 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1856 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:10.268511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:10.269488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:10.281917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:10.288039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:10.290118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:10.292806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:10.293590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:10.295370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:10.477836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:10.494414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:10.496608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:10.497878 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eaf8e7a7-340a-4c16-a486-cfb74eb18104 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1233 microversion: 2.25 time: 0.233795 Oct 12 22:36:10.500422 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 811/1470] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:10 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1233 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:36:10.512687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:10.517601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:10.538579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:10.547022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:10.547615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:10.548527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:10.549121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:10.549655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:10.634409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:10.651555 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e592d8b-e672-48ef-a303-a641642aecd2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.758483 Oct 12 22:36:10.653842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 660/1471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:09 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:10.675233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c0a758c-16f2-47d6-810a-cf19a9f469a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff6df310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:10.727244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lazy-loading 'services' on Instance uuid 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:36:10.787523 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c0a758c-16f2-47d6-810a-cf19a9f469a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.117476 Oct 12 22:36:10.796945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 661/1472] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:10 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:10.922849 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8791b53a-ca30-47c7-bee2-4c97fb0c889a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments/4c719740-98ef-4df5-bfbd-e6ad74cb81f5" status: 202 len: 0 microversion: 2.1 time: 0.413866 Oct 12 22:36:10.924899 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 812/1473] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 22:36:10 2022] DELETE /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments/4c719740-98ef-4df5-bfbd-e6ad74cb81f5 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:10.947962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:10.950240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:10.979790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:10.980338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:10.981027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:10.987145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:11.000469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:11.002757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:11.101090 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be24d76b-50b1-4b57-b779-0815b5dd480e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172852 Oct 12 22:36:11.102503 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 662/1474] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:10 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:11.532018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:11.533428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:11.549662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:11.550462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:11.552493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:11.553935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:11.556785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:11.557464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:11.680603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:11.681628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:11.692239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:11.694503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:11.695195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:11.697926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:11.698729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:11.699468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:11.848659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:11.872433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:11.878976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:11.881121 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38eb516e-ba53-45b2-92da-add5bc3349a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1251 microversion: 2.25 time: 0.354299 Oct 12 22:36:11.886720 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 813/1475] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:11 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1251 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:11.914654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f60dd741-95e8-4d37-bc8f-4de2d6f0cf82 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff470310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:12.004195 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f60dd741-95e8-4d37-bc8f-4de2d6f0cf82 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.098638 Oct 12 22:36:12.006192 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 814/1476] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:11 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:12.078719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:12.088121 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5eee465e-91aa-4406-ad6a-b819ab78da1d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.411967 Oct 12 22:36:12.115182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 663/1477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:11 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:12.121733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:12.124167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:12.136558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:12.141526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:12.142178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:12.143092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:12.143708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:12.144315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:12.240967 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-000cc601-fe79-4008-b172-508da3d27f3a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124404 Oct 12 22:36:12.241557 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 815/1478] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:12 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:36:12.920960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:12.922145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:12.933347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:12.940592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:12.941039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:12.942386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:12.944016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:12.946311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:13.022073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db80eb81-4651-459a-8a5f-63dd512cb5a4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff447e50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:13.116643 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db80eb81-4651-459a-8a5f-63dd512cb5a4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.098868 Oct 12 22:36:13.117563 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 816/1479] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:13 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:13.130686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:13.131453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:13.151922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:13.152409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:13.152848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:13.153561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:13.154012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:13.154435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:13.162060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:13.179317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:13.184574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:13.188718 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23299898-37ce-4ebf-b8e2-e7c7216a766f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1251 microversion: 2.25 time: 0.274722 Oct 12 22:36:13.205048 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 664/1480] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:12 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1251 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:13.253850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:13.256177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:13.268286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:13.268794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:13.269232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:13.269943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:13.270397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:13.270813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:13.353288 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-231799b5-f68a-483e-93ad-bce2212a0d9a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103667 Oct 12 22:36:13.361456 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 665/1481] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:13 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:13.789346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f8c90ee-a0c8-4cfa-aa44-d4b937a4b801 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff6e7790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1320642076", "description": "tempest-description-1857762301"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:14.074738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:14.087829 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7e123651-3aca-49f2-9376-0edb177a29e1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.960337 Oct 12 22:36:14.088625 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 817/1482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:13 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:14.137733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-63ebf709-517a-44a4-964c-896f3133b43e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff470310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:14.223784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-63ebf709-517a-44a4-964c-896f3133b43e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.090210 Oct 12 22:36:14.232197 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 818/1483] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:14 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:14.252393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:14.253021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:14.281973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:14.285117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:14.288578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:14.291356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:14.293439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:14.293857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:14.302954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:14.533757 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f8c90ee-a0c8-4cfa-aa44-d4b937a4b801 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.104558 Oct 12 22:36:14.536090 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 666/1484] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:36:13 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:14.560364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:14.571377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:14.608027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:14.610011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:14.610665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:14.613294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:14.615368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:14.619292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:14.672503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:14.689372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:14.698673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:14.706530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-477072f9-02d3-482b-9834-7b3e0a219564 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1251 microversion: 2.25 time: 0.472286 Oct 12 22:36:14.721815 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 819/1485] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:14 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1251 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:14.745282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9e144bd-59f6-405d-a9c0-15f13471afdb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff4aa0d0>, body: {"security_group_rule": {"parent_group_id": "d8cbc603-240d-4500-b971-79248fe15b60", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:14.778075 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d533dc55-4885-425e-b4aa-ba6218419e75 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226377 Oct 12 22:36:14.800856 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 667/1486] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:14 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:15.119759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:15.123426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:15.135545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:15.140326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:15.142055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:15.147020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:15.147950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:15.148748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:15.804224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:15.830646 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6356615-c2da-4d03-a78f-a568e885b095 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.703686 Oct 12 22:36:15.831494 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 668/1487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:15 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:15.860108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6fba5d52-3149-4541-bf5e-18bde38663e6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff769ee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:16.109970 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9e144bd-59f6-405d-a9c0-15f13471afdb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.375197 Oct 12 22:36:16.112098 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 820/1488] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:16.118187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:16.119047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:16.159061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:16.170390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:16.173537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:16.178236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:16.181429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:16.186711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:16.586016 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6fba5d52-3149-4541-bf5e-18bde38663e6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.752960 Oct 12 22:36:16.586735 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 669/1489] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:15 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:16.586985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:16.596886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:16.605589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:16.607037 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9910dfff-7c4d-403d-b699-c52624af8a96 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1251 microversion: 2.25 time: 0.492688 Oct 12 22:36:16.610725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:16.614919 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 821/1490] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:16 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1251 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:16.617390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:16.649739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:16.658388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:16.663374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:16.664318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:16.665058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:16.665754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:16.810394 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd3e46d0-d1c4-41df-94e5-fc94fd429e27 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221610 Oct 12 22:36:16.812766 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 670/1491] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:16 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:16.820669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca91ef66-2d21-4785-898c-c4d8ecb34593 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff7afee0>, body: {"security_group_rule": {"parent_group_id": "d8cbc603-240d-4500-b971-79248fe15b60", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:16.998704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a4394ec3-2531-4bc3-9ba2-cddc29d7a5d7 req-fb598809-b27b-4a66-9b9d-d020a70f4241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7f70c3-9232-4994-b238-9556a5739b11", "name": "network-vif-plugged", "status": "completed", "tag": "7d427587-2e7a-42dd-8652-a6e2f4d05bcc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:17.030320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4394ec3-2531-4bc3-9ba2-cddc29d7a5d7 req-fb598809-b27b-4a66-9b9d-d020a70f4241 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:17.032215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4394ec3-2531-4bc3-9ba2-cddc29d7a5d7 req-fb598809-b27b-4a66-9b9d-d020a70f4241 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:17.034784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4394ec3-2531-4bc3-9ba2-cddc29d7a5d7 req-fb598809-b27b-4a66-9b9d-d020a70f4241 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:17.097476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a4394ec3-2531-4bc3-9ba2-cddc29d7a5d7 req-fb598809-b27b-4a66-9b9d-d020a70f4241 service nova] Creating event network-vif-plugged:7d427587-2e7a-42dd-8652-a6e2f4d05bcc for instance 7d7f70c3-9232-4994-b238-9556a5739b11 on n-h2-860864-8 Oct 12 22:36:17.112597 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a4394ec3-2531-4bc3-9ba2-cddc29d7a5d7 req-fb598809-b27b-4a66-9b9d-d020a70f4241 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.491472 Oct 12 22:36:17.113276 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 822/1492] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:17.130127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:17.132763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:17.151659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:17.153067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:17.153690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:17.154857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:17.157153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:17.159034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:17.890944 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ca91ef66-2d21-4785-898c-c4d8ecb34593 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: This rule already exists in group d8cbc603-240d-4500-b971-79248fe15b60 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca91ef66-2d21-4785-898c-c4d8ecb34593 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 138 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: {"security_group_rule": {"parent_group_id": "d8cbc603-240d-4500-b971-79248fe15b60", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: exception: This rule already exists in group d8cbc603-240d-4500-b971-79248fe15b60 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd8cbc603-240d-4500-b971-79248fe15b60', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d8cbc603-240d-4500-b971-79248fe15b60 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d8cbc603-240d-4500-b971-79248fe15b60 Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:17.893607 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:17.898838 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:17.898838 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:17.898838 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d8cbc603-240d-4500-b971-79248fe15b60 Oct 12 22:36:17.898838 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:17.898838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca91ef66-2d21-4785-898c-c4d8ecb34593 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 400 to user: This rule already exists in group d8cbc603-240d-4500-b971-79248fe15b60 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:17.899251 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca91ef66-2d21-4785-898c-c4d8ecb34593 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 1.082511 Oct 12 22:36:17.900272 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 671/1493] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:16 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 1087 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:36:17.918509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-51e9bf53-6392-4631-b600-1c61b3d8d684 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff7bf160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:18.039566 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-51e9bf53-6392-4631-b600-1c61b3d8d684 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.138116 Oct 12 22:36:18.041527 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 672/1494] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:17 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:18.064490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:18.067610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:18.091207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:18.099187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:18.099985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:18.100906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:18.107071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:18.110118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:18.183768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:18.207204 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a0c7e27-17c2-4439-af38-5339cecdd8cc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 1.088372 Oct 12 22:36:18.232571 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 823/1495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:17 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:18.250568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:18.253807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:18.289304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:18.292537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:18.293673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:18.297845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:18.301636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:18.302305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:18.390541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25866df1-041e-4083-9851-e2cfac1582a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154960 Oct 12 22:36:18.402660 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 824/1496] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:18 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:18.408411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd639233-df14-4698-a74d-e1d5594055ac tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Calling method '.version_select at 0x7f44ff470d30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:18.492035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:19.199847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:19.381585 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dd639233-df14-4698-a74d-e1d5594055ac tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/9d0f9ed4-56a1-48e9-9e11-2c59bd1dde5f" status: 202 len: 0 microversion: 2.1 time: 0.977459 Oct 12 22:36:19.382355 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 825/1497] 10.222.0.20 () {58 vars in 1287 bytes} [Wed Oct 12 22:36:18 2022] DELETE /compute/v2.1/os-security-group-rules/9d0f9ed4-56a1-48e9-9e11-2c59bd1dde5f => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:19.387709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c894252-ce70-4f58-b1dc-acb7377e3c94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4340d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:19.478594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:19.489292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c894252-ce70-4f58-b1dc-acb7377e3c94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.105666 Oct 12 22:36:19.492772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 826/1498] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:19 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:19.504747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:19.505737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:19.510491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:19.518770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:19.520028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-28108ff8-1e53-45b1-b125-cac81c1318c8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1293 microversion: 2.25 time: 1.475967 Oct 12 22:36:19.531998 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 673/1499] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:18 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1293 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:19.531998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d4ea17d-f16c-4cde-b49c-f2b35bea6a61 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff6e7790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-102863258", "description": "tempest-description-1968211458"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:19.532339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:19.532339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:19.532339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:19.532339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:19.532339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:19.532339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:19.541846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:20.130973 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d4ea17d-f16c-4cde-b49c-f2b35bea6a61 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.609267 Oct 12 22:36:20.131953 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 674/1500] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:36:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:20.137440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:20.147479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:20.220709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:20.226678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:20.227247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:20.229788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:20.231047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:20.231488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:20.376391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f512dba0-4f64-4589-be7b-92e1dfde791d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243011 Oct 12 22:36:20.385228 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 675/1501] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:20 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:20.405991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea17e757-4e19-44b3-84f2-d7fde517c8a2 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff613700>, body: {"security_group_rule": {"parent_group_id": "87d6f67b-f699-4e5f-9d28-fb8e07a91dc8", "ip_protocol": "tcp", "from_port": 321310076, "to_port": 22}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:20.568867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:20.585462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec2f6cb8-7fbc-49a6-977f-6c12a5298ff2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 1.091320 Oct 12 22:36:20.597392 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 827/1502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:19 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:20.609867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3c204c1-af7a-4725-9f17-5d3d1a9620e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff47e700>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:20.734072 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f3c204c1-af7a-4725-9f17-5d3d1a9620e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.133494 Oct 12 22:36:20.734896 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 828/1503] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:20 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:20.753708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:20.787510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:20.805427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:20.806254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:20.806697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:20.811266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:20.812071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:20.813173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:20.989141 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ea17e757-4e19-44b3-84f2-d7fde517c8a2 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: Invalid port range 321310076:22. Former value cannot be greater than the later Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea17e757-4e19-44b3-84f2-d7fde517c8a2 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 145 Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: {"security_group_rule": {"parent_group_id": "87d6f67b-f699-4e5f-9d28-fb8e07a91dc8", "ip_protocol": "tcp", "from_port": 321310076, "to_port": 22}} Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid port range 321310076:22. Former value cannot be greater than the later Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'security_group_rule': {'parent_group_id': '87d6f67b-f699-4e5f-9d28-fb8e07a91dc8', 'ip_protocol': 'tcp', 'from_port': 321310076, 'to_port': 22}}} Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 321310076:22. Former value cannot be greater than the later Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 321310076:22. Former value cannot be greater than the later Oct 12 22:36:20.990685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 321310076:22. Former value cannot be greater than the later Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea17e757-4e19-44b3-84f2-d7fde517c8a2 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 400 to user: Invalid port range 321310076:22. Former value cannot be greater than the later {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea17e757-4e19-44b3-84f2-d7fde517c8a2 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.605466 Oct 12 22:36:20.997932 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 676/1504] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:20 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 607 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:36:21.003693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88dff467-d90d-493b-ade6-7d61536475fa tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff7afb80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-338014178", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:21.005837 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-88dff467-d90d-493b-ade6-7d61536475fa tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: Security group id should be uuid Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88dff467-d90d-493b-ade6-7d61536475fa tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 130 Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-338014178", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group id should be uuid Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-338014178', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:21.014511 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:21.019619 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 12 22:36:21.019619 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:21.019619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88dff467-d90d-493b-ade6-7d61536475fa tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 400 to user: Security group id should be uuid {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:21.019619 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88dff467-d90d-493b-ade6-7d61536475fa tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018340 Oct 12 22:36:21.023904 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 677/1505] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:20 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 22:36:21.045155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-378c08e6-3f3e-4d37-84f9-7f5e6e05dbb8 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ffad0040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1667187585", "description": "tempest-description-2132144913"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:21.647175 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-378c08e6-3f3e-4d37-84f9-7f5e6e05dbb8 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.622079 Oct 12 22:36:21.647849 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 678/1506] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:36:21 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:21.918816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-613115447", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "de19e183-4ef4-4fef-a2aa-b786a05433ca"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:21.966321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:21.981135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:21.982822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:21.984189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3813c56a-a312-470d-9cca-af5cdb35b9f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1293 microversion: 2.25 time: 1.247526 Oct 12 22:36:21.987654 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 829/1507] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:20 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1293 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:22.004802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:22.007516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:22.025070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:22.028335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:22.028780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:22.033632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:22.034126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:22.035515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:22.044869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] validate_networks() for [('de19e183-4ef4-4fef-a2aa-b786a05433ca', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:36:22.110056 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-66faaff2-f5d0-4f0d-be16-f65fae8f7146 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120677 Oct 12 22:36:22.118205 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 830/1508] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:21 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:22.141139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:22.146326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:22.161986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:22.162765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:22.163417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:22.164366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:22.165020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:22.167065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:22.599921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:22.614142 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89ae3bcc-4d02-4830-86c5-3556b11776db tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.483235 Oct 12 22:36:22.628811 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 831/1509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:22 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:22.652709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5042dde-e3dd-4cec-abfe-581a5e5e8445 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff470670>, body: {"security_group_rule": {"parent_group_id": "1a2480df-608b-4682-87f7-fb9df9ee6654", "ip_protocol": "tempest-999-834619565", "from_port": 22, "to_port": 22}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:23.036265 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f5042dde-e3dd-4cec-abfe-581a5e5e8445 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: Invalid IP protocol tempest-999-834619565. Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5042dde-e3dd-4cec-abfe-581a5e5e8445 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 156 Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: {"security_group_rule": {"parent_group_id": "1a2480df-608b-4682-87f7-fb9df9ee6654", "ip_protocol": "tempest-999-834619565", "from_port": 22, "to_port": 22}} Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid IP protocol tempest-999-834619565. Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1a2480df-608b-4682-87f7-fb9df9ee6654', 'ip_protocol': 'tempest-999-834619565', 'from_port': 22, 'to_port': 22}}} Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-834619565. Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-834619565. Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:23.038714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-834619565. Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5042dde-e3dd-4cec-abfe-581a5e5e8445 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 400 to user: Invalid IP protocol tempest-999-834619565. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f5042dde-e3dd-4cec-abfe-581a5e5e8445 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.418344 Oct 12 22:36:23.043185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 832/1510] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:22 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 420 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:36:23.058606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e023e4fa-ccf0-41cc-a9e4-010f6a4df745 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4fdf70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:23.086160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:23.086796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:23.087249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:23.087826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:23.088336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:23.090506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:23.128548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:23.129045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:23.129478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:23.130214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:23.140315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:23.140900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:23.167876 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e023e4fa-ccf0-41cc-a9e4-010f6a4df745 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.122548 Oct 12 22:36:23.168582 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 833/1511] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:23 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:23.223586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Getting quotas for project ac983f01662d415d955550f8bf915c52. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:36:23.254580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Getting quotas for user 2c378be604e740b2ba7d55953e34b25a and project ac983f01662d415d955550f8bf915c52. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:36:23.284939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Going to run 2 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:36:23.297982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 11682712-1cbe-4bff-a7ab-082e85d14154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:23.393979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=11682712-1cbe-4bff-a7ab-082e85d14154,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:23.541116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe5cf698-1c9a-4892-8850-0c8254075455 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.892210 Oct 12 22:36:23.542445 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 679/1512] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:36:23.550865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:23.556381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:23.573021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:23.576215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:23.576889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:23.579027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:23.579705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:23.581967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:23.643395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d8040c5b-f6f7-4149-a073-083ff60ee85e req-013e40ac-c317-45fe-ae55-833248e8f6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8efca20-5bdd-4ff4-97d4-8517b7539ae8", "tag": "c1b2ba2f-74a1-4b43-bd69-c011d0a69632"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:23.693798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d8040c5b-f6f7-4149-a073-083ff60ee85e req-013e40ac-c317-45fe-ae55-833248e8f6db service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:23.694302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d8040c5b-f6f7-4149-a073-083ff60ee85e req-013e40ac-c317-45fe-ae55-833248e8f6db service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:23.694747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d8040c5b-f6f7-4149-a073-083ff60ee85e req-013e40ac-c317-45fe-ae55-833248e8f6db service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:23.751439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d8040c5b-f6f7-4149-a073-083ff60ee85e req-013e40ac-c317-45fe-ae55-833248e8f6db service nova] Creating event network-changed:c1b2ba2f-74a1-4b43-bd69-c011d0a69632 for instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 on n-h1-860864-8 Oct 12 22:36:23.778690 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d8040c5b-f6f7-4149-a073-083ff60ee85e req-013e40ac-c317-45fe-ae55-833248e8f6db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.588172 Oct 12 22:36:23.782603 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 834/1513] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:23.818391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a186b547-e4c7-43a6-96d2-1b4b5fce9431 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff470dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-710320407", "description": "tempest-description-1562179877"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:24.073916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:24.087513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:24.097651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:24.100132 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-786b67d6-4c6d-4610-84d6-b6f29ce90101 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1293 microversion: 2.25 time: 0.556439 Oct 12 22:36:24.104010 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 680/1514] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:23 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1293 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:24.120277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:24.129826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:24.152913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:24.153450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:24.156408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:24.157973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:24.159456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:24.161570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:24.260235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12bff841-f958-4e35-a2fa-c64e08d33ed0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134952 Oct 12 22:36:24.260925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 681/1515] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:24 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:24.327629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:24.335593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:24.337276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Searching by: {'deleted': False, 'project_id': 'ac983f01662d415d955550f8bf915c52'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:36:24.474933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:24.475230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:24.475501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:24.480513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:24.485782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:24.486504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:24.796750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:24.823088 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a186b547-e4c7-43a6-96d2-1b4b5fce9431 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.035205 Oct 12 22:36:24.824480 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 835/1516] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:36:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:24.836206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:24.837123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:24.841290 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb9c75b2-7033-4917-9133-53b54561bbc4 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.568435 Oct 12 22:36:24.844437 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 682/1517] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:36:24 2022] GET /compute/v2.1/servers => generated 675 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:24.864078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:24.866822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:24.870075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:24.875737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:24.876863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-92f2db6b-7b24-4148-8401-45a587151aff req-93d0bbd2-14c7-4f19-aa12-7ac71c71ae7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c64bc5-a5d4-40b0-924c-87e882136445", "name": "network-vif-plugged", "status": "completed", "tag": "1efd6f5c-18bf-4caa-8ca3-34c24ab3d040"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:24.877429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:24.878174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:24.921761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-92f2db6b-7b24-4148-8401-45a587151aff req-93d0bbd2-14c7-4f19-aa12-7ac71c71ae7d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:24.927404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-92f2db6b-7b24-4148-8401-45a587151aff req-93d0bbd2-14c7-4f19-aa12-7ac71c71ae7d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:24.939875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-92f2db6b-7b24-4148-8401-45a587151aff req-93d0bbd2-14c7-4f19-aa12-7ac71c71ae7d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:24.975134 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-92f2db6b-7b24-4148-8401-45a587151aff req-93d0bbd2-14c7-4f19-aa12-7ac71c71ae7d service nova] Creating event network-vif-plugged:1efd6f5c-18bf-4caa-8ca3-34c24ab3d040 for instance 28c64bc5-a5d4-40b0-924c-87e882136445 on n-h1-860864-8 Oct 12 22:36:24.985344 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-92f2db6b-7b24-4148-8401-45a587151aff req-93d0bbd2-14c7-4f19-aa12-7ac71c71ae7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135929 Oct 12 22:36:24.987116 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 683/1518] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:25.015254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a9b7a819-978e-43e1-9136-2e679dae2149 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff6e73a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:25.117094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a9b7a819-978e-43e1-9136-2e679dae2149 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.128295 Oct 12 22:36:25.120559 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 684/1519] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:24 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:25.131140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afadd3d6-76ba-4616-a039-b91cfb005eb7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff773d30>, body: {"security_group_rule": {"parent_group_id": "6da22da7-938c-4329-9d6a-97e1cd47e607", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:25.247110 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-afadd3d6-76ba-4616-a039-b91cfb005eb7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afadd3d6-76ba-4616-a039-b91cfb005eb7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 138 Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: {"security_group_rule": {"parent_group_id": "6da22da7-938c-4329-9d6a-97e1cd47e607", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6da22da7-938c-4329-9d6a-97e1cd47e607', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:36:25.248866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afadd3d6-76ba-4616-a039-b91cfb005eb7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afadd3d6-76ba-4616-a039-b91cfb005eb7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.128665 Oct 12 22:36:25.258963 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 685/1520] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:25 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:36:25.267325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-229d6d32-b191-42b9-93f2-90d82268dd2a tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:25.268127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-229d6d32-b191-42b9-93f2-90d82268dd2a tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:25.430203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-229d6d32-b191-42b9-93f2-90d82268dd2a tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:25.438702 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-229d6d32-b191-42b9-93f2-90d82268dd2a tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1219 microversion: 2.1 time: 0.185822 Oct 12 22:36:25.439880 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 686/1521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:25 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:25.445813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:25.446592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:25.453880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:25.454854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:25.455642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:25.456659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:25.457271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:25.457928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:25.657423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:25.682665 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc3e5cf8-7387-467e-b2c9-bd5debe69f59 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.856805 Oct 12 22:36:25.683261 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 836/1522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:24 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:25.705311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a76419bd-0f1f-4835-86d0-9e5fc0c43a7b tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff447160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-959809012", "description": "tempest-description-725157626"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:25.895131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:25.912416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:25.914621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:25.918272 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f6ca50e-588a-42d4-a077-92bd3646030c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1293 microversion: 2.25 time: 0.474757 Oct 12 22:36:25.919938 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 687/1523] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:25 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1293 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:25.925660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:25.930012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:25.937254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:25.938081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:25.939875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:25.940863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:25.941562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:25.942382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:26.016340 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a98a1121-1ca8-4365-896b-7a05eb27e06a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094347 Oct 12 22:36:26.018926 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 688/1524] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:36:25 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:36:26.143202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ace9d529-9e92-4ce1-b3bd-66c430c8114d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff64baf0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:26.299242 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ace9d529-9e92-4ce1-b3bd-66c430c8114d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.161299 Oct 12 22:36:26.317153 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 689/1525] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:26 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:26.465522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:26.467064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:26.489511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:26.490376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:26.493935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:26.495581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:26.496359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:26.501813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:26.709338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:26.728158 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a20b8e4-9ec3-4033-bf34-bac4faf5b896 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1271 microversion: 2.1 time: 0.262312 Oct 12 22:36:26.731025 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 690/1526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:26 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1271 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:26.747000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:26.750955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:26.773930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:26.774595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:26.777082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:26.778156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:26.782554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:26.783317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:26.877794 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a76419bd-0f1f-4835-86d0-9e5fc0c43a7b tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.193405 Oct 12 22:36:26.879688 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 837/1527] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:36:25 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:26.893798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1546371e-381f-47a6-ae6f-a34ffbf67ec7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f4507c30940>, body: {"security_group_rule": {"parent_group_id": "062caad5-46aa-4794-98da-e6570011af20", "ip_protocol": "tcp", "from_port": 22, "to_port": 437811292}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:27.505893 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1546371e-381f-47a6-ae6f-a34ffbf67ec7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: Invalid port range 22:437811292. Valid TCP ports should be between 1-65535 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1546371e-381f-47a6-ae6f-a34ffbf67ec7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 145 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: {"security_group_rule": {"parent_group_id": "062caad5-46aa-4794-98da-e6570011af20", "ip_protocol": "tcp", "from_port": 22, "to_port": 437811292}} Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid port range 22:437811292. Valid TCP ports should be between 1-65535 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'security_group_rule': {'parent_group_id': '062caad5-46aa-4794-98da-e6570011af20', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 437811292}}} Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:437811292. Valid TCP ports should be between 1-65535 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:437811292. Valid TCP ports should be between 1-65535 Oct 12 22:36:27.515327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:437811292. Valid TCP ports should be between 1-65535 Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1546371e-381f-47a6-ae6f-a34ffbf67ec7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 400 to user: Invalid port range 22:437811292. Valid TCP ports should be between 1-65535 {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1546371e-381f-47a6-ae6f-a34ffbf67ec7 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.630177 Oct 12 22:36:27.520259 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 838/1528] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:26 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 631 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:36:27.644617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:27.656683 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f426e18-2806-4503-b793-d8764426d1b6 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1318 microversion: 2.1 time: 0.920367 Oct 12 22:36:27.657390 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 691/1529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:26 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1318 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:27.674396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e05508e-9210-49cd-b1c3-573284acbd30 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff60bc10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:27.871662 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e05508e-9210-49cd-b1c3-573284acbd30 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1411 microversion: 2.1 time: 0.212007 Oct 12 22:36:27.872290 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 692/1530] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:27 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:27.894547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1055e803-1ffc-4ca0-9c8c-819b039ce056 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Action: 'create', calling method: .version_select at 0x7f44ff6e7d30>, body: {"security_group_rule": {"parent_group_id": "61546376-0f8e-488b-9883-87e206daa290", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:28.062399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:28.063068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:28.087023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:28.096567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:28.097355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:28.098481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:28.099682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:28.107259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:28.255441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-1055e803-1ffc-4ca0-9c8c-819b039ce056 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:36:28.256312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-1055e803-1ffc-4ca0-9c8c-819b039ce056 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Neutron security group 61546376-0f8e-488b-9883-87e206daa290 not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:36:28.257020 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1055e803-1ffc-4ca0-9c8c-819b039ce056 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist Oct 12 22:36:28.257020 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-98e5fe95-6356-4f87-9539-a9cf22701a6e'] Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1055e803-1ffc-4ca0-9c8c-819b039ce056 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 138 Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: {"security_group_rule": {"parent_group_id": "61546376-0f8e-488b-9883-87e206daa290", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-98e5fe95-6356-4f87-9539-a9cf22701a6e'] Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'security_group_rule': {'parent_group_id': '61546376-0f8e-488b-9883-87e206daa290', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:36:28.261069 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98e5fe95-6356-4f87-9539-a9cf22701a6e'] Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98e5fe95-6356-4f87-9539-a9cf22701a6e'] Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98e5fe95-6356-4f87-9539-a9cf22701a6e'] Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98e5fe95-6356-4f87-9539-a9cf22701a6e'] Oct 12 22:36:28.265737 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.271932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1055e803-1ffc-4ca0-9c8c-819b039ce056 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 404 to user: Security group 61546376-0f8e-488b-9883-87e206daa290 does not exist Oct 12 22:36:28.271932 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-98e5fe95-6356-4f87-9539-a9cf22701a6e'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:28.271932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1055e803-1ffc-4ca0-9c8c-819b039ce056 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.397277 Oct 12 22:36:28.271932 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 693/1531] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:36:27 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:36:28.299318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:28.310552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:28.339268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:28.342878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:28.347712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:28.352712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:28.355458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:28.359098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:28.597789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:28.607094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23f8b20f-aa02-49fd-87c8-3f60fafb6242 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1277 microversion: 2.1 time: 0.334959 Oct 12 22:36:28.616989 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 694/1532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:28 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:28.624233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0f2a44e-c064-4c14-b35b-2768b4f05afb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Calling method '.version_select at 0x7f44ff7745e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:28.723670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-b0f2a44e-c064-4c14-b35b-2768b4f05afb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:36:28.724954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-b0f2a44e-c064-4c14-b35b-2768b4f05afb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Neutron security group rule 7899a225-c382-4486-8042-f040bdb30a6b not found {{(pid=120543) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 12 22:36:28.725870 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b0f2a44e-c064-4c14-b35b-2768b4f05afb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] HTTP exception thrown: Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist Oct 12 22:36:28.725870 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-b19e3747-eeff-4fcb-81e9-b42acd6d918c'] Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0f2a44e-c064-4c14-b35b-2768b4f05afb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Request method failure captured: Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-security-group-rules/7899a225-c382-4486-8042-f040bdb30a6b HTTP/1.1 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Fd-jDvBDJPFOqn49goyRc3wkGqumVe343DFdjvn_2qc91CCgyszBW7ygtDLu1ol4qxqD0aMPOLtLktLcFmHsfgIgCT4kKR5VZ1PRsUH2E9g3C9NmIS55nYHS8nJpmUM-0jetQJXGqKE5Xrx-Pk8NPY6OuHHak_lO5GW5_Fp6BUShs Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de3f018864cb498e8f6ffe4abbf1dd4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de3f018864cb498e8f6ffe4abbf1dd4f"}]}] Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: de3f018864cb498e8f6ffe4abbf1dd4f Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d2ba054d5c924c2da845b12903a882af Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-963522554-project Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-b19e3747-eeff-4fcb-81e9-b42acd6d918c'] Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7899a225-c382-4486-8042-f040bdb30a6b'} Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:36:28.728549 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19e3747-eeff-4fcb-81e9-b42acd6d918c'] Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19e3747-eeff-4fcb-81e9-b42acd6d918c'] Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19e3747-eeff-4fcb-81e9-b42acd6d918c'] Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19e3747-eeff-4fcb-81e9-b42acd6d918c'] Oct 12 22:36:28.734769 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:36:28.738620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0f2a44e-c064-4c14-b35b-2768b4f05afb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Returning 404 to user: Security group rule 7899a225-c382-4486-8042-f040bdb30a6b does not exist Oct 12 22:36:28.738620 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-b19e3747-eeff-4fcb-81e9-b42acd6d918c'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:28.738620 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0f2a44e-c064-4c14-b35b-2768b4f05afb tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/7899a225-c382-4486-8042-f040bdb30a6b" status: 404 len: 199 microversion: 2.1 time: 0.120231 Oct 12 22:36:28.739547 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 695/1533] 10.222.0.20 () {58 vars in 1287 bytes} [Wed Oct 12 22:36:28 2022] DELETE /compute/v2.1/os-security-group-rules/7899a225-c382-4486-8042-f040bdb30a6b => generated 199 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:36:28.752608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:28.753235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:28.787367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:28.787863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:28.788558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:28.789460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:28.790246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:28.791183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:29.459741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:29.479189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:29.480934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:29.482096 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2cbc4843-3809-41ee-832c-b00c3b8d3312 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1293 microversion: 2.25 time: 1.961382 Oct 12 22:36:29.488308 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 839/1534] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:27 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1293 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:29.496687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-767d6049-400f-4071-a65d-6a5e508a8719 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Calling method '.version_select at 0x7f44ff470e50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:29.544714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:29.558036 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-26bc3191-e037-43e7-bdaa-02b8008b6479 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1507 microversion: 2.1 time: 0.813288 Oct 12 22:36:29.571986 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 696/1535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:28 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1507 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:29.571986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea4cfb0c-e233-477a-abaa-0a208abff3a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff64b430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:32.706323 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-767d6049-400f-4071-a65d-6a5e508a8719 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/062caad5-46aa-4794-98da-e6570011af20" status: 202 len: 0 microversion: 2.1 time: 3.216636 Oct 12 22:36:32.707201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 840/1536] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:36:29 2022] DELETE /compute/v2.1/os-security-groups/062caad5-46aa-4794-98da-e6570011af20 => generated 0 bytes in 3218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:32.713769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:32.714383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:32.756478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:32.759114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:32.761048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:32.763241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:32.766849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:32.771230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:34.001130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:34.014723 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a079198-ea72-4d75-8dcf-5a258705493a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1507 microversion: 2.1 time: 1.305113 Oct 12 22:36:34.015599 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 841/1537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:32 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1507 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:34.066390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:34.067255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:34.087110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:34.087880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:34.089262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:34.094283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:34.098246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:34.099456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:34.693610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:35.142582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:35.157356 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c901da29-2989-481b-bc53-e56788cdc146 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1319 microversion: 2.1 time: 1.103192 Oct 12 22:36:35.163431 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 842/1538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:34 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1319 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:35.206790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:35.214590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:35.236970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:35.240335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:35.242841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:35.246017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:35.249817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:35.252281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:35.438418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:35.998869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:36.007687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:36.016168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:36.016955 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cdda37d7-df2f-453d-8f99-8b0f9c47aeb4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1293 microversion: 2.25 time: 0.851089 Oct 12 22:36:36.017523 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 843/1539] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:35 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1293 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:36.027472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d71f8136-8336-47b7-a376-dcd936adbc48 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Calling method '.version_select at 0x7f44ff4aaf70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:37.536766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d71f8136-8336-47b7-a376-dcd936adbc48 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6da22da7-938c-4329-9d6a-97e1cd47e607" status: 202 len: 0 microversion: 2.1 time: 1.517580 Oct 12 22:36:37.538894 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 844/1540] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:36:36 2022] DELETE /compute/v2.1/os-security-groups/6da22da7-938c-4329-9d6a-97e1cd47e607 => generated 0 bytes in 1521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:37.555555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:37.563793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:37.583005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:37.583692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:37.584468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:37.585364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:37.586129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:37.586896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:37.692356 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5552eba-a160-4847-aa08-484689538fc7 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "PUT /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1079 microversion: 2.1 time: 0.152018 Oct 12 22:36:37.699144 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 845/1541] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:36:37 2022] PUT /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1079 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:37.719692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:37.721013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:37.748025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:37.748531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:37.749244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:37.750594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:37.753021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:37.753475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:38.667091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:38.679488 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59be2731-7cbb-470d-b488-bf17ea5c37f0 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1319 microversion: 2.1 time: 0.976678 Oct 12 22:36:38.680105 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 846/1542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:37 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1319 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:38.691199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a05f4098-b654-4368-9824-415e1ed29567 req-ee8417fd-976f-4248-b6a3-f59c508b3b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11682712-1cbe-4bff-a7ab-082e85d14154", "tag": "f64b86b7-7493-4636-b624-d751036ca095"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:38.725252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a05f4098-b654-4368-9824-415e1ed29567 req-ee8417fd-976f-4248-b6a3-f59c508b3b3b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:38.725755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a05f4098-b654-4368-9824-415e1ed29567 req-ee8417fd-976f-4248-b6a3-f59c508b3b3b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:38.726530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a05f4098-b654-4368-9824-415e1ed29567 req-ee8417fd-976f-4248-b6a3-f59c508b3b3b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:38.747758 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a05f4098-b654-4368-9824-415e1ed29567 req-ee8417fd-976f-4248-b6a3-f59c508b3b3b service nova] Creating event network-changed:f64b86b7-7493-4636-b624-d751036ca095 for instance 11682712-1cbe-4bff-a7ab-082e85d14154 on n-h1-860864-8 Oct 12 22:36:38.761699 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a05f4098-b654-4368-9824-415e1ed29567 req-ee8417fd-976f-4248-b6a3-f59c508b3b3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080114 Oct 12 22:36:38.762894 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 847/1543] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:38.769209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:38.770157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:38.787408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:38.789512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:38.790535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:38.792372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:38.794093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:38.796481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:38.800656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:39.111594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:39.125210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:39.127341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:39.128944 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49c99331-7865-475e-806e-f303d712f49f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1281 microversion: 2.25 time: 0.364455 Oct 12 22:36:39.147918 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 848/1544] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:38 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1281 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:39.154227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-abdd1960-3d0d-4240-b20c-8c7e9b122f93 req-440193bf-e9bc-45d2-9379-cb95e5e0c091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8553b1-fff8-4db0-b2c7-80ab3a4638d3", "tag": "23d683b2-85ac-49e3-aa72-7ce1cf65e612"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:39.166189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-abdd1960-3d0d-4240-b20c-8c7e9b122f93 req-440193bf-e9bc-45d2-9379-cb95e5e0c091 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:39.167561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-abdd1960-3d0d-4240-b20c-8c7e9b122f93 req-440193bf-e9bc-45d2-9379-cb95e5e0c091 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:39.168264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-abdd1960-3d0d-4240-b20c-8c7e9b122f93 req-440193bf-e9bc-45d2-9379-cb95e5e0c091 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:39.182215 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-abdd1960-3d0d-4240-b20c-8c7e9b122f93 req-440193bf-e9bc-45d2-9379-cb95e5e0c091 service nova] Creating event network-changed:23d683b2-85ac-49e3-aa72-7ce1cf65e612 for instance 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 on n-h2-860864-8 Oct 12 22:36:39.188611 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-abdd1960-3d0d-4240-b20c-8c7e9b122f93 req-440193bf-e9bc-45d2-9379-cb95e5e0c091 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041597 Oct 12 22:36:39.189850 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 849/1545] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:39.195780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc0307ad-672d-412d-86fd-0b6a84d09d62 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Calling method '.version_select at 0x7f44ff4fdd30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:39.553096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=38 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:39.904448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc0307ad-672d-412d-86fd-0b6a84d09d62 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1a2480df-608b-4682-87f7-fb9df9ee6654" status: 202 len: 0 microversion: 2.1 time: 0.713053 Oct 12 22:36:39.906079 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 850/1546] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:36:39 2022] DELETE /compute/v2.1/os-security-groups/1a2480df-608b-4682-87f7-fb9df9ee6654 => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:39.920481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:39.922242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:39.939277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:39.940844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:39.941823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:39.943860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:39.951242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:39.952420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:40.531429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:40.543016 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84a16107-e02d-4571-a59f-0cc25c66431c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1505 microversion: 2.1 time: 0.635189 Oct 12 22:36:40.544189 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 851/1547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:39 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:40.554888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:40.555507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:40.568484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:40.568974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:40.569407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:40.570111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:40.570555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:40.570971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:41.072156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:41.092858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8513773c-52c3-49c8-a8b9-7eef3a0d2eb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1319 microversion: 2.1 time: 0.546020 Oct 12 22:36:41.093866 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 852/1548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:40 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:41.103245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e8d310d-7e95-4cb8-8ef6-5fa24fde4cd6 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Calling method '.version_select at 0x7f44ff465790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:42.757924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e8d310d-7e95-4cb8-8ef6-5fa24fde4cd6 tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/87d6f67b-f699-4e5f-9d28-fb8e07a91dc8" status: 202 len: 0 microversion: 2.1 time: 1.661413 Oct 12 22:36:42.762848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 853/1549] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:36:41 2022] DELETE /compute/v2.1/os-security-groups/87d6f67b-f699-4e5f-9d28-fb8e07a91dc8 => generated 0 bytes in 1667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:42.768954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:42.770177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:42.799499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:42.806956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:42.808537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:42.810708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:42.812079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:42.813381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:43.532797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:43.565858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:43.576320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:43.579133 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad54426c-64fe-4542-95b6-d7bab9f3722c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1281 microversion: 2.25 time: 0.814137 Oct 12 22:36:43.598848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 854/1550] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:42 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1281 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:43.629512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:43.632991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:43.658878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:43.663532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:43.665600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:43.669172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:43.674578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:43.676154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:43.704383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:44.352803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:44.367575 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b8087bc-250b-468e-a9b6-446eba1032f2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1505 microversion: 2.1 time: 0.767243 Oct 12 22:36:44.371017 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 855/1551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:43 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:44.378104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:44.379002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:44.388970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.390062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.391046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.392692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.393391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.394329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.447087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea4cfb0c-e233-477a-abaa-0a208abff3a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1420 microversion: 2.1 time: 14.884096 Oct 12 22:36:44.448739 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 697/1552] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:29 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1420 bytes in 14886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:44.454791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-39f19655-55ca-4800-a3e6-19c06a4e74ab tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] Calling method '.version_select at 0x7f44ff774790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:44.624232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:44.635703 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14195854-37d9-4d92-828f-c990b7ea1027 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1319 microversion: 2.1 time: 0.263498 Oct 12 22:36:44.636864 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 856/1553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:44 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:44.643303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3baeac6a-1ea0-431a-bfa7-3d2a9bd40969 req-5ad09ab6-f7ee-4410-9e0d-78003cfd6d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8553b1-fff8-4db0-b2c7-80ab3a4638d3", "name": "network-vif-plugged", "status": "completed", "tag": "23d683b2-85ac-49e3-aa72-7ce1cf65e612"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:44.653399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=50 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:44.656794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3baeac6a-1ea0-431a-bfa7-3d2a9bd40969 req-5ad09ab6-f7ee-4410-9e0d-78003cfd6d70 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.657478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3baeac6a-1ea0-431a-bfa7-3d2a9bd40969 req-5ad09ab6-f7ee-4410-9e0d-78003cfd6d70 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.658065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3baeac6a-1ea0-431a-bfa7-3d2a9bd40969 req-5ad09ab6-f7ee-4410-9e0d-78003cfd6d70 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.673630 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3baeac6a-1ea0-431a-bfa7-3d2a9bd40969 req-5ad09ab6-f7ee-4410-9e0d-78003cfd6d70 service nova] Creating event network-vif-plugged:23d683b2-85ac-49e3-aa72-7ce1cf65e612 for instance 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 on n-h2-860864-8 Oct 12 22:36:44.680719 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3baeac6a-1ea0-431a-bfa7-3d2a9bd40969 req-5ad09ab6-f7ee-4410-9e0d-78003cfd6d70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042154 Oct 12 22:36:44.683084 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 857/1554] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:44.687657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:44.691094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:44.697602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.698084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.698746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.699466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.699921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.700353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.844795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:44.845575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:44.846262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:44.846935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:44.847343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:44.941543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:44.954766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.956256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.957314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.959136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:44.959940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:44.960937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:44.993962 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f62c24a8-398a-489f-9a84-b239effdda71 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "POST /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445/action" status: 202 len: 1111 microversion: 2.1 time: 0.311066 Oct 12 22:36:45.010683 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 858/1555] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:36:44 2022] POST /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445/action => generated 1111 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 22:36:45.027668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ef28dcb-66ff-4623-bdb7-80cdecfae6ff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4bd0d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:45.123088 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ef28dcb-66ff-4623-bdb7-80cdecfae6ff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 200 len: 1420 microversion: 2.1 time: 0.107757 Oct 12 22:36:45.124478 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 859/1556] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:36:45 2022] GET /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:45.130726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:45.131718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:45.153025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:45.154853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:45.156835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:45.160186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:45.161113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:45.162327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:45.444988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:45.465952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:45.467686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:45.470674 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6308e155-8afb-4c83-970c-a782f62e0b0a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1281 microversion: 2.25 time: 0.345008 Oct 12 22:36:45.486042 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 860/1557] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:45 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1281 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:45.503797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:45.507380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:45.523269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:45.523792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:45.524205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:45.530409 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-39f19655-55ca-4800-a3e6-19c06a4e74ab tempest-SecurityGroupRulesNegativeTestJSON-963522554 tempest-SecurityGroupRulesNegativeTestJSON-963522554-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d8cbc603-240d-4500-b971-79248fe15b60" status: 202 len: 0 microversion: 2.1 time: 1.079225 Oct 12 22:36:45.530952 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 698/1558] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:36:44 2022] DELETE /compute/v2.1/os-security-groups/d8cbc603-240d-4500-b971-79248fe15b60 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:36:45.532446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:45.533011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:45.533439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:45.547958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-39bd773d-e0d3-4ce6-a8df-45d37153c2ea tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff7bf280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:46.074510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:46.090260 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d7bcb00-b070-42c3-886b-2847c6bda728 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1516 microversion: 2.1 time: 0.596689 Oct 12 22:36:46.092024 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 861/1559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:45 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1516 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:46.099378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:46.100564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:46.115190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.116123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.117973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.119000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.119704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.121215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.523276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:46.536519 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ade73e3-c890-4d29-b8d9-a54ad82084bc tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1319 microversion: 2.1 time: 0.443174 Oct 12 22:36:46.553313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 862/1560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:46 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:46.560721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:46.561608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:46.573647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.574404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.575023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.578111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.580863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.581760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.607505 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-39bd773d-e0d3-4ce6-a8df-45d37153c2ea tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 204 len: 0 microversion: 2.1 time: 1.075028 Oct 12 22:36:46.608410 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 699/1561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:45 2022] DELETE /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:36:46.616618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:46.618153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:46.631118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.632518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.632898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.633603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.636523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.636974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.695620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:36:46.815697 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9831d338-181d-4888-a515-ae3fa0cc3020 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 204 len: 0 microversion: 2.1 time: 0.202426 Oct 12 22:36:46.816679 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 700/1562] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:36:46 2022] DELETE /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:36:46.822012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-dd68a76f-5a46-4614-8db0-c749735d7031 req-eaa5e55c-4359-4b38-8f00-1dbb6fec77a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11682712-1cbe-4bff-a7ab-082e85d14154", "name": "network-vif-plugged", "status": "completed", "tag": "f64b86b7-7493-4636-b624-d751036ca095"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:46.855285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-dd68a76f-5a46-4614-8db0-c749735d7031 req-eaa5e55c-4359-4b38-8f00-1dbb6fec77a9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:46.855769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-dd68a76f-5a46-4614-8db0-c749735d7031 req-eaa5e55c-4359-4b38-8f00-1dbb6fec77a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:46.857955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-dd68a76f-5a46-4614-8db0-c749735d7031 req-eaa5e55c-4359-4b38-8f00-1dbb6fec77a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:46.887522 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-dd68a76f-5a46-4614-8db0-c749735d7031 req-eaa5e55c-4359-4b38-8f00-1dbb6fec77a9 service nova] Creating event network-vif-plugged:f64b86b7-7493-4636-b624-d751036ca095 for instance 11682712-1cbe-4bff-a7ab-082e85d14154 on n-h1-860864-8 Oct 12 22:36:46.898429 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-dd68a76f-5a46-4614-8db0-c749735d7031 req-eaa5e55c-4359-4b38-8f00-1dbb6fec77a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077911 Oct 12 22:36:46.904471 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 701/1563] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:47.021387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1857006202", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "25f09190-2cdc-41b9-9952-f833573da6b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:47.127750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] validate_networks() for [('25f09190-2cdc-41b9-9952-f833573da6b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:36:47.545777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:47.554951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:47.556952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:47.559160 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f2e23b9d-ed6c-4776-9a95-dd6315cac562 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1281 microversion: 2.25 time: 1.003881 Oct 12 22:36:47.584003 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 863/1564] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:46 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1281 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:47.594311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:47.595362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:47.600132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:47.601477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:47.602053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:47.602559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:47.603360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:47.622297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.622954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.623742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.624804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.625372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:47.626159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:47.628363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.629368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.629677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:47.630197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:47.631574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:47.633247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:47.661728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:36:47.669461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for user 080644f7502346ed8ff64a026ac9d15b and project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:36:47.683502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:36:47.687039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:47.736334 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a08ffe6-cca0-4529-993e-a1f43b47ac3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719882 Oct 12 22:36:47.737021 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 702/1565] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:36:48.006470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2de3ac0d-4cd2-4a77-8968-9470ca43fc2a tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:48.043500 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2de3ac0d-4cd2-4a77-8968-9470ca43fc2a tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.299439 Oct 12 22:36:48.048358 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 703/1566] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:36:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:48.062496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:48.062615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:48.075714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.076237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.076688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.077389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.077841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.078268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.124641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:48.140056 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13ea8eac-573c-4775-8ee2-47e48539763d tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1516 microversion: 2.1 time: 0.554068 Oct 12 22:36:48.151915 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 864/1567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:47 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1516 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:48.155521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb92e048-f6a7-4cd2-9052-c9d107058b27 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:48.156609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb92e048-f6a7-4cd2-9052-c9d107058b27 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:48.392384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:48.401544 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6091166e-b31b-43b1-9db1-711f900a7ff2 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 200 len: 1508 microversion: 2.1 time: 0.351809 Oct 12 22:36:48.402147 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 704/1568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:48 2022] GET /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:48.417988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb92e048-f6a7-4cd2-9052-c9d107058b27 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:48.433213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:48.433837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 11682712-1cbe-4bff-a7ab-082e85d14154] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:48.438130 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb92e048-f6a7-4cd2-9052-c9d107058b27 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1208 microversion: 2.1 time: 0.296402 Oct 12 22:36:48.452812 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 865/1569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:48 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1208 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:48.481323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.485143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.485831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.488979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.489469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.489902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.602342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:48.607448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:48.653478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.654078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.655211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:48.658653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:48.659390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:48.660104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.206205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.218435 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-677b8d18-c9dc-4dbc-b5fd-ee36f5edeace tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/11682712-1cbe-4bff-a7ab-082e85d14154" status: 200 len: 1319 microversion: 2.1 time: 0.792568 Oct 12 22:36:49.232834 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 705/1570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:48 2022] GET /compute/v2.1/servers/11682712-1cbe-4bff-a7ab-082e85d14154 => generated 1319 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:49.238624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f970a6e0-f9c2-46f1-8248-c38647aeb9ad req-be8ba9df-4f51-40a8-be42-afde84381e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7f70c3-9232-4994-b238-9556a5739b11", "name": "network-vif-unplugged", "status": "completed", "tag": "7d427587-2e7a-42dd-8652-a6e2f4d05bcc"}, {"server_uuid": "a8efca20-5bdd-4ff4-97d4-8517b7539ae8", "name": "network-vif-plugged", "status": "completed", "tag": "c1b2ba2f-74a1-4b43-bd69-c011d0a69632"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:49.272259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f970a6e0-f9c2-46f1-8248-c38647aeb9ad req-be8ba9df-4f51-40a8-be42-afde84381e85 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.274820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f970a6e0-f9c2-46f1-8248-c38647aeb9ad req-be8ba9df-4f51-40a8-be42-afde84381e85 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.276398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f970a6e0-f9c2-46f1-8248-c38647aeb9ad req-be8ba9df-4f51-40a8-be42-afde84381e85 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.298016 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f970a6e0-f9c2-46f1-8248-c38647aeb9ad req-be8ba9df-4f51-40a8-be42-afde84381e85 service nova] Creating event network-vif-unplugged:7d427587-2e7a-42dd-8652-a6e2f4d05bcc for instance 7d7f70c3-9232-4994-b238-9556a5739b11 on n-h2-860864-8 Oct 12 22:36:49.299225 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f970a6e0-f9c2-46f1-8248-c38647aeb9ad req-be8ba9df-4f51-40a8-be42-afde84381e85 service nova] Creating event network-vif-plugged:c1b2ba2f-74a1-4b43-bd69-c011d0a69632 for instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 on n-h1-860864-8 Oct 12 22:36:49.310403 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f970a6e0-f9c2-46f1-8248-c38647aeb9ad req-be8ba9df-4f51-40a8-be42-afde84381e85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.075310 Oct 12 22:36:49.311309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 706/1571] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:49.320545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:49.321315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:49.339298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.340064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.340587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.341880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.342402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.343044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.598727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.608947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.610412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.611541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8e1117f-5037-4575-9cd3-00c9a891b051 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1281 microversion: 2.25 time: 1.025982 Oct 12 22:36:49.629054 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 866/1572] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:48 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1281 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:49.634298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4dd9d85-2363-4ac8-96fe-174c2040f893 tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-382850886", "imageRef": "d118ddf6-f5a5-45ec-81a9-037b3e5ba801", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:49.664636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.683915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cbdadc35-258c-4dab-8310-59c3f093fdb3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1516 microversion: 2.1 time: 0.369401 Oct 12 22:36:49.686534 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 707/1573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:49 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1516 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:49.714205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:49.724840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:49.745535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.750484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.751410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.752401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.753470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.754144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.807091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e4dd9d85-2363-4ac8-96fe-174c2040f893 tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:36:49.906752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:49.920322 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4865d00f-a843-4fb0-aecc-67d7f9275f24 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1260 microversion: 2.1 time: 0.226846 Oct 12 22:36:49.923732 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 708/1574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:49 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:49.934258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d98dcc6b-0349-4c72-8527-ea299b1dc122 req-b3072da3-ea63-455a-a327-6d16c4d201ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7f70c3-9232-4994-b238-9556a5739b11", "name": "network-vif-deleted", "tag": "7d427587-2e7a-42dd-8652-a6e2f4d05bcc"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:49.955602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d98dcc6b-0349-4c72-8527-ea299b1dc122 req-b3072da3-ea63-455a-a327-6d16c4d201ca service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:49.960432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d98dcc6b-0349-4c72-8527-ea299b1dc122 req-b3072da3-ea63-455a-a327-6d16c4d201ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:49.960888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d98dcc6b-0349-4c72-8527-ea299b1dc122 req-b3072da3-ea63-455a-a327-6d16c4d201ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:49.992198 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d98dcc6b-0349-4c72-8527-ea299b1dc122 req-b3072da3-ea63-455a-a327-6d16c4d201ca service nova] Creating event network-vif-deleted:7d427587-2e7a-42dd-8652-a6e2f4d05bcc for instance 7d7f70c3-9232-4994-b238-9556a5739b11 on n-h2-860864-8 Oct 12 22:36:50.011722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d98dcc6b-0349-4c72-8527-ea299b1dc122 req-b3072da3-ea63-455a-a327-6d16c4d201ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084069 Oct 12 22:36:50.013936 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 709/1575] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:50.269218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:50.270701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 11682712-1cbe-4bff-a7ab-082e85d14154] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:50.278802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.280006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.280600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.281517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.282122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.282706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.441514 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e4dd9d85-2363-4ac8-96fe-174c2040f893 tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4dd9d85-2363-4ac8-96fe-174c2040f893 tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] Request method failure captured: Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 142 Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0F_PEVSOAsoo-pG4uh3VlXZ5jg-tnqGEC6LebKzVUgYOIK9NY5icyZ6OvsqkQC6mQHImf_C91hQ14hKKHnD1upnTiNx7Q5kgmLbtJfiali0XdZ8FFVM1KtzuD-n7qUVXTjLV3xDIh1sITDEMONo5uPS3qiJ0Kz8Kce2sEfUGzIiElg Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c163550e69194d109f964df469354dbd Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FlavorsV2NegativeTest-1658566930 Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c163550e69194d109f964df469354dbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c163550e69194d109f964df469354dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c163550e69194d109f964df469354dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c163550e69194d109f964df469354dbd"}]}] Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FlavorsV2NegativeTest-1658566930 Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c163550e69194d109f964df469354dbd Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1658566930 Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FlavorsV2NegativeTest-1658566930-project Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1a218da124c1462f8657aabaf213f13b Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FlavorsV2NegativeTest-1658566930-project Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-382850886", "imageRef": "d118ddf6-f5a5-45ec-81a9-037b3e5ba801", "flavorRef": "452"}} Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: exception: Flavor's memory is too small for requested image. Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-382850886', 'imageRef': 'd118ddf6-f5a5-45ec-81a9-037b3e5ba801', 'flavorRef': '452'}}} Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:36:50.443529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 12 22:36:50.449710 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:36:50.453157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4dd9d85-2363-4ac8-96fe-174c2040f893 tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:36:50.454831 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e4dd9d85-2363-4ac8-96fe-174c2040f893 tempest-FlavorsV2NegativeTest-1658566930 tempest-FlavorsV2NegativeTest-1658566930-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.824458 Oct 12 22:36:50.455669 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 867/1576] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:36:49 2022] POST /compute/v2.1/servers => generated 93 bytes in 826 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:36:50.656948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:50.658502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:50.680868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.681925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.682487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:50.683005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.684264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.687058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.691327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.697658 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59de0410-3b36-48f0-9b42-57f084f4ebb5 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/11682712-1cbe-4bff-a7ab-082e85d14154" status: 200 len: 1508 microversion: 2.1 time: 0.454785 Oct 12 22:36:50.698572 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 710/1577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:50 2022] GET /compute/v2.1/servers/11682712-1cbe-4bff-a7ab-082e85d14154 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:50.713034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:50.713649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:50.720792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.721275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.721711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:50.723313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:50.723841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:50.724319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.177515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:51.190820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94ebd261-7400-4c89-b81e-054c51cd04a2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1516 microversion: 2.1 time: 0.480676 Oct 12 22:36:51.192835 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 711/1578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:50 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1516 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:51.199763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:51.200630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 11682712-1cbe-4bff-a7ab-082e85d14154] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:51.211930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.212717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.213322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.214544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.215276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.215923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.283943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 11682712-1cbe-4bff-a7ab-082e85d14154] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:36:51.319195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:51.361110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:51.369531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:51.373961 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-83ad91ba-aa49-4f65-8046-f308e0bfa4fb tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1281 microversion: 2.25 time: 0.720930 Oct 12 22:36:51.375635 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 868/1579] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:50 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1281 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:36:51.402683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:51.408295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:51.431298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.431802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.432272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.437837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.440340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.440801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.594210 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27a4f422-27b7-4cdb-a938-49f541bc7a51 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "DELETE /compute/v2.1/servers/11682712-1cbe-4bff-a7ab-082e85d14154" status: 204 len: 0 microversion: 2.1 time: 0.399059 Oct 12 22:36:51.595220 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 712/1580] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:36:51 2022] DELETE /compute/v2.1/servers/11682712-1cbe-4bff-a7ab-082e85d14154 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:36:51.605627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:51.608266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:51.623740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.627944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.632497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.633518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:51.634159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:51.634757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:51.686155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:36:51.708102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:51.718917 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3585a70f-06be-45fd-86a5-dddc2320ac19 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1266 microversion: 2.1 time: 0.341925 Oct 12 22:36:51.728312 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 869/1581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:51 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:51.893914 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09f76a65-9055-4851-87f3-095bfea4743d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3" status: 204 len: 0 microversion: 2.1 time: 0.293783 Oct 12 22:36:51.894672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 713/1582] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:36:51 2022] DELETE /compute/v2.1/servers/4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:36:52.110460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1285618682", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "de19e183-4ef4-4fef-a2aa-b786a05433ca"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:52.208869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] validate_networks() for [('de19e183-4ef4-4fef-a2aa-b786a05433ca', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:36:52.224518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:52.225900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:52.233762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.234695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.235356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.236651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.237349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.238292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.499652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:52.523111 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0f625e9e-1b3b-45c7-8b23-d88e53c194c1 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1516 microversion: 2.1 time: 0.304072 Oct 12 22:36:52.536494 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 714/1583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:52 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1516 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:36:52.536494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:52.536494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:52.573837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.574328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.574768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.576378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:52.576378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:52.576615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:52.597457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:53.183017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:53.196336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:53.198312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:53.204276 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e375e60-a0cc-4f60-80b1-bc3716638222 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1476 microversion: 2.25 time: 0.678186 Oct 12 22:36:53.216916 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 715/1584] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:52 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1476 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:53.234821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:53.236199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:53.243072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:53.243917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:53.244530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:53.246810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:53.247604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:53.248346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:53.681163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:53.693585 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a9948112-5abb-4f96-9506-9cbd02bc5ace tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 0.475352 Oct 12 22:36:53.697552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 716/1585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:53 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:54.444532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:54.445552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:54.455668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:54.464535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:54.465395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:54.467089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:54.471884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:54.472831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:54.687749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:36:54.688313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:36:54.689583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:36:54.690025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:36:54.690449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:36:54.706135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:54.706623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:54.713070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:54.713992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:54.714477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:54.714915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:54.766469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Getting quotas for project ac983f01662d415d955550f8bf915c52. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:36:54.783417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Getting quotas for user 2c378be604e740b2ba7d55953e34b25a and project ac983f01662d415d955550f8bf915c52. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:36:54.838951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Going to run 2 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:36:54.847527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:54.897974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=afe5ded3-94ce-4977-9fec-d5b7781147d3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:36:54.963621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid a8efca20-5bdd-4ff4-97d4-8517b7539ae8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:36:55.000281 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-121dddc0-0899-4f2c-827f-3514c878cb50 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1969 microversion: 2.25 time: 1.300555 Oct 12 22:36:55.007426 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 717/1586] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:53 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1969 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:55.018340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:55.020361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:55.020531 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4b242c0-7d4b-4075-8ca8-f8ed3c851c11 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.912223 Oct 12 22:36:55.021519 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 870/1587] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:36:52 2022] POST /compute/v2.1/servers => generated 32 bytes in 2917 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:36:55.039188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.040782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.041399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:55.042309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.042911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e1c381f8-cd11-48ad-8169-41dd3b52d20a req-c8f79b11-15df-453f-88b5-056bdb66b62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8553b1-fff8-4db0-b2c7-80ab3a4638d3", "name": "network-vif-deleted", "tag": "23d683b2-85ac-49e3-aa72-7ce1cf65e612"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:55.047157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.047734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:55.084543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e1c381f8-cd11-48ad-8169-41dd3b52d20a req-c8f79b11-15df-453f-88b5-056bdb66b62d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.090830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e1c381f8-cd11-48ad-8169-41dd3b52d20a req-c8f79b11-15df-453f-88b5-056bdb66b62d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.092977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e1c381f8-cd11-48ad-8169-41dd3b52d20a req-c8f79b11-15df-453f-88b5-056bdb66b62d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:55.136059 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e1c381f8-cd11-48ad-8169-41dd3b52d20a req-c8f79b11-15df-453f-88b5-056bdb66b62d service nova] Creating event network-vif-deleted:23d683b2-85ac-49e3-aa72-7ce1cf65e612 for instance 4e8553b1-fff8-4db0-b2c7-80ab3a4638d3 on n-h2-860864-8 Oct 12 22:36:55.148799 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e1c381f8-cd11-48ad-8169-41dd3b52d20a req-c8f79b11-15df-453f-88b5-056bdb66b62d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118859 Oct 12 22:36:55.151239 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 871/1588] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:55.164173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:55.165177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:55.180458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.182094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.182912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:55.183877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.184848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.185538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:55.730587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:55.749531 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6480ab3-3b9d-4453-9158-557c149c75f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 0.596734 Oct 12 22:36:55.763946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 872/1589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:55 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:55.781064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:55.834704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:55.835645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Searching by: {'deleted': False, 'project_id': 'ac983f01662d415d955550f8bf915c52'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:36:55.865135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.865711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.866137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:55.872346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:55.889662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:55.891875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.084727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:36:56.226110 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d6ddd42-0d77-46b4-ac4e-512ccf146aec tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.454283 Oct 12 22:36:56.228274 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 873/1590] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:36:55 2022] GET /compute/v2.1/servers => generated 1004 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:56.234938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:56.236009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:56.255658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.257118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.258493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.259594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.261521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.263347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.304604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:56.639568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:56.666099 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef065d58-a1e0-430a-a222-150dac3414c4 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1516 microversion: 2.1 time: 1.654021 Oct 12 22:36:56.666740 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 718/1591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:55 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1516 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:56.700120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7aff2ee0-eb0e-4f97-a4b5-e9702a969090 req-149084ab-0a75-49b1-9e9c-72b0061ac345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11682712-1cbe-4bff-a7ab-082e85d14154", "name": "network-vif-deleted", "tag": "f64b86b7-7493-4636-b624-d751036ca095"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:56.710626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7aff2ee0-eb0e-4f97-a4b5-e9702a969090 req-149084ab-0a75-49b1-9e9c-72b0061ac345 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.711112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7aff2ee0-eb0e-4f97-a4b5-e9702a969090 req-149084ab-0a75-49b1-9e9c-72b0061ac345 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.711550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7aff2ee0-eb0e-4f97-a4b5-e9702a969090 req-149084ab-0a75-49b1-9e9c-72b0061ac345 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.727391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7aff2ee0-eb0e-4f97-a4b5-e9702a969090 req-149084ab-0a75-49b1-9e9c-72b0061ac345 service nova] Creating event network-vif-deleted:f64b86b7-7493-4636-b624-d751036ca095 for instance 11682712-1cbe-4bff-a7ab-082e85d14154 on n-h1-860864-8 Oct 12 22:36:56.742501 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7aff2ee0-eb0e-4f97-a4b5-e9702a969090 req-149084ab-0a75-49b1-9e9c-72b0061ac345 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049876 Oct 12 22:36:56.742772 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 719/1592] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:36:56.754904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:56.760103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:56.785609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.786109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.786555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.795945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.796457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.796903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.805036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid a8efca20-5bdd-4ff4-97d4-8517b7539ae8 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:36:56.836023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52126ac8-53e1-4406-9b0f-f7a78da9af98 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1969 microversion: 2.25 time: 0.606297 Oct 12 22:36:56.844657 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 874/1593] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:36:56 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1969 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:36:56.853986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:56.854605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:56.874855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.877307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.878873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:56.880874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:56.881639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:56.884918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.128482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:57.144429 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6588aaa-c180-467a-b60d-4a666a7e777d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1214 microversion: 2.1 time: 0.398261 Oct 12 22:36:57.146621 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 720/1594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:56 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1214 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:57.159231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:57.170766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.174360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.175375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.179546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.181041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.183115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.263823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0307166-e5e6-4332-827f-2cdd478d81fe tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.114387 Oct 12 22:36:57.264571 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 721/1595] 10.222.0.20 () {60 vars in 1217 bytes} [Wed Oct 12 22:36:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:36:57.284773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": "auto"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:36:57.287935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:57.299341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.300339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.301468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.303224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.304377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.305085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.366601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'flavor' on Instance uuid a8efca20-5bdd-4ff4-97d4-8517b7539ae8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:36:57.382644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120543) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:36:57.424845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:57.436237 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52719adf-50db-435c-927a-81cf7158698e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 0.590171 Oct 12 22:36:57.453244 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 875/1596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:56 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:57.678649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:36:57.695226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:57.696108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:57.710445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.713073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.713848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:57.714992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:57.715629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:57.716901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:58.719123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:58.728691 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2c25c0e-ab25-41ac-b0ba-215a19782154 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1522 microversion: 2.1 time: 1.037882 Oct 12 22:36:58.732920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 876/1597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:57 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1522 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:58.740016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:58.748911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:58.777141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:58.778616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:58.780070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:58.781309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:58.781987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:58.782653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:58.984033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:36:59.001538 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2fb02b1b-1218-4900-9094-e86b5ae0edd1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1270 microversion: 2.1 time: 0.264790 Oct 12 22:36:59.004697 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 877/1598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:58 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1270 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:36:59.024427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:36:59.027121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:36:59.045491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.046912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.047365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:36:59.049096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:36:59.049864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:36:59.050463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:00.256145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:00.282304 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f628969d-2d46-44b6-b965-4b53b76833a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 1.269746 Oct 12 22:37:00.283280 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 878/1599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:36:59 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:00.298189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f242c905-645f-4795-ac5e-56f78e078a9e req-a34fb9c1-b0de-4297-86fa-95a20be58640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94ffeab8-5085-444f-a1c4-9ad3cd21853c", "tag": "c2c856de-2050-4f75-b44f-592fd5130d47"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:00.332655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f242c905-645f-4795-ac5e-56f78e078a9e req-a34fb9c1-b0de-4297-86fa-95a20be58640 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:00.333149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f242c905-645f-4795-ac5e-56f78e078a9e req-a34fb9c1-b0de-4297-86fa-95a20be58640 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:00.333639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f242c905-645f-4795-ac5e-56f78e078a9e req-a34fb9c1-b0de-4297-86fa-95a20be58640 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:00.354504 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f242c905-645f-4795-ac5e-56f78e078a9e req-a34fb9c1-b0de-4297-86fa-95a20be58640 service nova] Creating event network-changed:c2c856de-2050-4f75-b44f-592fd5130d47 for instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c on n-h1-860864-8 Oct 12 22:37:00.381073 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f242c905-645f-4795-ac5e-56f78e078a9e req-a34fb9c1-b0de-4297-86fa-95a20be58640 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091633 Oct 12 22:37:00.383472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 879/1600] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:00.400221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:00.401092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:00.414361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:00.415001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:00.415453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:00.416328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:00.416829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:00.417265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:00.774596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:00.782730 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-16bae620-5dd6-4eac-bd2c-8145b46c2dcf tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1522 microversion: 2.1 time: 0.397322 Oct 12 22:37:00.787804 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 880/1601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:00 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:00.796850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:00.797467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:00.819067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:00.821247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:00.821711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:00.822459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:00.825796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:00.826780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:00.956176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:00.967272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4618ac54-f694-4f72-8aba-985c1a6fc5f6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1276 microversion: 2.1 time: 0.177155 Oct 12 22:37:00.968082 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 881/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:00 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:01.309719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:01.311621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:01.366246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.371636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.375873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.377433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.378788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.379474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.678700 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77175956-25e0-40a2-84b1-e86a3b51f0cf tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8/action" status: 202 len: 0 microversion: 2.25 time: 4.404012 Oct 12 22:37:01.684219 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 722/1603] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:36:57 2022] POST /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8/action => generated 0 bytes in 4411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:01.692690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5fb9e020-8ce6-4bcb-b227-966dfe775f56 req-e1860d12-18e5-4ee5-af70-bf4f123a458e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c64bc5-a5d4-40b0-924c-87e882136445", "name": "network-vif-unplugged", "status": "completed", "tag": "1efd6f5c-18bf-4caa-8ca3-34c24ab3d040"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:01.749329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5fb9e020-8ce6-4bcb-b227-966dfe775f56 req-e1860d12-18e5-4ee5-af70-bf4f123a458e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.750343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5fb9e020-8ce6-4bcb-b227-966dfe775f56 req-e1860d12-18e5-4ee5-af70-bf4f123a458e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.751908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5fb9e020-8ce6-4bcb-b227-966dfe775f56 req-e1860d12-18e5-4ee5-af70-bf4f123a458e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.771949 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5fb9e020-8ce6-4bcb-b227-966dfe775f56 req-e1860d12-18e5-4ee5-af70-bf4f123a458e service nova] Creating event network-vif-unplugged:1efd6f5c-18bf-4caa-8ca3-34c24ab3d040 for instance 28c64bc5-a5d4-40b0-924c-87e882136445 on n-h1-860864-8 Oct 12 22:37:01.787345 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5fb9e020-8ce6-4bcb-b227-966dfe775f56 req-e1860d12-18e5-4ee5-af70-bf4f123a458e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100566 Oct 12 22:37:01.789292 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 723/1604] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:01.799834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2018162543", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b7ba0f5c-73e2-4094-b8e5-360f49f48593"}], "block_device_mapping_v2": [{"uuid": "8dd24a4f-cdc2-4b74-ac97-870b9246ca06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:01.927286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] validate_networks() for [('b7ba0f5c-73e2-4094-b8e5-360f49f48593', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:37:01.942575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:01.953955 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12b83b5a-42ea-4144-bd88-ad12654a9e39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 0.650827 Oct 12 22:37:01.955110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 882/1605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:01 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:01.961053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:01.962271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:01.977218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.978152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.978849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:01.980339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:01.981275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:01.982019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:02.441818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:02.453015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:02.455510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:02.457999 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-019659f4-f290-4b1b-a073-d93c4d19405e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.501277 Oct 12 22:37:02.459094 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 883/1606] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:01 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:02.484919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:02.485982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:02.506346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:02.506865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:02.508203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:02.510068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:02.511589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:02.512418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.087207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:03.096450 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f6cd015-fcb1-47d9-bcdf-467c76407552 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1522 microversion: 2.1 time: 0.635753 Oct 12 22:37:03.097515 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 884/1607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:02 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:03.103487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:03.108310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:03.132897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.133774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.134450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.135498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.136318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.137122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.588325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:03.610655 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3f45bb8-0f27-4e68-af1d-fde0df995139 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.511543 Oct 12 22:37:03.612920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 885/1608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:03 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:03.620092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:03.621837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:03.636344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.637499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.638414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.640141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.641424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.646867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.716111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:37:03.717168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:37:03.717789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:37:03.718527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:37:03.719145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:37:03.738604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.739265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.739857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.740793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:03.741402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:03.743341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:03.785080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:03.800383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Getting quotas for user dd8fdd646f8546a0a3aae53d1b55a8b1 and project 5549d9a44ba740baa4abee1ea9a4c3f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:03.993820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:37:04.007745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dd24a4f-cdc2-4b74-ac97-870b9246ca06',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:37:04.263527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:04.267648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:04.283558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ec13690-0c24-4588-8fe9-5d2b128f8eab tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 0.668793 Oct 12 22:37:04.295189 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 886/1609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:03 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:04.304412 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f2f686f-4996-4acb-ba65-f96809783f81 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.513367 Oct 12 22:37:04.304978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5b42d795-2748-4cae-b214-7590b8239a25 req-59091ab5-b1ff-4f79-af9f-3cf7a9ee76cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe5ded3-94ce-4977-9fec-d5b7781147d3", "tag": "7f583a08-288a-477d-9583-b0c27b97a839"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:04.312052 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 724/1610] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:37:04.320261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:04.322088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:04.333765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b42d795-2748-4cae-b214-7590b8239a25 req-59091ab5-b1ff-4f79-af9f-3cf7a9ee76cc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.334521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b42d795-2748-4cae-b214-7590b8239a25 req-59091ab5-b1ff-4f79-af9f-3cf7a9ee76cc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.336052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b42d795-2748-4cae-b214-7590b8239a25 req-59091ab5-b1ff-4f79-af9f-3cf7a9ee76cc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.339492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.342113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.344237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.346491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.348770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.351070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.352279 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5b42d795-2748-4cae-b214-7590b8239a25 req-59091ab5-b1ff-4f79-af9f-3cf7a9ee76cc service nova] Creating event network-changed:7f583a08-288a-477d-9583-b0c27b97a839 for instance afe5ded3-94ce-4977-9fec-d5b7781147d3 on n-h2-860864-8 Oct 12 22:37:04.368296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5b42d795-2748-4cae-b214-7590b8239a25 req-59091ab5-b1ff-4f79-af9f-3cf7a9ee76cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071777 Oct 12 22:37:04.369519 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 887/1611] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:04.375641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:04.376624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:04.391769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.392552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.396340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.397326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.397987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.398586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.813399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:04.908254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:04.918891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:04.927553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:04.928970 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d460f0cf-7f11-4b01-89fc-d2874c4d29b4 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.620453 Oct 12 22:37:04.934180 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 725/1612] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:04 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:04.957812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:04.958929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:04.966425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.967694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.968388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:04.969351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:04.970033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:04.970661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.110218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:05.124720 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6cb7a107-7e93-48ff-b24c-110a2835ca1a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1103 microversion: 2.1 time: 0.178544 Oct 12 22:37:05.132298 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 726/1613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:04 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1103 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:05.146115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:05.153369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:05.167457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.170186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.170853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.171801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.172454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.174822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.177491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:05.195393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cede493e-9fb3-4566-bf41-230d72a5cb03 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1522 microversion: 2.1 time: 0.824373 Oct 12 22:37:05.196012 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 888/1614] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:04 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1522 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:05.308820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:05.309721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:05.321879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.328436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.331250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.332278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.337048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.337768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.668389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:05.678310 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03f00082-e505-4bf6-b48a-dd7c897aacb7 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.543615 Oct 12 22:37:05.702271 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 727/1615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:05 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:05.779726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e494f804-cd2a-4b64-beeb-a41ae1ebb9f0 req-7066284b-31b3-43a0-899b-f66bd8f05ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c64bc5-a5d4-40b0-924c-87e882136445", "name": "network-vif-plugged", "status": "completed", "tag": "1efd6f5c-18bf-4caa-8ca3-34c24ab3d040"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:05.815183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e494f804-cd2a-4b64-beeb-a41ae1ebb9f0 req-7066284b-31b3-43a0-899b-f66bd8f05ee2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.815963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e494f804-cd2a-4b64-beeb-a41ae1ebb9f0 req-7066284b-31b3-43a0-899b-f66bd8f05ee2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.816599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e494f804-cd2a-4b64-beeb-a41ae1ebb9f0 req-7066284b-31b3-43a0-899b-f66bd8f05ee2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.861903 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e494f804-cd2a-4b64-beeb-a41ae1ebb9f0 req-7066284b-31b3-43a0-899b-f66bd8f05ee2 service nova] Creating event network-vif-plugged:1efd6f5c-18bf-4caa-8ca3-34c24ab3d040 for instance 28c64bc5-a5d4-40b0-924c-87e882136445 on n-h1-860864-8 Oct 12 22:37:05.875161 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e494f804-cd2a-4b64-beeb-a41ae1ebb9f0 req-7066284b-31b3-43a0-899b-f66bd8f05ee2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100161 Oct 12 22:37:05.878277 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 728/1616] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:05.954012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:05.965100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:05.966612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:05.978873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.982035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.982947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:05.984240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:05.985520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:05.987290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.137382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:06.178018 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d4e28f5-3aff-47b0-9597-9a42b2643ec2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 0.869652 Oct 12 22:37:06.213097 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 889/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:05 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:06.246820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:06.249461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:06.300668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.302287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.304075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.306885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:06.312086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.314945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.317323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.328269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:06.333498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:06.335849 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c23268e1-1605-462c-9f46-d38161df285b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.376259 Oct 12 22:37:06.359184 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 729/1618] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:05 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:37:06.377648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:06.378280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:06.396905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.397871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.399682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.400717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.401436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.402101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.801608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:06.820660 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eff08506-e200-4ea4-ac45-a4e94e8a9915 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1169 microversion: 2.1 time: 0.601320 Oct 12 22:37:06.822056 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 890/1619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:06 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1169 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:06.837556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-b7478f98-5f97-4d85-adb6-f860f24c3f8f req-6c050876-8cd5-40c4-a5f3-f3b1a35281ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6abaa5c2-21df-4b5e-a11c-2116b0ffc899", "tag": "fad04e43-9ca7-462d-9683-9f9dbc606906"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:06.889326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b7478f98-5f97-4d85-adb6-f860f24c3f8f req-6c050876-8cd5-40c4-a5f3-f3b1a35281ca service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.889834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b7478f98-5f97-4d85-adb6-f860f24c3f8f req-6c050876-8cd5-40c4-a5f3-f3b1a35281ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.891810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b7478f98-5f97-4d85-adb6-f860f24c3f8f req-6c050876-8cd5-40c4-a5f3-f3b1a35281ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.926279 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-b7478f98-5f97-4d85-adb6-f860f24c3f8f req-6c050876-8cd5-40c4-a5f3-f3b1a35281ca service nova] Creating event network-changed:fad04e43-9ca7-462d-9683-9f9dbc606906 for instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 on n-h2-860864-8 Oct 12 22:37:06.939334 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-b7478f98-5f97-4d85-adb6-f860f24c3f8f req-6c050876-8cd5-40c4-a5f3-f3b1a35281ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112640 Oct 12 22:37:06.943863 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 891/1620] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:06.962908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:06.964545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:06.985211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.986860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.989369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:06.990576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:06.992510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:06.993132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:07.150000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:07.165265 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-44747aa6-9033-430d-a769-14209e72c2dc tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1522 microversion: 2.1 time: 0.804659 Oct 12 22:37:07.169635 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 730/1621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:06 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1522 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:07.222219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:07.223202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:07.233490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:07.236627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:07.238733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:07.240613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:07.244097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:07.244793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:07.800323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:07.809751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:07.815546 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8363792-975d-474c-baf8-1c13e3775795 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.869537 Oct 12 22:37:07.822008 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 892/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:06 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:07.837804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:07.838694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:07.852093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:07.852964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:07.853711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:07.854665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:07.858374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:07.861716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:08.707034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:08.717652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:08.723813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:08.725254 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb00c84b-dd10-46dc-b0b2-4edcb2693809 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.901580 Oct 12 22:37:08.732653 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 893/1623] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:07 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:08.738404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:08.740743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:08.773918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:08.774725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:08.776039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:08.777356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:08.777961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:08.778517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:08.979826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:08.988704 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24a284c1-58c9-4178-934e-9c8d6fe0f608 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1169 microversion: 2.1 time: 0.254363 Oct 12 22:37:08.994687 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 894/1624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:08 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1169 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:09.004378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:09.009237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:09.019513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:09.027806 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-469313e1-d36b-4471-a088-50879a2c28d7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 1.809962 Oct 12 22:37:09.028941 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 731/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:07 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:09.038850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:09.039732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:09.041335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:09.041828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:09.042264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:09.043502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:09.044099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:09.049886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:09.055430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:09.056165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:09.056398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:09.057533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:09.057533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:09.057978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:09.390740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:09.397751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:09.401082 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-895aee71-8a09-451f-9ee8-5d1b98c6eb6d tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.370953 Oct 12 22:37:09.404721 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 732/1626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:09 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:09.412101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b72d83b0-1b7d-4fc2-ab48-17a0ed9b5d15 req-2d39e2a1-f41e-4ab1-aa7f-a89724dfe9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ffeab8-5085-444f-a1c4-9ad3cd21853c", "name": "network-vif-plugged", "status": "completed", "tag": "c2c856de-2050-4f75-b44f-592fd5130d47"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:09.441869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b72d83b0-1b7d-4fc2-ab48-17a0ed9b5d15 req-2d39e2a1-f41e-4ab1-aa7f-a89724dfe9af service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:09.442728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b72d83b0-1b7d-4fc2-ab48-17a0ed9b5d15 req-2d39e2a1-f41e-4ab1-aa7f-a89724dfe9af service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:09.443513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b72d83b0-1b7d-4fc2-ab48-17a0ed9b5d15 req-2d39e2a1-f41e-4ab1-aa7f-a89724dfe9af service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:09.464065 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b72d83b0-1b7d-4fc2-ab48-17a0ed9b5d15 req-2d39e2a1-f41e-4ab1-aa7f-a89724dfe9af service nova] Creating event network-vif-plugged:c2c856de-2050-4f75-b44f-592fd5130d47 for instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c on n-h1-860864-8 Oct 12 22:37:09.480648 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b72d83b0-1b7d-4fc2-ab48-17a0ed9b5d15 req-2d39e2a1-f41e-4ab1-aa7f-a89724dfe9af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073867 Oct 12 22:37:09.484862 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 733/1627] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:09.767717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:09.772181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:09.788481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:09.788979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:09.790059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:09.790780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:09.791451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:09.792099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:09.970133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:10.008050 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-afcad920-0c26-4f50-bd2c-98901625fab8 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1507 microversion: 2.1 time: 1.007296 Oct 12 22:37:10.009013 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 895/1628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:08 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1507 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:10.021420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:10.022038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:10.023883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:10.038601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.045677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.046428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:10.047443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.048149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.048825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:10.192842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:10.222825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:10.230662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:10.248308 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c893c485-0eea-4ac3-89fa-3c585299815b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.485086 Oct 12 22:37:10.249510 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 734/1629] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:09 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:10.254455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:10.255040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:10.287672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.288179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.288722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:10.289437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.289893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.290317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:10.528457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:10.539404 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2db93575-b0a3-40c3-8a32-2daf17029d6c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1169 microversion: 2.1 time: 0.521801 Oct 12 22:37:10.540009 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 896/1630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:10 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1169 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:10.565949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:10.566573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:10.590709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.591506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.592270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:10.593692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.594661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.605019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:10.826036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:10.836511 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-658c2e85-2afa-4af3-b346-3371ada4cd50 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 200 len: 1507 microversion: 2.1 time: 0.585646 Oct 12 22:37:10.842776 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 735/1631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:10 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 1507 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:10.849893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:10.864902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:10.877738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.878236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.878685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:10.888185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:10.888818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:10.889273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:11.236212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:11.244750 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c12844b-7cf8-43f8-9b06-eefb14b32cb6 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.398618 Oct 12 22:37:11.245354 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 736/1632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:10 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:11.273410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:11.273659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:11.305748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:11.306249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:11.306695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:11.308928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:11.309396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:11.309829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:11.365077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:11.378863 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ca78aca-23b6-41eb-a2a2-ccb0ab0b1064 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1308 microversion: 2.1 time: 0.837745 Oct 12 22:37:11.380504 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 897/1633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:10 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1308 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:11.392618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:11.393574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:11.398246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:11.413901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:11.414755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:11.415377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:11.416311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:11.417021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:11.418240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:11.632974 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-748c155f-d60a-4ab3-9f49-1313a782dd3a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 204 len: 0 microversion: 2.1 time: 0.367306 Oct 12 22:37:11.638300 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 737/1634] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:11 2022] DELETE /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:11.647098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:11.647870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:11.673166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:11.677892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:11.679081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:11.680285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:11.681070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:11.681820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:12.219098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:12.233403 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bcca49f0-39f9-4d3a-af11-853834d645a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1211 microversion: 2.1 time: 0.597418 Oct 12 22:37:12.234000 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 738/1635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:11 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1211 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:12.265386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1684275318", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4c3491cd-4fc1-4799-8217-febe742dd336"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:12.410002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] validate_networks() for [('4c3491cd-4fc1-4799-8217-febe742dd336', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:37:12.535832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:12.545295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:12.546731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:12.547918 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39b1535d-5589-4be8-b843-1a6385507d11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 1.166242 Oct 12 22:37:12.557379 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 898/1636] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:11 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:12.566132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0a2bf569-1646-458f-bb77-5d88bd6e4714 req-ea47afc0-c7e4-4ff6-8f04-24630b94592c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe5ded3-94ce-4977-9fec-d5b7781147d3", "name": "network-vif-plugged", "status": "completed", "tag": "7f583a08-288a-477d-9583-b0c27b97a839"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:12.608750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a2bf569-1646-458f-bb77-5d88bd6e4714 req-ea47afc0-c7e4-4ff6-8f04-24630b94592c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:12.614227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a2bf569-1646-458f-bb77-5d88bd6e4714 req-ea47afc0-c7e4-4ff6-8f04-24630b94592c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:12.614819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a2bf569-1646-458f-bb77-5d88bd6e4714 req-ea47afc0-c7e4-4ff6-8f04-24630b94592c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:12.638838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0a2bf569-1646-458f-bb77-5d88bd6e4714 req-ea47afc0-c7e4-4ff6-8f04-24630b94592c service nova] Creating event network-vif-plugged:7f583a08-288a-477d-9583-b0c27b97a839 for instance afe5ded3-94ce-4977-9fec-d5b7781147d3 on n-h2-860864-8 Oct 12 22:37:12.650253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0a2bf569-1646-458f-bb77-5d88bd6e4714 req-ea47afc0-c7e4-4ff6-8f04-24630b94592c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087593 Oct 12 22:37:12.657025 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 899/1637] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:12.663730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:12.668629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:12.693010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:12.693705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:12.694262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:12.695067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:12.695764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:12.696453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:13.153406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:13.182523 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34c2a641-a4ef-432b-af36-210b22da4429 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.520665 Oct 12 22:37:13.185118 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 900/1638] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:12 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:13.203540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:13.204304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:13.218155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:13.218651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:13.223016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:13.225453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:13.226143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:13.226593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:13.765043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:13.826609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:37:13.827441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:37:13.833127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:37:13.836359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:37:13.837097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:37:13.850542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:13.877182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:13.880569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:13.881217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:13.882180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:13.882880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:13.886119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:13.916721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Getting quotas for project 84e58572633e42409a75c58f484b4d66. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:13.940341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Getting quotas for user a9d084d9f8b2417ab66fee6c29ee592d and project 84e58572633e42409a75c58f484b4d66. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:13.969279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:37:13.971882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:37:14.071455 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ad7528ad-e1a3-459f-9972-9a6722742e42 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836375 Oct 12 22:37:14.083288 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 739/1639] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:37:14.091923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:14.092590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:14.107425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:14.111854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:14.112209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:14.113232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:14.116881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:14.117348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:14.162631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:14.175018 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d1024b7c-dc39-4faf-b8f4-a7bd8302c8c5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1487 microversion: 2.1 time: 0.985114 Oct 12 22:37:14.175708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 901/1640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:13 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1487 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:14.195513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:14.205235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:14.232256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:14.236827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:14.237497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:14.239366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:14.240048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:14.240865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:14.497079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:14.521692 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a37477ef-3fdf-40d1-a273-55d5891bb0f5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1211 microversion: 2.1 time: 0.437047 Oct 12 22:37:14.538556 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 740/1641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:14 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1211 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:14.909743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd76dc0f-2d33-4364-acca-ec9f1514ec53 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Action: 'create', calling method: .version_select at 0x7f44ff832430>, body: {"pool": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:15.538199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:15.552667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:15.560438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:15.562215 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65345d4f-1be9-430a-a59e-41d05241c99b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 1.381196 Oct 12 22:37:15.564539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 902/1642] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:14 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:15.588028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:15.589504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:15.603704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:15.605979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:15.606990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:15.610397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:15.611479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:15.612161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:16.028970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:16.050850 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-422fd472-003f-4324-8943-565fa4f88a12 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1270 microversion: 2.1 time: 0.467890 Oct 12 22:37:16.060726 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 903/1643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:15 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1270 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:16.065873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ad6d52b-fdd3-4d25-9b6d-a58f844a09e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:16.082244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ad6d52b-fdd3-4d25-9b6d-a58f844a09e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:16.083133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ad6d52b-fdd3-4d25-9b6d-a58f844a09e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:16.084085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ad6d52b-fdd3-4d25-9b6d-a58f844a09e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:16.216168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ad6d52b-fdd3-4d25-9b6d-a58f844a09e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:37:16.332153 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ad6d52b-fdd3-4d25-9b6d-a58f844a09e5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c/action" status: 202 len: 0 microversion: 2.1 time: 0.269876 Oct 12 22:37:16.334066 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 904/1644] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:37:16 2022] POST /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:37:16.348680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:16.352354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:16.366022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:16.368523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:16.369210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:16.372887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:16.374021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:16.374660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:17.301779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:17.327706 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f173715-4c6e-4007-a49e-7d89c2e2d1bb tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.979661 Oct 12 22:37:17.330825 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 905/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:16 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:17.345470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:17.348234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:17.364981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:17.366005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:17.366617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:17.367627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:17.368265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:17.370383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:18.394466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:18.404541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf94916b-8dc9-4c29-b0e6-1e0605e0f5fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1211 microversion: 2.1 time: 1.070123 Oct 12 22:37:18.428159 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 906/1646] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:17 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1211 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:18.433610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-96ed9b69-0ea9-49d7-b0bf-52ecf311baee req-a3bccfe1-cb20-499c-9b60-e056412ead1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6abaa5c2-21df-4b5e-a11c-2116b0ffc899", "name": "network-vif-plugged", "status": "completed", "tag": "fad04e43-9ca7-462d-9683-9f9dbc606906"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:18.461112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96ed9b69-0ea9-49d7-b0bf-52ecf311baee req-a3bccfe1-cb20-499c-9b60-e056412ead1a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:18.461895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96ed9b69-0ea9-49d7-b0bf-52ecf311baee req-a3bccfe1-cb20-499c-9b60-e056412ead1a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:18.464910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96ed9b69-0ea9-49d7-b0bf-52ecf311baee req-a3bccfe1-cb20-499c-9b60-e056412ead1a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:18.490537 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-96ed9b69-0ea9-49d7-b0bf-52ecf311baee req-a3bccfe1-cb20-499c-9b60-e056412ead1a service nova] Creating event network-vif-plugged:fad04e43-9ca7-462d-9683-9f9dbc606906 for instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 on n-h2-860864-8 Oct 12 22:37:18.509231 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-96ed9b69-0ea9-49d7-b0bf-52ecf311baee req-a3bccfe1-cb20-499c-9b60-e056412ead1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077032 Oct 12 22:37:18.510610 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 907/1647] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:18.524192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-84f8fc1b-b1b5-49af-a224-9a388d3cebb3 req-ceba0197-5d69-46dd-8106-34581a51c38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8de8c4c-95a9-4b86-b434-66592b5ecf25", "tag": "99f4970d-9b83-4ef7-8efe-8853302117b1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:18.567485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-84f8fc1b-b1b5-49af-a224-9a388d3cebb3 req-ceba0197-5d69-46dd-8106-34581a51c38b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:18.568385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-84f8fc1b-b1b5-49af-a224-9a388d3cebb3 req-ceba0197-5d69-46dd-8106-34581a51c38b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:18.570571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-84f8fc1b-b1b5-49af-a224-9a388d3cebb3 req-ceba0197-5d69-46dd-8106-34581a51c38b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:18.610225 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-84f8fc1b-b1b5-49af-a224-9a388d3cebb3 req-ceba0197-5d69-46dd-8106-34581a51c38b service nova] Creating event network-changed:99f4970d-9b83-4ef7-8efe-8853302117b1 for instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 on n-h1-860864-8 Oct 12 22:37:18.616023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-84f8fc1b-b1b5-49af-a224-9a388d3cebb3 req-ceba0197-5d69-46dd-8106-34581a51c38b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103625 Oct 12 22:37:18.617262 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 908/1648] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:18.634194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:18.642273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:18.657264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:18.663247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:18.663247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:18.664232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:18.664412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:18.664721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.179598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:19.195384 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-734bfdef-d1be-4b97-85ed-b39d31648b3c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.576535 Oct 12 22:37:19.200513 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 909/1649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:18 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:19.232160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:19.233084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:19.240415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.241691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.242046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.243073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.243718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.244378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.285961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:19.820640 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd76dc0f-2d33-4364-acca-ec9f1514ec53 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.280352 Oct 12 22:37:19.822055 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 741/1650] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:37:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:19.828371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:19.829558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:19.837676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.838574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.839402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:19.840497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:19.841245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:19.842161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.038511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:20.057768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:20.060081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:20.061937 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3042a87-0fc3-4d52-a741-fdfb02369d31 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.839865 Oct 12 22:37:20.063226 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 910/1651] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:19 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:20.074298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:20.075337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:20.082962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:20.083952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:20.084711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.085706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:20.086629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:20.087470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.132883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:20.161453 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea84b732-cb53-4a57-b919-008cf825e9e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1318 microversion: 2.1 time: 0.336625 Oct 12 22:37:20.186407 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 742/1652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:19 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:20.206879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:20.207575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:20.230935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:20.231385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:20.231828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.234676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:20.235155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:20.235580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.551546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:20.566731 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2926de5b-a534-4ef8-8831-ef80d3757fdf tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1211 microversion: 2.1 time: 0.378370 Oct 12 22:37:20.581185 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 743/1653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:20 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1211 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:20.583564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7a2543d-250f-40cd-acce-17e2dadb541b tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Calling method '.version_select at 0x7f44ffcf3160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:20.877361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:20.887812 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e16a8894-c877-4357-abd4-da7eada4f761 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1318 microversion: 2.1 time: 0.823011 Oct 12 22:37:20.888750 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 911/1654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:20 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:20.910165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7a2543d-250f-40cd-acce-17e2dadb541b tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/1995a266-1641-4a66-b00c-00ad3fc2d3c7" status: 200 len: 141 microversion: 2.1 time: 0.339902 Oct 12 22:37:20.911523 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 744/1655] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:37:20 2022] GET /compute/v2.1/os-floating-ips/1995a266-1641-4a66-b00c-00ad3fc2d3c7 => generated 141 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:20.920604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:20.922745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:20.926036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f40ae7ff-ed16-45b2-94af-42baf76d45ae req-0ba18a59-c598-4e89-96be-cf53c5d50ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c64bc5-a5d4-40b0-924c-87e882136445", "name": "network-vif-deleted", "tag": "1efd6f5c-18bf-4caa-8ca3-34c24ab3d040"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:20.943562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:20.944173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:20.945095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.946294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f40ae7ff-ed16-45b2-94af-42baf76d45ae req-0ba18a59-c598-4e89-96be-cf53c5d50ae8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:20.947672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:20.949208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f40ae7ff-ed16-45b2-94af-42baf76d45ae req-0ba18a59-c598-4e89-96be-cf53c5d50ae8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:20.949777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:20.949909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f40ae7ff-ed16-45b2-94af-42baf76d45ae req-0ba18a59-c598-4e89-96be-cf53c5d50ae8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.951701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:20.963915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f40ae7ff-ed16-45b2-94af-42baf76d45ae req-0ba18a59-c598-4e89-96be-cf53c5d50ae8 service nova] Creating event network-vif-deleted:1efd6f5c-18bf-4caa-8ca3-34c24ab3d040 for instance 28c64bc5-a5d4-40b0-924c-87e882136445 on n-h1-860864-8 Oct 12 22:37:20.972290 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f40ae7ff-ed16-45b2-94af-42baf76d45ae req-0ba18a59-c598-4e89-96be-cf53c5d50ae8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055343 Oct 12 22:37:20.975116 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 745/1656] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:20.982119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c1c0cb3-5272-4568-896d-3618741b2c74 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Calling method '.version_select at 0x7f44ff90daf0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:21.402207 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c1c0cb3-5272-4568-896d-3618741b2c74 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.424636 Oct 12 22:37:21.403595 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 746/1657] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 22:37:20 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:21.408157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:21.408960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:21.419379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:21.419873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:21.429876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:21.430670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:21.431145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:21.431830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:21.698827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:21.712553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:21.715846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:21.717920 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6663ffa-d9a5-480c-bf53-9d836188b003 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.313286 Oct 12 22:37:21.734287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 747/1658] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:21 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:21.749116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c7e431f8-8ebd-4e7d-9002-cc1563b8de43 req-c9ce3b44-7763-4554-b84f-94d71305975f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c79cad3-9e51-4fc6-bc3b-891b7dc1415e", "tag": "6d5bc982-3174-4a16-b018-f51c7b6e9a9d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:21.761959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7e431f8-8ebd-4e7d-9002-cc1563b8de43 req-c9ce3b44-7763-4554-b84f-94d71305975f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:21.762861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7e431f8-8ebd-4e7d-9002-cc1563b8de43 req-c9ce3b44-7763-4554-b84f-94d71305975f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:21.764720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7e431f8-8ebd-4e7d-9002-cc1563b8de43 req-c9ce3b44-7763-4554-b84f-94d71305975f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:21.781320 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c7e431f8-8ebd-4e7d-9002-cc1563b8de43 req-c9ce3b44-7763-4554-b84f-94d71305975f service nova] Creating event network-changed:6d5bc982-3174-4a16-b018-f51c7b6e9a9d for instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e on n-h1-860864-8 Oct 12 22:37:21.788526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c7e431f8-8ebd-4e7d-9002-cc1563b8de43 req-c9ce3b44-7763-4554-b84f-94d71305975f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045695 Oct 12 22:37:21.789734 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 748/1659] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:21.790652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:21.797726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:21.798733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:21.798874 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-64ca65c5-a788-4776-86a4-90337d770a37 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.908799 Oct 12 22:37:21.807592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:21.808668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:21.809332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:21.810397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:21.811078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:21.812091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:21.817613 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 912/1660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:20 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:21.827768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9901405-b02c-4e03-a0f3-8bb8364d1417 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Calling method '.version_select at 0x7f4507bf0e50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:22.071154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:22.080528 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f292e05-b2ca-40c6-860b-49e6fc88db6b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1318 microversion: 2.1 time: 0.289160 Oct 12 22:37:22.081104 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 749/1661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:21 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:22.086285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:22.087277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:22.096286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:22.097237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:22.097951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:22.098984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:22.099564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:22.100079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:22.286423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:22.309245 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e253251-8769-439c-86bf-c76d431b2cb5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1211 microversion: 2.1 time: 0.226761 Oct 12 22:37:22.310068 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 750/1662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:22 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1211 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:22.316533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:22.317591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:22.326704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:22.327488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:22.328223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:22.329594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:22.330375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:22.332677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:22.538968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:22.548880 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e0f102eb-3550-49dd-8dd9-94e1ba9f3354 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 200 len: 1506 microversion: 2.1 time: 0.237206 Oct 12 22:37:22.549764 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 751/1663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:22 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:22.631305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d325e080-154e-4932-8614-4a2aa09b4047 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Action: 'create', calling method: .version_select at 0x7f44ff7c0430>, body: {"keypair": {"name": "tempest-keypair-1218618430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/jpyQCaA80nYC/I6hsd0c6hTCa+j/Gy1DaDifp+xHsVrCeVm20ku/gCS6nYcCmdzIh8WPJnk2QClH3DjICOJWwkdMYMZIuJvOoRaFU8JCNKFNUGz6mzDRZTBj3IAy81Q=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:22.649367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d325e080-154e-4932-8614-4a2aa09b4047 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Getting quotas for project 14a9f523cfeb445d8e29d7b623fc2ebb. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:22.655011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d325e080-154e-4932-8614-4a2aa09b4047 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Getting quotas for user 1c8e831ff5a04558af42247fcf15670b and project 14a9f523cfeb445d8e29d7b623fc2ebb. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:22.683970 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d325e080-154e-4932-8614-4a2aa09b4047 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131571 Oct 12 22:37:22.684670 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 752/1664] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:37:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:22.700538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:22.701459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:22.712952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:22.714413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:22.715177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:22.716246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:22.717343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:22.718011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.015007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:23.033678 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-feb74b9f-f86b-4cc3-86d7-deeecf78b6cd tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3" status: 200 len: 1506 microversion: 2.1 time: 0.347174 Oct 12 22:37:23.051853 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 753/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:22 2022] GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:23.077447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:23.078049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:23.091691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.092305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.092747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.093517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.094007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.094432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.137006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:23.429612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:23.446915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:23.449985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:23.452746 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc6c82da-cb97-4010-adea-7c9f05bfe4c2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.380067 Oct 12 22:37:23.453946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 754/1666] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:23 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:23.465084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:23.465739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:23.472598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.473857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.474380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.475177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.475632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.476098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.489936 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9901405-b02c-4e03-a0f3-8bb8364d1417 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/1995a266-1641-4a66-b00c-00ad3fc2d3c7" status: 202 len: 0 microversion: 2.1 time: 1.671086 Oct 12 22:37:23.494295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 913/1667] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:37:21 2022] DELETE /compute/v2.1/os-floating-ips/1995a266-1641-4a66-b00c-00ad3fc2d3c7 => generated 0 bytes in 1676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:37:23.509940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:23.516562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:23.524220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.524965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.525557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.526650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.527283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.527863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.556956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:23.684644 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb0669ea-0680-48e9-b228-49f507810391 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "DELETE /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3" status: 204 len: 0 microversion: 2.1 time: 0.184053 Oct 12 22:37:23.685640 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 914/1668] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:23 2022] DELETE /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:23.697550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:23.701453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:23.717662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.718569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.719224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.720231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.720842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.721442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.824872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:23.842795 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3047647-231b-4725-8696-b5951638daa7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.386998 Oct 12 22:37:23.844663 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 755/1669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:23 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:23.852763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:23.853652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:23.864311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.865539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.865943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.866878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:23.867578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:23.868050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:23.910673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:24.066859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:24.080574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a3d5158-b97f-447b-a551-ed7fbe44a98c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1318 microversion: 2.1 time: 0.389299 Oct 12 22:37:24.081492 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 915/1670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:23 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:24.092893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b8d27cf-955c-422b-9a9b-115dd332fc41 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Action: 'create', calling method: .version_select at 0x7f4507aee9d0>, body: {"pool": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:24.117618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:24.129057 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33475874-9e9d-45ea-baaf-f3d93f130b40 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1199 microversion: 2.1 time: 0.283084 Oct 12 22:37:24.129685 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 756/1671] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:23 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1199 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:24.144239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:24.144793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:24.159458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.159993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.160438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.163691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.168367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.169084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.232814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:24.368621 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afe84021-d0ac-4352-a9c0-bcae28cbbfa8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 204 len: 0 microversion: 2.1 time: 0.235773 Oct 12 22:37:24.373728 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 757/1672] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:24 2022] DELETE /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:24.381374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:24.382379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:24.391777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.394658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.395860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.399586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.402269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.403636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.680078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:24.688975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a5c8e4d-8ddf-490a-a845-89a68edc0fc8 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3" status: 200 len: 1512 microversion: 2.1 time: 0.313373 Oct 12 22:37:24.699715 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 758/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:24 2022] GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:24.705255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:24.706372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:24.710292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:24.715194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.716815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.717476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.718382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.719225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.720100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.910851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:24.924111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:24.926325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:24.930689 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59c14535-ffbe-4cd8-bd47-c959d8f85f20 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.227828 Oct 12 22:37:24.947919 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 759/1674] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:24 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:24.947919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:24.947919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:24.955139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.955715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.956280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:24.957086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:24.957713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:24.958166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.157366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:25.169623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d48884e-9eb6-4ac9-9ec0-56f98584d8a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.234828 Oct 12 22:37:25.180210 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 760/1675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:24 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:25.195303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:25.199502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:25.217067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.219639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.220952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.222788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.224539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.225198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.456889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:25.473428 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21fb8329-96a0-49cd-9d39-1f0a67ff6422 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1318 microversion: 2.1 time: 0.291839 Oct 12 22:37:25.474275 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 761/1676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:25 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:25.480338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:25.481445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:25.487647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.488233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.488751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.489540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.490973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.491500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.692052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:25.705745 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c9df8e27-e492-4e71-9493-c377ea289b89 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1199 microversion: 2.1 time: 0.229284 Oct 12 22:37:25.707126 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 762/1677] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:25 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1199 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:25.730735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:25.731361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:25.739037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.739529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.740234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.741101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.741737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.742361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.943868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:25.957471 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-66f95f2b-49c2-4ff8-9ec5-3ec4052bd0c1 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3" status: 200 len: 1512 microversion: 2.1 time: 0.230854 Oct 12 22:37:25.958370 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 763/1678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:25 2022] GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:25.964601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:25.965365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:25.972887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.973488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.974560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:25.975266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:25.975836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:25.976324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:26.144497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:26.157685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:26.163797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:26.168093 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4ced6d4-987f-4e67-ad50-34e274e2cd97 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.207234 Oct 12 22:37:26.179940 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 764/1679] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:25 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:26.202010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:26.202801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:26.236272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:26.237063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:26.237897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:26.238846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:26.239512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:26.241783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:26.454635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:26.462997 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a6ad0dd-4fbe-43e6-bc9a-1e5a4f264b0c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.270011 Oct 12 22:37:26.463983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 765/1680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:26 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:26.498250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:26.498840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:26.506317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:26.507391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:26.507964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:26.508952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:26.509525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:26.510353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:26.762903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:26.779865 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce9cbd23-e884-46fb-9c83-4f30148ccce3 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1318 microversion: 2.1 time: 0.285290 Oct 12 22:37:26.780533 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 766/1681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:26 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:26.788503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:26.790936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:26.804852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:26.805403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:26.805849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:26.806938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:26.807448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:26.807884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:27.745704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:27.754799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3567ab83-79c5-44e6-b299-4377da267773 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1199 microversion: 2.1 time: 0.971848 Oct 12 22:37:27.756141 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 767/1682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:26 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1199 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:27.762037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:27.769031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:27.777461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:27.778452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:27.779107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:27.780102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:27.780783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:27.781695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:27.979841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c378be604e740b2ba7d55953e34b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac983f01662d415d955550f8bf915c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:27.991468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f6ecfd3-9640-4097-8f4b-ac11831c9979 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3" status: 200 len: 1470 microversion: 2.1 time: 0.232171 Oct 12 22:37:27.993114 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 768/1683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:27 2022] GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:28.000213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:28.002050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:28.009597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:28.010637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:28.011810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:28.012540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:28.013156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:28.013887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:28.035603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:28.435785 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b8d27cf-955c-422b-9a9b-115dd332fc41 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.352811 Oct 12 22:37:28.437126 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 916/1684] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:37:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:28.444522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-73cf1c21-21b9-4f79-8153-6961bfc2c198 req-b9fd71e0-186f-454c-abf7-e972a2294419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79cad3-9e51-4fc6-bc3b-891b7dc1415e", "name": "network-vif-plugged", "status": "completed", "tag": "6d5bc982-3174-4a16-b018-f51c7b6e9a9d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:28.456776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-73cf1c21-21b9-4f79-8153-6961bfc2c198 req-b9fd71e0-186f-454c-abf7-e972a2294419 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:28.457772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-73cf1c21-21b9-4f79-8153-6961bfc2c198 req-b9fd71e0-186f-454c-abf7-e972a2294419 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:28.458103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-73cf1c21-21b9-4f79-8153-6961bfc2c198 req-b9fd71e0-186f-454c-abf7-e972a2294419 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:28.471598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-73cf1c21-21b9-4f79-8153-6961bfc2c198 req-b9fd71e0-186f-454c-abf7-e972a2294419 service nova] Creating event network-vif-plugged:6d5bc982-3174-4a16-b018-f51c7b6e9a9d for instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e on n-h1-860864-8 Oct 12 22:37:28.477138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-73cf1c21-21b9-4f79-8153-6961bfc2c198 req-b9fd71e0-186f-454c-abf7-e972a2294419 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038593 Oct 12 22:37:28.479821 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 917/1685] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:28.485825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b326fa30-0e6a-4479-b6d1-ebe7f999b315"}], "security_groups": [{"name": "tempest-securitygroup--1717463961"}], "key_name": "tempest-keypair-1218618430", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:28.508712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:28.527254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:28.534674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:28.536618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cda784f2-6f27-482a-96ef-202e04e3dabf tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.542174 Oct 12 22:37:28.540030 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 769/1686] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:27 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:28.545938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:28.547099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:28.554444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:28.556668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:28.561935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:28.563080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:28.585328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:28.595172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:29.020018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:29.030731 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb4e3460-29f7-4c4b-96b0-555cdb8f041b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.488642 Oct 12 22:37:29.046605 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 770/1687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:28 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:29.046605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-48e8fe55-a779-467d-aba9-cf8fac2350a1 req-e56df275-dc76-485e-9aa5-45bf1f2aee45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe5ded3-94ce-4977-9fec-d5b7781147d3", "name": "network-vif-deleted", "tag": "7f583a08-288a-477d-9583-b0c27b97a839"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:29.052235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-48e8fe55-a779-467d-aba9-cf8fac2350a1 req-e56df275-dc76-485e-9aa5-45bf1f2aee45 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:29.053554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-48e8fe55-a779-467d-aba9-cf8fac2350a1 req-e56df275-dc76-485e-9aa5-45bf1f2aee45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:29.054104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-48e8fe55-a779-467d-aba9-cf8fac2350a1 req-e56df275-dc76-485e-9aa5-45bf1f2aee45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:29.067829 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-48e8fe55-a779-467d-aba9-cf8fac2350a1 req-e56df275-dc76-485e-9aa5-45bf1f2aee45 service nova] Creating event network-vif-deleted:7f583a08-288a-477d-9583-b0c27b97a839 for instance afe5ded3-94ce-4977-9fec-d5b7781147d3 on n-h2-860864-8 Oct 12 22:37:29.077825 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-48e8fe55-a779-467d-aba9-cf8fac2350a1 req-e56df275-dc76-485e-9aa5-45bf1f2aee45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044455 Oct 12 22:37:29.079175 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 771/1688] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:29.084805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:29.085503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:29.091748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:29.092361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:29.093058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:29.093838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:29.094298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:29.094736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:29.229603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] validate_networks() for [('b326fa30-0e6a-4479-b6d1-ebe7f999b315', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:37:29.311234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:29.320996 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a3f1d16-cdc2-4346-88fe-eec126520273 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1318 microversion: 2.1 time: 0.240597 Oct 12 22:37:29.337317 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 772/1689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:29 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:29.343029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-861a7040-545e-4d39-b0de-633d76cf6a4c tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Calling method '.version_select at 0x7f44ff613700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:29.981542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:37:29.982636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:37:29.983304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:37:29.984716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:37:29.985373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:37:29.996838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:29.997575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:29.998206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:29.999131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:29.999780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.000743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.038156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Getting quotas for project 14a9f523cfeb445d8e29d7b623fc2ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:30.046250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Getting quotas for user 1c8e831ff5a04558af42247fcf15670b and project 14a9f523cfeb445d8e29d7b623fc2ebb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:30.062371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:37:30.065387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:37:30.125566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-931984d0-1a0f-4824-a3b4-6b61307e6357 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.644392 Oct 12 22:37:30.133419 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 918/1690] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:37:30.140292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-93868fa2-7f5a-45bf-8098-b619512a3ad5 req-405613c3-5101-490b-a9d5-6b1151eaaeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6abaa5c2-21df-4b5e-a11c-2116b0ffc899", "name": "network-vif-deleted", "tag": "fad04e43-9ca7-462d-9683-9f9dbc606906"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:30.159862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93868fa2-7f5a-45bf-8098-b619512a3ad5 req-405613c3-5101-490b-a9d5-6b1151eaaeca service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.161536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93868fa2-7f5a-45bf-8098-b619512a3ad5 req-405613c3-5101-490b-a9d5-6b1151eaaeca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.162543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93868fa2-7f5a-45bf-8098-b619512a3ad5 req-405613c3-5101-490b-a9d5-6b1151eaaeca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.183443 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-93868fa2-7f5a-45bf-8098-b619512a3ad5 req-405613c3-5101-490b-a9d5-6b1151eaaeca service nova] Creating event network-vif-deleted:fad04e43-9ca7-462d-9683-9f9dbc606906 for instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 on n-h2-860864-8 Oct 12 22:37:30.191491 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-93868fa2-7f5a-45bf-8098-b619512a3ad5 req-405613c3-5101-490b-a9d5-6b1151eaaeca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055209 Oct 12 22:37:30.193533 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 919/1691] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:30.204115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:30.205839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:30.213661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.214387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.215036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.216099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.216705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.217408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.609681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:30.618705 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4af661a4-66f9-40f2-8b03-2545fb379aa1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1199 microversion: 2.1 time: 0.423635 Oct 12 22:37:30.639775 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 920/1692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:30 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1199 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:30.646324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:30.647128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: afe5ded3-94ce-4977-9fec-d5b7781147d3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:30.654378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.655063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.655655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.656589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.657189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.657760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.675600 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] HTTP exception thrown: Instance afe5ded3-94ce-4977-9fec-d5b7781147d3 could not be found. Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Request method failure captured: Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3 HTTP/1.1 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Fl9RUjNO8vkhxGvNlKGyoNvxb5TlPQ4mvKrwjClpGwyQ-43ZGvwO32Zudf-9yl0ddtYHRvCyzjqC35V39pYfQ93IJ8CLPLyUpDVHLqJUUXX3Wsvm9QBCzlLBaiUBCXadPxR6M9BTSIJcWhwiWd2_WM610-SZbSV2KOK_L3lHGBnpA Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ac983f01662d415d955550f8bf915c52 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-MultipleCreateTestJSON-1963069579 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac983f01662d415d955550f8bf915c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac983f01662d415d955550f8bf915c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac983f01662d415d955550f8bf915c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac983f01662d415d955550f8bf915c52"}]}] Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-MultipleCreateTestJSON-1963069579 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ac983f01662d415d955550f8bf915c52 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1963069579 Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-MultipleCreateTestJSON-1963069579-project Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 2c378be604e740b2ba7d55953e34b25a Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-MultipleCreateTestJSON-1963069579-project Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance afe5ded3-94ce-4977-9fec-d5b7781147d3 could not be found. Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'afe5ded3-94ce-4977-9fec-d5b7781147d3'} Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe5ded3-94ce-4977-9fec-d5b7781147d3 could not be found. Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe5ded3-94ce-4977-9fec-d5b7781147d3 could not be found. Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:30.677524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe5ded3-94ce-4977-9fec-d5b7781147d3 could not be found. Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:30.685497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Returning 404 to user: Instance afe5ded3-94ce-4977-9fec-d5b7781147d3 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:30.690521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-837b1ddc-6f82-4fa2-9993-168f8b7072e3 tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3" status: 404 len: 111 microversion: 2.1 time: 0.046934 Oct 12 22:37:30.691271 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 921/1693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:30 2022] GET /compute/v2.1/servers/afe5ded3-94ce-4977-9fec-d5b7781147d3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:30.696798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:30.698746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:30.704916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.705624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.706987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.707749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.708659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.710275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.838128 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-861a7040-545e-4d39-b0de-633d76cf6a4c tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f" status: 202 len: 0 microversion: 2.1 time: 1.499116 Oct 12 22:37:30.843090 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 773/1694] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:37:29 2022] DELETE /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f => generated 0 bytes in 1505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:37:30.849253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:30.849982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:30.857946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.858773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.859474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.860481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.861221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.861781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.941572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:30.953177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:30.955752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:30.957464 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5508135-6618-4e0c-b05c-2ee653812ee6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.264486 Oct 12 22:37:30.958265 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 922/1695] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:30 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:30.966572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:30.968148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:30.982056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.982704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.982963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:30.983986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:30.984468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:30.984966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.075151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:31.084400 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12c2200c-37e9-44f7-8ec4-3bda68c1236a tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1222 microversion: 2.1 time: 0.124871 Oct 12 22:37:31.085483 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 923/1696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:30 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:31.091262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.092308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:31.098415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:31.106577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.107084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.107525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.108429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.108881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.109303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.110615 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5e3bc24-7604-486e-8da0-03fcd58357e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.265859 Oct 12 22:37:31.114436 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 774/1697] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:30 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:31.124314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.125291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] [instance: 6abaa5c2-21df-4b5e-a11c-2116b0ffc899] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:31.140231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.140981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.141605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.142832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.143710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.144349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.183726 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] HTTP exception thrown: Instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 could not be found. Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Request method failure captured: Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 HTTP/1.1 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Fl9RUjNO8vkhxGvNlKGyoNvxb5TlPQ4mvKrwjClpGwyQ-43ZGvwO32Zudf-9yl0ddtYHRvCyzjqC35V39pYfQ93IJ8CLPLyUpDVHLqJUUXX3Wsvm9QBCzlLBaiUBCXadPxR6M9BTSIJcWhwiWd2_WM610-SZbSV2KOK_L3lHGBnpA Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ac983f01662d415d955550f8bf915c52 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MultipleCreateTestJSON-1963069579 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac983f01662d415d955550f8bf915c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac983f01662d415d955550f8bf915c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac983f01662d415d955550f8bf915c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac983f01662d415d955550f8bf915c52"}]}] Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MultipleCreateTestJSON-1963069579 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ac983f01662d415d955550f8bf915c52 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1963069579 Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MultipleCreateTestJSON-1963069579-project Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 2c378be604e740b2ba7d55953e34b25a Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MultipleCreateTestJSON-1963069579-project Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 could not be found. Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '6abaa5c2-21df-4b5e-a11c-2116b0ffc899'} Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 could not be found. Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 could not be found. Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.188153 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.193499 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.193499 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:31.193499 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:31.193499 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:31.193499 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:31.193499 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 could not be found. Oct 12 22:37:31.193499 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.195214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] Returning 404 to user: Instance 6abaa5c2-21df-4b5e-a11c-2116b0ffc899 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:31.198125 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-243c9088-301e-4a55-96e3-1bc326e31e2b tempest-MultipleCreateTestJSON-1963069579 tempest-MultipleCreateTestJSON-1963069579-project] 10.222.0.20 "GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899" status: 404 len: 111 microversion: 2.1 time: 0.080431 Oct 12 22:37:31.198701 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 775/1698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/servers/6abaa5c2-21df-4b5e-a11c-2116b0ffc899 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:31.207336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d79d141a-0784-462e-ad3d-b207aff68607 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Calling method '.version_select at 0x7f44ff7c7f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.297732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:31.312904 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e246851-1b12-4d48-9d1e-7851fcb5c958 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1507 microversion: 2.1 time: 0.225899 Oct 12 22:37:31.313833 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 924/1699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:31.316958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-d79d141a-0784-462e-ad3d-b207aff68607 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP bca1ac40-2d62-4444-b262-4c33115dba7f could not be found", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:37:31.320101 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d79d141a-0784-462e-ad3d-b207aff68607 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] HTTP exception thrown: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d79d141a-0784-462e-ad3d-b207aff68607 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Request method failure captured: Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f HTTP/1.1 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0GZL9yrsav19zqFwYT3cwE9FWjMmKnci-klDXbVnUB52FHHHZ6dYlCId2jUav2UOyxrMq5ii1n7KP9qbk1k476StCdEG4qN36E0EBd5SznyPJJRPafuJ7D42R-OCxmkv-nn2nVT1zomWXOoNS9JromhvgccdTp4t8-9FEVYZ8dQmOM Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 51bffabc5e92410abe17974fc9722361 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FloatingIPsTestJSON-552465754 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51bffabc5e92410abe17974fc9722361"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/51bffabc5e92410abe17974fc9722361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_51bffabc5e92410abe17974fc9722361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51bffabc5e92410abe17974fc9722361"}]}] Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FloatingIPsTestJSON-552465754 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 51bffabc5e92410abe17974fc9722361 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FloatingIPsTestJSON-552465754 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FloatingIPsTestJSON-552465754-project Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1c340f7805b849c1825a1686a056dc82 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FloatingIPsTestJSON-552465754-project Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: exception: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'bca1ac40-2d62-4444-b262-4c33115dba7f'} Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP bca1ac40-2d62-4444-b262-4c33115dba7f could not be found Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd25b82e-1530-44ca-a88d-d8adba7ad845'] Oct 12 22:37:31.323667 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f. Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.328166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.333452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d79d141a-0784-462e-ad3d-b207aff68607 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Returning 404 to user: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:31.334311 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d79d141a-0784-462e-ad3d-b207aff68607 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f" status: 404 len: 111 microversion: 2.1 time: 0.131231 Oct 12 22:37:31.335046 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 776/1700] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:31.335742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.336412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:31.346450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-691cc2fe-df81-41af-a33a-a0c1191d4528 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Calling method '.version_select at 0x7f44ff8ac040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.352951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.354524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.354524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.356012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.357856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.360112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.480786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-691cc2fe-df81-41af-a33a-a0c1191d4528 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP bca1ac40-2d62-4444-b262-4c33115dba7f could not be found", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:37:31.482819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-691cc2fe-df81-41af-a33a-a0c1191d4528 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] HTTP exception thrown: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-691cc2fe-df81-41af-a33a-a0c1191d4528 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Request method failure captured: Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f HTTP/1.1 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0GZL9yrsav19zqFwYT3cwE9FWjMmKnci-klDXbVnUB52FHHHZ6dYlCId2jUav2UOyxrMq5ii1n7KP9qbk1k476StCdEG4qN36E0EBd5SznyPJJRPafuJ7D42R-OCxmkv-nn2nVT1zomWXOoNS9JromhvgccdTp4t8-9FEVYZ8dQmOM Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 51bffabc5e92410abe17974fc9722361 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FloatingIPsTestJSON-552465754 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51bffabc5e92410abe17974fc9722361"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/51bffabc5e92410abe17974fc9722361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_51bffabc5e92410abe17974fc9722361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51bffabc5e92410abe17974fc9722361"}]}] Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FloatingIPsTestJSON-552465754 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 51bffabc5e92410abe17974fc9722361 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FloatingIPsTestJSON-552465754 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FloatingIPsTestJSON-552465754-project Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1c340f7805b849c1825a1686a056dc82 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FloatingIPsTestJSON-552465754-project Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: exception: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'bca1ac40-2d62-4444-b262-4c33115dba7f'} Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP bca1ac40-2d62-4444-b262-4c33115dba7f could not be found Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ba4d68-74d2-46a2-a861-ad13b3c41f3e'] Oct 12 22:37:31.485168 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f. Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-691cc2fe-df81-41af-a33a-a0c1191d4528 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] Returning 404 to user: Floating IP not found for ID bca1ac40-2d62-4444-b262-4c33115dba7f {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:31.490422 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-691cc2fe-df81-41af-a33a-a0c1191d4528 tempest-FloatingIPsTestJSON-552465754 tempest-FloatingIPsTestJSON-552465754-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f" status: 404 len: 111 microversion: 2.1 time: 0.146839 Oct 12 22:37:31.496944 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 777/1701] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:37:31 2022] DELETE /compute/v2.1/os-floating-ips/bca1ac40-2d62-4444-b262-4c33115dba7f => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:31.546682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:31.554555 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95dcc3f9-90b3-4bce-be9a-fe52d9876947 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1507 microversion: 2.1 time: 0.222786 Oct 12 22:37:31.555119 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 925/1702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:31.577849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:31.580364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:31.587123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.587729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.588310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.589052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.589641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.590132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.645585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.646192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:31.653302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.653983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.654559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.655420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.656073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.656647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.656777 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9501a30a-b59b-46c9-9733-acfdc5deeb0a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "PUT /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1079 microversion: 2.1 time: 0.082826 Oct 12 22:37:31.657355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 778/1703] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:37:31 2022] PUT /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1079 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:31.678303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.679274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:31.686535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.687086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.687525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.688300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:31.688743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:31.689168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:31.829161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:31.840156 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-011e5ebf-c9f6-498d-8ce0-2d8bd5b5c699 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1199 microversion: 2.1 time: 0.197942 Oct 12 22:37:31.841536 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 926/1704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1199 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:31.990344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:31.991879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:32.002611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.003479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.004302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.005841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.006736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.007446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.257447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:32.267487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:32.269141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:32.270430 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50f668e1-0be9-4ebc-beac-c79d06655fd0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.287613 Oct 12 22:37:32.271112 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 927/1705] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:37:32.277598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:32.278867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:32.289007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.289936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.290479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.291792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.292495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.292989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.367346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:32.376220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b7dedc9-dfea-4def-b507-fa2bbc483e77 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1284 microversion: 2.1 time: 0.102524 Oct 12 22:37:32.376918 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 928/1706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:32 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:32.381953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:32.382870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:32.398107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.398606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.399042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.399747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.400252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.400700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.507771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:32.516564 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8925f913-3b37-4eb1-98df-db19c499d5ba tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1505 microversion: 2.1 time: 0.844277 Oct 12 22:37:32.517253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 779/1707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:31 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1505 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:32.529668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4a1a1c01-1187-4ec1-98a7-a4cc8907dc66 req-d37b2e54-5054-4ed0-be57-85c346ce7b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8efca20-5bdd-4ff4-97d4-8517b7539ae8", "name": "network-vif-unplugged", "status": "completed", "tag": "c1b2ba2f-74a1-4b43-bd69-c011d0a69632"}, {"name": "network-changed", "server_uuid": "a8efca20-5bdd-4ff4-97d4-8517b7539ae8", "tag": "c1b2ba2f-74a1-4b43-bd69-c011d0a69632"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:32.541330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4a1a1c01-1187-4ec1-98a7-a4cc8907dc66 req-d37b2e54-5054-4ed0-be57-85c346ce7b1f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.542070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4a1a1c01-1187-4ec1-98a7-a4cc8907dc66 req-d37b2e54-5054-4ed0-be57-85c346ce7b1f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.542580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4a1a1c01-1187-4ec1-98a7-a4cc8907dc66 req-d37b2e54-5054-4ed0-be57-85c346ce7b1f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.557779 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4a1a1c01-1187-4ec1-98a7-a4cc8907dc66 req-d37b2e54-5054-4ed0-be57-85c346ce7b1f service nova] Creating event network-vif-unplugged:c1b2ba2f-74a1-4b43-bd69-c011d0a69632 for instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 on n-h1-860864-8 Oct 12 22:37:32.558284 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4a1a1c01-1187-4ec1-98a7-a4cc8907dc66 req-d37b2e54-5054-4ed0-be57-85c346ce7b1f service nova] Creating event network-changed:c1b2ba2f-74a1-4b43-bd69-c011d0a69632 for instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 on n-h1-860864-8 Oct 12 22:37:32.563709 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4a1a1c01-1187-4ec1-98a7-a4cc8907dc66 req-d37b2e54-5054-4ed0-be57-85c346ce7b1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.045058 Oct 12 22:37:32.564555 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 780/1708] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:32.570484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:32.571179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:32.577778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.578493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.579090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.580013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.580638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.581218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.655036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:32.662117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:32.664267 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-77b3db66-5b3a-4d6b-876e-c688338469be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.285879 Oct 12 22:37:32.665579 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 929/1709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:32 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:32.865584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:32.866498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:32.872532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.873010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.873775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.874643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:32.875093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:32.875698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:32.880397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:33.168035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:33.181117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:33.198076 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebafcb38-a2dc-402d-9aa3-2213656c422d tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1199 microversion: 2.1 time: 0.329912 Oct 12 22:37:33.206969 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6367fc99-d001-4115-8391-a243f67b1d2b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1505 microversion: 2.1 time: 0.641040 Oct 12 22:37:33.211366 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 781/1710] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:32 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:33.211741 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 930/1711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:32 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1199 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:33.230069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:33.232902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:33.246065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.246688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.247250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:33.248167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.248711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.249227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:33.298423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:33.299087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:33.308924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.312609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.313185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:33.315576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.316180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.321821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:33.380591 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-655d4606-687e-4dc5-ba4b-094bc1c6afb0 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "PUT /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1081 microversion: 2.1 time: 0.154369 Oct 12 22:37:33.397745 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 782/1712] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:37:33 2022] PUT /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1081 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:33.409995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2650f333-b9ee-461e-85e8-198bdc122dfe req-c3613d44-aee8-410f-85e0-6b19a533e6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8de8c4c-95a9-4b86-b434-66592b5ecf25", "name": "network-vif-plugged", "status": "completed", "tag": "99f4970d-9b83-4ef7-8efe-8853302117b1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:33.426046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2650f333-b9ee-461e-85e8-198bdc122dfe req-c3613d44-aee8-410f-85e0-6b19a533e6ec service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.427604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2650f333-b9ee-461e-85e8-198bdc122dfe req-c3613d44-aee8-410f-85e0-6b19a533e6ec service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.428222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2650f333-b9ee-461e-85e8-198bdc122dfe req-c3613d44-aee8-410f-85e0-6b19a533e6ec service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:33.443738 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2650f333-b9ee-461e-85e8-198bdc122dfe req-c3613d44-aee8-410f-85e0-6b19a533e6ec service nova] Creating event network-vif-plugged:99f4970d-9b83-4ef7-8efe-8853302117b1 for instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 on n-h1-860864-8 Oct 12 22:37:33.450772 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2650f333-b9ee-461e-85e8-198bdc122dfe req-c3613d44-aee8-410f-85e0-6b19a533e6ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051403 Oct 12 22:37:33.452077 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 783/1713] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:33.458158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:33.459356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:33.472636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.473141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.473589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:33.478444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:33.479335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:33.480679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.031139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.052287 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3b97c0d-3eaa-4724-9203-4e31f9c564da tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1352 microversion: 2.1 time: 0.587209 Oct 12 22:37:34.053550 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 784/1714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:33 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1352 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:34.059219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:34.060112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:34.068427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.068921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.069419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.070127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.070582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.071403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.148969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.165433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.168047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.170554 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db1bd401-edeb-40d5-ae57-163bc5290c55 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.877365 Oct 12 22:37:34.188418 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 931/1715] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:33 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:37:34.195814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:34.196508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:34.203801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.204354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.204793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.205519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.205972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.206589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.499405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.512930 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a527bdf0-1e65-4354-a373-69227c6c43cc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.323084 Oct 12 22:37:34.514069 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 932/1716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:34 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:34.524569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:34.526013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:34.545624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.551475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.552159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.553980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.554555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.556403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.796718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.826914 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-717dd399-2439-48e9-b5ac-05fd6ef5c993 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1507 microversion: 2.1 time: 0.770755 Oct 12 22:37:34.828738 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 785/1717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:34 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1507 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:34.850294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:34.851197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:34.857522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.858228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.858823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.860134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:34.860379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:34.860976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:34.908273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:34.918098 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b93920d9-006d-4a43-b62c-79b6992d06f7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1199 microversion: 2.1 time: 0.401453 Oct 12 22:37:34.920065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 933/1718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:34 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1199 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:35.078920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:35.079926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:35.088491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.089846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.091320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.092916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.094609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.095216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.371615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:35.381393 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-42fcbf56-f29b-4203-b027-c90926a81607 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1507 microversion: 2.1 time: 0.534997 Oct 12 22:37:35.381983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 786/1719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:34 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:35.403009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5cefa04a-0fd0-429f-ae49-f0308cd1d5e8 req-4b181096-fb75-4dc7-be2d-2a59533ea341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ccd1b5-4f99-43fe-a203-bc5ede34932b", "tag": "d3627478-6dbb-4abf-90ce-8d102e179bd3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:35.425376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5cefa04a-0fd0-429f-ae49-f0308cd1d5e8 req-4b181096-fb75-4dc7-be2d-2a59533ea341 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.426161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5cefa04a-0fd0-429f-ae49-f0308cd1d5e8 req-4b181096-fb75-4dc7-be2d-2a59533ea341 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.426771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5cefa04a-0fd0-429f-ae49-f0308cd1d5e8 req-4b181096-fb75-4dc7-be2d-2a59533ea341 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.455544 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5cefa04a-0fd0-429f-ae49-f0308cd1d5e8 req-4b181096-fb75-4dc7-be2d-2a59533ea341 service nova] Creating event network-changed:d3627478-6dbb-4abf-90ce-8d102e179bd3 for instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b on n-h2-860864-8 Oct 12 22:37:35.467774 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5cefa04a-0fd0-429f-ae49-f0308cd1d5e8 req-4b181096-fb75-4dc7-be2d-2a59533ea341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074324 Oct 12 22:37:35.468714 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 787/1720] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:35.476730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:35.485101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:35.487582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:35.496640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.497717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce8030a6-0789-415e-95be-14a159deebaf tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1352 microversion: 2.1 time: 0.425449 Oct 12 22:37:35.498959 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 934/1721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:35 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1352 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:35.499123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.499700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.500470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.501012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.501417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.519928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:35.521106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:35.531505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.532518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.533125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.534349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.535150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.535573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.568240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:35.694064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:35.701972 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38efed0e-ef46-48f2-87e5-c9dc01e1e3ee tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 204 len: 0 microversion: 2.1 time: 0.200312 Oct 12 22:37:35.702911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 935/1722] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:35 2022] DELETE /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:35.715131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:35.716095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:35.726244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.726797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.727235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:35.728000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:35.729408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:35.730052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.034402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:36.044250 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62ba1244-abae-48be-8dd3-ffdc73efccbb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.339865 Oct 12 22:37:36.045033 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 936/1723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:35 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:36.049295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:36.049792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:36.056012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.056514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.056939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.057617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.058101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.058456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.078487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:36.085834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:36.089742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:36.091509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:36.092804 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-363e88bc-2243-488d-9639-1512439be5b6 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.622779 Oct 12 22:37:36.093576 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 788/1724] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:35 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:36.114747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:36.116316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:36.122955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.124155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.124787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.125347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.125857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.126282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.152315 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.compute.api [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Instance is already in deleting state, ignoring this request Oct 12 22:37:36.153663 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca275dd9-faaf-4ce5-8be2-7008eb0919e2 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 204 len: 0 microversion: 2.1 time: 0.107859 Oct 12 22:37:36.155408 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 937/1725] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:36 2022] DELETE /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:37:36.164598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:36.165678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:36.173939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.174733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.175534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.176645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.177306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.177934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.316437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:36.325386 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f81dc45d-47e0-46ac-b2ab-81f635fcbc02 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1513 microversion: 2.1 time: 0.166641 Oct 12 22:37:36.326289 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 938/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:36 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:36.523720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:36.525261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:36.533138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.533729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.534316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.535151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:36.535815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:36.536422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:36.706207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:36.714666 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9df1e9d8-4af8-4071-b47e-24e21c0104c0 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1352 microversion: 2.1 time: 0.195326 Oct 12 22:37:36.716687 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 939/1727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:36 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1352 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:36.821735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:36.832034 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-66f95010-5c2b-4449-a695-8429b193d7c3 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1381 microversion: 2.1 time: 0.723269 Oct 12 22:37:36.832689 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 789/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:36 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1381 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:37.071594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:37.072475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:37.081128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.082192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.082915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.083953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.084669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.085377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.171857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:37.176573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:37.186052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.187011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.188108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.190060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.191134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.191874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.511732 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e074bb19-4a50-4f2d-ba3d-c2bf5dbccb97 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1532 microversion: 2.1 time: 0.658732 Oct 12 22:37:37.515063 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 940/1729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:36 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1532 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:37.532958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:37.534263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:37.544637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.545125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.545558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.546264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.549367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.550155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.709363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:37.720181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d8cca2e-4591-49b2-bb8b-081e870ef64e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.653363 Oct 12 22:37:37.721412 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 790/1730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:37 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:37.727197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:37.729233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:37.738942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.739736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.740435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.741408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:37.742096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:37.742726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:37.755694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:38.303644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:38.316501 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-de8a70e4-82e3-4697-a7c5-b75f8556ef0e tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1513 microversion: 2.1 time: 0.591583 Oct 12 22:37:38.319169 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 791/1731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:37 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1513 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:38.326575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:38.332586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:38.345095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:38.346530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:38.347717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e3e221f9-4abf-4e73-b44f-2cefe36dae9c tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.831318 Oct 12 22:37:38.348756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:38.363250 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 941/1732] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:37 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:38.368171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:38.373665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.381502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.385090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.385436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:38.393206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.393957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.394544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.403000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.405121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.407414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.408560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.411561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.412127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.736205 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7cbff2fa-c8ce-4d25-a28d-84e425adf023 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1532 microversion: 2.1 time: 0.415510 Oct 12 22:37:38.740262 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 792/1733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:38 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1532 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:38.761430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:38.762540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:38.774862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.775354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.775792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:38.776533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:38.776986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:38.777668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.677456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:39.700000 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e714c236-6299-4c03-9676-740ec6eb4159 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1352 microversion: 2.1 time: 1.331665 Oct 12 22:37:39.701042 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 942/1734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:38 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1352 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:39.711018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:39.715607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.716678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.723802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.724954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.725559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.726157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.734714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:39.742789 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c07c1a82-4de3-4a32-80d0-e85dcab259d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 1.000150 Oct 12 22:37:39.743945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 793/1735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:38 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:39.755114 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8265380-91fa-4404-8c44-a11a723463a9 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051557 Oct 12 22:37:39.756158 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 943/1736] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:37:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:39.764847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:39.765306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:39.765778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:39.766435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:39.780208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.792364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.792935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.793700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.794159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.794993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.795292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.796157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.796719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.798101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:39.798667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:39.800787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:39.851202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:40.020807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d084d9f8b2417ab66fee6c29ee592d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e58572633e42409a75c58f484b4d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:40.047405 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d69a282-39a7-49a7-b2aa-cc405d6fd52a tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 200 len: 1471 microversion: 2.1 time: 0.298267 Oct 12 22:37:40.051348 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 794/1737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:39 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:40.056930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:40.058546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-8", "block_migration": false, "disk_over_commit": false}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:40.072802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:40.092474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:40.093702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:40.094314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:40.095077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:40.095486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:40.095929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:40.144408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lazy-loading 'flavor' on Instance uuid e8de8c4c-95a9-4b86-b434-66592b5ecf25 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:37:40.172624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Going to try to live migrate instance to n-h2-860864-8 {{(pid=120543) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 22:37:40.300499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:40.313990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:40.318532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:40.320722 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a42f0807-69f9-4fb0-bbb8-37bb591bd14f tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1486 microversion: 2.25 time: 0.563462 Oct 12 22:37:40.324488 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 944/1738] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:39 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1486 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:40.329249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a3272d09-6210-495b-82b8-cb2aaffdfb04 req-366aca25-fc60-4ef5-abce-9e33793fdcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79cad3-9e51-4fc6-bc3b-891b7dc1415e", "name": "network-vif-deleted", "tag": "6d5bc982-3174-4a16-b018-f51c7b6e9a9d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:40.360870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a3272d09-6210-495b-82b8-cb2aaffdfb04 req-366aca25-fc60-4ef5-abce-9e33793fdcc4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:40.361595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a3272d09-6210-495b-82b8-cb2aaffdfb04 req-366aca25-fc60-4ef5-abce-9e33793fdcc4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:40.362086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a3272d09-6210-495b-82b8-cb2aaffdfb04 req-366aca25-fc60-4ef5-abce-9e33793fdcc4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:40.386316 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a3272d09-6210-495b-82b8-cb2aaffdfb04 req-366aca25-fc60-4ef5-abce-9e33793fdcc4 service nova] Creating event network-vif-deleted:6d5bc982-3174-4a16-b018-f51c7b6e9a9d for instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e on n-h1-860864-8 Oct 12 22:37:40.396190 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a3272d09-6210-495b-82b8-cb2aaffdfb04 req-366aca25-fc60-4ef5-abce-9e33793fdcc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070362 Oct 12 22:37:40.398565 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 945/1739] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:40.724017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:40.725701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:40.741316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:40.742696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:40.744740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:40.746506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:40.747014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:40.747567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:41.126821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:41.142363 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-28f4efc4-ce54-4b85-bf3b-cc9518bf38c2 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1352 microversion: 2.1 time: 0.422643 Oct 12 22:37:41.144234 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 946/1740] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:40 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1352 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:41.160622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:41.161444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:41.185101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:41.185518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:41.185952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:41.193039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:41.193525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:41.193970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.044507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:42.052850 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1327ff54-350c-41b1-89da-8a4d9f217ba8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1497 microversion: 2.1 time: 0.907323 Oct 12 22:37:42.053929 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 947/1741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:41 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1497 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:42.059845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.060759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:42.067779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.068539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.069214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.070168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.073274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.074484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.103165 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] HTTP exception thrown: Instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e could not be found. Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Request method failure captured: Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e HTTP/1.1 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0EO5NRi43CSj8oBFZRGYYviwLskN9c-MY20-XPdBsh2ZNJEmst7u9Jn_oqTVFxqCOu1kqbVtSYS3cdHMDLETpPbl23dHX2mSCjko42PTi7CJN6yM2lR4YDbBKJtO3PUNJe3MJ2YondqiAhWXPzFiKfm8vkqJX834jPRXvGX4IBHeWE Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84e58572633e42409a75c58f484b4d66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84e58572633e42409a75c58f484b4d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}] Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: a9d084d9f8b2417ab66fee6c29ee592d Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e could not be found. Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3c79cad3-9e51-4fc6-bc3b-891b7dc1415e'} Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e could not be found. Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e could not be found. Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.105860 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.110703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.110703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.110703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.110703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:42.110703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:42.110703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e could not be found. Oct 12 22:37:42.110703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.113315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Returning 404 to user: Instance 3c79cad3-9e51-4fc6-bc3b-891b7dc1415e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:42.114405 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-83d75167-aed6-42f1-a14e-2118447e7c80 tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e" status: 404 len: 111 microversion: 2.1 time: 0.059278 Oct 12 22:37:42.115988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 948/1742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:42 2022] GET /compute/v2.1/servers/3c79cad3-9e51-4fc6-bc3b-891b7dc1415e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:42.146036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.147278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:42.155533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.156373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.157521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.158484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.159155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.162014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.295612 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4db00b4d-2bea-4a45-9f34-2c42a62bee82 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25/action" status: 202 len: 0 microversion: 2.1 time: 2.242510 Oct 12 22:37:42.298368 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 795/1743] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:37:40 2022] POST /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25/action => generated 0 bytes in 2246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:37:42.310780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1085f706-73a8-403b-9e95-6908ad07f011 req-0c0746f8-a855-465d-a86f-ebb897b6d2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ccd1b5-4f99-43fe-a203-bc5ede34932b", "name": "network-vif-plugged", "status": "completed", "tag": "d3627478-6dbb-4abf-90ce-8d102e179bd3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:42.326392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1085f706-73a8-403b-9e95-6908ad07f011 req-0c0746f8-a855-465d-a86f-ebb897b6d2d8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.327307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1085f706-73a8-403b-9e95-6908ad07f011 req-0c0746f8-a855-465d-a86f-ebb897b6d2d8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.328092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1085f706-73a8-403b-9e95-6908ad07f011 req-0c0746f8-a855-465d-a86f-ebb897b6d2d8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.345144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1085f706-73a8-403b-9e95-6908ad07f011 req-0c0746f8-a855-465d-a86f-ebb897b6d2d8 service nova] Creating event network-vif-plugged:d3627478-6dbb-4abf-90ce-8d102e179bd3 for instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b on n-h2-860864-8 Oct 12 22:37:42.351723 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1085f706-73a8-403b-9e95-6908ad07f011 req-0c0746f8-a855-465d-a86f-ebb897b6d2d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046960 Oct 12 22:37:42.354533 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 796/1744] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:42.361659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.363323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:42.374317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.375259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.376256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.377363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.379022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.379789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.403775 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] HTTP exception thrown: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Request method failure captured: Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 HTTP/1.1 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0EO5NRi43CSj8oBFZRGYYviwLskN9c-MY20-XPdBsh2ZNJEmst7u9Jn_oqTVFxqCOu1kqbVtSYS3cdHMDLETpPbl23dHX2mSCjko42PTi7CJN6yM2lR4YDbBKJtO3PUNJe3MJ2YondqiAhWXPzFiKfm8vkqJX834jPRXvGX4IBHeWE Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84e58572633e42409a75c58f484b4d66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84e58572633e42409a75c58f484b4d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}] Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a9d084d9f8b2417ab66fee6c29ee592d Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '28c64bc5-a5d4-40b0-924c-87e882136445'} Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:42.406053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.411277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.418511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Returning 404 to user: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:42.419549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d23d240-49a1-4b00-aef7-67278411bceb tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 404 len: 111 microversion: 2.1 time: 0.063269 Oct 12 22:37:42.424719 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 797/1745] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:42 2022] DELETE /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:42.429912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.430766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:42.440232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.440991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.441611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.442620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.443546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.443988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.728999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:42.743571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:42.745804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:42.747328 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57908ec3-ab07-4dc2-a39b-13ad45e2dfe8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1476 microversion: 2.25 time: 0.630013 Oct 12 22:37:42.748406 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 949/1746] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:42 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:42.753946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.755189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:42.762431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.763244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.765019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.766004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.766837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.767508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.798253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:42.807629 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f15999e-8e15-4dcf-bb3c-8daede4fc985 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1352 microversion: 2.1 time: 0.381438 Oct 12 22:37:42.821093 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 798/1747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:42 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1352 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:42.828859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.832862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 28c64bc5-a5d4-40b0-924c-87e882136445] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:42.842251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.842749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.843369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.844103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.844560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.844987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.862643 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] HTTP exception thrown: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Request method failure captured: Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 HTTP/1.1 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0EO5NRi43CSj8oBFZRGYYviwLskN9c-MY20-XPdBsh2ZNJEmst7u9Jn_oqTVFxqCOu1kqbVtSYS3cdHMDLETpPbl23dHX2mSCjko42PTi7CJN6yM2lR4YDbBKJtO3PUNJe3MJ2YondqiAhWXPzFiKfm8vkqJX834jPRXvGX4IBHeWE Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84e58572633e42409a75c58f484b4d66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84e58572633e42409a75c58f484b4d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}] Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a9d084d9f8b2417ab66fee6c29ee592d Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '28c64bc5-a5d4-40b0-924c-87e882136445'} Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.864308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Returning 404 to user: Instance 28c64bc5-a5d4-40b0-924c-87e882136445 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d583d7be-76a3-4efd-906e-d959a9241fff tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445" status: 404 len: 111 microversion: 2.1 time: 0.042812 Oct 12 22:37:42.870037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 799/1748] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:42 2022] GET /compute/v2.1/servers/28c64bc5-a5d4-40b0-924c-87e882136445 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:42.872177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d492c685-9994-4778-9dc7-7f4de7e8adb8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '.version_select at 0x7f44ffd644c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.875562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d492c685-9994-4778-9dc7-7f4de7e8adb8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.876077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d492c685-9994-4778-9dc7-7f4de7e8adb8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.876530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d492c685-9994-4778-9dc7-7f4de7e8adb8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.889073 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d492c685-9994-4778-9dc7-7f4de7e8adb8 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3619 microversion: 2.25 time: 0.021545 Oct 12 22:37:42.889945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 800/1749] 10.222.0.20 () {60 vars in 1184 bytes} [Wed Oct 12 22:37:42 2022] GET /compute/v2.1/os-migrations => generated 3619 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:42.894390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.894886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:42.904641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.905316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.905865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.906866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:42.908420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:42.909054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:42.934332 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] HTTP exception thrown: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Request method failure captured: Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 HTTP/1.1 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0EO5NRi43CSj8oBFZRGYYviwLskN9c-MY20-XPdBsh2ZNJEmst7u9Jn_oqTVFxqCOu1kqbVtSYS3cdHMDLETpPbl23dHX2mSCjko42PTi7CJN6yM2lR4YDbBKJtO3PUNJe3MJ2YondqiAhWXPzFiKfm8vkqJX834jPRXvGX4IBHeWE Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84e58572633e42409a75c58f484b4d66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84e58572633e42409a75c58f484b4d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}] Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a9d084d9f8b2417ab66fee6c29ee592d Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '4fd4c8b5-b976-46b1-9c2b-ba296eab2a87'} Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:42.936991 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:42.942871 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:42.945589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Returning 404 to user: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:42.951976 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36c813fb-49f9-421a-8ac5-c81c6f452b5c tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 404 len: 111 microversion: 2.1 time: 0.057758 Oct 12 22:37:42.956508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 801/1750] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:37:42 2022] DELETE /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:42.977741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:42.978523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.001837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.002403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.002859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.004752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.005237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.005749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.182037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] Lazy-loading 'services' on Instance uuid a8efca20-5bdd-4ff4-97d4-8517b7539ae8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:37:43.197932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b7c7f4b9-4fd1-46b0-8709-72c482c4fde1 tempest-LiveAutoBlockMigrationV225Test-521209750 tempest-LiveAutoBlockMigrationV225Test-521209750-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1969 microversion: 2.25 time: 0.240367 Oct 12 22:37:43.199124 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 802/1751] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:42 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1969 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:43.204874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.205605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] [instance: 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.211365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.212214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.212843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.213690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.214296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.214876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.241093 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] HTTP exception thrown: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Request method failure captured: Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 HTTP/1.1 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0EO5NRi43CSj8oBFZRGYYviwLskN9c-MY20-XPdBsh2ZNJEmst7u9Jn_oqTVFxqCOu1kqbVtSYS3cdHMDLETpPbl23dHX2mSCjko42PTi7CJN6yM2lR4YDbBKJtO3PUNJe3MJ2YondqiAhWXPzFiKfm8vkqJX834jPRXvGX4IBHeWE Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/84e58572633e42409a75c58f484b4d66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_84e58572633e42409a75c58f484b4d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/84e58572633e42409a75c58f484b4d66"}]}] Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 84e58572633e42409a75c58f484b4d66 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2030030909 Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a9d084d9f8b2417ab66fee6c29ee592d Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerDiskConfigTestJSON-2030030909-project Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '4fd4c8b5-b976-46b1-9c2b-ba296eab2a87'} Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:43.242809 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] Returning 404 to user: Instance 4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:43.248664 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d93708da-8dfe-4940-8767-fb4b9a48a72b tempest-ServerDiskConfigTestJSON-2030030909 tempest-ServerDiskConfigTestJSON-2030030909-project] 10.222.0.20 "GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87" status: 404 len: 111 microversion: 2.1 time: 0.046874 Oct 12 22:37:43.251417 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 803/1752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:43 2022] GET /compute/v2.1/servers/4fd4c8b5-b976-46b1-9c2b-ba296eab2a87 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:37:43.255210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.256331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.261186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:43.265511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.266158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.266665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.267435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.267978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.268471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.289098 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96530364-6f8e-4507-88e2-6714d11be8af tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.537825 Oct 12 22:37:43.300031 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 950/1753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:42 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:43.311235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.312109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.320479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.321843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.327189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.328368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.329389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.329956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.371504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:37:43.484886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:43.492912 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c9ed5c07-a5a9-4ef5-b2da-6d3885191c92 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 200 len: 1474 microversion: 2.1 time: 0.242108 Oct 12 22:37:43.494320 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 804/1754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:43 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 1474 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:43.517606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-432769244"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:43.520731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.529048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.529765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.530431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.531322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.532148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.532820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.570408 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78e141d6-e87c-4ca7-b02d-05125b9458f5 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 204 len: 0 microversion: 2.25 time: 0.268766 Oct 12 22:37:43.572501 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 951/1755] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:37:43 2022] DELETE /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:37:43.584133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.585340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.595320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.596005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.596734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.597742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.598661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.599183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.809790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c9adb49-4c9b-4cdd-a947-bb100b22b71a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c/action" status: 202 len: 0 microversion: 2.1 time: 0.295936 Oct 12 22:37:43.811021 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 805/1756] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:37:43 2022] POST /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 12 22:37:43.825429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33e5a650-b7c8-4b78-9b30-ada996d2815e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffd5cca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.885899 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33e5a650-b7c8-4b78-9b30-ada996d2815e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.066726 Oct 12 22:37:43.886504 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 806/1757] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:43 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:43.891241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:43.892263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:43.900329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.900794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.901447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:43.902576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:43.903185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:43.903833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:44.032327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:44.047113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:44.048583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:44.052521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f7293dd7-11e6-4ef0-bd07-92db14562e0b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1482 microversion: 2.25 time: 0.475922 Oct 12 22:37:44.063916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 952/1758] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:43 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1482 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:44.312025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:44.313350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:44.323415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:44.324223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:44.324817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:44.325920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:44.328426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:44.329074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:44.339907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:44.348045 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e3a6f01-fe05-4e16-b01f-debc103a3149 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1352 microversion: 2.1 time: 0.460487 Oct 12 22:37:44.352221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 807/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:43 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1352 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:44.723402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:44.731123 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d44d2180-8b1d-4dbe-8505-83d827abd3ac tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.422846 Oct 12 22:37:44.731708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 953/1760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:44 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:44.901656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-781d32cd-9600-4362-961c-24235d70db67 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffe1b040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:44.965072 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-781d32cd-9600-4362-961c-24235d70db67 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.067133 Oct 12 22:37:44.974253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 808/1761] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:44 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:45.083935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:45.085384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:45.107564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.110374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.111774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.112725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.113195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.113811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.618194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a12b861c-7d7c-4f9f-ac88-250f47d09bc1 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2126137547", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:45.622702 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-a12b861c-7d7c-4f9f-ac88-250f47d09bc1 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] HTTP exception thrown: min_count must be <= max_count Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a12b861c-7d7c-4f9f-ac88-250f47d09bc1 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Request method failure captured: Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 184 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5gaLFyBowCkQBbZeLDk_uCEvCx3s6UzeFJfCfxYz3it5hVTCUXzys_GXpzb6xu207frCS3W3mY-bvyllGSGloKw895Fhwf0z34yfTg0ArKtckm9AEWutFEQQOpQjJY2TNwJ8Kj1743stTt2Zv5uX7ZY7BhsPZ5QPqGZoHlfgCsmA Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}] Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 2241756d86fe4635828e43137d563f13 Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2126137547", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: exception: min_count must be <= max_count Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2126137547', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 12 22:37:45.625453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:45.630057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a12b861c-7d7c-4f9f-ac88-250f47d09bc1 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Returning 400 to user: min_count must be <= max_count {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:45.630057 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a12b861c-7d7c-4f9f-ac88-250f47d09bc1 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.387873 Oct 12 22:37:45.632880 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 809/1762] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:45 2022] POST /compute/v2.1/servers => generated 74 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 22:37:45.655997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:45.661831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:45.675587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.676052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.676498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.677207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:45.683596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:45.684199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:45.862841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:45.897547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:45.905507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:45.909931 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8fc2b58d-2f04-4ca7-a8d3-34dfbc85cd14 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1482 microversion: 2.25 time: 0.829827 Oct 12 22:37:45.913319 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 954/1763] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:45 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1482 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:45.970934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:45.981693 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b6335bb-d2d4-468f-962d-b492c57776ba tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1542 microversion: 2.1 time: 0.337579 Oct 12 22:37:45.982276 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 810/1764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:45 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1542 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:45.992431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83697477-37be-4ece-b155-131795805d49 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1505606109", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "max_count": 0}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83697477-37be-4ece-b155-131795805d49 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Request method failure captured: Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 168 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5gaLFyBowCkQBbZeLDk_uCEvCx3s6UzeFJfCfxYz3it5hVTCUXzys_GXpzb6xu207frCS3W3mY-bvyllGSGloKw895Fhwf0z34yfTg0ArKtckm9AEWutFEQQOpQjJY2TNwJ8Kj1743stTt2Zv5uX7ZY7BhsPZ5QPqGZoHlfgCsmA Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}] Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 2241756d86fe4635828e43137d563f13 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1505606109", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "max_count": 0}} Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1505606109', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'max_count': 0}}} Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 0 Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:37:46.008337 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:37:46.017435 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.034813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83697477-37be-4ece-b155-131795805d49 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.035743 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-83697477-37be-4ece-b155-131795805d49 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.052509 Oct 12 22:37:46.051445 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 811/1765] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:45 2022] POST /compute/v2.1/servers => generated 130 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:37:46.061463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.061942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3ed72ba-9b43-4caa-a33b-e9b65efe667f tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Calling method '.version_select at 0x7f4507ad2550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.062098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:46.074172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:46.075704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:46.077548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:46.078844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:46.079870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:46.080614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:46.086200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:46.109186 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f3ed72ba-9b43-4caa-a33b-e9b65efe667f tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] HTTP exception thrown: Image not found. Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3ed72ba-9b43-4caa-a33b-e9b65efe667f tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Request method failure captured: Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/815770d1-2ddf-40d4-8dee-d139b805cd12/metadata/os_distro HTTP/1.1 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0G5c7sm7x-UBvVyuSS_KvNJkOyE3WaVTBy0Kw3_PJiu4YZtBNGRUy_FqIuYvTRPmQN6lJ2LrMJR9hyTWpAoklT8Y4QMuCW1Vf3qj4vfuqET1UsSlD-GG_D6vXEvwJ5Vomeh0Nhc8Bj04qJNHPfoL0KH9YqKl8UluwMkpxWLUzVBM0c Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}] Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: fc8a6497526d4765acd257b7dec96b93 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'image_id': '815770d1-2ddf-40d4-8dee-d139b805cd12', 'id': 'os_distro'} Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 815770d1-2ddf-40d4-8dee-d139b805cd12 Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:37:46.111755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 815770d1-2ddf-40d4-8dee-d139b805cd12 could not be found. Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:37:46.118342 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.137571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3ed72ba-9b43-4caa-a33b-e9b65efe667f tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.141198 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f3ed72ba-9b43-4caa-a33b-e9b65efe667f tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] 10.222.0.20 "DELETE /compute/v2.1/images/815770d1-2ddf-40d4-8dee-d139b805cd12/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.224798 Oct 12 22:37:46.146861 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 955/1766] 10.222.0.20 () {58 vars in 1293 bytes} [Wed Oct 12 22:37:45 2022] DELETE /compute/v2.1/images/815770d1-2ddf-40d4-8dee-d139b805cd12/metadata/os_distro => generated 62 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:37:46.164279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f2cc00c0-be7f-4536-b751-29ff661a0b82 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a6bee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.290526 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f2cc00c0-be7f-4536-b751-29ff661a0b82 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.138447 Oct 12 22:37:46.299874 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 956/1767] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:46 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:46.327050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.336816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:46.344629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:46.358833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:46.360532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:46.364247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:46.364743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:46.365211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:46.423920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:46.440516 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19330c26-1787-4bd2-9fde-60d5560f28cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.382872 Oct 12 22:37:46.441703 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 812/1768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:46 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:46.460292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3d13f257-8234-41b0-9872-48abcf064861 req-ab281f7d-ea59-4e6d-b032-0b7358401ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8efca20-5bdd-4ff4-97d4-8517b7539ae8", "name": "network-vif-deleted", "tag": "c1b2ba2f-74a1-4b43-bd69-c011d0a69632"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.473981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d13f257-8234-41b0-9872-48abcf064861 req-ab281f7d-ea59-4e6d-b032-0b7358401ec5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:46.474934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d13f257-8234-41b0-9872-48abcf064861 req-ab281f7d-ea59-4e6d-b032-0b7358401ec5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:46.475660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d13f257-8234-41b0-9872-48abcf064861 req-ab281f7d-ea59-4e6d-b032-0b7358401ec5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:46.493987 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3d13f257-8234-41b0-9872-48abcf064861 req-ab281f7d-ea59-4e6d-b032-0b7358401ec5 service nova] Creating event network-vif-deleted:c1b2ba2f-74a1-4b43-bd69-c011d0a69632 for instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 on n-h2-860864-8 Oct 12 22:37:46.506945 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3d13f257-8234-41b0-9872-48abcf064861 req-ab281f7d-ea59-4e6d-b032-0b7358401ec5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062474 Oct 12 22:37:46.509237 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 813/1769] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:46.531596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62433db4-cbfe-4e4b-a4f0-2e6f7d50bc88 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-548762154", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "max_count": 2.5}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62433db4-cbfe-4e4b-a4f0-2e6f7d50bc88 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Request method failure captured: Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 169 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5gaLFyBowCkQBbZeLDk_uCEvCx3s6UzeFJfCfxYz3it5hVTCUXzys_GXpzb6xu207frCS3W3mY-bvyllGSGloKw895Fhwf0z34yfTg0ArKtckm9AEWutFEQQOpQjJY2TNwJ8Kj1743stTt2Zv5uX7ZY7BhsPZ5QPqGZoHlfgCsmA Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}] Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 2241756d86fe4635828e43137d563f13 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-548762154", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "max_count": 2.5}} Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-548762154', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'max_count': 2.5}}} Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:37:46.537894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.545219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.548866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62433db4-cbfe-4e4b-a4f0-2e6f7d50bc88 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.551788 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62433db4-cbfe-4e4b-a4f0-2e6f7d50bc88 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.040802 Oct 12 22:37:46.553432 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 814/1770] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:46 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:37:46.560940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eaa84b9e-e4d3-49c8-a6b1-4a3fb1537b13 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Calling method '.version_select at 0x7f44ff5adaf0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.606358 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-eaa84b9e-e4d3-49c8-a6b1-4a3fb1537b13 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] HTTP exception thrown: Image not found. Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eaa84b9e-e4d3-49c8-a6b1-4a3fb1537b13 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Request method failure captured: Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/images/a122e051-31dd-4b1a-abfc-1e8c15f4d15e/metadata/os_version HTTP/1.1 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5c7sm7x-UBvVyuSS_KvNJkOyE3WaVTBy0Kw3_PJiu4YZtBNGRUy_FqIuYvTRPmQN6lJ2LrMJR9hyTWpAoklT8Y4QMuCW1Vf3qj4vfuqET1UsSlD-GG_D6vXEvwJ5Vomeh0Nhc8Bj04qJNHPfoL0KH9YqKl8UluwMkpxWLUzVBM0c Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}] Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fc8a6497526d4765acd257b7dec96b93 Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'image_id': 'a122e051-31dd-4b1a-abfc-1e8c15f4d15e', 'id': 'os_version'} Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a122e051-31dd-4b1a-abfc-1e8c15f4d15e Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:37:46.611195 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a122e051-31dd-4b1a-abfc-1e8c15f4d15e could not be found. Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eaa84b9e-e4d3-49c8-a6b1-4a3fb1537b13 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.617180 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eaa84b9e-e4d3-49c8-a6b1-4a3fb1537b13 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] 10.222.0.20 "GET /compute/v2.1/images/a122e051-31dd-4b1a-abfc-1e8c15f4d15e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.058787 Oct 12 22:37:46.622885 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 815/1771] 10.222.0.20 () {58 vars in 1293 bytes} [Wed Oct 12 22:37:46 2022] GET /compute/v2.1/images/a122e051-31dd-4b1a-abfc-1e8c15f4d15e/metadata/os_version => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:37:46.627543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27bb9f41-8b02-4749-ae47-c78be0b83902 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Calling method '.version_select at 0x7f44ffe1b430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.683474 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-27bb9f41-8b02-4749-ae47-c78be0b83902 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] HTTP exception thrown: Image not found. Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27bb9f41-8b02-4749-ae47-c78be0b83902 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Request method failure captured: Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/images/7376a8f4-8629-4f3e-96cb-3adf1deb5178/metadata HTTP/1.1 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5c7sm7x-UBvVyuSS_KvNJkOyE3WaVTBy0Kw3_PJiu4YZtBNGRUy_FqIuYvTRPmQN6lJ2LrMJR9hyTWpAoklT8Y4QMuCW1Vf3qj4vfuqET1UsSlD-GG_D6vXEvwJ5Vomeh0Nhc8Bj04qJNHPfoL0KH9YqKl8UluwMkpxWLUzVBM0c Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}] Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fc8a6497526d4765acd257b7dec96b93 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'image_id': '7376a8f4-8629-4f3e-96cb-3adf1deb5178'} Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7376a8f4-8629-4f3e-96cb-3adf1deb5178 Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:37:46.685904 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7376a8f4-8629-4f3e-96cb-3adf1deb5178 could not be found. Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27bb9f41-8b02-4749-ae47-c78be0b83902 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.692277 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27bb9f41-8b02-4749-ae47-c78be0b83902 tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] 10.222.0.20 "GET /compute/v2.1/images/7376a8f4-8629-4f3e-96cb-3adf1deb5178/metadata" status: 404 len: 62 microversion: 2.1 time: 0.063892 Oct 12 22:37:46.703301 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 816/1772] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:37:46 2022] GET /compute/v2.1/images/7376a8f4-8629-4f3e-96cb-3adf1deb5178/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:37:46.703301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4cfc58e-5503-4b81-b431-66cc24f8423c tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1842512927", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 0}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4cfc58e-5503-4b81-b431-66cc24f8423c tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Request method failure captured: Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 168 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5gaLFyBowCkQBbZeLDk_uCEvCx3s6UzeFJfCfxYz3it5hVTCUXzys_GXpzb6xu207frCS3W3mY-bvyllGSGloKw895Fhwf0z34yfTg0ArKtckm9AEWutFEQQOpQjJY2TNwJ8Kj1743stTt2Zv5uX7ZY7BhsPZ5QPqGZoHlfgCsmA Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}] Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 2241756d86fe4635828e43137d563f13 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1842512927", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 0}} Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1842512927', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'min_count': 0}}} Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 0 Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:37:46.710675 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4cfc58e-5503-4b81-b431-66cc24f8423c tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.717363 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4cfc58e-5503-4b81-b431-66cc24f8423c tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016843 Oct 12 22:37:46.747461 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 817/1773] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:37:46.761186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f37f1f3-839e-4977-8c76-1051523d7ccb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Action: 'update_all', calling method: .version_select at 0x7f44ff5a54c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.810137 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1f37f1f3-839e-4977-8c76-1051523d7ccb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] HTTP exception thrown: Image not found. Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f37f1f3-839e-4977-8c76-1051523d7ccb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Request method failure captured: Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/images/bcba0d4f-5a68-4a8e-888c-a45cb1c77158/metadata HTTP/1.1 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 57 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5c7sm7x-UBvVyuSS_KvNJkOyE3WaVTBy0Kw3_PJiu4YZtBNGRUy_FqIuYvTRPmQN6lJ2LrMJR9hyTWpAoklT8Y4QMuCW1Vf3qj4vfuqET1UsSlD-GG_D6vXEvwJ5Vomeh0Nhc8Bj04qJNHPfoL0KH9YqKl8UluwMkpxWLUzVBM0c Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}] Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fc8a6497526d4765acd257b7dec96b93 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'image_id': 'bcba0d4f-5a68-4a8e-888c-a45cb1c77158', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bcba0d4f-5a68-4a8e-888c-a45cb1c77158 Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:37:46.812759 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bcba0d4f-5a68-4a8e-888c-a45cb1c77158 could not be found. Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f37f1f3-839e-4977-8c76-1051523d7ccb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f37f1f3-839e-4977-8c76-1051523d7ccb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] 10.222.0.20 "PUT /compute/v2.1/images/bcba0d4f-5a68-4a8e-888c-a45cb1c77158/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065745 Oct 12 22:37:46.821060 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 818/1774] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:37:46 2022] PUT /compute/v2.1/images/bcba0d4f-5a68-4a8e-888c-a45cb1c77158/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:37:46.830925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a087bb36-651e-40f6-bfde-56df8e3d8f06 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1628820592", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 2.5}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a087bb36-651e-40f6-bfde-56df8e3d8f06 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Request method failure captured: Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 170 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5gaLFyBowCkQBbZeLDk_uCEvCx3s6UzeFJfCfxYz3it5hVTCUXzys_GXpzb6xu207frCS3W3mY-bvyllGSGloKw895Fhwf0z34yfTg0ArKtckm9AEWutFEQQOpQjJY2TNwJ8Kj1743stTt2Zv5uX7ZY7BhsPZ5QPqGZoHlfgCsmA Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b1980e576354f86b6bdc2d7529956e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b1980e576354f86b6bdc2d7529956e8"}]}] Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8b1980e576354f86b6bdc2d7529956e8 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2056006110 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 2241756d86fe4635828e43137d563f13 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2056006110-project Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1628820592", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 2.5}} Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1628820592', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'min_count': 2.5}}} Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:37:46.847982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a087bb36-651e-40f6-bfde-56df8e3d8f06 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a087bb36-651e-40f6-bfde-56df8e3d8f06 tempest-MultipleCreateNegativeTestJSON-2056006110 tempest-MultipleCreateNegativeTestJSON-2056006110-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028616 Oct 12 22:37:46.856453 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 819/1775] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:46 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:37:46.860622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60531683-52b5-4eb1-b7aa-4cd46ae8123d tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Action: 'update', calling method: .version_select at 0x7f44ff5a50d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.895762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-60531683-52b5-4eb1-b7aa-4cd46ae8123d tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] HTTP exception thrown: Image not found. Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60531683-52b5-4eb1-b7aa-4cd46ae8123d tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Request method failure captured: Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/images/d1f19282-deb9-411a-bc41-1f9b2d99ad70/metadata/os_distro HTTP/1.1 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 30 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5c7sm7x-UBvVyuSS_KvNJkOyE3WaVTBy0Kw3_PJiu4YZtBNGRUy_FqIuYvTRPmQN6lJ2LrMJR9hyTWpAoklT8Y4QMuCW1Vf3qj4vfuqET1UsSlD-GG_D6vXEvwJ5Vomeh0Nhc8Bj04qJNHPfoL0KH9YqKl8UluwMkpxWLUzVBM0c Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}] Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fc8a6497526d4765acd257b7dec96b93 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: {"meta": {"os_distro": "alt"}} Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'image_id': 'd1f19282-deb9-411a-bc41-1f9b2d99ad70', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d1f19282-deb9-411a-bc41-1f9b2d99ad70 Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:37:46.898035 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1f19282-deb9-411a-bc41-1f9b2d99ad70 could not be found. Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60531683-52b5-4eb1-b7aa-4cd46ae8123d tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60531683-52b5-4eb1-b7aa-4cd46ae8123d tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] 10.222.0.20 "PUT /compute/v2.1/images/d1f19282-deb9-411a-bc41-1f9b2d99ad70/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.048553 Oct 12 22:37:46.907910 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 820/1776] 10.222.0.20 () {60 vars in 1310 bytes} [Wed Oct 12 22:37:46 2022] PUT /compute/v2.1/images/d1f19282-deb9-411a-bc41-1f9b2d99ad70/metadata/os_distro => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:37:46.919933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1f2b93a-05a0-41ff-b173-e1d67223cceb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Action: 'create', calling method: .version_select at 0x7f44ffd64790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:46.950684 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb88c2a7-4ca5-4330-95cc-ea92897b2b29 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.649065 Oct 12 22:37:46.952054 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 957/1777] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:37:46 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b/os-interface => generated 285 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:46.962750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:46.963547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:46.964967 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-e1f2b93a-05a0-41ff-b173-e1d67223cceb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] HTTP exception thrown: Image not found. Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1f2b93a-05a0-41ff-b173-e1d67223cceb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Request method failure captured: Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/images/7e8c47c1-fce5-4d34-9370-b90723f0e01f/metadata HTTP/1.1 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 57 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0G5c7sm7x-UBvVyuSS_KvNJkOyE3WaVTBy0Kw3_PJiu4YZtBNGRUy_FqIuYvTRPmQN6lJ2LrMJR9hyTWpAoklT8Y4QMuCW1Vf3qj4vfuqET1UsSlD-GG_D6vXEvwJ5Vomeh0Nhc8Bj04qJNHPfoL0KH9YqKl8UluwMkpxWLUzVBM0c Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85af2c1d02a45deb05f498b3127c2ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85af2c1d02a45deb05f498b3127c2ac"}]}] Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c85af2c1d02a45deb05f498b3127c2ac Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fc8a6497526d4765acd257b7dec96b93 Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1268867264-project Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'image_id': '7e8c47c1-fce5-4d34-9370-b90723f0e01f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7e8c47c1-fce5-4d34-9370-b90723f0e01f Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:37:46.967068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e8c47c1-fce5-4d34-9370-b90723f0e01f could not be found. Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1f2b93a-05a0-41ff-b173-e1d67223cceb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1f2b93a-05a0-41ff-b173-e1d67223cceb tempest-ImagesMetadataNegativeTestJSON-1268867264 tempest-ImagesMetadataNegativeTestJSON-1268867264-project] 10.222.0.20 "POST /compute/v2.1/images/7e8c47c1-fce5-4d34-9370-b90723f0e01f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.061927 Oct 12 22:37:46.975440 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 821/1778] 10.222.0.20 () {60 vars in 1281 bytes} [Wed Oct 12 22:37:46 2022] POST /compute/v2.1/images/7e8c47c1-fce5-4d34-9370-b90723f0e01f/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:37:47.008354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:47.010846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:47.011297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:47.013356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:47.016006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:47.016490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:47.177921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:47.188285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:47.199709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:47.204988 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a24e1fc-64cb-4898-8259-29aecac3c08b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1266 microversion: 2.25 time: 0.251694 Oct 12 22:37:47.206648 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 958/1779] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:46 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:47.317972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c02cc21-c05d-4560-9068-80350b527de8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff5ada60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:47.407010 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c02cc21-c05d-4560-9068-80350b527de8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.094838 Oct 12 22:37:47.411177 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 822/1780] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:47 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:47.479833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:47.481975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:47.504019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:47.507547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:47.524098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:47.529000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:47.531237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:47.533760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:48.238006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:48.239362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:48.258432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:48.259195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:48.259850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:48.260786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:48.264619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:48.265286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:48.493583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:48.511272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:48.513497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:48.518498 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01b4fa6f-7583-4980-8d28-2d55bf15e160 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1266 microversion: 2.25 time: 0.285629 Oct 12 22:37:48.529798 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 823/1781] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:48 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:48.537090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ac705c4-171a-4482-be4e-0bfa193498b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff5a5700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:48.645868 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ac705c4-171a-4482-be4e-0bfa193498b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.114537 Oct 12 22:37:48.647509 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 824/1782] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:48 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:49.199424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:49.212439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef35bcdc-df06-4bd5-9d51-6afe3b7b3d3e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.744686 Oct 12 22:37:49.228473 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 959/1783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:47 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:49.511921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-68338612-d32a-4313-a8d8-c30ceeb1ff6a req-9ffdc5d4-e882-4bf3-96ef-d37fbfedd582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ccd1b5-4f99-43fe-a203-bc5ede34932b", "tag": "d3627478-6dbb-4abf-90ce-8d102e179bd3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:49.543507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68338612-d32a-4313-a8d8-c30ceeb1ff6a req-9ffdc5d4-e882-4bf3-96ef-d37fbfedd582 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:49.544012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68338612-d32a-4313-a8d8-c30ceeb1ff6a req-9ffdc5d4-e882-4bf3-96ef-d37fbfedd582 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:49.552173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68338612-d32a-4313-a8d8-c30ceeb1ff6a req-9ffdc5d4-e882-4bf3-96ef-d37fbfedd582 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:49.557943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:49.559000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:49.573863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:49.576330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:49.576786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:49.577547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:49.581859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:49.582416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:49.591979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-68338612-d32a-4313-a8d8-c30ceeb1ff6a req-9ffdc5d4-e882-4bf3-96ef-d37fbfedd582 service nova] Creating event network-changed:d3627478-6dbb-4abf-90ce-8d102e179bd3 for instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b on n-h2-860864-8 Oct 12 22:37:49.616509 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-68338612-d32a-4313-a8d8-c30ceeb1ff6a req-9ffdc5d4-e882-4bf3-96ef-d37fbfedd582 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110009 Oct 12 22:37:49.623037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 825/1784] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:49.663066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c21f4b7-b204-48d0-abef-33782c593cba tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffe1b280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:49.732372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:49.732598 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c21f4b7-b204-48d0-abef-33782c593cba tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.073701 Oct 12 22:37:49.742911 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 826/1785] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:49 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:49.811811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:49.832332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:49.836291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:49.838361 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d137335-7cd0-40c2-9884-81aaa6d8117a tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1266 microversion: 2.25 time: 0.284864 Oct 12 22:37:49.854335 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 960/1786] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:49 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:37:50.240377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:50.241580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:50.245463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:50.261629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.266663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.271027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:50.272069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.275160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.275808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:50.750345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c0a92f4c-fa03-4817-bd89-ab79b58ed695 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a38af0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:50.865615 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c0a92f4c-fa03-4817-bd89-ab79b58ed695 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.119174 Oct 12 22:37:50.866861 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 961/1787] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:50 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:50.873320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:50.874193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:50.885702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.886594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.887317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:50.888317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:50.891259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:50.895269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:51.562209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:51.581123 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f7b0514-0f83-4435-ab19-d11275ed9dbe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.342650 Oct 12 22:37:51.587733 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 827/1788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:50 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:51.777371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4886f7d3-4726-498d-b201-38422ef1d516 req-f815f5e8-e7a9-4ed4-b00f-c92f1cb1a39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ffeab8-5085-444f-a1c4-9ad3cd21853c", "name": "network-vif-plugged", "status": "completed", "tag": "c2c856de-2050-4f75-b44f-592fd5130d47"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:51.817313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4886f7d3-4726-498d-b201-38422ef1d516 req-f815f5e8-e7a9-4ed4-b00f-c92f1cb1a39e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:51.819420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4886f7d3-4726-498d-b201-38422ef1d516 req-f815f5e8-e7a9-4ed4-b00f-c92f1cb1a39e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:51.821065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4886f7d3-4726-498d-b201-38422ef1d516 req-f815f5e8-e7a9-4ed4-b00f-c92f1cb1a39e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:51.869656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4886f7d3-4726-498d-b201-38422ef1d516 req-f815f5e8-e7a9-4ed4-b00f-c92f1cb1a39e service nova] Creating event network-vif-plugged:c2c856de-2050-4f75-b44f-592fd5130d47 for instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c on n-h1-860864-8 Oct 12 22:37:51.891356 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4886f7d3-4726-498d-b201-38422ef1d516 req-f815f5e8-e7a9-4ed4-b00f-c92f1cb1a39e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120806 Oct 12 22:37:51.901838 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 828/1789] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:37:51.928751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8564a5d0-ee20-4040-9132-9a13a790e7fe tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff541940>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:52.050788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:52.064578 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8564a5d0-ee20-4040-9132-9a13a790e7fe tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.161093 Oct 12 22:37:52.072574 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 829/1790] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:51 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:52.072927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:52.079200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:52.089377 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d2f1e118-38f7-43b3-a5f1-65c238433326 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1266 microversion: 2.25 time: 1.215668 Oct 12 22:37:52.111298 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 962/1791] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:50 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1266 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:52.616364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:52.617129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:52.636508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:52.637003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:52.637438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:52.638147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:52.638598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:52.639027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:53.080328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2687af4d-dfc8-4981-b80a-071c973068e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a393a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:53.234118 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2687af4d-dfc8-4981-b80a-071c973068e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.140367 Oct 12 22:37:53.235973 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 963/1792] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:53 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:53.244705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:53.246234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:53.254988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:53.255773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:53.256445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:53.257321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:53.257938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:53.259291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:53.497011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:53.528147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:53.534202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:53.537900 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-880dde90-92b4-4391-a38e-8ff5daa7d8a0 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1266 microversion: 2.25 time: 0.298170 Oct 12 22:37:53.540283 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 964/1793] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:53 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:37:54.006329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:54.019110 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b15be5d-14de-47af-ad6a-cf718533e5cc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.407848 Oct 12 22:37:54.025251 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 830/1794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:52 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:54.253285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec2dcc90-25b3-4576-ab42-c219fb8a8b39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff5b81f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:54.350295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec2dcc90-25b3-4576-ab42-c219fb8a8b39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.103559 Oct 12 22:37:54.351987 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 831/1795] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:54 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:54.534724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1174852877", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:37:54.567590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:54.568236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:54.579158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:54.579718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:54.580123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:54.580847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:54.586994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:54.587828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:54.912129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:54.929485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:54.935815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:54.938328 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87c74b4d-e993-4724-be7e-87b4196948d2 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1266 microversion: 2.25 time: 0.374158 Oct 12 22:37:54.942109 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 832/1796] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:54 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:37:55.048986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:55.051117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:55.062311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:55.063584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:55.064345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:55.065598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:55.066765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:55.067470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:55.232215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:37:55.596565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:55.605154 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38f49c12-4a84-4fb6-8d21-a73a1ac6f9b2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.561790 Oct 12 22:37:55.607561 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 833/1797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:55 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:55.630390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-236f65a1-ac11-41cc-b699-7f0d80dff8da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff5b8040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:55.730129 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-236f65a1-ac11-41cc-b699-7f0d80dff8da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.106285 Oct 12 22:37:55.730839 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 834/1798] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:55 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:55.970839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:55.972241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:56.005896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:56.006406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:56.016127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:56.019001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:56.037763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:56.038730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:56.313299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:56.337564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:56.356071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:56.359409 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46f34182-f2bb-44c5-81d3-adcb38dd4dbc tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 200 len: 1266 microversion: 2.25 time: 0.394386 Oct 12 22:37:56.362691 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 835/1799] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:55 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:37:56.630135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:56.631209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:56.643112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:56.648065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:56.652187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:56.657123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:56.657809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:56.660734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:57.021211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:37:57.021844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:37:57.022244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:37:57.022662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:37:57.023081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:37:57.032940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:57.048526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d57e61c-98a3-46ee-adc3-c9c506cd8ca5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.417979 Oct 12 22:37:57.050715 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 836/1800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:56 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:57.062601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:57.065766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:57.066681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:57.069975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03f987b1-625f-4d3c-a1e1-64d6e3f8b9d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffe3a9d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:57.071613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:57.075380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:57.077095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:57.129690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:37:57.171209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Getting quotas for project 4fc4f5adce674ecfa266bc4499a771fe. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:37:57.176430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03f987b1-625f-4d3c-a1e1-64d6e3f8b9d3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.123239 Oct 12 22:37:57.177160 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 837/1801] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:57 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:57.185604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Getting quotas for user c822c44d83fc477387b40ee6dac04468 and project 4fc4f5adce674ecfa266bc4499a771fe. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:37:57.255855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:37:57.260797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:37:57.393554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:57.394449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: a8efca20-5bdd-4ff4-97d4-8517b7539ae8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:57.415591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:57.420496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:57.423439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:57.426131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:57.426736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:57.432217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:57.435010 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0141b2b1-eeb6-481b-9697-c9e2cefb9344 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.202755 Oct 12 22:37:57.437041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 965/1802] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:37:57.458956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59ef9806-2c00-4fe6-bfcc-e8427e1e74fd tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:57.460295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-59ef9806-2c00-4fe6-bfcc-e8427e1e74fd tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:57.522457 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] HTTP exception thrown: Instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 could not be found. Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Request method failure captured: Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 HTTP/1.1 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Axh5r9_1x3MlpMhytNpWT227ZKrvtXNtEdykJCwXUOZxlc48KhOdpQV-58CUhTUAHMcZr8BCrN3cga1qgGYHGvI8tvRTFWwePXuQjEJHG6flLbyi3731H-fCKtKqc9O0UmkD1ktp8n5Ls3juafbS8_AjeWIE2zkR1Syoe9NPqwPeA Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_accb9cc4a17842af84b0002428db16d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}] Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 03a180537b9149b1bf4250bc9965bb7b Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 could not be found. Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a8efca20-5bdd-4ff4-97d4-8517b7539ae8'} Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 could not be found. Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 could not be found. Oct 12 22:37:57.528204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 could not be found. Oct 12 22:37:57.532870 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:37:57.540436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Returning 404 to user: Instance a8efca20-5bdd-4ff4-97d4-8517b7539ae8 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:37:57.542959 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63b0fb84-a9a6-4466-87e9-6b84c4612126 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8" status: 404 len: 111 microversion: 2.25 time: 0.156179 Oct 12 22:37:57.544551 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 838/1803] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:37:57 2022] GET /compute/v2.1/servers/a8efca20-5bdd-4ff4-97d4-8517b7539ae8 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:37:57.693642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-59ef9806-2c00-4fe6-bfcc-e8427e1e74fd tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:57.706406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59ef9806-2c00-4fe6-bfcc-e8427e1e74fd tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1217 microversion: 2.1 time: 0.261203 Oct 12 22:37:57.709670 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 966/1804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:57 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:37:58.078192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:58.079106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:58.097436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:58.101050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:58.104477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:58.108737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:58.109296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:58.118303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:58.195504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3cb1535-1b90-4deb-b93f-b414ed7a389d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a75550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:58.308150 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3cb1535-1b90-4deb-b93f-b414ed7a389d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.117582 Oct 12 22:37:58.309099 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 967/1805] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:58 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:58.617363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:58.635001 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-28dd9b20-c7d4-4b72-b82a-3693221c01ad tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.561437 Oct 12 22:37:58.636811 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 839/1806] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:58 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:58.733659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:58.734990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:58.744077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:58.749219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:58.750032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:58.751174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:58.752049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:58.764286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:59.152905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:37:59.162843 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aa928e20-82d6-47bc-8f76-93a6cf4b360d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1221 microversion: 2.1 time: 0.435099 Oct 12 22:37:59.174316 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 968/1807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:58 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1221 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:59.327124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ba040ec-61e6-4c97-a11c-2aba44e9fa87 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff6139d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:59.487001 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ba040ec-61e6-4c97-a11c-2aba44e9fa87 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.167079 Oct 12 22:37:59.487760 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 840/1808] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:37:59 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:37:59.662098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:37:59.662780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:37:59.680590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:59.681076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:59.685028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:37:59.686662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:37:59.692164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:37:59.693051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:00.198350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:00.199058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:00.217518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:00.218957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:00.219941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:00.222564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:00.223193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:00.229384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:00.579114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:00.595501 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29f58e63-5f92-45e2-b3b6-56f27b72bea5 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1275 microversion: 2.1 time: 0.401962 Oct 12 22:38:00.597530 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 841/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:00 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1275 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:00.617293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43530cf9-8741-403e-abd1-8d6ab1c415e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff5a90d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:00.671328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:00.709971 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-33a8c0e3-0d00-49b0-afee-30216011132a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.051854 Oct 12 22:38:00.720777 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 969/1810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:37:59 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:00.794357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-43530cf9-8741-403e-abd1-8d6ab1c415e1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.191638 Oct 12 22:38:00.797808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 842/1811] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:00 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:01.625993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:01.626621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:01.641948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:01.642802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:01.643453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:01.644422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:01.645125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:01.645920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:01.742969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:01.743588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:01.777251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:01.782915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:01.784845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:01.787625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:01.788328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:01.789593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:01.898828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:01.909719 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2681d616-7e5c-4319-9b62-3975a12c9c91 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1275 microversion: 2.1 time: 0.287762 Oct 12 22:38:01.931163 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 970/1812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:01 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1275 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:01.951047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7bbf29f1-d39e-4830-97da-55616260c41f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a75790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:02.010382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7bbf29f1-d39e-4830-97da-55616260c41f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.078011 Oct 12 22:38:02.011595 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 971/1813] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:01 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:02.356746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:02.366499 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4832d86c-5f3a-4f30-9a94-d633cd185dc0 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.628894 Oct 12 22:38:02.367680 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 843/1814] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:01 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:02.936394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:02.937070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:02.946768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:02.947588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:02.948260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:02.949224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:02.949896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:02.950532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:03.027446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b09fb797-1ee3-4520-bf07-934701e5f527 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffe3a9d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:03.138557 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b09fb797-1ee3-4520-bf07-934701e5f527 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.115674 Oct 12 22:38:03.139402 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 844/1815] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:03 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:03.393689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:03.395429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:03.408613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:03.412419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:03.414576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:03.417680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:03.418560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:03.419249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:03.659246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:03.674362 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-643d4de4-ec97-4739-8ea5-e684be741ab3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 0.743104 Oct 12 22:38:03.677290 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 972/1816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:02 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:04.165687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8740e4d5-661f-43aa-bfb4-aa90cd3b43e9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507c374c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:04.259861 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8740e4d5-661f-43aa-bfb4-aa90cd3b43e9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.098702 Oct 12 22:38:04.269133 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 973/1817] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:04 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:04.703768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:04.704357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:04.721911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:04.722399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:04.722840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:04.723622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:04.724461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:04.725423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:04.828979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:04.860247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7ef68050-c0f6-4255-bb97-0e650efffcc8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.470544 Oct 12 22:38:04.861652 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 845/1818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:03 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:05.217789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:05.228092 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4612b0fa-2672-4c21-b0ac-1b7893554f20 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 0.528024 Oct 12 22:38:05.237286 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 974/1819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:04 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:05.275744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc5a0f66-7d61-4bc7-9472-a0607e4bdaa6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffd64430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:05.355297 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc5a0f66-7d61-4bc7-9472-a0607e4bdaa6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.083390 Oct 12 22:38:05.356950 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 846/1820] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:05 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:05.889928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:05.890488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:05.893185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:05.905142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:05.905940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:05.907478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:05.912445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:05.914466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:05.915215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:06.261437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:06.266207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:06.278581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:06.280476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:06.281098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:06.283573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:06.284294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:06.286610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:07.102641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:07.128409 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-756b59dc-3eee-450c-b103-1d4f1d134119 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.242874 Oct 12 22:38:07.131408 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 975/1821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:05 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:07.148868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fdce9fe6-836e-45d4-b5f7-14799e74a104 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507aeef70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:07.167188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:07.252792 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fdce9fe6-836e-45d4-b5f7-14799e74a104 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.118663 Oct 12 22:38:07.255092 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 976/1822] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:07 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:08.165424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:08.174609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:08.203536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:08.214664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:08.219188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:08.223231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:08.224789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:08.226362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:08.228814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:08.260869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:08.271708 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70d2634b-91e9-49da-9b45-018ac41502dc tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 2.019951 Oct 12 22:38:08.292892 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 847/1823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:06 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:08.315487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c0e70a8-add3-4298-bbf0-d1908be3de1b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff613700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:08.424181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c0e70a8-add3-4298-bbf0-d1908be3de1b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.129830 Oct 12 22:38:08.425612 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 848/1824] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:08 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:09.307653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:09.309139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:09.348100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:09.356984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:09.359301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:09.364580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:09.365544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:09.368877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:09.903408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:09.924104 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b9fb3f3-1c3a-426e-8e02-2df1faf9262f tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.772615 Oct 12 22:38:09.928443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 977/1825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:08 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:09.950000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1ac7b322-4562-4912-8479-b73af7052efa req-6a01053f-3b60-4427-9c6a-58e568ec91d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee", "tag": "e00b7c80-471e-4143-b726-931f38e44dfc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:09.976404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ac7b322-4562-4912-8479-b73af7052efa req-6a01053f-3b60-4427-9c6a-58e568ec91d4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:09.976903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ac7b322-4562-4912-8479-b73af7052efa req-6a01053f-3b60-4427-9c6a-58e568ec91d4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:09.979171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ac7b322-4562-4912-8479-b73af7052efa req-6a01053f-3b60-4427-9c6a-58e568ec91d4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.041880 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1ac7b322-4562-4912-8479-b73af7052efa req-6a01053f-3b60-4427-9c6a-58e568ec91d4 service nova] Creating event network-changed:e00b7c80-471e-4143-b726-931f38e44dfc for instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee on n-h1-860864-8 Oct 12 22:38:10.063953 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1ac7b322-4562-4912-8479-b73af7052efa req-6a01053f-3b60-4427-9c6a-58e568ec91d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130846 Oct 12 22:38:10.068652 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 978/1826] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:10.087104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a74684a-5be7-4b99-b3d9-d80c9141fb56 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a75280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:10.238794 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a74684a-5be7-4b99-b3d9-d80c9141fb56 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.165056 Oct 12 22:38:10.239952 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 979/1827] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:10 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:10.352195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:10.352960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:10.370626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.372558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.376233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.378518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.398055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.401427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.490367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:10.680900 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2ba31065-6313-4523-8114-0c324502905b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 204 len: 0 microversion: 2.25 time: 0.327498 Oct 12 22:38:10.681701 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 980/1828] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:38:10 2022] DELETE /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:38:10.714190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:10.715484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:10.716224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:10.727313 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-da9c0838-6d0c-4865-b0d2-d6033d8d07f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 1.419558 Oct 12 22:38:10.731710 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 849/1829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:09 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:10.775654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.781760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.782302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.783073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.783527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.794002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.952976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:10.953865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:10.967989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.969148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.969792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:10.971562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:10.974502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:10.975261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.611446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:11.627508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:11.629993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:11.632736 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cf948c0-20ce-4f28-909e-051ea557d393 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1728 microversion: 2.25 time: 0.942953 Oct 12 22:38:11.634946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 981/1830] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:10 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1728 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:38:11.640852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-883a6bd8-6c5d-49bd-b5e6-7479a5d83e4f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a39430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:11.659676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:11.684749 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-51685b1a-67f1-46e1-bd13-3cbb656bb275 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.737113 Oct 12 22:38:11.688867 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 850/1831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:10 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:11.749287 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-883a6bd8-6c5d-49bd-b5e6-7479a5d83e4f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.112452 Oct 12 22:38:11.749871 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 982/1832] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:11 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:11.758912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:11.759538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:11.770847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.771401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.771833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.772635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:11.773527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:11.773527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:11.879793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:12.263552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:12.275571 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6411f5ac-9b1f-4773-9803-898ba4451dee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 0.522013 Oct 12 22:38:12.282697 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 851/1833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:11 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:12.669054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:12.670359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:12.692294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.692794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.693236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:12.694071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.699850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.707083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:12.713940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:12.714551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:12.722347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.724456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.727556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:12.728487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:12.729111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:12.729715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:13.225446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:13.237490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:13.250012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:13.255551 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-443e54d9-26e7-48f2-8e67-f7dc673d2d05 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1728 microversion: 2.25 time: 0.593607 Oct 12 22:38:13.268985 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 983/1834] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:12 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1728 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:38:13.290447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46075339-1e2f-4b72-88ef-94fe06496282 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4020d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:13.361656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46075339-1e2f-4b72-88ef-94fe06496282 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.091326 Oct 12 22:38:13.362470 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 984/1835] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:13 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:13.372812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:13.373671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:13.390194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:13.390980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:13.391596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:13.393313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:13.393939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:13.394837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:13.546336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:13.568906 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.859772 Oct 12 22:38:13.572676 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 852/1836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:12 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:13.873347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:13.894968 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b5ba93f-a9d2-4454-a54a-21e2a324ab61 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 0.530452 Oct 12 22:38:13.914740 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 985/1837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:13 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:14.140860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.141834 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46b8f668-7515-4aee-81b4-3537717b121c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001340 Oct 12 22:38:14.150521 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 853/1838] 10.222.0.20 () {56 vars in 886 bytes} [Wed Oct 12 22:38:14 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:38:14.286858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.287494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:14.310351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.310852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.311291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.312056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.312520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.312951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.378724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22fd58e3-c97f-4e1d-a02d-f39190c93e62 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffdc1d30>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.460587 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-22fd58e3-c97f-4e1d-a02d-f39190c93e62 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.084865 Oct 12 22:38:14.462677 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 854/1839] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:14 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:14.599223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:14.601187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:14.612667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.613855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.614479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:14.615527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:14.617585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:14.618232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:15.022662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:15.042094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:15.043572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:15.045016 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e5d13c0-1fb7-42d9-bcb5-4b4ed5c96dd7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1728 microversion: 2.25 time: 0.762573 Oct 12 22:38:15.055925 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 986/1840] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:14 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1728 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:38:15.055925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:15.055925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:15.058103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:15.058787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:15.059426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:15.060399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:15.061124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:15.062052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:15.216602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:15.234509 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-686640e4-28a1-4384-85de-486b0eb52ebe tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.643515 Oct 12 22:38:15.238238 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 855/1841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:14 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:15.477647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc1e6e1b-154c-482b-becd-4c96610c1748 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffdf8310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:15.564970 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc1e6e1b-154c-482b-becd-4c96610c1748 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.091293 Oct 12 22:38:15.565868 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 856/1842] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:15 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:15.994870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:16.003407 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a048aeb-213e-4e28-b3ed-b92aab19dcec tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 0.956450 Oct 12 22:38:16.008004 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 987/1843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:15 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:16.072267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:16.072861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:16.084160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.104024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.104545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.105520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.105998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.106427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.270517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:16.273074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:16.282495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:16.291163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.297346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.298211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.298608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:16.300143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:16.301245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.301984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.304641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.309500 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-97ef6a3d-332c-4660-8fb3-829de91477d8 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1661 microversion: 2.25 time: 0.241935 Oct 12 22:38:16.319492 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 857/1844] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:16 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1661 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:38:16.487832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-37b8a101-4871-47dd-b9de-6dc343409273 req-b27a1505-f429-4fba-b995-a80da52b0fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa0aaef-a675-4aed-a3e3-93790420d284", "name": "network-vif-deleted", "tag": "a581aa07-c5be-4251-bae8-eb700c203ba5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:16.535083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-37b8a101-4871-47dd-b9de-6dc343409273 req-b27a1505-f429-4fba-b995-a80da52b0fa4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:16.535556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-37b8a101-4871-47dd-b9de-6dc343409273 req-b27a1505-f429-4fba-b995-a80da52b0fa4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:16.536494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-37b8a101-4871-47dd-b9de-6dc343409273 req-b27a1505-f429-4fba-b995-a80da52b0fa4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:16.584762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-37b8a101-4871-47dd-b9de-6dc343409273 req-b27a1505-f429-4fba-b995-a80da52b0fa4 service nova] Creating event network-vif-deleted:a581aa07-c5be-4251-bae8-eb700c203ba5 for instance 8fa0aaef-a675-4aed-a3e3-93790420d284 on n-h2-860864-8 Oct 12 22:38:16.601834 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-37b8a101-4871-47dd-b9de-6dc343409273 req-b27a1505-f429-4fba-b995-a80da52b0fa4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121318 Oct 12 22:38:16.602952 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 858/1845] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:16.630847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65bd6cfc-5d63-4022-a690-fc21f7d84890 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff54e820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:16.682564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:16.696270 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad92e28c-8a34-47a5-ab3a-3080b771b982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.436147 Oct 12 22:38:16.697649 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 988/1846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:16 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:16.731550 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65bd6cfc-5d63-4022-a690-fc21f7d84890 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1411 microversion: 2.1 time: 0.127136 Oct 12 22:38:16.740246 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 859/1847] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:16 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:17.029339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:17.029958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:17.040317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.046293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.048257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.049619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.052986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.057423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.170845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:17.339735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:17.340653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:17.348269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.356581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.357189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.358069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.360450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.360997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.461713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.468291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.469431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.470461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lazy-loading 'fault' on Instance uuid 8fa0aaef-a675-4aed-a3e3-93790420d284 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:38:17.686717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:17.695848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:17.710692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:17.728295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a97059a4-7435-4cad-8c14-8f786be9bcce tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 200 len: 1374 microversion: 2.25 time: 0.390255 Oct 12 22:38:17.747963 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 860/1848] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:17 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 1374 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:38:17.753134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:17.778678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:17.792811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.793312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.793752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:17.797677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:17.798148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:17.799543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.141557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:18.150393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-631680a0-df4d-4c74-93ad-cd0f29433348 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 1.125077 Oct 12 22:38:18.168369 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 989/1849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:17 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:18.181699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b3ef1dc-afd5-4823-96e1-5d550f3f7056 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff434550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.256991 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b3ef1dc-afd5-4823-96e1-5d550f3f7056 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1420 microversion: 2.1 time: 0.086701 Oct 12 22:38:18.266520 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 990/1850] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:18 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:18.271859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-913d75e7-7159-471a-9384-bc8e65b0b658 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507aee9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.345852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:18.347167 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-913d75e7-7159-471a-9384-bc8e65b0b658 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 200 len: 1420 microversion: 2.1 time: 0.079089 Oct 12 22:38:18.348748 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 991/1851] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:18 2022] GET /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:18.368730 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-82932c8d-1385-4b03-abad-e1a258403d05 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.632176 Oct 12 22:38:18.371276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25b213b9-e5ea-47d6-8b20-27e92071b305 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff434160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.372747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 861/1852] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:17 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:18.762489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.763189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 8fa0aaef-a675-4aed-a3e3-93790420d284] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:18.780956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.781451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.785593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.786507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:18.787068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:18.788066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:18.821710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] HTTP exception thrown: Instance 8fa0aaef-a675-4aed-a3e3-93790420d284 could not be found. Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Request method failure captured: Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 HTTP/1.1 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Axh5r9_1x3MlpMhytNpWT227ZKrvtXNtEdykJCwXUOZxlc48KhOdpQV-58CUhTUAHMcZr8BCrN3cga1qgGYHGvI8tvRTFWwePXuQjEJHG6flLbyi3731H-fCKtKqc9O0UmkD1ktp8n5Ls3juafbS8_AjeWIE2zkR1Syoe9NPqwPeA Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_accb9cc4a17842af84b0002428db16d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}] Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 03a180537b9149b1bf4250bc9965bb7b Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 8fa0aaef-a675-4aed-a3e3-93790420d284 could not be found. Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '8fa0aaef-a675-4aed-a3e3-93790420d284'} Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa0aaef-a675-4aed-a3e3-93790420d284 could not be found. Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa0aaef-a675-4aed-a3e3-93790420d284 could not be found. Oct 12 22:38:18.823668 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa0aaef-a675-4aed-a3e3-93790420d284 could not be found. Oct 12 22:38:18.828565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:18.839075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Returning 404 to user: Instance 8fa0aaef-a675-4aed-a3e3-93790420d284 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:18.840240 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1072cade-c67f-4bd2-ade9-575eb08a3426 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284" status: 404 len: 111 microversion: 2.25 time: 0.081890 Oct 12 22:38:18.842375 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 862/1853] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:18 2022] GET /compute/v2.1/servers/8fa0aaef-a675-4aed-a3e3-93790420d284 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:38:18.852400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5aa5820-429c-49d7-b837-ae9701604337 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '.version_select at 0x7f44ffdf8940>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:18.883215 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c5aa5820-429c-49d7-b837-ae9701604337 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12003459" status: 204 len: 0 microversion: 2.25 time: 0.036271 Oct 12 22:38:18.887700 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 863/1854] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:38:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12003459 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:38:19.185698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:19.186976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:19.205425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.206566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.208572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.213611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.214580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.215273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.373063 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25b213b9-e5ea-47d6-8b20-27e92071b305 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 204 len: 0 microversion: 2.1 time: 1.006188 Oct 12 22:38:19.377064 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 992/1855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:18 2022] DELETE /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:38:19.383390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:19.384134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:19.393482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.394380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.395178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.396086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.410860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.411647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.479821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:19.616084 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-07355950-b264-4c8e-bf86-b90f516bde51 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 204 len: 0 microversion: 2.1 time: 0.237371 Oct 12 22:38:19.622029 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 993/1856] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:38:19 2022] DELETE /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:38:19.628634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:19.629726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:19.638436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.639307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.640201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.641204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:19.642580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:19.643249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:19.702496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:19.717674 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-236262d6-df2a-4652-b527-fe1af36d06e7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 0.531464 Oct 12 22:38:19.720258 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 864/1857] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:19 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:19.884686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1445463428", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "25f09190-2cdc-41b9-9952-f833573da6b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:19.981811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] validate_networks() for [('25f09190-2cdc-41b9-9952-f833573da6b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:38:20.542526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:20.562037 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32a3f96c-2392-404d-9bb2-fd168e175f7b tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.934169 Oct 12 22:38:20.578532 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 994/1858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:19 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:20.586569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c154e72b-88cb-4043-a889-db42ce0b8802 req-2f134d59-c060-4f28-8eed-96d9f0c4d31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8de8c4c-95a9-4b86-b434-66592b5ecf25", "name": "network-vif-unplugged", "status": "completed", "tag": "99f4970d-9b83-4ef7-8efe-8853302117b1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:20.622051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c154e72b-88cb-4043-a889-db42ce0b8802 req-2f134d59-c060-4f28-8eed-96d9f0c4d31b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.622511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c154e72b-88cb-4043-a889-db42ce0b8802 req-2f134d59-c060-4f28-8eed-96d9f0c4d31b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.623146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c154e72b-88cb-4043-a889-db42ce0b8802 req-2f134d59-c060-4f28-8eed-96d9f0c4d31b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.638647 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c154e72b-88cb-4043-a889-db42ce0b8802 req-2f134d59-c060-4f28-8eed-96d9f0c4d31b service nova] Creating event network-vif-unplugged:99f4970d-9b83-4ef7-8efe-8853302117b1 for instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 on n-h1-860864-8 Oct 12 22:38:20.644761 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c154e72b-88cb-4043-a889-db42ce0b8802 req-2f134d59-c060-4f28-8eed-96d9f0c4d31b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067955 Oct 12 22:38:20.652969 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 995/1859] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:20.661666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3837cac9-33ad-4448-854d-ce9708185ac5 req-04e46890-a8f4-4d5a-9f91-3d58f659ecc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee", "name": "network-vif-plugged", "status": "completed", "tag": "e00b7c80-471e-4143-b726-931f38e44dfc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:20.682133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3837cac9-33ad-4448-854d-ce9708185ac5 req-04e46890-a8f4-4d5a-9f91-3d58f659ecc4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.683269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3837cac9-33ad-4448-854d-ce9708185ac5 req-04e46890-a8f4-4d5a-9f91-3d58f659ecc4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.684075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3837cac9-33ad-4448-854d-ce9708185ac5 req-04e46890-a8f4-4d5a-9f91-3d58f659ecc4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.718587 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3837cac9-33ad-4448-854d-ce9708185ac5 req-04e46890-a8f4-4d5a-9f91-3d58f659ecc4 service nova] Creating event network-vif-plugged:e00b7c80-471e-4143-b726-931f38e44dfc for instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee on n-h1-860864-8 Oct 12 22:38:20.732652 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3837cac9-33ad-4448-854d-ce9708185ac5 req-04e46890-a8f4-4d5a-9f91-3d58f659ecc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077813 Oct 12 22:38:20.734903 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 996/1860] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:20.751956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:20.753351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:20.768145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.776461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.777108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.778586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:20.781412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:20.782082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:20.998413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:38:20.999485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:38:21.000341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:38:21.000999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:38:21.001650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:38:21.006641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:21.017054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.017834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.018464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.019417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.020046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.020572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.044497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:38:21.052399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for user 080644f7502346ed8ff64a026ac9d15b and project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:38:21.068027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:38:21.075212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:38:21.151679 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea6dbdfb-a2a2-400e-8807-17afda1653d1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271999 Oct 12 22:38:21.153194 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 865/1861] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:38:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:38:21.167384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ed613ce-0882-439e-b6a6-95152081c92c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:21.168595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ed613ce-0882-439e-b6a6-95152081c92c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:21.324134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ed613ce-0882-439e-b6a6-95152081c92c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:21.353680 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ed613ce-0882-439e-b6a6-95152081c92c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1208 microversion: 2.1 time: 0.186529 Oct 12 22:38:21.357867 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 866/1862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:21 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:21.384518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:21.388867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:21.398825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.400126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.400377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.401525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.402154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.402800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.440313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:21.576218 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-15571766-35b2-4da3-8d57-13b879b2ee7d tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 204 len: 0 microversion: 2.25 time: 0.205731 Oct 12 22:38:21.580695 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 867/1863] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:38:21 2022] DELETE /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:38:21.595662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:21.597706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:21.608248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.608913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.609648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.610600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.611858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.612571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.635481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:21.649333 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d84b52b7-b46c-49e8-857d-771057878b22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1317 microversion: 2.1 time: 0.906694 Oct 12 22:38:21.650441 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 997/1864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:20 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1317 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:21.658743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:21.663010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:21.674409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.676401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.677040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.678514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:21.679172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:21.679822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:21.916804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:21.931931 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0f3514b-0b17-4158-9ea8-c2e10b692775 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.347530 Oct 12 22:38:21.937108 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 868/1865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:21 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:22.386642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:22.387697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:22.408670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:22.409717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:22.410619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:22.411697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:22.414337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:22.414776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:22.550209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:22.562234 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dbf8a46-04e6-4d66-82e5-d60047eb5d23 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1260 microversion: 2.1 time: 0.182197 Oct 12 22:38:22.581788 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 869/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:22 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:22.684115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:22.685386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:22.711731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:22.712403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:22.714552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:22.718393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:22.718966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:22.720874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.003640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:23.014298 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a5b60557-a315-4deb-a886-5b83856214eb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1466 microversion: 2.1 time: 0.338528 Oct 12 22:38:23.024024 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 870/1867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:22 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1466 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:23.024024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0d523ceb-b67f-44ea-b491-a0e96e5e0499 req-31381976-dc44-4d91-a512-4c8d03e23cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c3fadd-3c92-4818-b641-8799d43ed387", "name": "network-vif-deleted", "tag": "08d5fd64-1e78-4647-b7f5-b975906b2fcb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:23.033770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0d523ceb-b67f-44ea-b491-a0e96e5e0499 req-31381976-dc44-4d91-a512-4c8d03e23cd2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.034605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0d523ceb-b67f-44ea-b491-a0e96e5e0499 req-31381976-dc44-4d91-a512-4c8d03e23cd2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.035236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0d523ceb-b67f-44ea-b491-a0e96e5e0499 req-31381976-dc44-4d91-a512-4c8d03e23cd2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.051823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0d523ceb-b67f-44ea-b491-a0e96e5e0499 req-31381976-dc44-4d91-a512-4c8d03e23cd2 service nova] Creating event network-vif-deleted:08d5fd64-1e78-4647-b7f5-b975906b2fcb for instance 04c3fadd-3c92-4818-b641-8799d43ed387 on n-h2-860864-8 Oct 12 22:38:23.059227 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0d523ceb-b67f-44ea-b491-a0e96e5e0499 req-31381976-dc44-4d91-a512-4c8d03e23cd2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042123 Oct 12 22:38:23.060532 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 871/1868] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:23.068872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:23.070249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:23.079977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.081669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.082830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.083799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.085358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.086276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.301095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:23.322766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:23.324298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:23.325812 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5525e65-2a3b-482a-a749-c95e27e44b19 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1549 microversion: 2.25 time: 1.673932 Oct 12 22:38:23.330965 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 998/1869] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:21 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1549 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:38:23.339869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1469052435", "metadata": {"image_type": "test"}}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:23.348514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:23.357838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:23.367389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.368159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.368750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.369609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.370250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.370844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.375105 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e16648a2-3f11-478e-8e05-929e068f21ff tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.310319 Oct 12 22:38:23.378713 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 872/1870] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:23 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:23.392234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ffd1594f-36ae-4929-b7cd-49a468843b21 req-178cac9a-18fc-435d-a1f2-85631616ae77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8de8c4c-95a9-4b86-b434-66592b5ecf25", "tag": "99f4970d-9b83-4ef7-8efe-8853302117b1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:23.419586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ffd1594f-36ae-4929-b7cd-49a468843b21 req-178cac9a-18fc-435d-a1f2-85631616ae77 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.419990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ffd1594f-36ae-4929-b7cd-49a468843b21 req-178cac9a-18fc-435d-a1f2-85631616ae77 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.420427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ffd1594f-36ae-4929-b7cd-49a468843b21 req-178cac9a-18fc-435d-a1f2-85631616ae77 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.443226 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ffd1594f-36ae-4929-b7cd-49a468843b21 req-178cac9a-18fc-435d-a1f2-85631616ae77 service nova] Creating event network-changed:99f4970d-9b83-4ef7-8efe-8853302117b1 for instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 on n-h1-860864-8 Oct 12 22:38:23.452631 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ffd1594f-36ae-4929-b7cd-49a468843b21 req-178cac9a-18fc-435d-a1f2-85631616ae77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073781 Oct 12 22:38:23.456849 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 873/1871] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:23.468619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:23.469218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:23.470916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Getting quotas for project 4fc4f5adce674ecfa266bc4499a771fe. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:38:23.485317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.485829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.486268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.486965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.491530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Getting quotas for user c822c44d83fc477387b40ee6dac04468 and project 4fc4f5adce674ecfa266bc4499a771fe. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:38:23.493576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.494208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.540578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:23.601463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:23.724919 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e60009d-3778-4359-8193-56df1329dc70 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 204 len: 0 microversion: 2.1 time: 0.266429 Oct 12 22:38:23.725974 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 874/1872] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:38:23 2022] DELETE /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:38:23.734989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:23.736046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:23.744818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.745562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.746263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.747143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.747765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.748446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.809389 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78567743-c93e-4702-ac17-f5a4e4e75774 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "POST /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee/action" status: 202 len: 0 microversion: 2.1 time: 0.476853 Oct 12 22:38:23.811046 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 999/1873] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:23 2022] POST /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:38:23.819009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:23.820058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:23.832755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.833532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.834783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.834976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:23.836267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.836976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.837673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.851620 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4750cf84-195e-41ea-a877-8760143caf39 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1266 microversion: 2.1 time: 0.123250 Oct 12 22:38:23.852169 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 875/1874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:23 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:23.868960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-292f2af3-f347-454f-9732-16ce8fc5b447 req-c5914fd3-f06f-4019-95b2-1f63c75ae870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ffeab8-5085-444f-a1c4-9ad3cd21853c", "name": "network-vif-unplugged", "status": "completed", "tag": "c2c856de-2050-4f75-b44f-592fd5130d47"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:23.891530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-292f2af3-f347-454f-9732-16ce8fc5b447 req-c5914fd3-f06f-4019-95b2-1f63c75ae870 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:23.893185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-292f2af3-f347-454f-9732-16ce8fc5b447 req-c5914fd3-f06f-4019-95b2-1f63c75ae870 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:23.893641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-292f2af3-f347-454f-9732-16ce8fc5b447 req-c5914fd3-f06f-4019-95b2-1f63c75ae870 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:23.921416 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-292f2af3-f347-454f-9732-16ce8fc5b447 req-c5914fd3-f06f-4019-95b2-1f63c75ae870 service nova] Creating event network-vif-unplugged:c2c856de-2050-4f75-b44f-592fd5130d47 for instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c on n-h1-860864-8 Oct 12 22:38:23.927201 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-292f2af3-f347-454f-9732-16ce8fc5b447 req-c5914fd3-f06f-4019-95b2-1f63c75ae870 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073543 Oct 12 22:38:23.928900 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 876/1875] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:23.936704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a0add3af-e574-4a89-ab99-6776f3912ecb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff54b700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:24.002087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a0add3af-e574-4a89-ab99-6776f3912ecb tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.071460 Oct 12 22:38:24.003322 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 877/1876] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:23 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:24.359009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:24.360007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:24.372264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.373070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.373516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.374237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.374693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.375123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.422200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.423676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.424747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.426582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lazy-loading 'fault' on Instance uuid 04c3fadd-3c92-4818-b641-8799d43ed387 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:38:24.522548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:24.535350 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d8ee7e7-0484-463a-8f34-8aed7ab26f8d tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1667 microversion: 2.1 time: 0.721971 Oct 12 22:38:24.548275 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1000/1877] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:23 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1667 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:24.551613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:24.553777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:24.554480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:24.569782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:24.571783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:24.573729 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-522141fb-3f76-4b86-8922-37d4822a1bb7 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 200 len: 1352 microversion: 2.25 time: 0.218956 Oct 12 22:38:24.573948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.574455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.574900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.575619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.576099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.576735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.579075 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 878/1878] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:24 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 1352 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:38:24.883574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:24.885398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:24.900244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.901572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.902471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:24.903631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:24.904498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:24.913907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.156401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:25.177843 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70b8a446-ce1c-42aa-95ec-7abdc880a551 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1308 microversion: 2.1 time: 0.299526 Oct 12 22:38:25.179347 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 879/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:24 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:25.187535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8d8ad91-e9d1-466a-b971-1df8f960cc62 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ffdc4940>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:25.201123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:25.212091 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82601080-9dc3-496d-88ab-12f8fff04bc6 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.662600 Oct 12 22:38:25.212672 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1001/1880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:24 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:25.302253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ca3a018b-64d5-4c55-b041-84b5738bf89b req-65e612d9-67d2-4365-9c99-3cb097d5bafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ba94be-a6bf-4bed-8644-0971210edb33", "tag": "4aae5597-b208-41ad-afab-4f29fe01b52b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:25.307661 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8d8ad91-e9d1-466a-b971-1df8f960cc62 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.127036 Oct 12 22:38:25.308426 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 880/1881] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:25 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:25.332055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ca3a018b-64d5-4c55-b041-84b5738bf89b req-65e612d9-67d2-4365-9c99-3cb097d5bafb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.332998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ca3a018b-64d5-4c55-b041-84b5738bf89b req-65e612d9-67d2-4365-9c99-3cb097d5bafb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.334920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ca3a018b-64d5-4c55-b041-84b5738bf89b req-65e612d9-67d2-4365-9c99-3cb097d5bafb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.363975 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ca3a018b-64d5-4c55-b041-84b5738bf89b req-65e612d9-67d2-4365-9c99-3cb097d5bafb service nova] Creating event network-changed:4aae5597-b208-41ad-afab-4f29fe01b52b for instance 65ba94be-a6bf-4bed-8644-0971210edb33 on n-h1-860864-8 Oct 12 22:38:25.369366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ca3a018b-64d5-4c55-b041-84b5738bf89b req-65e612d9-67d2-4365-9c99-3cb097d5bafb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071044 Oct 12 22:38:25.370287 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1002/1882] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:38:25.498059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-760fbc20-2da1-4935-b004-1aae575822b1 req-165b5bf7-faa2-48f4-90f4-022d3cf21962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ffeab8-5085-444f-a1c4-9ad3cd21853c", "name": "network-vif-deleted", "tag": "c2c856de-2050-4f75-b44f-592fd5130d47"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:25.512459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-760fbc20-2da1-4935-b004-1aae575822b1 req-165b5bf7-faa2-48f4-90f4-022d3cf21962 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.513465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-760fbc20-2da1-4935-b004-1aae575822b1 req-165b5bf7-faa2-48f4-90f4-022d3cf21962 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.514271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-760fbc20-2da1-4935-b004-1aae575822b1 req-165b5bf7-faa2-48f4-90f4-022d3cf21962 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.543825 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-760fbc20-2da1-4935-b004-1aae575822b1 req-165b5bf7-faa2-48f4-90f4-022d3cf21962 service nova] Creating event network-vif-deleted:c2c856de-2050-4f75-b44f-592fd5130d47 for instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c on n-h1-860864-8 Oct 12 22:38:25.549327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-760fbc20-2da1-4935-b004-1aae575822b1 req-165b5bf7-faa2-48f4-90f4-022d3cf21962 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055051 Oct 12 22:38:25.551121 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 881/1883] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:25.563220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:25.565478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:25.573363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.574094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.574711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.580980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.581722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.583070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.604007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:25.605118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 04c3fadd-3c92-4818-b641-8799d43ed387] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:25.616383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.619810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.624414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.625569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.628451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.629642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.662122 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] HTTP exception thrown: Instance 04c3fadd-3c92-4818-b641-8799d43ed387 could not be found. Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Request method failure captured: Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 HTTP/1.1 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Axh5r9_1x3MlpMhytNpWT227ZKrvtXNtEdykJCwXUOZxlc48KhOdpQV-58CUhTUAHMcZr8BCrN3cga1qgGYHGvI8tvRTFWwePXuQjEJHG6flLbyi3731H-fCKtKqc9O0UmkD1ktp8n5Ls3juafbS8_AjeWIE2zkR1Syoe9NPqwPeA Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_accb9cc4a17842af84b0002428db16d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}] Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 03a180537b9149b1bf4250bc9965bb7b Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 04c3fadd-3c92-4818-b641-8799d43ed387 could not be found. Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04c3fadd-3c92-4818-b641-8799d43ed387'} Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c3fadd-3c92-4818-b641-8799d43ed387 could not be found. Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c3fadd-3c92-4818-b641-8799d43ed387 could not be found. Oct 12 22:38:25.668200 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c3fadd-3c92-4818-b641-8799d43ed387 could not be found. Oct 12 22:38:25.672837 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:25.676465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Returning 404 to user: Instance 04c3fadd-3c92-4818-b641-8799d43ed387 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:25.677654 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f33c7188-fc09-4abf-b0af-5e8090fb4f92 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387" status: 404 len: 111 microversion: 2.25 time: 0.079068 Oct 12 22:38:25.680499 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 882/1884] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:25 2022] GET /compute/v2.1/servers/04c3fadd-3c92-4818-b641-8799d43ed387 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:38:25.691621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:25.695656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:25.714903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.715409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.716547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.717289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:25.718795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:25.720526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:25.774769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:25.974483 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4f6a8d4-b7df-43e1-9539-d7e03d9b904b tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "DELETE /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 204 len: 0 microversion: 2.25 time: 0.287706 Oct 12 22:38:25.980138 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 883/1885] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:38:25 2022] DELETE /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:38:25.987401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:25.990826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:26.003531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:26.012347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:26.012814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:26.013606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:26.014075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:26.014506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:26.346832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:26.355648 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-296703a3-d241-42a0-a93b-0f0e5aaf66c6 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1667 microversion: 2.1 time: 0.796906 Oct 12 22:38:26.362451 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1003/1886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:25 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1667 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:26.368361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:26.369202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:26.385695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:26.386515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:26.387211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:26.388192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:26.388845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:26.389765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:26.866323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:26.877912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:26.879375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:26.881138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-295224f5-7119-4773-8db8-fc8c458a1c0e tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1564 microversion: 2.25 time: 0.898738 Oct 12 22:38:26.881925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 884/1887] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:25 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1564 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:38:26.887220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:26.888135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:26.904087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:26.904914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:26.905887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:26.906744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:26.909186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:26.909621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:26.942910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:26.957438 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-387734c0-f71d-44a7-acc7-9be691fe881d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1308 microversion: 2.1 time: 0.593265 Oct 12 22:38:26.958666 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1004/1888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:26 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1308 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:26.963676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b98ad60-b5bf-4571-91ad-9d9d94bee946 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff4ff790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:27.021920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b98ad60-b5bf-4571-91ad-9d9d94bee946 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.061872 Oct 12 22:38:27.023177 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1005/1889] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:26 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:27.290537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2096804182", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d120bee4-e62d-4506-a41c-c497069504b2"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:27.376790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] validate_networks() for [('d120bee4-e62d-4506-a41c-c497069504b2', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:38:27.721141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:27.739923 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c375d9a8-f604-4f7e-9c12-01433bf9be42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.856468 Oct 12 22:38:27.749176 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 885/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:26 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:27.769958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:27.770852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:27.792669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:27.794775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:27.796419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:27.799383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:27.808070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:27.808758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.277914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:29.299195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-83a6980b-1890-4834-ad46-5be2d152e9e1 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1667 microversion: 2.1 time: 1.547118 Oct 12 22:38:29.300052 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 886/1891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:27 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1667 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:29.304822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8216b753-f165-4a1f-92ab-f15fba8741a6 req-bfbb311f-8e36-42af-93c4-4194176342ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ccd1b5-4f99-43fe-a203-bc5ede34932b", "name": "network-vif-unplugged", "status": "completed", "tag": "d3627478-6dbb-4abf-90ce-8d102e179bd3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:29.321932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8216b753-f165-4a1f-92ab-f15fba8741a6 req-bfbb311f-8e36-42af-93c4-4194176342ea service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.322629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8216b753-f165-4a1f-92ab-f15fba8741a6 req-bfbb311f-8e36-42af-93c4-4194176342ea service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.323219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8216b753-f165-4a1f-92ab-f15fba8741a6 req-bfbb311f-8e36-42af-93c4-4194176342ea service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.338492 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8216b753-f165-4a1f-92ab-f15fba8741a6 req-bfbb311f-8e36-42af-93c4-4194176342ea service nova] Creating event network-vif-unplugged:d3627478-6dbb-4abf-90ce-8d102e179bd3 for instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b on n-h2-860864-8 Oct 12 22:38:29.346449 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8216b753-f165-4a1f-92ab-f15fba8741a6 req-bfbb311f-8e36-42af-93c4-4194176342ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044242 Oct 12 22:38:29.348395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 887/1892] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:29.359575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:29.364081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:29.398586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.401840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.402539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.404395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.405955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.408012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.487926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.495520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.496131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.496701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lazy-loading 'fault' on Instance uuid 379c4c15-434c-4786-9738-63649c335334 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:38:29.672150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:38:29.672613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:38:29.672681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:38:29.673144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:38:29.673566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:38:29.690648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.691132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.691569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.701610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.703161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.705111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.786829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Getting quotas for project fb938e6b23274630851659d8ee7333dd. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:38:29.790576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:29.821003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Getting quotas for user 118b009d22e243f68aad905b06faf3ac and project fb938e6b23274630851659d8ee7333dd. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:38:29.821370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:29.824086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03a180537b9149b1bf4250bc9965bb7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb9cc4a17842af84b0002428db16d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:29.836068 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91d45857-87a3-48de-96df-a505811e93ae tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 200 len: 1352 microversion: 2.25 time: 0.486362 Oct 12 22:38:29.852832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 888/1893] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:29 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 1352 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:38:29.875100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:29.875986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:29.877157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:38:29.886306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:38:29.900148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.901030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.901541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:29.902579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:29.906547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:29.907368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:30.032582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b276d3a-a045-4e62-b086-fa9e5e841a0e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.007245 Oct 12 22:38:30.034332 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1006/1894] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:38:30.042587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e58517f-56b4-42ad-b40a-ea92614d1702 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff4fff70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:30.157517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e58517f-56b4-42ad-b40a-ea92614d1702 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.121542 Oct 12 22:38:30.158598 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1007/1895] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:30 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:30.189165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-60addd9a-e0ca-4925-aa2c-3a4451e8c4ce req-a9b9d33c-d746-42da-b070-5b6f04a07b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "379c4c15-434c-4786-9738-63649c335334", "name": "network-vif-deleted", "tag": "a7e0e2d1-e880-4aab-a151-307201918d79"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:30.233557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-60addd9a-e0ca-4925-aa2c-3a4451e8c4ce req-a9b9d33c-d746-42da-b070-5b6f04a07b36 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:30.235940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-60addd9a-e0ca-4925-aa2c-3a4451e8c4ce req-a9b9d33c-d746-42da-b070-5b6f04a07b36 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:30.238519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-60addd9a-e0ca-4925-aa2c-3a4451e8c4ce req-a9b9d33c-d746-42da-b070-5b6f04a07b36 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:30.287204 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-60addd9a-e0ca-4925-aa2c-3a4451e8c4ce req-a9b9d33c-d746-42da-b070-5b6f04a07b36 service nova] Creating event network-vif-deleted:a7e0e2d1-e880-4aab-a151-307201918d79 for instance 379c4c15-434c-4786-9738-63649c335334 on n-h2-860864-8 Oct 12 22:38:30.299881 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-60addd9a-e0ca-4925-aa2c-3a4451e8c4ce req-a9b9d33c-d746-42da-b070-5b6f04a07b36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139167 Oct 12 22:38:30.307848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1008/1896] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:30.330155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:30.330911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:30.357898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:30.358671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:30.359321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:30.360291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:30.361194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:30.364187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:30.744615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:30.753920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6c57d99-a74a-4334-969f-a1dc3f7680fc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.444668 Oct 12 22:38:30.790518 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1009/1897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:30 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:30.802544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c1041c3-cbdb-4f34-948c-9aaf1234257a tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:30.806620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1c1041c3-cbdb-4f34-948c-9aaf1234257a tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:30.979053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1c1041c3-cbdb-4f34-948c-9aaf1234257a tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:30.986946 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1c1041c3-cbdb-4f34-948c-9aaf1234257a tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1217 microversion: 2.1 time: 0.195130 Oct 12 22:38:30.991625 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1010/1898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:30 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:30.998957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:31.000843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:31.008667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:31.014721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:31.015420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:31.016273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:31.017209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:31.017866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:31.018797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:31.023675 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c7bbf17-9892-4c38-92f2-c70a8c744a91 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1308 microversion: 2.1 time: 1.165120 Oct 12 22:38:31.028545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 889/1899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:29 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1308 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:31.045008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:31.048750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] [instance: 379c4c15-434c-4786-9738-63649c335334] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:31.052677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:31.071225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:31.086207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:31.090350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:31.095504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:31.097199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:31.097892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:31.162969 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] HTTP exception thrown: Instance 379c4c15-434c-4786-9738-63649c335334 could not be found. Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Request method failure captured: Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 HTTP/1.1 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Axh5r9_1x3MlpMhytNpWT227ZKrvtXNtEdykJCwXUOZxlc48KhOdpQV-58CUhTUAHMcZr8BCrN3cga1qgGYHGvI8tvRTFWwePXuQjEJHG6flLbyi3731H-fCKtKqc9O0UmkD1ktp8n5Ls3juafbS8_AjeWIE2zkR1Syoe9NPqwPeA Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/accb9cc4a17842af84b0002428db16d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_accb9cc4a17842af84b0002428db16d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/accb9cc4a17842af84b0002428db16d8"}]}] Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: accb9cc4a17842af84b0002428db16d8 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-918134513 Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 03a180537b9149b1bf4250bc9965bb7b Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-918134513-project Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 379c4c15-434c-4786-9738-63649c335334 could not be found. Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '379c4c15-434c-4786-9738-63649c335334'} Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 379c4c15-434c-4786-9738-63649c335334 could not be found. Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 379c4c15-434c-4786-9738-63649c335334 could not be found. Oct 12 22:38:31.169211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 379c4c15-434c-4786-9738-63649c335334 could not be found. Oct 12 22:38:31.172775 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:31.176637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] Returning 404 to user: Instance 379c4c15-434c-4786-9738-63649c335334 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:31.179531 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b507e496-444e-4c5a-8e13-8e44364abd11 tempest-LiveAutoBlockMigrationV225Test-918134513 tempest-LiveAutoBlockMigrationV225Test-918134513-project] 10.222.0.20 "GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334" status: 404 len: 111 microversion: 2.25 time: 0.149708 Oct 12 22:38:31.185216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:31.189101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:31.194566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c46f7a5b-5610-4cd0-a2f2-a70bfe37979c tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1599 microversion: 2.1 time: 0.201592 Oct 12 22:38:31.195136 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 890/1900] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:38:31 2022] GET /compute/v2.1/servers/379c4c15-434c-4786-9738-63649c335334 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:38:31.211300 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1011/1901] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:30 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:31.212968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fff3f382-f583-4909-9107-24015598c2a1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff54b5e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:31.287351 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fff3f382-f583-4909-9107-24015598c2a1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.090786 Oct 12 22:38:31.301340 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 891/1902] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:31 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:31.808016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:31.809318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:31.833422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:31.836061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:31.837421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:31.838492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:31.839652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:31.841438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:32.012643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:32.017692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:32.018308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:32.034003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:32.034506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:32.034951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:32.035690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:32.056315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:32.056890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:32.679416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:32.697181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-149bc979-d900-42b7-91be-9fa9963a08fe tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1269 microversion: 2.1 time: 0.685149 Oct 12 22:38:32.711988 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 892/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:32 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1269 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:32.711988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:32.711988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:32.717198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:32.717690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:32.718538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:32.718825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:32.719277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:32.719701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:33.011516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:33.021292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e07b9c70-6d99-461f-bb63-f26da67e85a1 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 1.223948 Oct 12 22:38:33.040369 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1012/1904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:31 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:33.052852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:33.054208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:33.071453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:33.072193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:33.072802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:33.073799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:33.074101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:33.074527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:33.224818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8e831ff5a04558af42247fcf15670b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a9f523cfeb445d8e29d7b623fc2ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:33.242616 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2784de70-6485-4f26-b16c-405fe38f0248 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 200 len: 1311 microversion: 2.1 time: 0.200811 Oct 12 22:38:33.243211 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1013/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:33 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 1311 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:33.247922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be508bb7-577b-48d5-9a6c-3adc99366422 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff4fd0d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:33.347749 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be508bb7-577b-48d5-9a6c-3adc99366422 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.103271 Oct 12 22:38:33.348392 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1014/1906] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:33 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:33.376160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f481db27-2e42-4bf8-afe3-aa9684610749 req-1a402854-3b6d-4855-be3c-6a8151da6433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee", "name": "network-vif-plugged", "status": "completed", "tag": "e00b7c80-471e-4143-b726-931f38e44dfc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:33.429439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f481db27-2e42-4bf8-afe3-aa9684610749 req-1a402854-3b6d-4855-be3c-6a8151da6433 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:33.436830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f481db27-2e42-4bf8-afe3-aa9684610749 req-1a402854-3b6d-4855-be3c-6a8151da6433 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:33.440083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f481db27-2e42-4bf8-afe3-aa9684610749 req-1a402854-3b6d-4855-be3c-6a8151da6433 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:33.506525 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f481db27-2e42-4bf8-afe3-aa9684610749 req-1a402854-3b6d-4855-be3c-6a8151da6433 service nova] Creating event network-vif-plugged:e00b7c80-471e-4143-b726-931f38e44dfc for instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee on n-h1-860864-8 Oct 12 22:38:33.530274 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f481db27-2e42-4bf8-afe3-aa9684610749 req-1a402854-3b6d-4855-be3c-6a8151da6433 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180089 Oct 12 22:38:33.544782 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1015/1907] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:33.550266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ccd1b5-4f99-43fe-a203-bc5ede34932b", "name": "network-vif-deleted", "tag": "d3627478-6dbb-4abf-90ce-8d102e179bd3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:33.606388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:33.606863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:33.607292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:33.642272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Creating event network-vif-deleted:d3627478-6dbb-4abf-90ce-8d102e179bd3 for instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b on n-h2-860864-8 Oct 12 22:38:33.681283 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134934 Oct 12 22:38:33.682377 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1016/1908] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:33.683605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:33.684576 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001326 Oct 12 22:38:33.684903 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1017/1909] 10.222.0.20 () {56 vars in 886 bytes} [Wed Oct 12 22:38:33 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:38:33.698528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:33.699865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001866 Oct 12 22:38:33.701789 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1018/1910] 10.222.0.20 () {54 vars in 1035 bytes} [Wed Oct 12 22:38:33 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 12 22:38:33.710282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:33.711308 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-59f24eda-c6db-47a8-ac71-ead5f1a47885 req-4d6580aa-d882-42df-a655-ff216dc2874c service nova] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 12 22:38:33.715405 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1019/1911] 10.222.0.20 () {54 vars in 1041 bytes} [Wed Oct 12 22:38:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:33.725882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:33.727440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:33.733416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:33.737941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:33.738625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:33.739298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:33.740373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:33.740968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:33.741575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:34.055329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:34.070717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1287 microversion: 2.1 time: 0.344373 Oct 12 22:38:34.073015 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1020/1912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:33 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1287 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:34.077125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:34.079759 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-233fccc6-26d7-4723-bfc9-b09ed656d041 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005426 Oct 12 22:38:34.082543 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1021/1913] 10.222.0.20 () {56 vars in 886 bytes} [Wed Oct 12 22:38:34 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 22:38:34.110652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:34.111346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:34.112206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:34.120695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:34.122048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:34.122631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:34.123425 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dcfca9ad-93be-462b-823e-08c87efed9ec tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1308 microversion: 2.1 time: 1.424266 Oct 12 22:38:34.123815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:34.127026 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 893/1914] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:32 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1308 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:34.127250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:34.129057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:34.269150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:34.270126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [instance: c9ccd1b5-4f99-43fe-a203-bc5ede34932b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:34.285131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:34.289870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:34.291333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:34.298349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:34.303754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:34.304360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:34.332502 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] HTTP exception thrown: Instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b could not be found. Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Request method failure captured: Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b HTTP/1.1 Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0GiroDKPWHNzqw_GIV7c3Ke2BUe1ddZvoSQ5_fg7kvdJx4Wr7qY2GGOAySsyYbdi87q3C7K-TqALXfAQJV5DqMVp1k3oowRo8tgu8HgJqvtSakhZc4SxjE3SlugFHhJYZzgFF8-CdRRG9EAsyEyOs65ppRFDcTSO7_kvqajKM7fLKo Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 14a9f523cfeb445d8e29d7b623fc2ebb Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestFqdnHostnames-1692066079 Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a9f523cfeb445d8e29d7b623fc2ebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14a9f523cfeb445d8e29d7b623fc2ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14a9f523cfeb445d8e29d7b623fc2ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14a9f523cfeb445d8e29d7b623fc2ebb"}]}] Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestFqdnHostnames-1692066079 Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 14a9f523cfeb445d8e29d7b623fc2ebb Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1692066079 Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestFqdnHostnames-1692066079-project Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1c8e831ff5a04558af42247fcf15670b Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestFqdnHostnames-1692066079-project Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b could not be found. Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'c9ccd1b5-4f99-43fe-a203-bc5ede34932b'} Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b could not be found. Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b could not be found. Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:34.334461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:34.338661 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:34.338661 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:34.338661 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:34.338661 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:34.338661 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:34.338661 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b could not be found. Oct 12 22:38:34.338661 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:34.351532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Returning 404 to user: Instance c9ccd1b5-4f99-43fe-a203-bc5ede34932b could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:34.352773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f37d0fb-798d-4311-8a7e-03d22814e4d5 tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b" status: 404 len: 111 microversion: 2.1 time: 0.087788 Oct 12 22:38:34.355282 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 894/1915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:34 2022] GET /compute/v2.1/servers/c9ccd1b5-4f99-43fe-a203-bc5ede34932b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:38:34.375162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71700bc1-b19a-4021-b8c5-780b9a12e26e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff52b5e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:34.470598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:34.492558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-415a2d2c-c15c-4826-be8e-b85a11a71ffc tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.406010 Oct 12 22:38:34.496332 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1022/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:34 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:34.523391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71700bc1-b19a-4021-b8c5-780b9a12e26e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.157521 Oct 12 22:38:34.526207 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 895/1917] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:34 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:34.542981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dbf22ad4-8446-4b2f-bbc9-c8088e4cb8ab tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] Calling method '.version_select at 0x7f44ff4fd670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:34.560368 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbf22ad4-8446-4b2f-bbc9-c8088e4cb8ab tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [83abae92-5615-47ce-a196-1b120e44cf08] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 22:38:35.107706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:35.108664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:35.125086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:35.131212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:35.134684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:35.136315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:35.139113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:35.141107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:35.166450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:35.569125 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbf22ad4-8446-4b2f-bbc9-c8088e4cb8ab tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] [83abae92-5615-47ce-a196-1b120e44cf08] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41442. Oct 12 22:38:35.592416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:35.612052 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32120eef-96af-49f1-a28b-d7022fe0e122 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1275 microversion: 2.1 time: 0.505744 Oct 12 22:38:35.622032 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 896/1918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:35 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1275 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:35.628427 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dbf22ad4-8446-4b2f-bbc9-c8088e4cb8ab tempest-ServersTestFqdnHostnames-1692066079 tempest-ServersTestFqdnHostnames-1692066079-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218618430" status: 202 len: 0 microversion: 2.1 time: 1.103220 Oct 12 22:38:35.634114 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1023/1919] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:38:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218618430 => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:38:35.637105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:35.637921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:35.645276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:35.648845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:35.655713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:35.657323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:35.657907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:35.660034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:35.662120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:35.665606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:35.666473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:35.669432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:35.670015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:35.670900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:35.671483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:35.673555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:36.004696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:36.014730 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e0f00a46-5738-4413-8146-631375f94f58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1308 microversion: 2.1 time: 0.391165 Oct 12 22:38:36.020385 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 897/1920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:35 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:36.038672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7ddedade-a5b0-4f79-9cc6-cbab601f1445 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff5210d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:36.115632 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7ddedade-a5b0-4f79-9cc6-cbab601f1445 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.093825 Oct 12 22:38:36.122713 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 898/1921] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:36 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:36.488994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:36.500366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aeee5c76-ee7a-4007-8ce4-851fdeae94aa tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1391 microversion: 2.1 time: 0.864691 Oct 12 22:38:36.501307 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1024/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:35 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1391 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:36.654725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:36.655405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:36.675688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:36.677123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:36.677824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:36.680775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:36.682439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:36.682916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:37.049562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:37.050604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:37.072970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:37.077341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:37.078873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:37.082310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:37.083125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:37.085194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:37.707236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:37.722738 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ecff5b2-3b12-444f-8a3c-f99ec52b59c4 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1317 microversion: 2.1 time: 1.076658 Oct 12 22:38:37.724575 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 899/1923] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:36 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1317 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:37.734086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0a9c60d-be04-4683-ac10-1fb8a4f67d0a tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff521430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:37.845772 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0a9c60d-be04-4683-ac10-1fb8a4f67d0a tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.118617 Oct 12 22:38:37.847477 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 900/1924] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:37 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:37.854260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:37.860473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:37.877195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:37.880529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:37.883723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:37.884867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:37.885750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:37.886389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:37.915239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:37.926975 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90d09582-629d-47a4-bf5f-ee56f53b9465 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1308 microversion: 2.1 time: 0.883633 Oct 12 22:38:37.934201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1025/1925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:37 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1308 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:38.182300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a764351c-66c7-4cac-a4eb-bd4d45c3e665 req-c4b6ce7c-a8f8-47bd-8f34-319b50f235fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba94be-a6bf-4bed-8644-0971210edb33", "name": "network-vif-plugged", "status": "completed", "tag": "4aae5597-b208-41ad-afab-4f29fe01b52b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:38.204635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a764351c-66c7-4cac-a4eb-bd4d45c3e665 req-c4b6ce7c-a8f8-47bd-8f34-319b50f235fc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:38.205131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a764351c-66c7-4cac-a4eb-bd4d45c3e665 req-c4b6ce7c-a8f8-47bd-8f34-319b50f235fc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:38.208813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a764351c-66c7-4cac-a4eb-bd4d45c3e665 req-c4b6ce7c-a8f8-47bd-8f34-319b50f235fc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:38.241077 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a764351c-66c7-4cac-a4eb-bd4d45c3e665 req-c4b6ce7c-a8f8-47bd-8f34-319b50f235fc service nova] Creating event network-vif-plugged:4aae5597-b208-41ad-afab-4f29fe01b52b for instance 65ba94be-a6bf-4bed-8644-0971210edb33 on n-h1-860864-8 Oct 12 22:38:38.257774 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a764351c-66c7-4cac-a4eb-bd4d45c3e665 req-c4b6ce7c-a8f8-47bd-8f34-319b50f235fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079932 Oct 12 22:38:38.262528 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1026/1926] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:38.747815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:38.748576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:38.759918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:38.760417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:38.760861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:38.761572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:38.775858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:38.779875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:38.924971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:38.939885 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8718f756-daac-4963-afd5-879adbcab3ba tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1381 microversion: 2.1 time: 1.085498 Oct 12 22:38:38.956675 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 901/1927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:37 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1381 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:38.964055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67c56360-2152-4014-91e9-513eeb740fdf tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ffcf3e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:39.043310 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-67c56360-2152-4014-91e9-513eeb740fdf tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.085220 Oct 12 22:38:39.044287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 902/1928] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:38 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:39.054311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:39.055853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:39.075875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:39.076761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:39.077424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:39.078770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:39.080949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:39.081813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:39.347163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:39.384830 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47183ec2-f7a9-4817-a70e-ddc31bf70af2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1317 microversion: 2.1 time: 0.641663 Oct 12 22:38:39.388641 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1027/1929] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:38 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:39.393518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b4a67d8-139e-42f6-a4c7-c341f49294b2 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '.version_select at 0x7f4507a3aaf0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:39.404802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4a67d8-139e-42f6-a4c7-c341f49294b2 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:39.414962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4a67d8-139e-42f6-a4c7-c341f49294b2 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:39.418901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4a67d8-139e-42f6-a4c7-c341f49294b2 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:39.436415 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b4a67d8-139e-42f6-a4c7-c341f49294b2 tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.046329 Oct 12 22:38:39.437517 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1028/1930] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:38:39 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:39.459254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:39.460625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:39.472332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:39.473262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:39.476150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:39.478120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:39.478995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:39.481347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:39.601339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:39.615939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54822d6a-6c17-48e6-a571-c43ab0bf44ca tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1308 microversion: 2.1 time: 0.567970 Oct 12 22:38:39.616532 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 903/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:39 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1308 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:39.745603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:39.972594 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-413073b1-2710-4b3f-9895-451d02f5438c tempest-LiveMigrationTest-239559052 tempest-LiveMigrationTest-239559052-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1532 microversion: 2.1 time: 0.520868 Oct 12 22:38:39.979058 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1029/1932] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:39 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1532 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:39.999590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2b52f434-4de3-4fc6-a20b-baf44029d87d req-c7d29079-2e7a-43cb-bb91-739328a2f8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958ca6f5-ee99-4ed6-a471-189f8aa14962", "tag": "9e4efcf4-72ad-4e12-929b-73d1628faf47"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:40.012129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:40.022451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:40.022957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:40.029512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2b52f434-4de3-4fc6-a20b-baf44029d87d req-c7d29079-2e7a-43cb-bb91-739328a2f8da service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:40.033478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2b52f434-4de3-4fc6-a20b-baf44029d87d req-c7d29079-2e7a-43cb-bb91-739328a2f8da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:40.034145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2b52f434-4de3-4fc6-a20b-baf44029d87d req-c7d29079-2e7a-43cb-bb91-739328a2f8da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:40.043734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:40.044461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:40.045035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:40.046843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:40.047431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:40.051342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:40.081193 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2b52f434-4de3-4fc6-a20b-baf44029d87d req-c7d29079-2e7a-43cb-bb91-739328a2f8da service nova] Creating event network-changed:9e4efcf4-72ad-4e12-929b-73d1628faf47 for instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 on n-h2-860864-8 Oct 12 22:38:40.104122 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2b52f434-4de3-4fc6-a20b-baf44029d87d req-c7d29079-2e7a-43cb-bb91-739328a2f8da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109736 Oct 12 22:38:40.107809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 904/1933] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:40.141621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe07bc62-c761-4574-bf1d-bd843ab8cd70 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff5511f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:40.191537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:38:40.296334 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe07bc62-c761-4574-bf1d-bd843ab8cd70 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.182357 Oct 12 22:38:40.299486 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 905/1934] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:40 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:40.412852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:40.417331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:40.428762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:40.429250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:40.429717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:40.437572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:40.438099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:40.438537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:40.543968 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85ff6501-f11d-4e78-aaf1-607bb285605c tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 204 len: 0 microversion: 2.1 time: 0.532317 Oct 12 22:38:40.548472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1030/1935] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:38:40 2022] DELETE /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:38:40.570186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:40.572633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:40.590455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:40.591418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:40.592195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:40.592985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:40.593462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:40.594110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:40.983776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:41.014836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:41.014993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:41.026635 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b7ee62e-75ce-4c0c-b760-f6285fa5cc3f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1317 microversion: 2.1 time: 0.618932 Oct 12 22:38:41.028316 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-339020c1-7774-454a-9f5c-c90f830fe4f4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1387 microversion: 2.1 time: 0.475049 Oct 12 22:38:41.029109 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1031/1936] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:40 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1387 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:41.041096 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 906/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:40 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:41.045376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:41.045376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:41.066864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:41.067944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:41.068389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:41.079600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:41.080129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:41.080798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:41.313533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93b8e30e-0cff-4085-be43-997028ebc8f6 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff57c160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:41.413700 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93b8e30e-0cff-4085-be43-997028ebc8f6 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.103871 Oct 12 22:38:41.422892 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 907/1938] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:41 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:41.465804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:41.486384 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8d0f8695-f0ab-4f84-94f8-34bccde164e3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1487 microversion: 2.1 time: 0.448348 Oct 12 22:38:41.487318 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1032/1939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:41 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1487 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:41.515704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:41.516315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:41.528248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:41.528744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:41.529186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:41.529894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:41.540592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:41.541257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:41.587772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lazy-loading 'flavor' on Instance uuid 65ba94be-a6bf-4bed-8644-0971210edb33 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:38:41.820864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4cf1f3b8-6e46-4767-bc2e-32dc4d89a2f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33/action" status: 202 len: 0 microversion: 2.1 time: 0.310410 Oct 12 22:38:41.822108 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 908/1940] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:41 2022] POST /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:38:41.830120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:41.831359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:41.841044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:41.852721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:41.853439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:41.854370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:41.855005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:41.855604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:42.054002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:42.056367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:42.071082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:42.075727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:42.076261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:42.077016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:42.084510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:42.085148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:42.306135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:42.314697 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-814b37cc-9650-4da4-989c-82f03f742a9f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1495 microversion: 2.1 time: 0.488324 Oct 12 22:38:42.328468 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1033/1941] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:41 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1495 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:42.338262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:42.343325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:42.357233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:42.357736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:42.358185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:42.358901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:42.359359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:42.359783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:42.843005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:42.844309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:42.859263 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbd411c1-c9b1-43ce-ba8c-f728e761f77a tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1387 microversion: 2.1 time: 0.804380 Oct 12 22:38:42.859602 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e014a9e-f23e-4b47-8645-5ef120d0915d tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1317 microversion: 2.1 time: 0.529227 Oct 12 22:38:42.862739 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1034/1942] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:42 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:42.878593 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 909/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:42 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1387 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:42.879426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39b277b6-d760-46bb-87c6-ff60cf6e46d1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f4507a92280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:42.977819 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39b277b6-d760-46bb-87c6-ff60cf6e46d1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.113594 Oct 12 22:38:42.979448 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1035/1944] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:42 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:43.350999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:43.351588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:43.362957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:43.364608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:43.371189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:43.372160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:43.372798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:43.373385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:43.886249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:43.886886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:43.902038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:43.902536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:43.902976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:43.903691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:43.904171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:43.914131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:43.959624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:44.193758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:44.207527 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5111556e-d8e4-4340-bb61-97da1124e9af tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1317 microversion: 2.1 time: 0.328510 Oct 12 22:38:44.213970 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1036/1945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:43 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:44.224394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:44.225018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:44.241554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:44.242045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:44.242482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:44.245760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:44.248203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:44.248838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:44.385504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:44.396919 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d9569fc-ddd2-4b04-8bf4-aadba083b1b5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1345 microversion: 2.1 time: 0.179388 Oct 12 22:38:44.412757 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1037/1946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:44 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:44.425069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef481a57-950e-46ec-92f3-407c13559420 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f4507aee9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:44.430368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:44.439779 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-031eb41a-12cb-4f40-a89f-a6b9721a4d09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 200 len: 1478 microversion: 2.1 time: 1.093011 Oct 12 22:38:44.443611 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 910/1947] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:43 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 1478 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:44.469534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-970430072"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:44.472478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:44.485854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:44.486545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:44.488505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:44.490036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:44.492272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:44.494287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:44.549212 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef481a57-950e-46ec-92f3-407c13559420 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.135110 Oct 12 22:38:44.550272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1038/1948] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:44 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:44.984574 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35850464-42a8-442b-9bee-d7235da39a94 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33/action" status: 202 len: 0 microversion: 2.1 time: 0.519223 Oct 12 22:38:44.986760 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 911/1949] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:44 2022] POST /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 12 22:38:44.998721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-33d133ae-7fe7-4268-9af1-f51f31ec4d87 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a92280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:45.121511 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-33d133ae-7fe7-4268-9af1-f51f31ec4d87 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.127712 Oct 12 22:38:45.128055 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1039/1950] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:44 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:45.240053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:45.241278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:45.255352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:45.268796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-efc4c45c-b8b3-4951-90df-c75b7f838823 req-d99b209e-718d-48c3-8e67-d4bbb5608827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8de8c4c-95a9-4b86-b434-66592b5ecf25", "name": "network-vif-deleted", "tag": "99f4970d-9b83-4ef7-8efe-8853302117b1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:45.289869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:45.292605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:45.306446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:45.307090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:45.310018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-efc4c45c-b8b3-4951-90df-c75b7f838823 req-d99b209e-718d-48c3-8e67-d4bbb5608827 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:45.310762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:45.321514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-efc4c45c-b8b3-4951-90df-c75b7f838823 req-d99b209e-718d-48c3-8e67-d4bbb5608827 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:45.322206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-efc4c45c-b8b3-4951-90df-c75b7f838823 req-d99b209e-718d-48c3-8e67-d4bbb5608827 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:45.388209 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-efc4c45c-b8b3-4951-90df-c75b7f838823 req-d99b209e-718d-48c3-8e67-d4bbb5608827 service nova] Creating event network-vif-deleted:99f4970d-9b83-4ef7-8efe-8853302117b1 for instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 on n-h2-860864-8 Oct 12 22:38:45.422639 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-efc4c45c-b8b3-4951-90df-c75b7f838823 req-d99b209e-718d-48c3-8e67-d4bbb5608827 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157812 Oct 12 22:38:45.439041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1040/1951] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:38:45.447186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:45.481707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:45.532427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:45.533729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:45.536804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:45.550209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:45.550848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:45.551956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:46.085528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:46.098378 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b385628-d753-49ad-b2ca-49fa8dee8326 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1184 microversion: 2.1 time: 0.656759 Oct 12 22:38:46.121936 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1041/1952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:45 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1184 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:46.138226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bff2b933-cba5-4cb4-81d9-63128a31abc8 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff434550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:46.268542 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bff2b933-cba5-4cb4-81d9-63128a31abc8 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.144897 Oct 12 22:38:46.269068 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1042/1953] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:46 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:46.300034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09fa56f6-ffb0-4e1b-a8a8-b6136e3d692f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507c5c5e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:46.467921 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09fa56f6-ffb0-4e1b-a8a8-b6136e3d692f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.183490 Oct 12 22:38:46.469939 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1043/1954] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:46 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:47.153591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:47.155941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:47.163547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:47.181488 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0830fbcc-5f6c-47dc-ae6c-9b76e37e7b55 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1317 microversion: 2.1 time: 1.945785 Oct 12 22:38:47.190294 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 912/1955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:45 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1317 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:47.196832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:47.198297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:47.200168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:47.204702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:47.205420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:47.206126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:47.284911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-469dbf40-109b-4cc9-aff6-3f62e881cc22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff523e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:47.390468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-469dbf40-109b-4cc9-aff6-3f62e881cc22 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.109238 Oct 12 22:38:47.391346 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 913/1956] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:47 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:47.489979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c4fd10d-868e-4095-9e57-f30a80aa2670 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff5238b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:47.586977 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c4fd10d-868e-4095-9e57-f30a80aa2670 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.099844 Oct 12 22:38:47.607396 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 914/1957] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:47 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:38:47.661817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:47.671411 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a3545ff-a859-4ab4-a831-f31210bd87a8 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1184 microversion: 2.1 time: 0.539966 Oct 12 22:38:47.697318 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1044/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:47 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1184 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:48.221485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:48.223668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:48.241678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:48.243657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:48.247165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:48.250077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:48.251257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:48.254698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:48.406618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eda05cd5-2e39-461f-992d-b6140617576d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff470f70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:49.001792 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eda05cd5-2e39-461f-992d-b6140617576d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1422 microversion: 2.1 time: 0.598790 Oct 12 22:38:49.002560 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1045/1959] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:48 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1422 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:49.018064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17dad4ab-cd15-4ee5-b5b1-6bcceab92e6b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a38a60>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:50.484079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:50.494390 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80363a83-2151-4978-8e3b-48d20af07d5c tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1317 microversion: 2.1 time: 2.279910 Oct 12 22:38:50.496499 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 915/1960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:48 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1317 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:50.512519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:50.513159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:50.530825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:50.531314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:50.531742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:50.532617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:50.533210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:50.533766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:50.812007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:50.828091 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a98713d2-6f1f-4c40-bbbc-3c6139ae4ea2 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1184 microversion: 2.1 time: 0.329419 Oct 12 22:38:50.836234 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 916/1961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:50 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1184 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:50.840982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8fb509d3-4575-4ebe-a4ba-30e26880f228 req-fa55a8ae-ee04-4c67-9d14-89c30220f5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958ca6f5-ee99-4ed6-a471-189f8aa14962", "name": "network-vif-plugged", "status": "completed", "tag": "9e4efcf4-72ad-4e12-929b-73d1628faf47"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:50.881781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8fb509d3-4575-4ebe-a4ba-30e26880f228 req-fa55a8ae-ee04-4c67-9d14-89c30220f5cc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:50.882257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8fb509d3-4575-4ebe-a4ba-30e26880f228 req-fa55a8ae-ee04-4c67-9d14-89c30220f5cc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:50.882683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8fb509d3-4575-4ebe-a4ba-30e26880f228 req-fa55a8ae-ee04-4c67-9d14-89c30220f5cc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:50.906250 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8fb509d3-4575-4ebe-a4ba-30e26880f228 req-fa55a8ae-ee04-4c67-9d14-89c30220f5cc service nova] Creating event network-vif-plugged:9e4efcf4-72ad-4e12-929b-73d1628faf47 for instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 on n-h2-860864-8 Oct 12 22:38:50.926575 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8fb509d3-4575-4ebe-a4ba-30e26880f228 req-fa55a8ae-ee04-4c67-9d14-89c30220f5cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088511 Oct 12 22:38:50.932506 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 917/1962] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:50.948114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f18c853-1db7-46cb-bba3-4f2fcae9339e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff5234c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:55.764201 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17dad4ab-cd15-4ee5-b5b1-6bcceab92e6b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 6.760568 Oct 12 22:38:55.772472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1046/1963] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:49 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 6762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:55.776249 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f18c853-1db7-46cb-bba3-4f2fcae9339e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1431 microversion: 2.1 time: 4.841455 Oct 12 22:38:55.780061 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 918/1964] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:50 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1431 bytes in 4846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:55.801305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:55.810351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:55.812080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:55.819001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:55.833249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.833738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.834174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.839226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.840328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.848979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.850042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.850955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:55.851633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.852677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.853159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:55.856578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:55.937991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:38:56.105651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:56.115476 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7db38030-a69b-4bbf-9d19-91b2c472ef20 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1184 microversion: 2.1 time: 0.334340 Oct 12 22:38:56.116078 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 919/1965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:55 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1184 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:56.148665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-660b8bc6-57ed-49c2-b480-f1920951fca4 req-6390624e-69f0-4836-bef0-9ddb07632e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba94be-a6bf-4bed-8644-0971210edb33", "name": "network-vif-plugged", "status": "completed", "tag": "4aae5597-b208-41ad-afab-4f29fe01b52b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:56.176959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-660b8bc6-57ed-49c2-b480-f1920951fca4 req-6390624e-69f0-4836-bef0-9ddb07632e55 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.177684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-660b8bc6-57ed-49c2-b480-f1920951fca4 req-6390624e-69f0-4836-bef0-9ddb07632e55 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.178273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-660b8bc6-57ed-49c2-b480-f1920951fca4 req-6390624e-69f0-4836-bef0-9ddb07632e55 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.228445 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-660b8bc6-57ed-49c2-b480-f1920951fca4 req-6390624e-69f0-4836-bef0-9ddb07632e55 service nova] Creating event network-vif-plugged:4aae5597-b208-41ad-afab-4f29fe01b52b for instance 65ba94be-a6bf-4bed-8644-0971210edb33 on n-h1-860864-8 Oct 12 22:38:56.244868 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-660b8bc6-57ed-49c2-b480-f1920951fca4 req-6390624e-69f0-4836-bef0-9ddb07632e55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119463 Oct 12 22:38:56.246969 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 920/1966] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:56.257774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-838f0cc4-87ac-45aa-9127-85b933f7e069 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff5a5280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:56.388687 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-838f0cc4-87ac-45aa-9127-85b933f7e069 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 200 len: 1431 microversion: 2.1 time: 0.137506 Oct 12 22:38:56.390332 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 921/1967] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:56 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 1431 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:56.398710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:56.407636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42c0858d-ca15-4f56-9544-fc75e3d5a5ea tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1507 microversion: 2.1 time: 0.641241 Oct 12 22:38:56.408250 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1047/1968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:55 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1507 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:56.411950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:56.412687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:56.428677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.431681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:56.432272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:56.433852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.434758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.438953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.440092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.441970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.449085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.451576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.454808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.455756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.461799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.462249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.554598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:56.557788 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69262ee2-8666-4d77-859e-7ca18ab22c21 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962/os-instance-actions/req-1b276d3a-a045-4e62-b086-fa9e5e841a0e" status: 200 len: 313 microversion: 2.1 time: 0.130389 Oct 12 22:38:56.563753 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1048/1969] 10.222.0.20 () {58 vars in 1419 bytes} [Wed Oct 12 22:38:56 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962/os-instance-actions/req-1b276d3a-a045-4e62-b086-fa9e5e841a0e => generated 313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:56.577550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:56.580265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:56.592988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.593683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.594269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.597833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:56.598483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:56.600440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:56.782574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c7b110ea-f125-4be2-82bc-a6163db9e74e tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "POST /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962/action" status: 202 len: 0 microversion: 2.1 time: 0.204294 Oct 12 22:38:56.787493 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1049/1970] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:56 2022] POST /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:38:56.802409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-924cc0ca-18cd-47c4-bce7-694bc18b8d1d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff564b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:57.027094 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-924cc0ca-18cd-47c4-bce7-694bc18b8d1d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.237905 Oct 12 22:38:57.035516 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1050/1971] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:56 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:57.053253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:57.054131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:57.089777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:57.099601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:57.102828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:57.103866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:57.107992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:57.110971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:57.606144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:57.663421 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a26d608-27da-4310-976a-aa6b931f7764 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1466 microversion: 2.1 time: 1.246673 Oct 12 22:38:57.666943 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 922/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:56 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1466 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:57.682321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:57.693364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:57.702442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:57.703162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:57.703747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:57.704643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:57.705230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:57.705787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:57.786378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:57.801011 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2df4a574-380a-4636-b927-f94ad5a47fcd tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1509 microversion: 2.1 time: 0.763983 Oct 12 22:38:57.802194 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1051/1973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:57 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1509 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:57.808829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03789ed0-1f49-4de7-afdd-82726d15273c tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ffbaec10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:57.855678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:57.856530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:57.860661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:57.861316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lazy-loading 'fault' on Instance uuid e8de8c4c-95a9-4b86-b434-66592b5ecf25 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:38:57.944817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03789ed0-1f49-4de7-afdd-82726d15273c tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/d8a76847-f2a3-4e2c-96d3-13bb62ec0d50" status: 200 len: 784 microversion: 2.1 time: 0.123603 Oct 12 22:38:57.946866 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1052/1974] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:57 2022] GET /compute/v2.1/images/d8a76847-f2a3-4e2c-96d3-13bb62ec0d50 => generated 784 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:57.967200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb829f90-90e1-4a1e-a49c-46b4505703ff tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:57.982790 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb829f90-90e1-4a1e-a49c-46b4505703ff tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025122 Oct 12 22:38:57.993573 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1053/1975] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:38:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:38:57.998718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb7ca01f-1798-45da-8000-dd753123bfd2 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ffbaef70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:58.168992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:38:58.178203 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af7a4ec7-a997-4380-8e1d-0d7bcec8f0dd tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 200 len: 1143 microversion: 2.1 time: 0.510146 Oct 12 22:38:58.178986 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 923/1976] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:57 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 1143 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:58.191348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eaa9133b-dc24-47bc-a736-e48246339ff6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4e8e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:59.181855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bb7ca01f-1798-45da-8000-dd753123bfd2 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "DELETE /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 204 len: 0 microversion: 2.1 time: 1.186246 Oct 12 22:38:59.186781 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1054/1977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:57 2022] DELETE /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 0 bytes in 1189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:38:59.195232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:59.196177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:59.212321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.213357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.213982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:59.214879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.216999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.225623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:59.251690 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eaa9133b-dc24-47bc-a736-e48246339ff6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 1.070631 Oct 12 22:38:59.260954 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 924/1978] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:58 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:38:59.263938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9dae7065-a883-4283-a74a-997a176226b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff57cdc0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:59.317879 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9dae7065-a883-4283-a74a-997a176226b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] HTTP exception thrown: Image not found. Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9dae7065-a883-4283-a74a-997a176226b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Request method failure captured: Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 HTTP/1.1 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0HBydVqfkKRNppg60TnKZ0s-9fIbieX_Biv1QDiLwQpGHsnr45H04XCAGXJ_VgYaTFNx2tHHQWcbZMfwGDBY8dYWvjFJpYtvv-75D2Wko1aWqttpy4WvQ3siRZtA_ZXHXXGCs5pTxkw3Q8_u8Tmr5mgQSjYGDfYvsp_d591e9fqpeU Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 4fc4f5adce674ecfa266bc4499a771fe Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fc4f5adce674ecfa266bc4499a771fe"}]}] Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 4fc4f5adce674ecfa266bc4499a771fe Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerTestJSON-318901103-project Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: c822c44d83fc477387b40ee6dac04468 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerTestJSON-318901103-project Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '754c4702-d320-4cb1-904b-e35654133e25'} Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 754c4702-d320-4cb1-904b-e35654133e25 Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:38:59.320129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 754c4702-d320-4cb1-904b-e35654133e25 could not be found. Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.324415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9dae7065-a883-4283-a74a-997a176226b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:59.327163 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9dae7065-a883-4283-a74a-997a176226b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 404 len: 62 microversion: 2.1 time: 0.069980 Oct 12 22:38:59.327163 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 925/1979] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:38:59 2022] GET /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:38:59.354870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:38:59.365295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: e8de8c4c-95a9-4b86-b434-66592b5ecf25] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:59.372096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.372668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.373166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:59.376668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.377276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.377726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:59.410075 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] HTTP exception thrown: Instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 could not be found. Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Request method failure captured: Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 HTTP/1.1 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AvgwNj6mn3lZBYlGHEKK4IY_pFS-nD6slAwxHGHbdbMt7yTMZrT-gMOc0WGk4WPHZD99QFamxrl3g4773JU3JHeI8HOrHzM7EhkhATPNn-hGdIbIqKGfzovEFmvgFDgLlZOEnH0ZxZ-BTyWGKvIDyvUmxa_Fo9rKvfVkclzU21utw Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}] Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveMigrationTest-181527662 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveMigrationTest-181527662-project Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: dd8fdd646f8546a0a3aae53d1b55a8b1 Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveMigrationTest-181527662-project Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 could not be found. Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'e8de8c4c-95a9-4b86-b434-66592b5ecf25'} Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 could not be found. Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 could not be found. Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:38:59.411270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 could not be found. Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:38:59.415354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Returning 404 to user: Instance e8de8c4c-95a9-4b86-b434-66592b5ecf25 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:38:59.418158 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ef09e31-d2cf-4a73-a8ae-0a87e57a7251 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25" status: 404 len: 111 microversion: 2.1 time: 0.072110 Oct 12 22:38:59.418158 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 926/1980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:59 2022] GET /compute/v2.1/servers/e8de8c4c-95a9-4b86-b434-66592b5ecf25 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:38:59.433507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-494866008"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:38:59.444837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:38:59.464146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.465008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.468368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:38:59.469512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:38:59.470204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:38:59.473622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:00.201599 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f0397da-8114-45dd-9895-41016a3c8fb9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "POST /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee/action" status: 202 len: 0 microversion: 2.1 time: 0.770089 Oct 12 22:39:00.208934 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 927/1981] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:38:59 2022] POST /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:39:00.234043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e29f8a25-4a9f-4142-8dbc-07f44e0f2a2f req-1e333c9c-5fbe-4fc5-9eef-139dca65764e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee", "name": "network-vif-unplugged", "status": "completed", "tag": "e00b7c80-471e-4143-b726-931f38e44dfc"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:00.266992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e29f8a25-4a9f-4142-8dbc-07f44e0f2a2f req-1e333c9c-5fbe-4fc5-9eef-139dca65764e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:00.272348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e29f8a25-4a9f-4142-8dbc-07f44e0f2a2f req-1e333c9c-5fbe-4fc5-9eef-139dca65764e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:00.274533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e29f8a25-4a9f-4142-8dbc-07f44e0f2a2f req-1e333c9c-5fbe-4fc5-9eef-139dca65764e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:00.309196 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e29f8a25-4a9f-4142-8dbc-07f44e0f2a2f req-1e333c9c-5fbe-4fc5-9eef-139dca65764e service nova] Creating event network-vif-unplugged:e00b7c80-471e-4143-b726-931f38e44dfc for instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee on n-h1-860864-8 Oct 12 22:39:00.336063 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e29f8a25-4a9f-4142-8dbc-07f44e0f2a2f req-1e333c9c-5fbe-4fc5-9eef-139dca65764e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119758 Oct 12 22:39:00.337068 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 928/1982] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:00.348015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6852acc1-49b6-41e2-86e6-1c09d8136984 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff5a5e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:00.392917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:00.420258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a3aa813-62d9-4dae-ab54-9610a8c34f39 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1509 microversion: 2.1 time: 1.230107 Oct 12 22:39:00.422623 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1055/1983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:38:59 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1509 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:00.436650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-253efb26-9435-45a5-92b7-55b2b0a89743 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a3aaf0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:00.583819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6852acc1-49b6-41e2-86e6-1c09d8136984 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.245288 Oct 12 22:39:00.584597 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 929/1984] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:00 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:00.630245 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-253efb26-9435-45a5-92b7-55b2b0a89743 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.206445 Oct 12 22:39:00.632644 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1056/1985] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:00 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:01.447842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:01.448777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:01.472667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:01.493949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:01.495322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:01.496576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:01.504294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:01.506235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:01.602402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-43698e87-fdf0-4c20-a1b1-d8209228f6d8 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff434550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:01.699547 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-43698e87-fdf0-4c20-a1b1-d8209228f6d8 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.103915 Oct 12 22:39:01.700400 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1057/1986] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:01 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:01.716736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2727094-30d8-4019-a018-087de59e43fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507a925e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:01.869779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2727094-30d8-4019-a018-087de59e43fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.157724 Oct 12 22:39:01.870932 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1058/1987] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:01 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:02.686291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:02.712752 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8689c4b8-63d3-49d0-9074-a0891aa51f12 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1507 microversion: 2.1 time: 1.270116 Oct 12 22:39:02.713355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 930/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:01 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1507 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:02.719362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa83d4f2-dc0d-4220-9e8c-3119853febaa tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff434700>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:02.735710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '.version_select at 0x7f44ff5210d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:02.736700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:02.752140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:02.752631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:02.753113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:02.753816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:02.754275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:02.754690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:02.836665 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa83d4f2-dc0d-4220-9e8c-3119853febaa tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.123572 Oct 12 22:39:02.837696 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1059/1989] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:02 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:02.856673 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78cb1e1a-c065-4e34-966a-1845fdb6e3e2 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.124972 Oct 12 22:39:02.859285 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 931/1990] 10.222.0.20 () {58 vars in 1296 bytes} [Wed Oct 12 22:39:02 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962/os-instance-actions => generated 611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:02.872427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:02.873344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:02.887204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b77e78f1-bd60-4808-b3a5-fe181235d2fd tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff54ee50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:02.901302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:02.905561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:02.906417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:02.907533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:02.908221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:02.910055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:02.973582 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b77e78f1-bd60-4808-b3a5-fe181235d2fd tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.090309 Oct 12 22:39:02.975473 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 932/1991] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:02 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:03.010506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:03.169033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e93c33d5-7385-4730-b7a3-0869490b53c6 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "DELETE /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 204 len: 0 microversion: 2.1 time: 0.300853 Oct 12 22:39:03.170079 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1060/1992] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:39:02 2022] DELETE /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:39:03.182562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:03.183392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:03.199825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:03.200867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:03.201519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:03.202423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:03.203128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:03.203724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:03.853976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f045519-4e10-4f59-b993-8959776ae31f tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f4507c374c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:03.937975 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f045519-4e10-4f59-b993-8959776ae31f tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.088730 Oct 12 22:39:03.938560 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1061/1993] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:03 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:03.989917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3772867d-3eee-42b9-842a-9a5c838433da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff470280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:04.051175 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3772867d-3eee-42b9-842a-9a5c838433da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1437 microversion: 2.1 time: 0.065193 Oct 12 22:39:04.051757 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1062/1994] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:03 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:04.224150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118b009d22e243f68aad905b06faf3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb938e6b23274630851659d8ee7333dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:04.245351 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d61ef77-105c-41b8-8d56-fb79cb401257 tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 200 len: 1513 microversion: 2.1 time: 1.062741 Oct 12 22:39:04.249857 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 933/1995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:03 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 1513 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:04.957520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc7ec0b2-6b54-43b9-82f7-035f0ed268f7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f4507c5c9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:05.072764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-adcc79e3-82c3-43f9-952e-9eb4677fda58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4e8790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:13.084978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:13.161663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:13.195523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=41 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:14.231016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:16.272439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc7ec0b2-6b54-43b9-82f7-035f0ed268f7 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 11.322485 Oct 12 22:39:16.273386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1063/1996] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:04 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 11324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:16.291523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:16.292309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] [instance: 958ca6f5-ee99-4ed6-a471-189f8aa14962] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:16.307242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.316965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.318184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.319412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.319901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.320336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.352248 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] HTTP exception thrown: Instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 could not be found. Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Request method failure captured: Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 HTTP/1.1 Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0HiasHV5GBAn4jQoUUvaHqj_J4NyHFA7GWZ4nfXezkS8Xs0_dWjPjbFoZ_yCKJJle6VwvpUUc8vFWqmYS-QmFau-vayJuRfQHqIFZBQ6qzxzoJ2M1Kue8Sm1bmD6FQmTRMAk0o_CVe-Mk4amPgvWNc1C1C_khC5wkAGvj07FBc5QBw Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: fb938e6b23274630851659d8ee7333dd Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-InstanceActionsTestJSON-259795638 Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb938e6b23274630851659d8ee7333dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb938e6b23274630851659d8ee7333dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb938e6b23274630851659d8ee7333dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb938e6b23274630851659d8ee7333dd"}]}] Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-InstanceActionsTestJSON-259795638 Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: fb938e6b23274630851659d8ee7333dd Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-InstanceActionsTestJSON-259795638 Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-InstanceActionsTestJSON-259795638-project Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 118b009d22e243f68aad905b06faf3ac Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-InstanceActionsTestJSON-259795638-project Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 could not be found. Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '958ca6f5-ee99-4ed6-a471-189f8aa14962'} Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 could not be found. Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 could not be found. Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:16.357180 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 could not be found. Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] Returning 404 to user: Instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:16.361586 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3d58386-57e0-4a04-bc92-3fa4aeedba0f tempest-InstanceActionsTestJSON-259795638 tempest-InstanceActionsTestJSON-259795638-project] 10.222.0.20 "GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962" status: 404 len: 111 microversion: 2.1 time: 0.084190 Oct 12 22:39:16.364811 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1064/1997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:16 2022] GET /compute/v2.1/servers/958ca6f5-ee99-4ed6-a471-189f8aa14962 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:39:16.373248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c1bbcd85-30cf-42ef-b01f-dd378434fb13 req-734f611b-fbfc-41ed-8b1b-d3e963e131e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee", "name": "network-vif-plugged", "status": "completed", "tag": "e00b7c80-471e-4143-b726-931f38e44dfc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:16.399107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c1bbcd85-30cf-42ef-b01f-dd378434fb13 req-734f611b-fbfc-41ed-8b1b-d3e963e131e6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.399587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c1bbcd85-30cf-42ef-b01f-dd378434fb13 req-734f611b-fbfc-41ed-8b1b-d3e963e131e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.402283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c1bbcd85-30cf-42ef-b01f-dd378434fb13 req-734f611b-fbfc-41ed-8b1b-d3e963e131e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.423500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c1bbcd85-30cf-42ef-b01f-dd378434fb13 req-734f611b-fbfc-41ed-8b1b-d3e963e131e6 service nova] Creating event network-vif-plugged:e00b7c80-471e-4143-b726-931f38e44dfc for instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee on n-h1-860864-8 Oct 12 22:39:16.437590 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c1bbcd85-30cf-42ef-b01f-dd378434fb13 req-734f611b-fbfc-41ed-8b1b-d3e963e131e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071324 Oct 12 22:39:16.440485 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1065/1998] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:16.449490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:16.450434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:16.468601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.471675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.472368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.473251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.474337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.474989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.541585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:16.726980 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32c747ef-385c-4229-bc3e-9b3a5fe9e0d5 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 204 len: 0 microversion: 2.1 time: 0.284837 Oct 12 22:39:16.731654 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1066/1999] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:39:16 2022] DELETE /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:16.737366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9fd17cd2-910f-4b48-9553-d83f4c3c334a req-28597b09-252d-41fa-891e-69c40ff34a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958ca6f5-ee99-4ed6-a471-189f8aa14962", "name": "network-vif-deleted", "tag": "9e4efcf4-72ad-4e12-929b-73d1628faf47"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:16.749377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9fd17cd2-910f-4b48-9553-d83f4c3c334a req-28597b09-252d-41fa-891e-69c40ff34a22 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.750669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9fd17cd2-910f-4b48-9553-d83f4c3c334a req-28597b09-252d-41fa-891e-69c40ff34a22 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.751308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9fd17cd2-910f-4b48-9553-d83f4c3c334a req-28597b09-252d-41fa-891e-69c40ff34a22 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.813671 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9fd17cd2-910f-4b48-9553-d83f4c3c334a req-28597b09-252d-41fa-891e-69c40ff34a22 service nova] Creating event network-vif-deleted:9e4efcf4-72ad-4e12-929b-73d1628faf47 for instance 958ca6f5-ee99-4ed6-a471-189f8aa14962 on n-h2-860864-8 Oct 12 22:39:16.851218 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9fd17cd2-910f-4b48-9553-d83f4c3c334a req-28597b09-252d-41fa-891e-69c40ff34a22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117371 Oct 12 22:39:16.851802 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1067/2000] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:16.920082 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-adcc79e3-82c3-43f9-952e-9eb4677fda58 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1446 microversion: 2.1 time: 11.852186 Oct 12 22:39:16.921549 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 934/2001] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:05 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1446 bytes in 11854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:16.933465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:16.943578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:16.968301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.972174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.972678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:16.973631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:16.974107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:16.974536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:17.544294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d8de382-9d4e-4f24-9963-88673478fe78 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Action: 'create', calling method: .version_select at 0x7f44ff57a4c0>, body: {"keypair": {"name": "tempest-keypair-1856239845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmdwQsUv9ya0Pm/0ZPfu6+ttnlUDxvcCXEzTpQHQ8DHvdb9aY2sTQPGEavK4LWjYJ+FccK2jH92P9PmeQ2ShlorvedY8m3LuDRIOSkxLoprmq41NG54Sf9I1qQu9Dq6iQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:17.602111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d8de382-9d4e-4f24-9963-88673478fe78 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Getting quotas for project bff192152eb64e288b26ca5d385f0ac0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:17.628660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d8de382-9d4e-4f24-9963-88673478fe78 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Getting quotas for user e1e3744c94e14a60915104704e1c70ff and project bff192152eb64e288b26ca5d385f0ac0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:17.694029 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d8de382-9d4e-4f24-9963-88673478fe78 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.826385 Oct 12 22:39:17.695958 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1068/2002] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:17.715122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aaf11f8a-8d63-4b6c-9e27-2340f60559a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff564040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:17.968638 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aaf11f8a-8d63-4b6c-9e27-2340f60559a1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 200 len: 1446 microversion: 2.1 time: 0.270083 Oct 12 22:39:17.971933 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1069/2003] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:17 2022] GET /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 1446 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:18.008623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c9fec72-502d-480e-b4e4-ae87a508010d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff57a0d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:18.239263 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c9fec72-502d-480e-b4e4-ae87a508010d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.255055 Oct 12 22:39:18.247433 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1070/2004] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:17 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:18.421161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-306285226", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": "none"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:18.627444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:18.643088 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7973d708-cb1e-462a-8299-e9041930d0e4 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1665 microversion: 2.1 time: 1.716792 Oct 12 22:39:18.646052 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 935/2005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:16 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1665 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:18.663006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d751add5-d733-471a-aa9e-a5a143cfb5c0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff57c5e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:18.769966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:39:18.770964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:39:18.771567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:39:18.773247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:39:18.776422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:39:18.794126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:18.797019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:18.797625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:18.798541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:18.800490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:18.802924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:18.843613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Getting quotas for project 43f1521906ca40218765a847b473f003. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:18.854872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Getting quotas for user 4fe78f8ea83749af8b040f6538a30710 and project 43f1521906ca40218765a847b473f003. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:18.886461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:39:18.888913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:39:18.985181 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fbed3731-a0db-4181-b041-9d2f9b2b2a1e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.741161 Oct 12 22:39:18.986590 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1071/2006] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:39:19.008169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29408d53-b2fa-4182-8c5a-164184f490c3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:19.029763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-29408d53-b2fa-4182-8c5a-164184f490c3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:19.177648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-29408d53-b2fa-4182-8c5a-164184f490c3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:19.213636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-29408d53-b2fa-4182-8c5a-164184f490c3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:19.219042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-29408d53-b2fa-4182-8c5a-164184f490c3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:19.232858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-29408d53-b2fa-4182-8c5a-164184f490c3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1452 microversion: 2.91 time: 0.232164 Oct 12 22:39:19.237802 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1072/2007] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:18 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:19.267910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71a4cc1f-64cb-4409-952b-fba8b8b3ecd8 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ffc5c940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:20.368874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d751add5-d733-471a-aa9e-a5a143cfb5c0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 204 len: 0 microversion: 2.1 time: 1.718884 Oct 12 22:39:20.369512 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 936/2008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:18 2022] DELETE /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 0 bytes in 1723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:20.385102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:20.388860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:20.403473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.413546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.414283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:20.415786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.417615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.419124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:20.575714 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71a4cc1f-64cb-4409-952b-fba8b8b3ecd8 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 1.324390 Oct 12 22:39:20.587219 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1073/2009] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:19 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:20.596204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:20.600471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:20.641585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.642280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.643639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:20.644562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.645165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.646500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:20.790283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:20.806583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:20.820795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:20.828590 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d45f2ca-0e20-4f78-8eaf-df844a74e6a7 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1597 microversion: 2.1 time: 0.452138 Oct 12 22:39:20.829683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:20.833919 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 937/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:20 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1597 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:20.858479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:20.860093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:20.864111 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-001c7232-43ec-437b-b6a1-96b488f758e6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1504 microversion: 2.91 time: 0.275534 Oct 12 22:39:20.865383 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1074/2011] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:20 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:20.896011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.898126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.900091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:20.901026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:20.903342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:20.908164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:20.988380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:21.398568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e61e5865-3f3b-420d-b7ac-5ff031e48074 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 204 len: 0 microversion: 2.1 time: 0.561941 Oct 12 22:39:21.409220 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 938/2012] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:39:20 2022] DELETE /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:21.591988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25a0f0de-06fd-4b92-ad11-6e8e47f6d74b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ffbaedc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:21.672462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25a0f0de-06fd-4b92-ad11-6e8e47f6d74b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.084498 Oct 12 22:39:21.685020 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1075/2013] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:21 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:21.820414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2126446082", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "25f09190-2cdc-41b9-9952-f833573da6b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:21.858484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:21.859169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:21.881267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:21.884916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:21.890970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:21.892521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:21.893596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:21.894458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:21.951384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] validate_networks() for [('25f09190-2cdc-41b9-9952-f833573da6b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:39:22.151403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:22.164888 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-681a9050-df32-42bf-b0c6-035f717d1560 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1597 microversion: 2.1 time: 0.310125 Oct 12 22:39:22.167579 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1076/2014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:21 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1597 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:22.181090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:22.182036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:22.197945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:22.199088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:22.200122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:22.201576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:22.204105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:22.206834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:22.412698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:22.430340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:22.433537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:22.441952 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-692d331a-2d28-41a0-9fba-d946e533636d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1510 microversion: 2.91 time: 0.271078 Oct 12 22:39:22.442787 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1077/2015] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:22 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:22.472180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1832879772", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "21129576-0a20-462d-a60d-6a035d8088d5"}], "security_groups": [{"name": "tempest-securitygroup--1776243656"}], "key_name": "tempest-keypair-1856239845", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:22.642057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] validate_networks() for [('21129576-0a20-462d-a60d-6a035d8088d5', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:39:23.356360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Getting quotas for project bff192152eb64e288b26ca5d385f0ac0. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:23.363834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Getting quotas for user e1e3744c94e14a60915104704e1c70ff and project bff192152eb64e288b26ca5d385f0ac0. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:23.381352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:39:23.382769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:39:23.383259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:39:23.384015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:39:23.384591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:39:23.399814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:23.400330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:23.400766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:23.401509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:23.401959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:23.402386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:23.429212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Getting quotas for project bff192152eb64e288b26ca5d385f0ac0. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:23.435785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Getting quotas for user e1e3744c94e14a60915104704e1c70ff and project bff192152eb64e288b26ca5d385f0ac0. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:23.449827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:39:23.452760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:39:23.539342 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56f5a975-0a5e-42d8-a857-65af8d46c3b2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.072013 Oct 12 22:39:23.540606 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1078/2016] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:39:22 2022] POST /compute/v2.1/servers => generated 407 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:39:23.551838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-dc399b54-d0bb-4d66-811c-87b6ae3ecfb8 req-2ce8fe78-ca83-47dc-8496-1dff6edb1355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c2dd1a-5106-4a62-bef0-e496ea3e8e49", "name": "network-vif-deleted", "tag": "47fb6b3d-e4f4-4930-ae0e-e73ef491584c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:23.564594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dc399b54-d0bb-4d66-811c-87b6ae3ecfb8 req-2ce8fe78-ca83-47dc-8496-1dff6edb1355 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:23.565508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dc399b54-d0bb-4d66-811c-87b6ae3ecfb8 req-2ce8fe78-ca83-47dc-8496-1dff6edb1355 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:23.566128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dc399b54-d0bb-4d66-811c-87b6ae3ecfb8 req-2ce8fe78-ca83-47dc-8496-1dff6edb1355 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:23.580800 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-dc399b54-d0bb-4d66-811c-87b6ae3ecfb8 req-2ce8fe78-ca83-47dc-8496-1dff6edb1355 service nova] Creating event network-vif-deleted:47fb6b3d-e4f4-4930-ae0e-e73ef491584c for instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 on n-h2-860864-8 Oct 12 22:39:23.586972 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-dc399b54-d0bb-4d66-811c-87b6ae3ecfb8 req-2ce8fe78-ca83-47dc-8496-1dff6edb1355 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044939 Oct 12 22:39:23.588201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1079/2017] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:23.593792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-20a3f4a6-d544-48b1-86f3-1b2c0889d821 req-6df0fc52-2d97-4234-89c2-3cf5682191c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba94be-a6bf-4bed-8644-0971210edb33", "name": "network-vif-unplugged", "status": "completed", "tag": "4aae5597-b208-41ad-afab-4f29fe01b52b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:23.606611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-20a3f4a6-d544-48b1-86f3-1b2c0889d821 req-6df0fc52-2d97-4234-89c2-3cf5682191c0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:23.617215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-20a3f4a6-d544-48b1-86f3-1b2c0889d821 req-6df0fc52-2d97-4234-89c2-3cf5682191c0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:23.618075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-20a3f4a6-d544-48b1-86f3-1b2c0889d821 req-6df0fc52-2d97-4234-89c2-3cf5682191c0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:23.667661 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-20a3f4a6-d544-48b1-86f3-1b2c0889d821 req-6df0fc52-2d97-4234-89c2-3cf5682191c0 service nova] Creating event network-vif-unplugged:4aae5597-b208-41ad-afab-4f29fe01b52b for instance 65ba94be-a6bf-4bed-8644-0971210edb33 on n-h1-860864-8 Oct 12 22:39:23.688436 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-20a3f4a6-d544-48b1-86f3-1b2c0889d821 req-6df0fc52-2d97-4234-89c2-3cf5682191c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097435 Oct 12 22:39:23.690384 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1080/2018] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:23.708579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc1a8fe9-1f06-4589-bec0-c9a71ca64e9d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff5003a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:23.792462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc1a8fe9-1f06-4589-bec0-c9a71ca64e9d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.099088 Oct 12 22:39:23.798289 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1081/2019] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:23 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:23.841070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:23.850606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:23.863408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:23.864116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:23.866014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:23.866747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:23.867255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:23.867846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:23.963758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:23.965115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:23.966325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:23.972289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lazy-loading 'fault' on Instance uuid 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:24.091557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:24.131574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5ea842f-df5b-46ed-9bc6-2b9ae382f321 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 200 len: 1323 microversion: 2.1 time: 0.322295 Oct 12 22:39:24.153874 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1082/2020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:23 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:24.165436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:24.166338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:24.177791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:24.178558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:24.179264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:24.180337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:24.180889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:24.181509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:24.294145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:24.309273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:24.311287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:24.318799 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a683b30d-cc37-4ec0-bf96-9f9d01c4947a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1510 microversion: 2.91 time: 0.162555 Oct 12 22:39:24.319830 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1083/2021] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:24 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:24.344767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00127926-d3a0-4d88-aef8-6b449359053c tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:24.349442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-00127926-d3a0-4d88-aef8-6b449359053c tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:24.357093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:24.430576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-00127926-d3a0-4d88-aef8-6b449359053c tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:24.449167 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00127926-d3a0-4d88-aef8-6b449359053c tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1270 microversion: 2.1 time: 0.107255 Oct 12 22:39:24.450768 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1084/2022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:24 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:24.814215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c1b5272-90fb-4640-87da-b377192436aa tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f4507c37c10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:24.850229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:39:24.857422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:39:24.858265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:39:24.860297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:39:24.860960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:39:24.905024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:24.906177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:24.908901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:24.912320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:24.913017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:24.914988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:24.956974 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c1b5272-90fb-4640-87da-b377192436aa tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.146151 Oct 12 22:39:24.958589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1085/2023] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:24 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:24.976466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:25.016815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for user 080644f7502346ed8ff64a026ac9d15b and project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:25.071344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:39:25.078794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:39:25.161141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:25.161950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: 95c2dd1a-5106-4a62-bef0-e496ea3e8e49] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:25.175095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:25.178112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:25.180644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:25.181588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:25.184106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:25.186410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:25.229224 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] HTTP exception thrown: Instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 could not be found. Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Request method failure captured: Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 HTTP/1.1 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0AvgwNj6mn3lZBYlGHEKK4IY_pFS-nD6slAwxHGHbdbMt7yTMZrT-gMOc0WGk4WPHZD99QFamxrl3g4773JU3JHeI8HOrHzM7EhkhATPNn-hGdIbIqKGfzovEFmvgFDgLlZOEnH0ZxZ-BTyWGKvIDyvUmxa_Fo9rKvfVkclzU21utw Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}] Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-LiveMigrationTest-181527662 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-LiveMigrationTest-181527662-project Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: dd8fdd646f8546a0a3aae53d1b55a8b1 Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-LiveMigrationTest-181527662-project Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 could not be found. Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '95c2dd1a-5106-4a62-bef0-e496ea3e8e49'} Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 could not be found. Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 could not be found. Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:25.233721 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:25.237871 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:25.237871 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:25.237871 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:25.237871 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:25.237871 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:25.237871 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 could not be found. Oct 12 22:39:25.237871 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:25.243469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Returning 404 to user: Instance 95c2dd1a-5106-4a62-bef0-e496ea3e8e49 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:25.246990 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34cb99a0-5dfb-488a-9329-9d8213f66e14 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49" status: 404 len: 111 microversion: 2.1 time: 0.090995 Oct 12 22:39:25.252772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1086/2024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:25 2022] GET /compute/v2.1/servers/95c2dd1a-5106-4a62-bef0-e496ea3e8e49 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:39:25.264657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3496752c-b220-418e-b2a7-ae33f1b81468 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '.version_select at 0x7f4507c5c820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:25.290701 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a62d395-e8c7-400d-9e0d-b88f4e6f2710 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.474489 Oct 12 22:39:25.293200 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 939/2025] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:39:25.322853 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3496752c-b220-418e-b2a7-ae33f1b81468 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89062266" status: 202 len: 0 microversion: 2.1 time: 0.065812 Oct 12 22:39:25.324024 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1087/2026] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 12 22:39:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89062266 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:39:25.332831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5005e756-3875-4661-9036-06f643162b8b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:25.334862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5005e756-3875-4661-9036-06f643162b8b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:25.361299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:25.375826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:25.385547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:25.387069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:25.387831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:25.388808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:25.389674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:25.390298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:25.566492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:25.581955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:25.586302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:25.612267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5005e756-3875-4661-9036-06f643162b8b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:25.619068 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c9a8c38-f18e-4128-95c9-7f1942172061 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1531 microversion: 2.91 time: 0.266910 Oct 12 22:39:25.623178 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1088/2027] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:25 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1531 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:25.631793 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5005e756-3875-4661-9036-06f643162b8b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1208 microversion: 2.1 time: 0.317031 Oct 12 22:39:25.633162 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 940/2028] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:25 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1208 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:25.656722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:25.658801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:25.671119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:25.671907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:25.672384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:25.674173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:25.674709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:25.675157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:26.118278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:26.119151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:26.136559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:26.137343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:26.139866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:26.142578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:26.145319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:26.146628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:26.457335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lazy-loading 'services' on Instance uuid 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:26.513316 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a6ae389-c0a8-4b4c-b592-7d715837bf80 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1936 microversion: 2.91 time: 0.862920 Oct 12 22:39:26.515737 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 941/2029] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:25 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1936 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:26.526667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d78c8d48-3bce-470b-b571-dd3d55ef6545 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ffdc4c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:26.584892 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d78c8d48-3bce-470b-b571-dd3d55ef6545 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.067260 Oct 12 22:39:26.586437 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 942/2030] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:26 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:26.596813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-39f3dcf4-2366-4104-aede-42dbcdc6af5f req-5a017ba8-4656-44d7-8083-dbe7ce68b290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ba94be-a6bf-4bed-8644-0971210edb33", "name": "network-vif-deleted", "tag": "4aae5597-b208-41ad-afab-4f29fe01b52b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:26.626589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-39f3dcf4-2366-4104-aede-42dbcdc6af5f req-5a017ba8-4656-44d7-8083-dbe7ce68b290 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:26.628935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-39f3dcf4-2366-4104-aede-42dbcdc6af5f req-5a017ba8-4656-44d7-8083-dbe7ce68b290 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:26.629730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-39f3dcf4-2366-4104-aede-42dbcdc6af5f req-5a017ba8-4656-44d7-8083-dbe7ce68b290 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:26.661384 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-39f3dcf4-2366-4104-aede-42dbcdc6af5f req-5a017ba8-4656-44d7-8083-dbe7ce68b290 service nova] Creating event network-vif-deleted:4aae5597-b208-41ad-afab-4f29fe01b52b for instance 65ba94be-a6bf-4bed-8644-0971210edb33 on n-h1-860864-8 Oct 12 22:39:26.696787 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-39f3dcf4-2366-4104-aede-42dbcdc6af5f req-5a017ba8-4656-44d7-8083-dbe7ce68b290 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092655 Oct 12 22:39:26.701641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 943/2031] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:26.712543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:26.713533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:26.722341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:26.723001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:26.723779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:26.725108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:26.726238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:26.726935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:26.741296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:26.752457 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f858e43-334a-4fe8-ab8c-28088a01f1ff tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1322 microversion: 2.1 time: 1.125010 Oct 12 22:39:26.770672 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1089/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:25 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1322 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:26.776095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:26.780655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:26.790654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:26.791390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:26.792000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:26.793027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:26.793632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:26.794890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:27.003465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lazy-loading 'services' on Instance uuid 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:27.041326 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3ffa187d-c4c6-4a6e-9837-5f810f9fa836 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1936 microversion: 2.91 time: 0.334710 Oct 12 22:39:27.043117 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 944/2033] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:26 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1936 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:27.075379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:27.087726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:27.089803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:27.092462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:27.094489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:27.096650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:27.099444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:27.193727 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-233c815a-7875-447a-a1dd-88eea47041c3 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.124825 Oct 12 22:39:27.211528 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 945/2034] 10.222.0.20 () {60 vars in 1217 bytes} [Wed Oct 12 22:39:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:39:27.228259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:27.231498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:27.250637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:27.257443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:27.259555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:27.262355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:27.264465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:27.267017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:27.268686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:27.280763 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0f8b436-cf3f-45bc-b93c-6bf839ab5a81 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1204 microversion: 2.1 time: 0.508674 Oct 12 22:39:27.294498 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1090/2035] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:26 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1204 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:27.342257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lazy-loading 'flavor' on Instance uuid 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:27.607305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69575f50-862a-4d17-a53c-c0f2cdb1fd08 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff6891f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:27.939425 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c5af4198-6edc-44f7-9f2f-cd7f36fefe80 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action" status: 202 len: 0 microversion: 2.91 time: 0.726373 Oct 12 22:39:27.944696 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 946/2036] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:39:27 2022] POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:27.959679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:27.968102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:27.993341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:27.999044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:28.002971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:28.005321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:28.006392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:28.007870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:28.038843 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69575f50-862a-4d17-a53c-c0f2cdb1fd08 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.440020 Oct 12 22:39:28.040079 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1091/2037] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:27 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:28.052253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:28.053697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:28.074079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:28.076352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:28.080869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:28.082993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:28.083440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:28.083884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:28.282596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:28.305380 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a5c3a362-3efb-47ce-840c-ccc35aee3ba8 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1328 microversion: 2.1 time: 0.359332 Oct 12 22:39:28.321452 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 947/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:27 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1328 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:28.343493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:28.344085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:28.359485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:28.360161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:28.360709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:28.362367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:28.363063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:28.363593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:28.370131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:28.386390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:28.390054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:28.408936 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b6908191-944f-4f9a-b702-e9ca788010a5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.367461 Oct 12 22:39:28.418495 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1092/2039] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:28 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:28.573339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:28.581455 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5400350b-bbcf-4687-b09a-7d879adf7c65 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1266 microversion: 2.1 time: 0.258774 Oct 12 22:39:28.586487 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 948/2040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:28 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:29.063229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:29.063543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09e42318-8071-455f-9ed1-3b286286da63 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff689a60>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:29.064277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:29.071044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:29.076618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:29.077410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:29.078381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:29.079058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:29.079727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:29.161609 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09e42318-8071-455f-9ed1-3b286286da63 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.108843 Oct 12 22:39:29.162863 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1093/2041] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:29 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:29.169277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:29.336411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:29.339071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:29.359063 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-659a576f-381e-48b9-aaba-f1a72233cd4e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 204 len: 0 microversion: 2.1 time: 0.299409 Oct 12 22:39:29.364139 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 949/2042] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:39:29 2022] DELETE /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:29.364446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:29.366022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:29.369921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:29.370588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:29.370734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:29.371622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:29.372271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:29.384640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:29.385127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:29.385770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:29.387463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:29.387830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:29.388471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:29.393338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:29.451161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:30.006947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:30.014748 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91635965-e453-49c4-8ff6-5fe17d11ae1e tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1484 microversion: 2.1 time: 0.648953 Oct 12 22:39:30.028366 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 950/2043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:29 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1484 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:30.036180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:30.037157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:30.042624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:30.043704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:30.044383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:30.044985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:30.045866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:30.046459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:30.047038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:30.054516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c5bd4b3-a9f3-4c29-95ba-89451e4b6052 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1328 microversion: 2.1 time: 0.721542 Oct 12 22:39:30.064367 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1094/2044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:29 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1328 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:30.087632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:30.093790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:30.101247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:30.109536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:30.114361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:30.115354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:30.120255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:30.120993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:30.200758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:30.213719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:30.215195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:30.223694 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b24c268-71ba-49e3-9448-4e23591d7c0a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.194178 Oct 12 22:39:30.228336 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 951/2045] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:30 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:30.259813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-746862cb-d1f5-424a-8cf6-16becdd94e8c tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff4e83a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:30.306140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:30.309882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:30.314737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e75f7509-f7f5-460c-ab41-d5f67efd444a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1266 microversion: 2.1 time: 0.249103 Oct 12 22:39:30.324675 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1095/2046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:30 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:30.646405 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-746862cb-d1f5-424a-8cf6-16becdd94e8c tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1426 microversion: 2.1 time: 0.397351 Oct 12 22:39:30.646997 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 952/2047] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:30 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1426 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:31.042699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:31.043519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:31.058130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.060626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.061286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:31.064454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.066135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.067048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:31.083173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:31.084005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:31.098201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.100390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.101947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:31.102832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.103595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.104199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:31.284193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:31.296971 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a40e47a7-28a0-43a1-9286-55415afe4d42 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1442 microversion: 2.1 time: 0.258443 Oct 12 22:39:31.297930 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1096/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:31 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1442 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:31.306765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:31.312182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:31.326880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.334632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.335475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:31.336512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.337498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.338199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:31.690818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:31.700327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:31.702061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:31.707746 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4fc04d50-9409-4a60-a941-4f30540d907f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.408406 Oct 12 22:39:31.708677 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1097/2049] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:31 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:31.713409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:31.714310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:31.722321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.723113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.723760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:31.724710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:31.726991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:31.728039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.296758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:32.309647 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6405cff-8089-49f8-9c5f-192c6d7da3c3 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1396 microversion: 2.1 time: 1.230781 Oct 12 22:39:32.329816 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 953/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:31 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1396 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:32.346108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b352ac90-1538-44af-8734-0b41b013d215 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff523670>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:32.446163 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b352ac90-1538-44af-8734-0b41b013d215 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1435 microversion: 2.1 time: 0.114417 Oct 12 22:39:32.447001 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 954/2051] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:32 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1435 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:32.453921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d409bf07-5a7a-4b06-9f35-c63dddb9fed5 req-b7e5ff28-dba4-47f7-8368-32323d30a87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3fa1d46-716f-4398-b632-5f38dbce83cb", "name": "network-vif-deleted", "tag": "3c005992-3f1c-4460-9fb1-2094f54865e7"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:32.466348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:32.472300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d409bf07-5a7a-4b06-9f35-c63dddb9fed5 req-b7e5ff28-dba4-47f7-8368-32323d30a87e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.473069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d409bf07-5a7a-4b06-9f35-c63dddb9fed5 req-b7e5ff28-dba4-47f7-8368-32323d30a87e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.473890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d409bf07-5a7a-4b06-9f35-c63dddb9fed5 req-b7e5ff28-dba4-47f7-8368-32323d30a87e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.479312 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23a7fe5b-6549-4e96-bb4e-fa5e56a756c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.766943 Oct 12 22:39:32.481815 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1098/2052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:31 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:32.487356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:32.489365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:32.496437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.499624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.500171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.500962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.501418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.501843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.508458 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d409bf07-5a7a-4b06-9f35-c63dddb9fed5 req-b7e5ff28-dba4-47f7-8368-32323d30a87e service nova] Creating event network-vif-deleted:3c005992-3f1c-4460-9fb1-2094f54865e7 for instance b3fa1d46-716f-4398-b632-5f38dbce83cb on n-h2-860864-8 Oct 12 22:39:32.525670 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d409bf07-5a7a-4b06-9f35-c63dddb9fed5 req-b7e5ff28-dba4-47f7-8368-32323d30a87e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066042 Oct 12 22:39:32.526346 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 955/2053] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:32.535712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d9886009-284d-42ff-b668-f3d253eaa1f3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff519af0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:32.540612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.541849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.542450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.543516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lazy-loading 'fault' on Instance uuid b3fa1d46-716f-4398-b632-5f38dbce83cb {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:32.586484 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d9886009-284d-42ff-b668-f3d253eaa1f3 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 200 len: 1435 microversion: 2.1 time: 0.055017 Oct 12 22:39:32.587075 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 956/2054] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:32 2022] GET /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 1435 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:32.602478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:32.603422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:32.612898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.613593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.617852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:32.624070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.625623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.626293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.626400 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5f392ef3-c3fd-4389-9c20-c676f6c65982 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 200 len: 1301 microversion: 2.1 time: 0.143365 Oct 12 22:39:32.627564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.627874 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1099/2055] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:32 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:32.740422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:32.741527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:32.755576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.757118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.759363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.760346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.761349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.762457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.881862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:32.897897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:32.899330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:32.905008 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e6088f0-69fb-4b05-86bd-04bb5d1acb76 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.169143 Oct 12 22:39:32.920813 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1100/2056] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:32 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:39:32.931654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ba6cbe28-4d93-43dd-b7a6-f29edad11723 req-9aea424f-7993-47e0-bcfb-cffdc03f442c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb49ed2-f013-4b9c-ae4f-8d4137be1290", "tag": "a45a3e55-f7dd-411f-a861-aee70b8b0613"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:32.942430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ba6cbe28-4d93-43dd-b7a6-f29edad11723 req-9aea424f-7993-47e0-bcfb-cffdc03f442c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:32.943202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ba6cbe28-4d93-43dd-b7a6-f29edad11723 req-9aea424f-7993-47e0-bcfb-cffdc03f442c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:32.944915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ba6cbe28-4d93-43dd-b7a6-f29edad11723 req-9aea424f-7993-47e0-bcfb-cffdc03f442c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:32.957509 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ba6cbe28-4d93-43dd-b7a6-f29edad11723 req-9aea424f-7993-47e0-bcfb-cffdc03f442c service nova] Creating event network-changed:a45a3e55-f7dd-411f-a861-aee70b8b0613 for instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 on n-h1-860864-8 Oct 12 22:39:32.963621 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ba6cbe28-4d93-43dd-b7a6-f29edad11723 req-9aea424f-7993-47e0-bcfb-cffdc03f442c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041324 Oct 12 22:39:32.964868 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1101/2057] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:33.169989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:33.181729 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21e6c993-44de-4f79-957c-3aa6696896b1 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1466 microversion: 2.1 time: 0.583537 Oct 12 22:39:33.182489 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 957/2058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:32 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1466 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:33.207310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-027957c9-60a3-4059-9997-e26ffc174754 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff4701f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:33.351022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:33.352377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:33.393694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:33.394609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:33.395220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:33.396797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:33.398668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:33.401162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:33.418091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:33.915029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:33.937173 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-027957c9-60a3-4059-9997-e26ffc174754 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "DELETE /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b" status: 204 len: 0 microversion: 2.1 time: 0.735340 Oct 12 22:39:33.938536 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1102/2059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:33 2022] DELETE /compute/v2.1/images/8c1824e7-66f2-40d3-bd76-29ad48085e4b => generated 0 bytes in 738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:33.946367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:33.951006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:33.955307 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd9027fe-56c3-48f2-ada6-74c72c97d07b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1396 microversion: 2.1 time: 0.624901 Oct 12 22:39:33.962439 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 958/2060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:33 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1396 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:33.970317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:33.971290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:33.971727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:33.972465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:33.977309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:33.977925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: b3fa1d46-716f-4398-b632-5f38dbce83cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:33.980034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:33.980556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:33.991575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:33.993333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:33.993783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:33.994482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.000576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.001029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.033993 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] HTTP exception thrown: Instance b3fa1d46-716f-4398-b632-5f38dbce83cb could not be found. Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Request method failure captured: Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb HTTP/1.1 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AvgwNj6mn3lZBYlGHEKK4IY_pFS-nD6slAwxHGHbdbMt7yTMZrT-gMOc0WGk4WPHZD99QFamxrl3g4773JU3JHeI8HOrHzM7EhkhATPNn-hGdIbIqKGfzovEFmvgFDgLlZOEnH0ZxZ-BTyWGKvIDyvUmxa_Fo9rKvfVkclzU21utw Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}] Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveMigrationTest-181527662 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveMigrationTest-181527662-project Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: dd8fdd646f8546a0a3aae53d1b55a8b1 Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveMigrationTest-181527662-project Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance b3fa1d46-716f-4398-b632-5f38dbce83cb could not be found. Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'b3fa1d46-716f-4398-b632-5f38dbce83cb'} Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3fa1d46-716f-4398-b632-5f38dbce83cb could not be found. Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3fa1d46-716f-4398-b632-5f38dbce83cb could not be found. Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:34.041105 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.044644 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:34.044644 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:34.044644 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:34.044644 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:34.044644 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:34.044644 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3fa1d46-716f-4398-b632-5f38dbce83cb could not be found. Oct 12 22:39:34.044644 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.045650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Returning 404 to user: Instance b3fa1d46-716f-4398-b632-5f38dbce83cb could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:34.048548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57d91006-b3a7-4ce0-8dc2-4e3bcf5ee736 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb" status: 404 len: 111 microversion: 2.1 time: 0.083220 Oct 12 22:39:34.049218 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 959/2061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:33 2022] GET /compute/v2.1/servers/b3fa1d46-716f-4398-b632-5f38dbce83cb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:39:34.058062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:34.060300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:34.079399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.081318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.082581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.084604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.086510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.087998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.144679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:34.155910 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-33312634-cdc9-4e1d-952e-92dba02cabd3 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.216013 Oct 12 22:39:34.162730 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1103/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:33 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:34.177746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a1940b8-b813-4239-896b-ecd9e3358e1d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '.version_select at 0x7f44ff6dea60>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:34.218336 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9a1940b8-b813-4239-896b-ecd9e3358e1d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] HTTP exception thrown: Image not found. Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a1940b8-b813-4239-896b-ecd9e3358e1d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Request method failure captured: Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 HTTP/1.1 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0HBydVqfkKRNppg60TnKZ0s-9fIbieX_Biv1QDiLwQpGHsnr45H04XCAGXJ_VgYaTFNx2tHHQWcbZMfwGDBY8dYWvjFJpYtvv-75D2Wko1aWqttpy4WvQ3siRZtA_ZXHXXGCs5pTxkw3Q8_u8Tmr5mgQSjYGDfYvsp_d591e9fqpeU Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 4fc4f5adce674ecfa266bc4499a771fe Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fc4f5adce674ecfa266bc4499a771fe"}]}] Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 4fc4f5adce674ecfa266bc4499a771fe Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesOneServerTestJSON-318901103-project Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: c822c44d83fc477387b40ee6dac04468 Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesOneServerTestJSON-318901103-project Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '754c4702-d320-4cb1-904b-e35654133e25'} Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 754c4702-d320-4cb1-904b-e35654133e25 to delete Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 754c4702-d320-4cb1-904b-e35654133e25 could not be found. Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.221215 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a1940b8-b813-4239-896b-ecd9e3358e1d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a1940b8-b813-4239-896b-ecd9e3358e1d tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "DELETE /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25" status: 404 len: 62 microversion: 2.1 time: 0.058837 Oct 12 22:39:34.225077 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1104/2063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:34 2022] DELETE /compute/v2.1/images/754c4702-d320-4cb1-904b-e35654133e25 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:39:34.237960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:34.238574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:34.250726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:34.255451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.258343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.258893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.259635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.261829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.261940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:34.262272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.263391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:34.276325 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29ec3675-ed84-4710-8da6-f63272fda3ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.225764 Oct 12 22:39:34.280338 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 960/2064] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:34 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:34.292252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:34.293194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:34.310867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.314589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.315611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.316366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.319348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.330387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:34.331930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.371250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:34.442212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=24 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:34.494438 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e027e12-6cfa-4c97-8eaa-cfc95b3148ec tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 204 len: 0 microversion: 2.1 time: 0.268779 Oct 12 22:39:34.496049 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1105/2065] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:39:34 2022] DELETE /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:34.508588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:34.509579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:34.519270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.521117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.522057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.523215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.524091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.525376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.583975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ffee683-2c44-405a-af03-9b70d226421e tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 204 len: 0 microversion: 2.1 time: 0.301999 Oct 12 22:39:34.591801 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 961/2066] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:39:34 2022] DELETE /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:39:34.608081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:34.608775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:34.618333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.618825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.620553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.621498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.622225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.622955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.866246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:34.875185 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2b20d19-7284-4542-8037-1aff26763800 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1472 microversion: 2.1 time: 0.281928 Oct 12 22:39:34.875865 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 962/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:34 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:34.880604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ec507dc0-84ce-4cb3-80fc-74e9bbd72f61 req-92841a99-9208-49a3-9c38-98947fb824e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23ffeb9-2df6-4806-a53f-597231c291a0", "tag": "1a320b77-fd84-42ca-9ac6-b5a541475a0b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:34.890968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ec507dc0-84ce-4cb3-80fc-74e9bbd72f61 req-92841a99-9208-49a3-9c38-98947fb824e6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:34.891846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ec507dc0-84ce-4cb3-80fc-74e9bbd72f61 req-92841a99-9208-49a3-9c38-98947fb824e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:34.893627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ec507dc0-84ce-4cb3-80fc-74e9bbd72f61 req-92841a99-9208-49a3-9c38-98947fb824e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:34.905975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ec507dc0-84ce-4cb3-80fc-74e9bbd72f61 req-92841a99-9208-49a3-9c38-98947fb824e6 service nova] Creating event network-changed:1a320b77-fd84-42ca-9ac6-b5a541475a0b for instance f23ffeb9-2df6-4806-a53f-597231c291a0 on n-h2-860864-8 Oct 12 22:39:34.911968 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ec507dc0-84ce-4cb3-80fc-74e9bbd72f61 req-92841a99-9208-49a3-9c38-98947fb824e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034615 Oct 12 22:39:34.912860 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 963/2068] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:34.987619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:34.988479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:35.004100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.004100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.004100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.004100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.004100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.004100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.016941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.030253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a09dd62-1a6f-4489-9fcf-c2d576501091 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1498 microversion: 2.1 time: 0.526224 Oct 12 22:39:35.031859 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1106/2069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:34 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1498 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:35.209460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1570411096", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": "none"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:35.275725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:39:35.276237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:39:35.276872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:39:35.277483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:39:35.277886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:39:35.288011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.288606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.289111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.289984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.290467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.290954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.309469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Getting quotas for project d416377a120d4e5ba278dd6b9b3f6fb8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:35.315856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Getting quotas for user 5ce914189e9b4ae6aa27ca19676017b4 and project d416377a120d4e5ba278dd6b9b3f6fb8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:35.331123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:39:35.333520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:39:35.367673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.375325 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35e84fb6-ae91-4ee7-ac41-41c03108338d tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1396 microversion: 2.1 time: 0.392167 Oct 12 22:39:35.378397 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 964/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:34 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1396 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:35.384892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:35.389738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:35.402091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.402437 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1347f6ff-ec61-42cb-8703-1c2d9fce2810 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.344530 Oct 12 22:39:35.406821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.407484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.408523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.409170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.409836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.412670 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1107/2071] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 12 22:39:35.435596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:35.438494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:35.446520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.447255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.448024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.448998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.449601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.451010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.582918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.594560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.596728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.603027 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e1d3d70-7aa9-410f-bc82-eb79753c77ab tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.188733 Oct 12 22:39:35.604365 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1108/2072] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:35 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:35.614404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13f55d12-ed0f-415a-8afd-2193a5c4e709 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:35.615243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13f55d12-ed0f-415a-8afd-2193a5c4e709 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:35.631354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:35.797366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-13f55d12-ed0f-415a-8afd-2193a5c4e709 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.810973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-13f55d12-ed0f-415a-8afd-2193a5c4e709 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.815243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-13f55d12-ed0f-415a-8afd-2193a5c4e709 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.818688 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13f55d12-ed0f-415a-8afd-2193a5c4e709 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 200 len: 1281 microversion: 2.47 time: 0.212867 Oct 12 22:39:35.821589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1109/2073] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:35 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 1281 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:35.838844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:35.856835 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87161651-ab40-4b92-9213-3f1dabfd2d07 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.477082 Oct 12 22:39:35.857611 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 965/2074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:35 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:35.902370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:35.903279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:35.912259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.913551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.914168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:35.915207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:35.916470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:35.917177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:36.015120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-71106b90-94a7-4144-9dd7-f1487c641784 req-e65c566f-929b-4dc4-8cde-3e7802011fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee", "name": "network-vif-unplugged", "status": "completed", "tag": "e00b7c80-471e-4143-b726-931f38e44dfc"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:36.035843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-71106b90-94a7-4144-9dd7-f1487c641784 req-e65c566f-929b-4dc4-8cde-3e7802011fda service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:36.037142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-71106b90-94a7-4144-9dd7-f1487c641784 req-e65c566f-929b-4dc4-8cde-3e7802011fda service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:36.037630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-71106b90-94a7-4144-9dd7-f1487c641784 req-e65c566f-929b-4dc4-8cde-3e7802011fda service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:36.091591 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-71106b90-94a7-4144-9dd7-f1487c641784 req-e65c566f-929b-4dc4-8cde-3e7802011fda service nova] Creating event network-vif-unplugged:e00b7c80-471e-4143-b726-931f38e44dfc for instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee on n-h1-860864-8 Oct 12 22:39:36.122964 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-71106b90-94a7-4144-9dd7-f1487c641784 req-e65c566f-929b-4dc4-8cde-3e7802011fda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111256 Oct 12 22:39:36.126355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 966/2075] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:39:36.135941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:36.145535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:36.152877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:36.158715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:36.161200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:36.165317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:36.166425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:36.167149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:36.167839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:36.633446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:36.646175 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84bf6456-4fc5-42a8-8441-9134dcfc468b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1472 microversion: 2.1 time: 0.749722 Oct 12 22:39:36.646765 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1110/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:35 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1472 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:36.682394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:36.683349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:36.712673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:36.713138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:36.713598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:36.714820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:36.714820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:36.715164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.048618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8fdd646f8546a0a3aae53d1b55a8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5549d9a44ba740baa4abee1ea9a4c3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.060638 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a99a768-779a-4fd1-94d5-d94d4ebcb415 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 200 len: 1456 microversion: 2.1 time: 0.931170 Oct 12 22:39:37.062079 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 967/2077] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:36 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 1456 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:37.067000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:37.067692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:37.107968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.108601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.110175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.112892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.113440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.113954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.144991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:37.246685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.264594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.265947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.268891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.276659 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f623088d-5201-40a3-8bf9-b26c227ef77b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.213375 Oct 12 22:39:37.278589 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b8a2aad-50a8-42f7-81ae-cdefc8a21bbb tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1396 microversion: 2.1 time: 0.626330 Oct 12 22:39:37.280894 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1111/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:36 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1396 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:37.284482 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 968/2079] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:37 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:37.289576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:37.297153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:37.303656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:37.306446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:37.311835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.312992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.314458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.316250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.317254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.320472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.322424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.322918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.328031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.329340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.332069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.332529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.509717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.524902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.526764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.528220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f9499d0-a085-41a5-b21f-4ecc5ef07e17 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 200 len: 1341 microversion: 2.47 time: 0.238266 Oct 12 22:39:37.537204 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1112/2080] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:37 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 1341 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:37.554902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-502ec8f0-b6e2-4687-b670-3b2c13cad99b req-3c6851ef-1dd8-4003-a096-03f3bc542b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6", "name": "network-vif-deleted", "tag": "95bae054-475a-40d0-aca7-9f2771d8157a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:37.573765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-502ec8f0-b6e2-4687-b670-3b2c13cad99b req-3c6851ef-1dd8-4003-a096-03f3bc542b2a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.574242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-502ec8f0-b6e2-4687-b670-3b2c13cad99b req-3c6851ef-1dd8-4003-a096-03f3bc542b2a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.574865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-502ec8f0-b6e2-4687-b670-3b2c13cad99b req-3c6851ef-1dd8-4003-a096-03f3bc542b2a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.591756 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-502ec8f0-b6e2-4687-b670-3b2c13cad99b req-3c6851ef-1dd8-4003-a096-03f3bc542b2a service nova] Creating event network-vif-deleted:95bae054-475a-40d0-aca7-9f2771d8157a for instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 on n-h2-860864-8 Oct 12 22:39:37.598498 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-502ec8f0-b6e2-4687-b670-3b2c13cad99b req-3c6851ef-1dd8-4003-a096-03f3bc542b2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059912 Oct 12 22:39:37.599649 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1113/2081] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:37.673892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:37.674885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:37.682685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.682685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.683214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.684865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:37.684865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:37.685095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:37.941942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.956605 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1553ae63-447d-479b-b8b4-ab4a0d334555 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.670752 Oct 12 22:39:37.958790 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 969/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:37 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:37.965350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:37.979516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dae17c63-23e7-4d98-8d5f-cca394c4f797 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1472 microversion: 2.1 time: 0.312407 Oct 12 22:39:37.980154 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1114/2083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:37 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:38.085548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:38.087155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] [instance: abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:38.093776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.094773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.095398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.096492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.097152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.097793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.114697 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] HTTP exception thrown: Instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 could not be found. Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Request method failure captured: Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 HTTP/1.1 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0AvgwNj6mn3lZBYlGHEKK4IY_pFS-nD6slAwxHGHbdbMt7yTMZrT-gMOc0WGk4WPHZD99QFamxrl3g4773JU3JHeI8HOrHzM7EhkhATPNn-hGdIbIqKGfzovEFmvgFDgLlZOEnH0ZxZ-BTyWGKvIDyvUmxa_Fo9rKvfVkclzU21utw Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5549d9a44ba740baa4abee1ea9a4c3f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5549d9a44ba740baa4abee1ea9a4c3f1"}]}] Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-LiveMigrationTest-181527662 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5549d9a44ba740baa4abee1ea9a4c3f1 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-LiveMigrationTest-181527662 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-LiveMigrationTest-181527662-project Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: dd8fdd646f8546a0a3aae53d1b55a8b1 Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-LiveMigrationTest-181527662-project Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 could not be found. Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6'} Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 could not be found. Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 could not be found. Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:38.116721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:38.120127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:38.120127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:38.120127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:38.120127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:38.120127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:38.120127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 could not be found. Oct 12 22:39:38.120127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:38.122232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] Returning 404 to user: Instance abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:38.123626 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4306c469-93d4-432b-9efb-135dd3ff3bc9 tempest-LiveMigrationTest-181527662 tempest-LiveMigrationTest-181527662-project] 10.222.0.20 "GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6" status: 404 len: 111 microversion: 2.1 time: 0.042222 Oct 12 22:39:38.124624 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 970/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:38 2022] GET /compute/v2.1/servers/abdc68b3-70cd-4fbe-a999-ca1b97e6eaa6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:39:38.211359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4d7bbe97-52ba-4094-afe6-a2b32a5d940e req-562b1b2e-3559-47e1-a802-212fbce90e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb49ed2-f013-4b9c-ae4f-8d4137be1290", "name": "network-vif-plugged", "status": "completed", "tag": "a45a3e55-f7dd-411f-a861-aee70b8b0613"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:38.222251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d7bbe97-52ba-4094-afe6-a2b32a5d940e req-562b1b2e-3559-47e1-a802-212fbce90e8c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.223046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d7bbe97-52ba-4094-afe6-a2b32a5d940e req-562b1b2e-3559-47e1-a802-212fbce90e8c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.223660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d7bbe97-52ba-4094-afe6-a2b32a5d940e req-562b1b2e-3559-47e1-a802-212fbce90e8c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.242749 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4d7bbe97-52ba-4094-afe6-a2b32a5d940e req-562b1b2e-3559-47e1-a802-212fbce90e8c service nova] Creating event network-vif-plugged:a45a3e55-f7dd-411f-a861-aee70b8b0613 for instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 on n-h1-860864-8 Oct 12 22:39:38.249155 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4d7bbe97-52ba-4094-afe6-a2b32a5d940e req-562b1b2e-3559-47e1-a802-212fbce90e8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042025 Oct 12 22:39:38.251131 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1115/2085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:38.318491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:38.319208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:38.320229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:38.324442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:38.356729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.358375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.359592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.360264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.362896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.363996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.364616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.365543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.366103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.366607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.367071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.368357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.385583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:38.508429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.521346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.526553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.538534 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d319bd20-f257-422d-b32f-334e82495b3b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.230565 Oct 12 22:39:38.539118 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1116/2086] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:38 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:38.561929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:38.562751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:38.569039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.569776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.571366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.572413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.573147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.573580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.670219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.674437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:38.680372 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3b20717-c5d0-4251-80f7-7fe1126a5675 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1396 microversion: 2.1 time: 0.373393 Oct 12 22:39:38.681591 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 971/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:38 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1396 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:38.708416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.720184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.722408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:38.724295 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5002559b-e643-4822-90b3-c0d78e1abfc7 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 200 len: 1339 microversion: 2.47 time: 0.166356 Oct 12 22:39:38.725596 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1117/2088] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:38 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 1339 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:38.982779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:38.983403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:38.989932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.991595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.992150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:38.992949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:38.993550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:38.994036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.009138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:39.010200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:39.023028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.023721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.024682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.027155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.027991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.029629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.088057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.088903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.089517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.090444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lazy-loading 'fault' on Instance uuid 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:39.183846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.197320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-18b24511-707a-42d6-9d70-a10311ba4aee tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1307 microversion: 2.1 time: 0.192156 Oct 12 22:39:39.213825 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1118/2089] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:39 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:39.286299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.298536 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f9efdc67-571f-4aa9-a484-65b18deda59d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.319897 Oct 12 22:39:39.305318 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 972/2090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:38 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:39:39.466205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Calling method '.version_select at 0x7f44ffb17f70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:39.468276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.469063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.469491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.486236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:39.488976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.489685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.490341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.539686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.542429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.543170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.569510 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79c4225c-8f5d-4043-aea7-cd9fc2e721c1 tempest-PortsAdminExtendedAttrsTestJSON-492046464 tempest-PortsAdminExtendedAttrsTestJSON-492046464-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.307915 Oct 12 22:39:39.570114 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1119/2091] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:39:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:39.570444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:39.571986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:39.590232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.591122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.594943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.595813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.596430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.597133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.635553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-22c31391-faa0-41c8-a321-d33a5590a1eb req-202db1f1-4b9b-4128-a32c-f71f9472235e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee", "name": "network-vif-deleted", "tag": "e00b7c80-471e-4143-b726-931f38e44dfc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:39.657421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-22c31391-faa0-41c8-a321-d33a5590a1eb req-202db1f1-4b9b-4128-a32c-f71f9472235e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.662828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-22c31391-faa0-41c8-a321-d33a5590a1eb req-202db1f1-4b9b-4128-a32c-f71f9472235e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.663471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-22c31391-faa0-41c8-a321-d33a5590a1eb req-202db1f1-4b9b-4128-a32c-f71f9472235e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.692875 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-22c31391-faa0-41c8-a321-d33a5590a1eb req-202db1f1-4b9b-4128-a32c-f71f9472235e service nova] Creating event network-vif-deleted:e00b7c80-471e-4143-b726-931f38e44dfc for instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee on n-h1-860864-8 Oct 12 22:39:39.701910 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-22c31391-faa0-41c8-a321-d33a5590a1eb req-202db1f1-4b9b-4128-a32c-f71f9472235e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070646 Oct 12 22:39:39.703836 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1120/2092] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:39.711562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:39.712935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:39.724769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.726105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.728079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.728748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.732085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.733119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.734184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.734967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.737661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.743867 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c70f236-c019-4487-b538-217bd4b1d819 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.178804 Oct 12 22:39:39.744658 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 973/2093] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:39 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:39.776690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:39.777160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:39.807841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.808569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.809526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.810365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:39.810932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:39.811566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:39.976467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.986714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.988230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:39.994484 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f2ca0dae-c2c2-4c45-9243-34fbd1d19d78 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 200 len: 1360 microversion: 2.47 time: 0.234314 Oct 12 22:39:40.003134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:40.008851 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 974/2094] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:39 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 1360 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:40.022875 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a2ba7deb-22d2-47da-bd99-8ee382746ccc tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1396 microversion: 2.1 time: 0.317503 Oct 12 22:39:40.023079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1704937077"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:40.023446 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1121/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:39 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1396 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:40.026344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:40.034883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.035939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.036574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.037482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.038078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.038641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.224690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:40.225566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:40.235647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.236160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.237140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.237834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.238355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.238685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.356972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.361258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.362742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.363452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lazy-loading 'fault' on Instance uuid 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:40.538040 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-49550dc9-70a8-476e-9cc2-d42b3655062b tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "POST /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d/action" status: 202 len: 52 microversion: 2.47 time: 0.518771 Oct 12 22:39:40.547097 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 975/2096] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:39:40 2022] POST /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d/action => generated 52 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:39:40.567463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:40.569113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:40.575940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.576637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.577310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.578276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.579725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.580540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.592906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c822c44d83fc477387b40ee6dac04468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc4f5adce674ecfa266bc4499a771fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:40.603420 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e11aeb95-c386-46c4-8a65-06c4911dcf7b tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 200 len: 1307 microversion: 2.1 time: 0.383676 Oct 12 22:39:40.615943 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1122/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:40 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:40.616788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:40.618321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:40.636580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.639809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.640291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.641140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.643549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.644025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.705819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:39:40.858198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:40.870987 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b47ebe1b-6711-437d-af3f-0f7bea52ce2a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.329855 Oct 12 22:39:40.871917 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 976/2098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:40 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:40.878595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:40.879473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:40.886813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.888110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.888811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.889692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.895189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3af773a8-c365-4162-a52f-d5d3c2330485 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 204 len: 0 microversion: 2.47 time: 0.285877 Oct 12 22:39:40.897276 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1123/2099] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:39:40 2022] DELETE /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:39:40.898118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.899114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.907520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:40.909297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:40.921397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.922174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.922947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:40.924232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:40.925016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:40.926425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.043239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.059691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.061295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.068651 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca22771c-7f58-44ef-9fcf-4ea972b05b09 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.194247 Oct 12 22:39:41.069293 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 977/2100] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:40 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:41.076239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:41.077225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:41.084265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.085989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.087058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.087659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.088691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.089439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.090271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.099284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.100758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.110819 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d767c68-012e-4546-af05-9921c0d944a1 tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 200 len: 1366 microversion: 2.47 time: 0.200141 Oct 12 22:39:41.111514 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1124/2101] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:40 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:39:41.295741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:41.305231 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0bcec1aa-5c1c-4fe3-8ff0-b5b7923a2fae tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1578 microversion: 2.1 time: 0.233436 Oct 12 22:39:41.305815 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 978/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:41 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:41.331153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:41.332005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:41.339134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.339831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.340517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.341296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.341819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.342386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.611563 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f42ba03a-1677-4014-89a8-54d87dee95a6 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.285104 Oct 12 22:39:41.614025 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1125/2103] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:39:41 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:41.639373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:41.639839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] [instance: 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:41.648897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.649643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.650087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.668477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.669157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.672918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.686251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e99be1ea-8323-435f-b2e8-15cd132a3cc3 req-565b624d-63e5-4ee1-82df-696f172da5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23ffeb9-2df6-4806-a53f-597231c291a0", "name": "network-vif-plugged", "status": "completed", "tag": "1a320b77-fd84-42ca-9ac6-b5a541475a0b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:41.724875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e99be1ea-8323-435f-b2e8-15cd132a3cc3 req-565b624d-63e5-4ee1-82df-696f172da5d6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.728761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e99be1ea-8323-435f-b2e8-15cd132a3cc3 req-565b624d-63e5-4ee1-82df-696f172da5d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.729452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e99be1ea-8323-435f-b2e8-15cd132a3cc3 req-565b624d-63e5-4ee1-82df-696f172da5d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.746327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] HTTP exception thrown: Instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee could not be found. Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Request method failure captured: Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee HTTP/1.1 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0HBydVqfkKRNppg60TnKZ0s-9fIbieX_Biv1QDiLwQpGHsnr45H04XCAGXJ_VgYaTFNx2tHHQWcbZMfwGDBY8dYWvjFJpYtvv-75D2Wko1aWqttpy4WvQ3siRZtA_ZXHXXGCs5pTxkw3Q8_u8Tmr5mgQSjYGDfYvsp_d591e9fqpeU Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 4fc4f5adce674ecfa266bc4499a771fe Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4fc4f5adce674ecfa266bc4499a771fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4fc4f5adce674ecfa266bc4499a771fe"}]}] Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 4fc4f5adce674ecfa266bc4499a771fe Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-318901103 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesOneServerTestJSON-318901103-project Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: c822c44d83fc477387b40ee6dac04468 Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesOneServerTestJSON-318901103-project Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee could not be found. Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee'} Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee could not be found. Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee could not be found. Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:41.754909 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:41.759748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:41.759748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:41.759748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:41.759748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:41.759748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:41.759748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee could not be found. Oct 12 22:39:41.759748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:41.760270 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e99be1ea-8323-435f-b2e8-15cd132a3cc3 req-565b624d-63e5-4ee1-82df-696f172da5d6 service nova] Creating event network-vif-plugged:1a320b77-fd84-42ca-9ac6-b5a541475a0b for instance f23ffeb9-2df6-4806-a53f-597231c291a0 on n-h2-860864-8 Oct 12 22:39:41.762988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] Returning 404 to user: Instance 9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:41.764669 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7ed76e9-83af-4607-bd77-09c2a8e102f9 tempest-ImagesOneServerTestJSON-318901103 tempest-ImagesOneServerTestJSON-318901103-project] 10.222.0.20 "GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee" status: 404 len: 111 microversion: 2.1 time: 0.130061 Oct 12 22:39:41.766059 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 979/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:41 2022] GET /compute/v2.1/servers/9fc6bac5-0c9a-4dd1-ae98-bf8eb30183ee => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:39:41.802002 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e99be1ea-8323-435f-b2e8-15cd132a3cc3 req-565b624d-63e5-4ee1-82df-696f172da5d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105150 Oct 12 22:39:41.805565 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1126/2105] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:41.895094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:41.895716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:41.909551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.910050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.910493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:41.911213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:41.911665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:41.924632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.098203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:42.098904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:42.108698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:42.109183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:42.113387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.114282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:42.114888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:42.115486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.261776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.278244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.285669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.304122 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b814316b-8477-4ecd-b091-f61798e1f153 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.208950 Oct 12 22:39:42.304889 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1127/2106] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:42 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:42.322925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:42.325956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:42.343134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:42.346712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:42.347181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.347938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:42.350038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:42.350483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:42.351714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.363684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d59ded39-347b-49b6-851d-e3f0282059d4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.473229 Oct 12 22:39:42.365093 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 980/2107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:41 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:42.524027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.535926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.538146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:42.540179 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-55dc0f28-7f89-4528-b273-ac9dbb77e2ba tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 200 len: 1366 microversion: 2.47 time: 0.233276 Oct 12 22:39:42.560613 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1128/2108] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:42 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:43.344285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:43.345676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:43.372137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.372925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.373468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.375165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.379105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.379980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.403546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:43.405341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:43.434545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.435395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.437176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.438692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.440815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.441496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.568126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.580527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.583018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.601881 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-82e9f334-6fa2-4b52-ae22-31c49f67f289 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.273167 Oct 12 22:39:43.602716 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 981/2109] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:43 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:43.615346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:43.616550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:43.624755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.625577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.626124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.626910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.627484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.627984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.738521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:43.739109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:43.740315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:43.741518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lazy-loading 'fault' on Instance uuid 0550c1db-4a51-4c34-8e0e-2ab13d4f246d {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:39:43.854573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.865210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.870511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ce914189e9b4ae6aa27ca19676017b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd416377a120d4e5ba278dd6b9b3f6fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.872587 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71323191-bf14-4d5a-b7ae-f079e6de238f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 200 len: 1371 microversion: 2.47 time: 0.265592 Oct 12 22:39:43.874183 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 982/2110] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:43 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:43.933480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:43.945910 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d847e0d-b23f-4562-b74c-3f7275afdba4 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1308 microversion: 2.1 time: 0.562470 Oct 12 22:39:43.947167 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1129/2111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:43 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:44.504074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:44.504749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:44.512530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-264c572d-96e0-47b1-a88e-652eaf3261c2 req-f5d533a7-b068-4e50-ad55-59bccd469698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb49ed2-f013-4b9c-ae4f-8d4137be1290", "tag": "a45a3e55-f7dd-411f-a861-aee70b8b0613"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:44.535505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.538307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-264c572d-96e0-47b1-a88e-652eaf3261c2 req-f5d533a7-b068-4e50-ad55-59bccd469698 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.538530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.539838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.542049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.543325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.543590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-264c572d-96e0-47b1-a88e-652eaf3261c2 req-f5d533a7-b068-4e50-ad55-59bccd469698 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.544286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-264c572d-96e0-47b1-a88e-652eaf3261c2 req-f5d533a7-b068-4e50-ad55-59bccd469698 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.544923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.582326 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-264c572d-96e0-47b1-a88e-652eaf3261c2 req-f5d533a7-b068-4e50-ad55-59bccd469698 service nova] Creating event network-changed:a45a3e55-f7dd-411f-a861-aee70b8b0613 for instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 on n-h1-860864-8 Oct 12 22:39:44.600779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-264c572d-96e0-47b1-a88e-652eaf3261c2 req-f5d533a7-b068-4e50-ad55-59bccd469698 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089229 Oct 12 22:39:44.602206 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1130/2112] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:44.638378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:44.640676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:44.659546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.660060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.660701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.661643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.662489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.663140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.779592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:44.795735 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76ddcf5d-242e-4c92-8600-1ac7dc7db977 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1578 microversion: 2.1 time: 0.295546 Oct 12 22:39:44.798401 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 983/2113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:44 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1578 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:44.830621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:44.839415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:44.840885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:44.853630 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38ebd251-78b3-417c-bd71-de6361741b29 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.220461 Oct 12 22:39:44.867920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1131/2114] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:44 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:44.898797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:44.899415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] [instance: 0550c1db-4a51-4c34-8e0e-2ab13d4f246d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:44.907875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.908400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.911664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.912553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.915130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.915736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.948826 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] HTTP exception thrown: Instance 0550c1db-4a51-4c34-8e0e-2ab13d4f246d could not be found. Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Request method failure captured: Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d HTTP/1.1 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Im9Jr2nRcTWnNx3nGaCRQMsPIFbk6NUneu1R1-zxtCK_mxWeDpI9RCuz26jlU7cBFfWKkDq5yjy3omwKYPdHwv0MK-Jf_3EVXFueqzBXqmlCnHaTXb29Vw_OaifH9c7Mqm-opKkWkFLXyMdHof026cBrh5zlrZc3Ls74L7f7mkTBM Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d416377a120d4e5ba278dd6b9b3f6fb8 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAaction247Test-637653363 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d416377a120d4e5ba278dd6b9b3f6fb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d416377a120d4e5ba278dd6b9b3f6fb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d416377a120d4e5ba278dd6b9b3f6fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d416377a120d4e5ba278dd6b9b3f6fb8"}]}] Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAaction247Test-637653363 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d416377a120d4e5ba278dd6b9b3f6fb8 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAaction247Test-637653363 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAaction247Test-637653363-project Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5ce914189e9b4ae6aa27ca19676017b4 Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAaction247Test-637653363-project Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 0550c1db-4a51-4c34-8e0e-2ab13d4f246d could not be found. Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '0550c1db-4a51-4c34-8e0e-2ab13d4f246d'} Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0550c1db-4a51-4c34-8e0e-2ab13d4f246d could not be found. Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0550c1db-4a51-4c34-8e0e-2ab13d4f246d could not be found. Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:44.950523 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0550c1db-4a51-4c34-8e0e-2ab13d4f246d could not be found. Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] Returning 404 to user: Instance 0550c1db-4a51-4c34-8e0e-2ab13d4f246d could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e48eaaaf-c404-48a9-9f5c-fb3eee73613f tempest-ServersAaction247Test-637653363 tempest-ServersAaction247Test-637653363-project] 10.222.0.20 "GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d" status: 404 len: 111 microversion: 2.47 time: 0.057174 Oct 12 22:39:44.954868 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1132/2115] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:44 2022] GET /compute/v2.1/servers/0550c1db-4a51-4c34-8e0e-2ab13d4f246d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:39:44.968784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fec3daa1-3967-420d-9424-f06de512203b tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Action: 'create', calling method: .version_select at 0x7f44ff4b0160>, body: {"keypair": {"name": "tempest-keypair-263965057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv8XNqllpVFHM+HiiKg66/FYIVP7ZEffPdpd8qIy41A7Hv9801QCm//BUpVGUes1kdC9ipKXHO9lTl9yzm9OhnZooVng70I5XeGqLaUOhQkbXPWpXVF3CCKvpeFkHEinA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:44.980142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:44.982534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:44.995242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:44.995456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:44.997721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:44.998633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:45.000505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:45.001107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:45.010175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fec3daa1-3967-420d-9424-f06de512203b tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:45.019019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fec3daa1-3967-420d-9424-f06de512203b tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for user d71d1f9a62cd48aa8ffa1c7d218c5ea4 and project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:45.042409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:45.057107 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fec3daa1-3967-420d-9424-f06de512203b tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256604 Oct 12 22:39:45.058427 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 984/2116] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:45.080474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a22ee63-1f8e-431f-8a83-bc8aacf7c59e tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff462430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.103597 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a22ee63-1f8e-431f-8a83-bc8aacf7c59e tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-263965057" status: 200 len: 497 microversion: 2.1 time: 0.036541 Oct 12 22:39:45.106461 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 985/2117] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 12 22:39:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-263965057 => generated 497 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:45.125479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3c1f164-5d71-4d43-9e38-5e913ff8f712 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff453940>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.163810 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3c1f164-5d71-4d43-9e38-5e913ff8f712 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-263965057" status: 202 len: 0 microversion: 2.1 time: 0.047938 Oct 12 22:39:45.171606 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 986/2118] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 22:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-263965057 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:39:45.182079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-def6730a-eb6f-4474-aac3-52c6fa0a7cca tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Action: 'create', calling method: .version_select at 0x7f44ff453790>, body: {"keypair": {"name": "tempest-keypair-972593419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbR7OGFK19qYP7P2dl4W2zqO05a7e5JO44GTgm1pmVwoK1Th6jWt4kHEs0OJiaTnx0c5ZYWmSAiWDcw30tiMmN3HLglclPUwyH25bFQagCnnOHMINz8A7LXJo4NaJuOw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:45.206383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-def6730a-eb6f-4474-aac3-52c6fa0a7cca tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:45.213157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-def6730a-eb6f-4474-aac3-52c6fa0a7cca tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for user d71d1f9a62cd48aa8ffa1c7d218c5ea4 and project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:45.250063 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-def6730a-eb6f-4474-aac3-52c6fa0a7cca tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076397 Oct 12 22:39:45.252281 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 987/2119] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:45.263525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8acba1eb-f525-44c5-bd6a-4dd8ab584028 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff57cca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.288799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8acba1eb-f525-44c5-bd6a-4dd8ab584028 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-972593419" status: 202 len: 0 microversion: 2.1 time: 0.029193 Oct 12 22:39:45.289842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 988/2120] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 22:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-972593419 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:39:45.298704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:45.310371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01e3b207-21f3-4503-a933-ce0eac140c21 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Action: 'create', calling method: .version_select at 0x7f44ff4bb940>, body: {"keypair": {"name": "tempest-keypair-1886578082", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:45.356118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-01e3b207-21f3-4503-a933-ce0eac140c21 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:45.371326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-01e3b207-21f3-4503-a933-ce0eac140c21 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for user d71d1f9a62cd48aa8ffa1c7d218c5ea4 and project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:45.429754 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01e3b207-21f3-4503-a933-ce0eac140c21 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.134208 Oct 12 22:39:45.439015 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 989/2121] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:45 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:45.445034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5255c5d-0877-4b9a-8756-9ebdcc6f2b52 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff4553a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.469627 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5255c5d-0877-4b9a-8756-9ebdcc6f2b52 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886578082" status: 202 len: 0 microversion: 2.1 time: 0.028751 Oct 12 22:39:45.473016 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 990/2122] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886578082 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:39:45.489907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78aad007-710b-45fd-84a5-3fb3faccee20 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Action: 'create', calling method: .version_select at 0x7f44ff4bb040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-870139447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC+LYAdHCIQ7E2cwAT/nmCmYKWOYkgrLqNf8tTV8Ot1NuEi3UBqGN33zwlEJq+NAFOiFJazsMwZwYcRo5iQIu2CuOqDXSjehZrEbrm/SDyUsiSBMDw22bWOzoqLGLT2cw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:45.521346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-78aad007-710b-45fd-84a5-3fb3faccee20 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:45.534627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-78aad007-710b-45fd-84a5-3fb3faccee20 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for user d71d1f9a62cd48aa8ffa1c7d218c5ea4 and project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:45.540851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:45.580806 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78aad007-710b-45fd-84a5-3fb3faccee20 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.099097 Oct 12 22:39:45.580806 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 991/2123] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:39:45.594588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec7f3b30-e0a7-44cd-a1cd-0e9197c9904d tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Action: 'create', calling method: .version_select at 0x7f44ff4bb1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-531864240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfUO/RzQlzRkwQiHglSsYQTWVwnksnKzjr7PieO6tRQyyNDHBD6HjgjJ0jl2ftOlnshszmUf9RcSr1Qr4XBdyOOlK+1uUr1wDxVDihEmrnRfAnbL2ZHgN7ggmgnzQBSjg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:45.614298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ec7f3b30-e0a7-44cd-a1cd-0e9197c9904d tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:45.622609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ec7f3b30-e0a7-44cd-a1cd-0e9197c9904d tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for user d71d1f9a62cd48aa8ffa1c7d218c5ea4 and project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:45.657663 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec7f3b30-e0a7-44cd-a1cd-0e9197c9904d tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.067908 Oct 12 22:39:45.659258 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 992/2124] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:45.677543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f0db1fd3-2acd-479f-8df6-f28bcab11626 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Action: 'create', calling method: .version_select at 0x7f44ff4b4ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1270732638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7yyeIkEUdmiVuwal1X2t0mqIb5VlRIy29S4tbiG6qc8ZY9hZmrBzr97hQETEX89dzk6j1boKai3vqcKY7u2Qpck3+T5WeJT6MRhhhOQUbese+ZgY6WjfQ5dvsc0dLEEw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:45.695335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-f0db1fd3-2acd-479f-8df6-f28bcab11626 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:45.699586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:45.701858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-f0db1fd3-2acd-479f-8df6-f28bcab11626 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Getting quotas for user d71d1f9a62cd48aa8ffa1c7d218c5ea4 and project 4f5d105c570b4441af20e23c976616a5. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:45.708051 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10f17392-4186-4169-8ea2-5a57e171b7d9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 200 len: 1488 microversion: 2.1 time: 0.739029 Oct 12 22:39:45.708620 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1133/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:39:44 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 1488 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:45.731953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1450012093"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:45.734819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:45.743590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:45.744404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:45.745060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:45.746250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:45.747740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:45.747740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:45.764381 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f0db1fd3-2acd-479f-8df6-f28bcab11626 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.091134 Oct 12 22:39:45.770569 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 993/2126] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:39:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:39:45.775746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1133da4-4eb3-43ca-a679-43321946b070 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff453310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.779754 n-d-860864-8 devstack@n-api.service[120543]: WARNING oslo_db.sqlalchemy.utils [None req-c1133da4-4eb3-43ca-a679-43321946b070 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:39:45.788245 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c1133da4-4eb3-43ca-a679-43321946b070 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.016516 Oct 12 22:39:45.795020 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 994/2127] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:39:45 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:45.800500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a7140f4-1c32-4774-b96f-14069ac2630b tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff4bbb80>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.815068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:45.831204 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a7140f4-1c32-4774-b96f-14069ac2630b tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1270732638" status: 202 len: 0 microversion: 2.1 time: 0.034766 Oct 12 22:39:45.837464 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 995/2128] 10.222.0.20 () {58 vars in 1278 bytes} [Wed Oct 12 22:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1270732638 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:39:45.843106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11dcb275-c3cd-4397-bade-0f17d11eb35f tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff4bb3a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.872397 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-11dcb275-c3cd-4397-bade-0f17d11eb35f tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-531864240" status: 202 len: 0 microversion: 2.1 time: 0.033315 Oct 12 22:39:45.878857 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 996/2129] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-531864240 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:39:45.885311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98dfc2fa-584e-4db2-af4b-6f6fa0f38c47 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] Calling method '.version_select at 0x7f44ff4b41f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.911360 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98dfc2fa-584e-4db2-af4b-6f6fa0f38c47 tempest-KeyPairsV2TestJSON-406410286 tempest-KeyPairsV2TestJSON-406410286-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-870139447" status: 202 len: 0 microversion: 2.1 time: 0.031227 Oct 12 22:39:45.918159 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 997/2130] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-870139447 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:39:45.925732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:45.926552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:45.939685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:45.940278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:45.940780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:45.941611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:45.942123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:45.942610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:46.148797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:46.157864 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-07a81586-c425-401f-a219-64b6cf7a6207 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0/action" status: 202 len: 0 microversion: 2.1 time: 0.430672 Oct 12 22:39:46.158327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:46.165973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:46.176922 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1134/2131] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:39:45 2022] POST /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:39:46.178842 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21deb166-78cc-4687-a40d-2c37077115ae tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.259243 Oct 12 22:39:46.186588 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 998/2132] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:45 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:46.187309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9366cc6a-64af-4364-a270-aeb73fb9ae8b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff434160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:46.267433 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9366cc6a-64af-4364-a270-aeb73fb9ae8b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.086768 Oct 12 22:39:46.284783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1135/2133] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:46 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:47.210564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:47.211947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:47.223063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:47.224489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:47.227254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:47.229781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:47.230326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:47.231974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:47.289218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac2c7312-5c23-4479-b07f-f2be9b48f9e7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffcab430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:47.379494 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac2c7312-5c23-4479-b07f-f2be9b48f9e7 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.095764 Oct 12 22:39:47.381965 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1136/2134] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:47 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:47.415595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:47.429951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:47.432819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:47.438635 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b939544c-d85d-476e-817b-b2897a047fb2 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.231918 Oct 12 22:39:47.440463 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 999/2135] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:47 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:48.403458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7088f4fe-c2cf-4a1d-a6e9-7b81f2043094 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff761310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:48.467474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:48.468189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:48.470973 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7088f4fe-c2cf-4a1d-a6e9-7b81f2043094 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.078521 Oct 12 22:39:48.472116 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1137/2136] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:48 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:48.485070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.485674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.486115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.487361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:48.487933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:48.488442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:48.606823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:48.620434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:48.625086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:48.643727 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79a61e4b-97b3-492b-965d-db9f7e47dd58 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.179500 Oct 12 22:39:48.645704 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1000/2137] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:48 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:49.489508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c4cc2c6-9b09-4d69-9095-7a48cdaf445f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff57a1f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:49.613461 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c4cc2c6-9b09-4d69-9095-7a48cdaf445f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.130721 Oct 12 22:39:49.614975 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1138/2138] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:49 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:49.677210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:49.677969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:49.689225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:49.690139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:49.692844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:49.694012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:49.695243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:49.695923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:49.735669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:50.063474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:50.075766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:50.081464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:50.097610 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e0a814eb-0c08-4030-b31c-c9c178b55c4d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.426776 Oct 12 22:39:50.114995 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1001/2139] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:49 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:50.631693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3bb281d-6bfa-463c-b82f-ef5ebc8eb914 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffe2f280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:50.709241 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f3bb281d-6bfa-463c-b82f-ef5ebc8eb914 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.083978 Oct 12 22:39:50.718932 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1139/2140] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:50 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:51.129791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:51.130307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:51.143104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.148967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.149528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.150731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.151206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.151637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.410378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:51.425014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:51.427245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:51.452486 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ffc3ff8-02c6-4c8d-a51a-86187b48b179 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.327147 Oct 12 22:39:51.453091 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1002/2141] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:51 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:51.726783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2580fd5-9ab7-4e67-9311-3c52e8efb4cf tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ffcabf70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:51.819447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2580fd5-9ab7-4e67-9311-3c52e8efb4cf tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.097718 Oct 12 22:39:51.829241 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1140/2142] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:51 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:51.833152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-77cb0a24-8734-4803-9801-5e1b968ce768 req-bff8fc30-fc32-4bc2-9d06-b4b9eb4650cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23ffeb9-2df6-4806-a53f-597231c291a0", "name": "network-vif-plugged", "status": "completed", "tag": "1a320b77-fd84-42ca-9ac6-b5a541475a0b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:51.872631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-77cb0a24-8734-4803-9801-5e1b968ce768 req-bff8fc30-fc32-4bc2-9d06-b4b9eb4650cb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:51.873106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-77cb0a24-8734-4803-9801-5e1b968ce768 req-bff8fc30-fc32-4bc2-9d06-b4b9eb4650cb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:51.873534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-77cb0a24-8734-4803-9801-5e1b968ce768 req-bff8fc30-fc32-4bc2-9d06-b4b9eb4650cb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:51.941106 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-77cb0a24-8734-4803-9801-5e1b968ce768 req-bff8fc30-fc32-4bc2-9d06-b4b9eb4650cb service nova] Creating event network-vif-plugged:1a320b77-fd84-42ca-9ac6-b5a541475a0b for instance f23ffeb9-2df6-4806-a53f-597231c291a0 on n-h2-860864-8 Oct 12 22:39:51.969468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-77cb0a24-8734-4803-9801-5e1b968ce768 req-bff8fc30-fc32-4bc2-9d06-b4b9eb4650cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135272 Oct 12 22:39:51.974006 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1003/2143] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:39:52.488715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:52.489468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:52.501475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:52.504655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:52.506371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:52.508318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:52.509246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:52.510229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:52.784788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:52.814475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:52.816939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:52.825447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc5c14ad-d155-4241-bbb2-9d2ca1d03528 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.342533 Oct 12 22:39:52.845528 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1141/2144] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:52 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:52.848657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80fe3242-ca23-400e-b074-f0b00bb49c42 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff496700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:52.929988 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80fe3242-ca23-400e-b074-f0b00bb49c42 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.096735 Oct 12 22:39:52.930949 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1004/2145] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:52 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:53.871935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:53.872528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:53.889778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:53.890517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:53.893032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:53.893950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:53.894554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:53.897223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:53.949426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7e4b4f7-9000-4d1b-b8b5-3ff28e064d93 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff468dc0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:54.020917 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7e4b4f7-9000-4d1b-b8b5-3ff28e064d93 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.077205 Oct 12 22:39:54.022328 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1005/2146] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:53 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:54.162485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:54.174807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:54.180215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:54.197330 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40381317-5100-4b32-bde8-d9eaa4af75d9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1558 microversion: 2.91 time: 0.329495 Oct 12 22:39:54.197923 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1142/2147] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:53 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1558 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:55.038518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d98f4ca-d841-402b-8878-ed2c6f62009e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4550d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:55.113296 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d98f4ca-d841-402b-8878-ed2c6f62009e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 0.079435 Oct 12 22:39:55.114163 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1006/2148] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:55 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:39:55.225592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:55.226405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:55.248801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:55.250347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:55.256380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:55.257452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:55.261467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:55.262701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:55.514880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:55.535478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:55.543332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:55.565534 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5dd44e79-0c99-474a-942f-9aa7b94c5b94 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1558 microversion: 2.91 time: 0.344010 Oct 12 22:39:55.566386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1143/2149] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:55 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1558 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:56.027293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=24 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:56.129677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-804f97fb-d76f-4a2a-ae31-68b863eb5836 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff434790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:56.406891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6245c12c-9223-465e-9598-e8b53578a08e tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Action: 'create', calling method: .version_select at 0x7f44ff4bb5e0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:39:56.436172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6245c12c-9223-465e-9598-e8b53578a08e tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Getting quotas for project 9be6f5f595dc478889430c817828614f. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:56.457693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6245c12c-9223-465e-9598-e8b53578a08e tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Getting quotas for user 6776a3b1378f4fed97753ad9cefbce28 and project 9be6f5f595dc478889430c817828614f. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:56.586578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6245c12c-9223-465e-9598-e8b53578a08e tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Getting quotas for project 9be6f5f595dc478889430c817828614f. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:39:56.602498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6245c12c-9223-465e-9598-e8b53578a08e tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Getting quotas for user 6776a3b1378f4fed97753ad9cefbce28 and project 9be6f5f595dc478889430c817828614f. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:39:56.626839 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6245c12c-9223-465e-9598-e8b53578a08e tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.600472 Oct 12 22:39:56.633834 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1007/2150] 10.222.0.20 () {62 vars in 1214 bytes} [Wed Oct 12 22:39:56 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:39:56.641483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:56.642692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:56.657670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:56.661843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:56.662589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:56.663536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:56.665467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:56.666149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:56.997012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:57.011641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:57.033025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:57.055658 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-894d2321-b4a5-4044-9949-958112ec1485 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.420302 Oct 12 22:39:57.076308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1008/2151] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:56 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:57.106986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1bc0793a-337a-474b-a5d0-7049c6167ea3 tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:57.181228 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1bc0793a-337a-474b-a5d0-7049c6167ea3 tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.112406 Oct 12 22:39:57.190600 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1009/2152] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 12 22:39:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:39:57.223089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41c6918d-1415-4d56-96f8-1286b4449fd0 tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:57.293017 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41c6918d-1415-4d56-96f8-1286b4449fd0 tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/005c7701-d530-4a9c-9e69-759bb603a0df" status: 200 len: 235 microversion: 2.64 time: 0.094776 Oct 12 22:39:57.294267 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1010/2153] 10.222.0.20 () {60 vars in 1304 bytes} [Wed Oct 12 22:39:57 2022] GET /compute/v2.1/os-server-groups/005c7701-d530-4a9c-9e69-759bb603a0df => generated 235 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 22:39:57.307838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d520191-8d69-481d-a55c-4586c801d3a6 tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:57.310291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:39:57.399228 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d520191-8d69-481d-a55c-4586c801d3a6 tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/005c7701-d530-4a9c-9e69-759bb603a0df" status: 204 len: 0 microversion: 2.64 time: 0.095773 Oct 12 22:39:57.406646 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1011/2154] 10.222.0.20 () {60 vars in 1307 bytes} [Wed Oct 12 22:39:57 2022] DELETE /compute/v2.1/os-server-groups/005c7701-d530-4a9c-9e69-759bb603a0df => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:39:57.413305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-172086fb-7a3e-4291-86b1-07b744dc062a tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:57.424885 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-172086fb-7a3e-4291-86b1-07b744dc062a tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] HTTP exception thrown: Instance group 005c7701-d530-4a9c-9e69-759bb603a0df could not be found. Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-172086fb-7a3e-4291-86b1-07b744dc062a tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Request method failure captured: Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-server-groups/005c7701-d530-4a9c-9e69-759bb603a0df HTTP/1.1 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0I7kbV5fATFdxPX0BaNWDT0ft1u9bRpRw261avwV740Iy1dCuNXeSceedRa16fmYSzeVumVjs3-paS9VMqPxpL9ZIS4YqLpDcRM2aOZT6nlW0HN__meUYxiBbwM6CtXPV_ptAOCv3gFPXNkwQxKQRlguJ0O0pCI5oQ2ddFOENN30EM Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.64 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 9be6f5f595dc478889430c817828614f Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerGroup264TestJSON-50686590 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9be6f5f595dc478889430c817828614f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9be6f5f595dc478889430c817828614f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9be6f5f595dc478889430c817828614f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9be6f5f595dc478889430c817828614f"}]}] Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerGroup264TestJSON-50686590 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 9be6f5f595dc478889430c817828614f Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerGroup264TestJSON-50686590 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerGroup264TestJSON-50686590-project Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6776a3b1378f4fed97753ad9cefbce28 Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerGroup264TestJSON-50686590-project Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance group 005c7701-d530-4a9c-9e69-759bb603a0df could not be found. Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '005c7701-d530-4a9c-9e69-759bb603a0df'} Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 005c7701-d530-4a9c-9e69-759bb603a0df could not be found. Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 005c7701-d530-4a9c-9e69-759bb603a0df could not be found. Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:57.434542 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:39:57.439083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:39:57.439083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:39:57.439083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:39:57.439083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:39:57.439083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 005c7701-d530-4a9c-9e69-759bb603a0df could not be found. Oct 12 22:39:57.439083 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:39:57.441760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-172086fb-7a3e-4291-86b1-07b744dc062a tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] Returning 404 to user: Instance group 005c7701-d530-4a9c-9e69-759bb603a0df could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:39:57.443379 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-172086fb-7a3e-4291-86b1-07b744dc062a tempest-ServerGroup264TestJSON-50686590 tempest-ServerGroup264TestJSON-50686590-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/005c7701-d530-4a9c-9e69-759bb603a0df" status: 404 len: 117 microversion: 2.64 time: 0.035002 Oct 12 22:39:57.462099 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1012/2155] 10.222.0.20 () {60 vars in 1307 bytes} [Wed Oct 12 22:39:57 2022] DELETE /compute/v2.1/os-server-groups/005c7701-d530-4a9c-9e69-759bb603a0df => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:39:58.092259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:58.093157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:58.120614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:58.121482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:58.122122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:58.125339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:58.125984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:58.126573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:58.832321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:58.845837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:58.847857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:39:58.865961 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7db1135-1603-452b-a5d7-37f58dcc9754 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.781024 Oct 12 22:39:58.866555 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1013/2156] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:58 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:39:59.898790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:39:59.899503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:39:59.921722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.922221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.922660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:39:59.923377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:39:59.923825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:39:59.924833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:00.724283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:00.733406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:00.749341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:00.765986 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c10cdb9-8abd-49a5-8c97-baa870d54e1b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.871156 Oct 12 22:40:00.790825 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1014/2157] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:39:59 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:01.798358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:01.800504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:01.817245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:01.821500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:01.822192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:01.825480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:01.829740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:01.830219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:02.300391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:02.323822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:02.332415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:02.347006 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2333c436-a33d-4d1a-92ef-98b19c42fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.551409 Oct 12 22:40:02.349214 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1015/2158] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:01 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:03.381101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:03.381878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:03.399875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:03.399875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:03.399875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:03.399875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:03.409603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:03.410352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:03.901197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:03.916495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:03.930277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:03.966793 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aa2cd450-2728-4d5f-8368-f130adaecf5c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.589586 Oct 12 22:40:03.971697 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1016/2159] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:03 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:05.001057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:05.001730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:05.033221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:05.033788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:05.034235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.034945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:05.043471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:05.045514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:05.388392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:05.406159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:05.447026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:05.478569 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a986105-6f98-44c6-bcf6-c1aae6bf3067 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.481861 Oct 12 22:40:05.479468 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1017/2160] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:04 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:40:05.519250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:05.548100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:06.509788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:06.511122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:06.533522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.534235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.534715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.539483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:06.540002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:06.540456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:06.632031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:06.927799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:06.942861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:06.952816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:06.968398 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3de0e9c7-15d1-42c4-bfbb-cb0e74ba7452 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.462725 Oct 12 22:40:06.969011 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1018/2161] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:06 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:08.005933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:08.006722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:08.025880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.031779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.032615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:08.034128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:08.037481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:08.042262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:08.428839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:08.452138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:08.459062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:08.487689 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89a73c77-8ee4-4d0d-b9a4-115400f4875e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.477706 Oct 12 22:40:08.488606 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1019/2162] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:07 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:40:09.522675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:09.524148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:09.542482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:09.552755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:09.553619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:09.561792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:09.562638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:09.564743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:10.004216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:10.013881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:10.042304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:10.074362 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8195b01a-b15c-4b01-b6e6-9bc228dd2e0c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.555392 Oct 12 22:40:10.086157 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1020/2163] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:09 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:40:11.111643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:11.113109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:11.123545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:11.125273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:11.127315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:11.128554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:11.130723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:11.132647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:11.274331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:11.292096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:11.294651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:11.331535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c0c1f5ce-b2f9-4469-8b4b-45e1e3fd5ea6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.223934 Oct 12 22:40:11.337984 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1021/2164] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:11 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:12.370738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:12.372360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:12.384867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:12.389312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:12.389961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:12.393696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:12.394331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:12.397627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:12.627086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:12.653710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:12.661908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:12.696629 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5abdfb9e-f05c-4798-8b61-dee3301b9e04 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.326185 Oct 12 22:40:12.702017 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1022/2165] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:12 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:13.423993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-831c2887-777c-430a-a573-68ad0e1f5b46 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Action: 'create', calling method: .version_select at 0x7f44ff3d9f70>, body: {"keypair": {"name": "tempest-keypair-934515603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItRN1X0qBow8bAZaqwAVVRGzHilJNjZteU+jEXXekvLVo6vyGJfx6ZIyiZ8k+2/5Jr+PU6UgFk5TtxNn9E5RwMBzyc2+uPxO646LNVRWLspUb/gyKz8UsedblZUe7jn3Q=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:13.483648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-831c2887-777c-430a-a573-68ad0e1f5b46 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Getting quotas for project 0eedb6331b634a7199cdd877e847c6db. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:13.510740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-831c2887-777c-430a-a573-68ad0e1f5b46 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Getting quotas for user 6857ea19a8194e5680b1b376dcdbcb30 and project 0eedb6331b634a7199cdd877e847c6db. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:13.599134 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-831c2887-777c-430a-a573-68ad0e1f5b46 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.756124 Oct 12 22:40:13.600092 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1023/2166] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:40:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:13.731067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1712195304", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:14.848489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-804f97fb-d76f-4a2a-ae31-68b863eb5836 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1412 microversion: 2.1 time: 18.722506 Oct 12 22:40:14.849666 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1144/2167] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:39:56 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1412 bytes in 18724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:14.854382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:14.854998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:14.893634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.896406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.897847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.899191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:14.903060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:14.904615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:14.940423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:40:15.254238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:15.274579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:15.277922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:15.294188 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9111357-7a7b-4513-aef2-5897b0fa8209 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.443435 Oct 12 22:40:15.296828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1145/2168] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:14 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:15.499973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:40:15.500404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:40:15.500886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:40:15.501296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:40:15.501709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:40:15.518922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.519414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.519850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.520609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:15.521063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:15.521490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:15.588960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:15.612870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for user 70dbe0c8a7784391a83066cb1cb74604 and project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:15.657794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:40:15.660761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:40:15.781634 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca5307cf-8829-4ae1-b465-964e43c6319d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.180164 Oct 12 22:40:15.782568 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1024/2169] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:40:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:40:15.793939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc80bd72-493f-4dfe-a668-937a2fefcefe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:15.795034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc80bd72-493f-4dfe-a668-937a2fefcefe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:15.864031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30949175-94cf-4eb9-925d-02e4f385e880 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff3e5940>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:15.925622 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30949175-94cf-4eb9-925d-02e4f385e880 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1421 microversion: 2.1 time: 0.065510 Oct 12 22:40:15.927363 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1025/2170] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:40:15 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1421 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:15.941493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-165b00cb-ba48-48aa-ad16-aae324858c40 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff3e5d30>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:15.995466 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-165b00cb-ba48-48aa-ad16-aae324858c40 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 200 len: 1421 microversion: 2.1 time: 0.058254 Oct 12 22:40:15.996683 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1026/2171] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:40:15 2022] GET /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 1421 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:16.137882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1337895261", "imageRef": "cbbbe05b-b730-4be2-a1af-664e5eebd8ad", "flavorRef": "452", "networks": [{"uuid": "25f09190-2cdc-41b9-9952-f833573da6b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:16.217045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc80bd72-493f-4dfe-a668-937a2fefcefe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:16.219622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] validate_networks() for [('25f09190-2cdc-41b9-9952-f833573da6b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:40:16.226581 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc80bd72-493f-4dfe-a668-937a2fefcefe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1213 microversion: 2.1 time: 0.436421 Oct 12 22:40:16.228048 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1146/2172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:15 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1213 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:16.329702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:16.330974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:16.350611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.351411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.354689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:16.356903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:16.359668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:16.360388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.208639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:40:17.209541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:40:17.210190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:40:17.210748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:40:17.211445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:40:17.225811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.226303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.232177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.233101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.233590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.234029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.288440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:17.305820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:17.312797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:17.314518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:17.314701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for user 080644f7502346ed8ff64a026ac9d15b and project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:17.331362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:40:17.333708 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bf962340-ac7b-4587-8d25-8fe6139bf52e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 1.009048 Oct 12 22:40:17.334184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cbbbe05b-b730-4be2-a1af-664e5eebd8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:40:17.349725 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1147/2173] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:16 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:17.349725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:17.349725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:17.376196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.377004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.377488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.380197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:17.380669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:17.381103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:17.513466 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a31ae61-618f-43fb-b23e-938fb6478067 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380165 Oct 12 22:40:17.514126 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1027/2174] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:40:17.526830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c33b7067-4d12-4016-b251-e7d9b854042c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:17.562114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c33b7067-4d12-4016-b251-e7d9b854042c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:17.773997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:17.792397 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2bf77497-44c0-46e3-8aab-fc6209724615 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1265 microversion: 2.1 time: 0.454940 Oct 12 22:40:17.793182 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1148/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:17 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1265 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:17.819405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c33b7067-4d12-4016-b251-e7d9b854042c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:17.836798 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c33b7067-4d12-4016-b251-e7d9b854042c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1208 microversion: 2.1 time: 0.311052 Oct 12 22:40:17.837438 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1028/2176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:17 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1208 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:18.283384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:18.301587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.305785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Searching by: {'deleted': False, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:40:18.339799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.343693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.344479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.351291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.352676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.356453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.366101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:18.366834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:18.375289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.375784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.376279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.376973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.377964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.382595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.461778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:40:18.556065 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-43b25d00-00a0-484a-8f71-c3bca34baf31 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.282539 Oct 12 22:40:18.577929 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1149/2177] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:40:18 2022] GET /compute/v2.1/servers => generated 334 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:18.592245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:18.616863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.620412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Searching by: {'deleted': False, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:40:18.646786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.651297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.655414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.660965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.665441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.668119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.747029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.765641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.771387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:40:18.772313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:18.782309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:18.811355 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04a0a9f5-ca7b-4aec-aef5-c972524480fd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.448976 Oct 12 22:40:18.817799 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1029/2178] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:18 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:18.842227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:18.844414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:18.881408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.889496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.890211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:18.891179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:18.895125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:18.895769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.042031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:19.060921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.061270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.061556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.118209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:19.133296 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b9980444-6785-4fa5-a9a2-7d0beef87bca tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1271 microversion: 2.1 time: 0.311894 Oct 12 22:40:19.140437 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1030/2179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:18 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1271 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:19.161060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:19.162872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:19.197357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.197852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.198993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.199717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.200269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.200872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.444816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:19.464183 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-de3c15c0-ba03-4e2b-aae5-079c0971205d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1260 microversion: 2.1 time: 0.321804 Oct 12 22:40:19.478501 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1031/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:19 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1260 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:19.848408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:19.849225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:19.867230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.867858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.868665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.869508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:19.870034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:19.870529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:19.888356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:20.041275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a15b1f2c-90d9-4275-bfb8-5b51d5a7f549 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 1.461827 Oct 12 22:40:20.042339 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1150/2181] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:40:18 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:20.070507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0168cb72-8a20-4ca9-9e04-e247ffc25679 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.078627 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0168cb72-8a20-4ca9-9e04-e247ffc25679 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011919 Oct 12 22:40:20.092819 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1151/2182] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:40:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:20.159995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.167289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.168629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:20.178608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.179448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.180133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.181048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.181699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.182083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.182602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.190241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.224576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6f79288-d134-4316-adae-9280fc09b184 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.379460 Oct 12 22:40:20.237380 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1032/2183] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:19 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:20.317662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-39a0ca59-dadb-4b7d-8ee6-a4300742d127 req-68c9b1cf-6214-49be-bb3c-d7272d59e874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23ffeb9-2df6-4806-a53f-597231c291a0", "name": "network-vif-unplugged", "status": "completed", "tag": "1a320b77-fd84-42ca-9ac6-b5a541475a0b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:20.366483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-39a0ca59-dadb-4b7d-8ee6-a4300742d127 req-68c9b1cf-6214-49be-bb3c-d7272d59e874 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.367530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-39a0ca59-dadb-4b7d-8ee6-a4300742d127 req-68c9b1cf-6214-49be-bb3c-d7272d59e874 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.368278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-39a0ca59-dadb-4b7d-8ee6-a4300742d127 req-68c9b1cf-6214-49be-bb3c-d7272d59e874 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.410309 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-39a0ca59-dadb-4b7d-8ee6-a4300742d127 req-68c9b1cf-6214-49be-bb3c-d7272d59e874 service nova] Creating event network-vif-unplugged:1a320b77-fd84-42ca-9ac6-b5a541475a0b for instance f23ffeb9-2df6-4806-a53f-597231c291a0 on n-h2-860864-8 Oct 12 22:40:20.421244 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-39a0ca59-dadb-4b7d-8ee6-a4300742d127 req-68c9b1cf-6214-49be-bb3c-d7272d59e874 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108944 Oct 12 22:40:20.422487 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1033/2184] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:40:20.435801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.436741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:20.469253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.470443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.471173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.472085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.472696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.473451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.530100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:40:20.737848 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cdf2d321-95f0-43da-b436-71c017f93903 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 204 len: 0 microversion: 2.1 time: 0.310364 Oct 12 22:40:20.738768 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1034/2185] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:40:20 2022] DELETE /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:40:20.761808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.765272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:20.791234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.793839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.794314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.795049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.795512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.796983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.823551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:20.841245 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4795be51-e25f-42af-a6c5-3094b0567829 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1271 microversion: 2.1 time: 0.676047 Oct 12 22:40:20.842390 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1152/2186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:20 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1271 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:20.857917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:20.858648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:20.885195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.885694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.886127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:20.886840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:20.887288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:20.887736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.034253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:21.054760 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f19a3961-216b-435a-94e9-ebed671d66a0 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1266 microversion: 2.1 time: 0.304412 Oct 12 22:40:21.071380 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1035/2187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:20 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:21.261282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:21.261885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:21.293665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.294198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.294750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.295372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.295831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.296288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.572996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:21.584776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:21.594360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:21.617924 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-86138f82-2acf-4220-917d-c556c8bd184d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.359204 Oct 12 22:40:21.633815 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1036/2188] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:21 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:21.867001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:21.867801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:21.902500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.909895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.917540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:21.923579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:21.926775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:21.928949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:22.386785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:22.399789 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6fce8c42-99ca-4eff-aba8-310de5e21dd0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1271 microversion: 2.1 time: 0.538290 Oct 12 22:40:22.400599 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1037/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:21 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1271 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:22.411233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:22.411233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:22.425468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:22.426452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:22.427042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:22.427877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:22.428435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:22.428947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:22.440413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:22.450046 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-68b67af7-6de8-4347-bc97-6ffdbe022a46 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1702 microversion: 2.1 time: 1.606407 Oct 12 22:40:22.454501 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1153/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:20 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1702 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:22.651952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:22.652692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:22.675239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:22.683350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:22.686631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:22.689271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:22.694597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:22.706538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:22.978744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:22.996038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:22.999203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:23.034053 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-efe74bc2-04de-4421-a75e-98d09d66a4f0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.386633 Oct 12 22:40:23.050636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1154/2191] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:22 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:23.427449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:23.428639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:23.450886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.459112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.459799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:23.461791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:23.462481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:23.470669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.236142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:24.255932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03c7a78e-c910-4339-a032-4d57e52db4be tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1266 microversion: 2.1 time: 1.853818 Oct 12 22:40:24.257407 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1038/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:22 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1266 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:24.264520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:24.265596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:24.288251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.289253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.292462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:24.301369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.303457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.306063 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23875b61-e39e-4dcf-9fd0-76241e58af67 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1271 microversion: 2.1 time: 0.887293 Oct 12 22:40:24.307404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.309317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.309560 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1155/2193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:23 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1271 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:24.351059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:24.354491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:24.373303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.376324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.376714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:24.381357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:24.381939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:24.383683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.046058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:25.060742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:25.063552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:25.079043 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb633940-f86d-459d-9d3b-cdb224108cf6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1535 microversion: 2.91 time: 0.767962 Oct 12 22:40:25.103129 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1156/2194] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:24 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1535 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:25.285038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:25.285764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:25.296610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.297107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.297546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.298253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.298701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.303725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.438894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:25.447451 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85148bd5-99bf-4dfa-894a-df95d57fb5f5 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1266 microversion: 2.1 time: 0.167290 Oct 12 22:40:25.468421 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1157/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:25 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:25.480155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:25.480834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:25.510714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.511434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.512567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.516312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:25.517194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:25.521654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:25.623034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:25.653285 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-177bb741-4dfe-4bbe-a0e4-43c313b2697f tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1702 microversion: 2.1 time: 1.392735 Oct 12 22:40:25.671692 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1039/2196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:24 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1702 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:26.119875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:26.120522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:26.129740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:26.130231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:26.130667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:26.131472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:26.136066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:26.136743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:26.314642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:26.335591 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78977b53-a2cf-4ab8-af1a-13f9da88a928 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 0.855166 Oct 12 22:40:26.336469 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1158/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:25 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:26.476980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:26.477600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:26.508307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:26.508790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:26.509285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:26.509993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:26.510441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:26.510865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:26.617570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:26.647175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:26.649589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:26.669674 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71e563fd-3cce-4833-91b4-b37064b70afd tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1535 microversion: 2.91 time: 0.554655 Oct 12 22:40:26.671190 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1040/2198] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:26 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1535 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:40:26.695639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:26.696923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:26.727750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:26.730683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:26.731149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:26.731935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:26.732399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:26.732833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.042179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e3744c94e14a60915104704e1c70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff192152eb64e288b26ca5d385f0ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:27.056226 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f673a75c-864b-4058-9a6b-5e15d3a511c2 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 200 len: 1634 microversion: 2.1 time: 0.366567 Oct 12 22:40:27.074011 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1041/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:26 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 1634 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:27.130662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:27.140252 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2b0cc63-e180-4a82-a95c-2c3386138ba1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.668621 Oct 12 22:40:27.141462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1159/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:26 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:27.361146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:27.362358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:27.371101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-efd4992e-03a5-4431-a40b-b20c34b293c5 req-26bb44d3-71b1-4720-83ea-61ba631979eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb49ed2-f013-4b9c-ae4f-8d4137be1290", "name": "network-vif-deleted", "tag": "a45a3e55-f7dd-411f-a861-aee70b8b0613"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:27.387109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:27.391702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.395060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-efd4992e-03a5-4431-a40b-b20c34b293c5 req-26bb44d3-71b1-4720-83ea-61ba631979eb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.395811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.396454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.397341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.398864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.399470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.408862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-efd4992e-03a5-4431-a40b-b20c34b293c5 req-26bb44d3-71b1-4720-83ea-61ba631979eb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.410617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-efd4992e-03a5-4431-a40b-b20c34b293c5 req-26bb44d3-71b1-4720-83ea-61ba631979eb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.445295 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-efd4992e-03a5-4431-a40b-b20c34b293c5 req-26bb44d3-71b1-4720-83ea-61ba631979eb service nova] Creating event network-vif-deleted:a45a3e55-f7dd-411f-a861-aee70b8b0613 for instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 on n-h1-860864-8 Oct 12 22:40:27.460513 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-efd4992e-03a5-4431-a40b-b20c34b293c5 req-26bb44d3-71b1-4720-83ea-61ba631979eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092956 Oct 12 22:40:27.465675 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1160/2201] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:27.706356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:27.708584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:27.739678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.740227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.748425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.750294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:27.761917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:27.763013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:27.829071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=18 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:28.443758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:28.464569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:28.472002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:28.489961 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aad07436-9a7e-43e4-acb3-0d4ed34f77b3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1535 microversion: 2.91 time: 0.788932 Oct 12 22:40:28.490602 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1161/2202] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:27 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1535 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:28.495475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:28.510891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:28.521117 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-817dda67-f7e1-40c0-b579-ac815f8a8701 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 1.163772 Oct 12 22:40:28.521346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] [instance: bbb49ed2-f013-4b9c-ae4f-8d4137be1290] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:28.544506 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1042/2203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:27 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:28.546853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.547356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.547798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.550393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:28.555013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:28.557692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.558200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.558703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.569427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.573248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.573950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.576469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:28.578658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:28.579372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:28.610348 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] HTTP exception thrown: Instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 could not be found. Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Request method failure captured: Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 HTTP/1.1 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0IQTlMcg8k1T6P4gDHx0wpOPjNTJlWekXRY1qNlBjb2QwJvBRsr31gM3ln7JiH3lN9qTTy-7HjMQuRpzUbys-kT3G15T1z_E8k_YaPmj6_noJe1JsVTji35NmaVMrG-PORmXjR6p6JW7pLST9h6oozP30n7xtqyaLE4emI1KEC4_bU Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: bff192152eb64e288b26ca5d385f0ac0 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1269060103 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bff192152eb64e288b26ca5d385f0ac0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bff192152eb64e288b26ca5d385f0ac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bff192152eb64e288b26ca5d385f0ac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bff192152eb64e288b26ca5d385f0ac0"}]}] Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1269060103 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: bff192152eb64e288b26ca5d385f0ac0 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1269060103 Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1269060103-project Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e1e3744c94e14a60915104704e1c70ff Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1269060103-project Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 could not be found. Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'bbb49ed2-f013-4b9c-ae4f-8d4137be1290'} Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 could not be found. Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 could not be found. Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:40:28.621145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 could not be found. Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Returning 404 to user: Instance bbb49ed2-f013-4b9c-ae4f-8d4137be1290 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75ec533e-2397-4d72-8a83-246df4c82d13 tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290" status: 404 len: 111 microversion: 2.1 time: 0.130781 Oct 12 22:40:28.624840 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1162/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:28 2022] GET /compute/v2.1/servers/bbb49ed2-f013-4b9c-ae4f-8d4137be1290 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:40:28.632748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0af028c9-3af0-4e8f-8a8a-34aaba73bf5b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] Calling method '.version_select at 0x7f44ff81ed30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:28.703352 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0af028c9-3af0-4e8f-8a8a-34aaba73bf5b tempest-ServersTestJSON-1269060103 tempest-ServersTestJSON-1269060103-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856239845" status: 202 len: 0 microversion: 2.1 time: 0.074356 Oct 12 22:40:28.703946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1163/2205] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856239845 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:40:29.341445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:29.353552 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c799f7c-d911-4ebf-9191-393b0bde059e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.807546 Oct 12 22:40:29.356492 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1043/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:28 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:29.526840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:29.527619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:29.532123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:29.532785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:29.550965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:29.551812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:29.570544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.571050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.571491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:29.572233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.581571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.585868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.586668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.588754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:29.589592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:29.590367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.590833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.591264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:29.866991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:29.874870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:29.887845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:29.897519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:29.914954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e583102-d4cf-4a13-bccd-33bda3421210 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1478 microversion: 2.91 time: 0.390010 Oct 12 22:40:29.916239 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1164/2207] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:29 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1478 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:29.952687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:29.955815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:29.979671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.980551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.981222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:29.982415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:29.983099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:29.984637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.180371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860864-8". {{(pid=120542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 22:40:30.313534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:30.328617 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c82c36a-d1d7-42a2-adab-8ab200a28f24 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 0.781770 Oct 12 22:40:30.332499 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1044/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:29 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:30.381008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:30.381815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:30.393974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.407409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.409865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.410669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.411155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.411596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.413257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2289de1b-c03c-4bfb-8f16-f262d8545d75 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action" status: 202 len: 0 microversion: 2.91 time: 0.464390 Oct 12 22:40:30.416221 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1165/2209] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:40:29 2022] POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:40:30.426959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:30.435310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:30.449423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.454007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.458404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.459388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:30.460046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:30.461001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:30.971588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:30.988786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:30.994581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:31.013489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8f781d9-4a33-40d7-86af-2eb8b0ce688b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1486 microversion: 2.91 time: 0.588411 Oct 12 22:40:31.014432 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1166/2210] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:30 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1486 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:31.357285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:31.360742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:31.377730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:31.378157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:31.391832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:31.393336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:31.393822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:31.396167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:31.622849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:31.633166 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7300309b-8368-4def-b5bb-b6ba5859cf99 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 1.256055 Oct 12 22:40:31.644854 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1045/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:30 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:32.051301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:32.052098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:32.076426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:32.079242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:32.081338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:32.083181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:32.084809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:32.086958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:32.951960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:32.963875 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6c20f16-c722-4aad-8b31-f4f290a5fb11 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 1.611425 Oct 12 22:40:32.964553 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1167/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:31 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:32.974393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:32.975000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:33.003478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:33.006693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:33.008405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:33.011091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:33.013814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:33.016481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:33.072989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:33.084917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:33.086725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:33.098963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5614e59b-1909-4aa2-81e3-73182273b964 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1486 microversion: 2.91 time: 1.052145 Oct 12 22:40:33.114662 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1046/2213] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:32 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1486 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:33.453381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0ff1c60d-2eb9-4732-a8b2-68211c91765a req-6a98ffca-e819-4344-9d11-a6dd5ea03a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bbf111-4479-4f63-b205-094fb84ab3c9", "tag": "33396dab-3e25-41bf-a80c-4f7317e8f40d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:33.517550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0ff1c60d-2eb9-4732-a8b2-68211c91765a req-6a98ffca-e819-4344-9d11-a6dd5ea03a64 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:33.517975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0ff1c60d-2eb9-4732-a8b2-68211c91765a req-6a98ffca-e819-4344-9d11-a6dd5ea03a64 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:33.518417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0ff1c60d-2eb9-4732-a8b2-68211c91765a req-6a98ffca-e819-4344-9d11-a6dd5ea03a64 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:33.561512 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0ff1c60d-2eb9-4732-a8b2-68211c91765a req-6a98ffca-e819-4344-9d11-a6dd5ea03a64 service nova] Creating event network-changed:33396dab-3e25-41bf-a80c-4f7317e8f40d for instance 33bbf111-4479-4f63-b205-094fb84ab3c9 on n-h1-860864-8 Oct 12 22:40:33.573766 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0ff1c60d-2eb9-4732-a8b2-68211c91765a req-6a98ffca-e819-4344-9d11-a6dd5ea03a64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124155 Oct 12 22:40:33.583343 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1047/2214] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:40:33.877852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0900bdbf-55aa-4952-a584-92e694b88147 req-fb5d5ceb-a36d-41ae-a0d2-fae133785109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87453709-f447-4daa-9cdf-1bf7738bee87", "tag": "7e20769c-28d0-4c51-9a50-3820e49d12ef"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:33.908996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0900bdbf-55aa-4952-a584-92e694b88147 req-fb5d5ceb-a36d-41ae-a0d2-fae133785109 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:33.913389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0900bdbf-55aa-4952-a584-92e694b88147 req-fb5d5ceb-a36d-41ae-a0d2-fae133785109 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:33.916240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0900bdbf-55aa-4952-a584-92e694b88147 req-fb5d5ceb-a36d-41ae-a0d2-fae133785109 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:33.952295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0900bdbf-55aa-4952-a584-92e694b88147 req-fb5d5ceb-a36d-41ae-a0d2-fae133785109 service nova] Creating event network-changed:7e20769c-28d0-4c51-9a50-3820e49d12ef for instance 87453709-f447-4daa-9cdf-1bf7738bee87 on n-h2-860864-8 Oct 12 22:40:33.972107 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0900bdbf-55aa-4952-a584-92e694b88147 req-fb5d5ceb-a36d-41ae-a0d2-fae133785109 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087916 Oct 12 22:40:33.973381 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1048/2215] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:40:33.993168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:33.994866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:34.019649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:34.020450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:34.024011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:34.026441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:34.027135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:34.027725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:34.042924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:34.214173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:34.255297 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-675afd65-7d1c-4407-ac7e-083c8fa4898f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 1.285790 Oct 12 22:40:34.256268 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1168/2216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:32 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:34.277356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:34.278556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:34.292883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:34.293510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:34.297308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:34.301778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:34.302248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:34.302688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:34.746477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:34.756167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:34.768224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:34.794889 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d38172e4-8174-4605-a308-ca89f86f5db1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1486 microversion: 2.91 time: 0.535940 Oct 12 22:40:34.797328 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1169/2217] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:34 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1486 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:35.282950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:35.283876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:35.296634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.300041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.300629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:35.306436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:35.307064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:35.308957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:36.409459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:36.417748 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-de2b18a0-d785-45d3-b9fb-0db56c42e51e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 1.138726 Oct 12 22:40:36.418350 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1170/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:35 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:36.440580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:36.441201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:36.460878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:36.463439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:36.472979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:36.473696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:36.474465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:36.474945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:36.475371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:36.480865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:36.489729 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-db14c538-5c0e-4fac-b370-a574566a2c15 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 2.504789 Oct 12 22:40:36.490317 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1049/2219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:33 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:36.783588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:36.792970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:36.798745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:36.827944 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cba7f837-89db-40b7-91c1-19a124b299cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1486 microversion: 2.91 time: 0.403788 Oct 12 22:40:36.828845 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1171/2220] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:36 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1486 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:37.246352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-514566022", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:37.357561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] validate_networks() for [('1643edd0-55e0-496c-9457-01f4988576a4', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:40:37.457673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:37.464453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:37.476239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:37.480307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:37.481220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:37.482843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:37.485736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:37.487793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.158203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:38.173264 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a55442a-2b2b-4639-bc30-b327978fd4b6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.731451 Oct 12 22:40:38.188577 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1172/2221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:37 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:38.197956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:38.200161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:38.207762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:38.209003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:38.209587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.210467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:38.211071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:38.211646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.560725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:38.573009 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99e2944a-996b-49fa-ac7d-546b9c110cd5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 0.378779 Oct 12 22:40:38.584463 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1173/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:38 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:38.600023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:38.600904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:38.612709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:38.613247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:38.613784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.614455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:38.614818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:38.615234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:38.798192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:38.808898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:38.811579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:38.822556 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cfb1be6b-41f0-439a-a016-fbe74a04f2cf tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.235928 Oct 12 22:40:38.822556 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1174/2223] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:38 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:39.291771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:39.292593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:39.308273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:39.309036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:39.309635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:39.310486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:39.311077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:39.311642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:39.551106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:39.570162 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22eaa514-58ef-4b0a-af35-a80e919b8c15 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.374214 Oct 12 22:40:39.584398 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1175/2224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:39 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:39.607601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:39.608664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:39.618473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:39.625133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:39.625770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:39.626690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:39.627991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:39.628627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:40.120212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:40.132573 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-df546b66-023b-4e6d-8e9e-b2d52f40fe06 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 0.529295 Oct 12 22:40:40.135264 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1176/2225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:39 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:40.150489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:40.151142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:40.169737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:40.170372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:40.173138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:40.173922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:40.175366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:40.177394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:40.251937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:40:40.252684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:40:40.253345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:40:40.254865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:40:40.255669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:40:40.280753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:40.284831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:40.285797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:40.288770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:40.289470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:40.290900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:40.349789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Getting quotas for project c3ed4ff0893f449495446f3b50561c90. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:40:40.360520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Getting quotas for user a2d2288e0a284d94bc787491ccacd1e8 and project c3ed4ff0893f449495446f3b50561c90. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:40:40.382060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:40:40.385101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:40:40.541608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa3a40ad-ec05-486d-8ddf-a88ba60c5164 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.461174 Oct 12 22:40:40.543226 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1050/2226] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:40:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 3464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:40:40.573955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2593a542-0529-4ef2-81b9-54733cf7e748 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:40.574815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2593a542-0529-4ef2-81b9-54733cf7e748 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:41.083741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:41.098787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:41.102277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:41.116889 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5fc7322-99da-40fa-b353-537be137ae3e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.978363 Oct 12 22:40:41.117999 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1177/2227] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:40 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:41.130491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:41.131436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:41.165528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:41.166220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:41.166924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:41.167759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:41.168187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:41.168559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:41.499480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2593a542-0529-4ef2-81b9-54733cf7e748 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:41.522323 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2593a542-0529-4ef2-81b9-54733cf7e748 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1213 microversion: 2.1 time: 0.952270 Oct 12 22:40:41.546303 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1051/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:40 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1213 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:41.573590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:41.574258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:41.609838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:41.611451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:41.612031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:41.618081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:41.619804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:41.621900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:41.787427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:41.805104 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d95ba46-69eb-4f21-9542-0726283b95d6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.685374 Oct 12 22:40:41.807715 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1178/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:41 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:42.149807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:42.151769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:42.187859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.193517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.193954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.194714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.207735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.208339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.350714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:42.363199 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-756b378d-3faf-4175-a384-edd8ad9ab003 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 0.814096 Oct 12 22:40:42.369139 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1052/2230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:41 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:42.568468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:42.569365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:42.582393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.585251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.585963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.590998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.592281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.593087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.698888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:42.722717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:42.724842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:42.773906 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0d220b75-c1f9-4219-bac0-f11ec01645cc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.629901 Oct 12 22:40:42.779227 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1179/2231] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:42 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:42.841160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:42.841998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:42.859534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.860240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.860756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.862271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:42.862816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:42.863242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:42.934393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:43.429456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:43.441490 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e1b7825-e561-4a1a-a316-d3463148aa03 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1265 microversion: 2.1 time: 0.890055 Oct 12 22:40:43.467096 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1053/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:42 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1265 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:43.478548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:43.479104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:43.522125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:43.522817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:43.529233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:43.531566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:43.533994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:43.538787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:43.737361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:43.775909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af6569d8-f84b-4e1d-a396-d8edc04750fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.943213 Oct 12 22:40:43.787703 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1180/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:42 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:43.814484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:43.816139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:43.834376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:43.835091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:43.835851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:43.836870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:43.837476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:43.838120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:44.916229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:44.944917 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47b287d4-0ed1-47cc-8b29-173ac8590a75 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 1.463609 Oct 12 22:40:44.945611 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1054/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:43 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:44.969570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:44.974343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:44.996520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:44.999264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:45.000146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:45.004399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:45.005204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:45.008165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:45.188405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:45.225302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:45.226746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:45.264669 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ca96d43-2221-4957-9fb5-3500cb218617 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 1.438410 Oct 12 22:40:45.267219 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1181/2235] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:43 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:40:45.284521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:45.289346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:45.322557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:45.328816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:45.332193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:45.337400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:45.338096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:45.353377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:45.719929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:45.729651 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-576781f1-580b-4de7-a621-deb076f71012 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1271 microversion: 2.1 time: 0.782814 Oct 12 22:40:45.730965 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1055/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:44 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1271 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:45.737067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ec7eda0e-f827-46cd-82b4-071e18a3dcaa req-8ea6760f-b760-4069-8f0f-a736705c5a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bbf111-4479-4f63-b205-094fb84ab3c9", "name": "network-vif-plugged", "status": "completed", "tag": "33396dab-3e25-41bf-a80c-4f7317e8f40d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:45.748651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ec7eda0e-f827-46cd-82b4-071e18a3dcaa req-8ea6760f-b760-4069-8f0f-a736705c5a2a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:45.749366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ec7eda0e-f827-46cd-82b4-071e18a3dcaa req-8ea6760f-b760-4069-8f0f-a736705c5a2a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:45.749936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ec7eda0e-f827-46cd-82b4-071e18a3dcaa req-8ea6760f-b760-4069-8f0f-a736705c5a2a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:45.764216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ec7eda0e-f827-46cd-82b4-071e18a3dcaa req-8ea6760f-b760-4069-8f0f-a736705c5a2a service nova] Creating event network-vif-plugged:33396dab-3e25-41bf-a80c-4f7317e8f40d for instance 33bbf111-4479-4f63-b205-094fb84ab3c9 on n-h1-860864-8 Oct 12 22:40:45.770381 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ec7eda0e-f827-46cd-82b4-071e18a3dcaa req-8ea6760f-b760-4069-8f0f-a736705c5a2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037957 Oct 12 22:40:45.771606 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1056/2237] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:45.975657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:45.977353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:45.997712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:45.999449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:46.003227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:46.004117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:46.007843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:46.009528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:46.726101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:46.741957 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59bdb81a-4923-43ac-bff1-7facbe793653 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1313 microversion: 2.1 time: 0.771971 Oct 12 22:40:46.744115 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1057/2238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:45 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1313 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:46.760193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:46.761215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:46.780375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:46.781101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:46.781763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:46.783688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:46.784418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:46.785088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:46.923228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:46.933694 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f3b1bacb-593e-4180-874e-2a7a70eefa45 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 1.657123 Oct 12 22:40:46.940352 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1182/2239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:45 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:46.976934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:46.980599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:47.016850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:47.017628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:47.019057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:47.022703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:47.024385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:47.025361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:47.370351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:47.399381 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b4281667-6b58-4b1d-b129-2a6ec2cbcf7a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1271 microversion: 2.1 time: 0.442118 Oct 12 22:40:47.409534 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1183/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:46 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1271 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:47.769336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:47.770209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:47.806947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:47.807970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:47.815554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:47.819071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:47.820914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:47.821530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:47.973368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:47.989052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:47.993719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:48.008559 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8f18578-c873-4eb2-b0cc-b20ac773882b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 1.261295 Oct 12 22:40:48.013649 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1058/2241] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:46 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:48.030328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fa9caaed-34b2-423d-bcc1-5e1897313980 req-250a2b03-3808-442f-bbe9-fa3362bbe4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87453709-f447-4daa-9cdf-1bf7738bee87", "name": "network-vif-plugged", "status": "completed", "tag": "7e20769c-28d0-4c51-9a50-3820e49d12ef"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:48.070739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa9caaed-34b2-423d-bcc1-5e1897313980 req-250a2b03-3808-442f-bbe9-fa3362bbe4d7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:48.072236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa9caaed-34b2-423d-bcc1-5e1897313980 req-250a2b03-3808-442f-bbe9-fa3362bbe4d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:48.073712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa9caaed-34b2-423d-bcc1-5e1897313980 req-250a2b03-3808-442f-bbe9-fa3362bbe4d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:48.116391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fa9caaed-34b2-423d-bcc1-5e1897313980 req-250a2b03-3808-442f-bbe9-fa3362bbe4d7 service nova] Creating event network-vif-plugged:7e20769c-28d0-4c51-9a50-3820e49d12ef for instance 87453709-f447-4daa-9cdf-1bf7738bee87 on n-h2-860864-8 Oct 12 22:40:48.141951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fa9caaed-34b2-423d-bcc1-5e1897313980 req-250a2b03-3808-442f-bbe9-fa3362bbe4d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126578 Oct 12 22:40:48.143513 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1059/2242] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:48.151149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:48.152568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:48.163436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:48.164193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:48.164844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:48.179187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:48.180942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:48.185153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:48.683490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:48.703484 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0f96af1-976d-4a71-9dc4-6c3f23470941 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.555349 Oct 12 22:40:48.723432 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1060/2243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:48 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:48.735714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:48.739999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:48.757843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:48.758366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:48.758797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:48.759523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:48.760003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:48.760433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:48.928013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:48.942468 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-29ea0f27-35d0-40dd-afe1-612f935b9b07 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1462 microversion: 2.1 time: 1.175539 Oct 12 22:40:48.962415 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1184/2244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:47 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1462 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:49.194894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:49.208706 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b7576a72-b58d-4436-981d-b48a33700229 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 0.482627 Oct 12 22:40:49.211335 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1061/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:48 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:49.229895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:49.237991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:49.264886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:49.265490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:49.273311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:49.275494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:49.276022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:49.280238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:49.280677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:49.281589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:49.284505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:49.284877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:49.285022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:49.285724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:49.286189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:49.286477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:49.286617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:49.435044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:49.447239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:49.449463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:49.456530 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0fb35f2c-7a24-4124-8b58-68d4329fe925 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.243763 Oct 12 22:40:49.472713 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1062/2246] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:49 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:49.728174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:49.739572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:49.739572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:49.739572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:49.739572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:49.751213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:49.751761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:49.752397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:50.090666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:50.101106 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d48c9e89-2312-4b8c-a608-d0975998a26c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1308 microversion: 2.1 time: 0.376721 Oct 12 22:40:50.118707 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1063/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:49 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:50.237465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:50.238147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:50.259691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:50.266005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:50.269052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:50.270022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:50.270672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:50.271283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:50.330050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:50.631874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:50.646228 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9933c214-192f-4f8e-908d-9bce00b0b858 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 0.411953 Oct 12 22:40:50.647208 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1064/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:50 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:50.654349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:50.654958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:50.693627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:50.698377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:50.699069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:50.700048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:50.703089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:50.704849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:50.884340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:50.897327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:50.898774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:50.912821 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4554bed4-1cfd-45aa-8305-e936cd91ead0 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.264422 Oct 12 22:40:50.937956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1065/2249] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:50 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:51.125245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:51.125897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:51.137628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:51.138362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:51.139327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:51.140263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:51.140864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:51.148681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:51.497846 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-925f15e3-eabb-4400-9bf9-6304290dee7d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1613 microversion: 2.1 time: 2.527843 Oct 12 22:40:51.499921 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1185/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:48 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1613 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:51.516666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:51.525399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:51.526328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:51.538219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:51.540881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:51.541575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:51.543085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:51.551367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:51.552223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:51.790962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8b640e03bd0841b69243c130353a16a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6142d017e3224e08af7e88d8ebbb1cac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:51.812831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] flavor_id is None. Assuming migration. {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 22:40:51.813301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:40:52.156766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:52.168709 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a36ff3f-cdf1-4705-82d8-5ff24ecf7ce9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1488 microversion: 2.1 time: 1.047205 Oct 12 22:40:52.184527 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1066/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:51 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1488 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:52.206393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:52.207026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:52.227443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:52.228208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:52.228800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:52.229913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:52.230542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:52.231120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:52.840954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e731f859-0127-44a5-97ec-5d229bd54df1 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9/action" status: 202 len: 0 microversion: 2.1 time: 1.318713 Oct 12 22:40:52.845648 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1186/2252] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:40:51 2022] POST /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9/action => generated 0 bytes in 1324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:40:52.873166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:52.874176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:52.888469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:52.889850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:52.890467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:52.891913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:52.894964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:52.896676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:53.324237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:53.339696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:53.344394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:53.362154 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-83faeceb-8bce-4fe6-8673-0309194f82b6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.510053 Oct 12 22:40:53.364184 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1187/2253] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:52 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:53.377046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:53.382886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:53.403962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:53.412153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:53.412982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:53.414847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:53.416473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:53.417999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:53.439116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:53.449461 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c6733cd-eb5a-4839-b7c3-00681f7c19ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 1.263714 Oct 12 22:40:53.452894 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1067/2254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:52 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:53.458514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-85881e59-ee9d-4139-992b-63dcf966722e req-4abe8780-9432-4ef2-8249-2e47416a4ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36885901-b37c-4864-ab4a-32d9c41b923e", "tag": "a23ac33d-f4d7-46c8-960c-5f6f9afc264a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:53.502655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-85881e59-ee9d-4139-992b-63dcf966722e req-4abe8780-9432-4ef2-8249-2e47416a4ea2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:53.503389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-85881e59-ee9d-4139-992b-63dcf966722e req-4abe8780-9432-4ef2-8249-2e47416a4ea2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:53.504887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-85881e59-ee9d-4139-992b-63dcf966722e req-4abe8780-9432-4ef2-8249-2e47416a4ea2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:53.510050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:40:53.538170 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-85881e59-ee9d-4139-992b-63dcf966722e req-4abe8780-9432-4ef2-8249-2e47416a4ea2 service nova] Creating event network-changed:a23ac33d-f4d7-46c8-960c-5f6f9afc264a for instance 36885901-b37c-4864-ab4a-32d9c41b923e on n-h1-860864-8 Oct 12 22:40:53.553697 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-85881e59-ee9d-4139-992b-63dcf966722e req-4abe8780-9432-4ef2-8249-2e47416a4ea2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099198 Oct 12 22:40:53.556826 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1068/2255] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:53.579433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:53.580178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:53.601823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:53.603019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:53.603623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:53.604787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:53.608198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:53.617161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:53.639722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:53.865700 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c1aaff32-ea0d-409a-9c3e-23427f347eae tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 204 len: 0 microversion: 2.1 time: 0.491642 Oct 12 22:40:53.870435 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1188/2256] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:40:53 2022] DELETE /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:40:53.905612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:53.907455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:53.927759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:53.929230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:53.930483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:53.933283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:53.936811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:53.939555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:54.243085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:54.260735 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8ea6afc-621c-457c-be13-81a476c112ec tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1471 microversion: 2.1 time: 0.698157 Oct 12 22:40:54.264985 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1069/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:53 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1471 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:54.394649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:54.395419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:54.409259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:54.428121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:54.429383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:54.435283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:54.437834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:54.438539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:54.746493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:54.775752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:54.780258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:54.796425 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-766b732f-16a8-4757-aea3-63fb3ce8eb67 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.406252 Oct 12 22:40:54.797873 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1070/2258] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:54 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:54.814177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:54.816476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:54.838225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:54.841480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:54.842918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:54.848293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:54.849038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:54.851751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:54.983788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:54.995494 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0192a777-514a-4a49-be8c-f16d071bcd09 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1494 microversion: 2.1 time: 1.117532 Oct 12 22:40:55.006981 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1189/2259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:53 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1494 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:55.290121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:55.290689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:55.310239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:55.323573 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a982efdd-c768-447e-be91-5581b241ef4c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 0.522136 Oct 12 22:40:55.324999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:55.324999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:55.325212 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1071/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:54 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:55.325453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:55.326170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:55.326623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:55.327052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:55.828432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:55.829635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:55.854317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:55.857580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:55.859630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:55.862600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:55.866916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:55.869292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:56.027624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:56.040176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6052c5aa-db68-42a0-8678-66458b74d7ee tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1471 microversion: 2.1 time: 0.753948 Oct 12 22:40:56.059701 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1190/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:55 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1471 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:56.073018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:56.077171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:56.099411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:56.100609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:56.101064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:56.103572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:56.105531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:56.105996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:56.173420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:56.188214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:56.193932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:56.234219 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-066ee724-4c88-49aa-8938-3a297eaf6db8 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.409829 Oct 12 22:40:56.236101 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1072/2262] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:55 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:40:56.349126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:56.350005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:56.363471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:56.364497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:56.366445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:56.368037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:56.372637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:56.395661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:57.059376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:57.072287 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12db662c-edda-4c42-bf3f-9850dc0d7180 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 0.727139 Oct 12 22:40:57.076149 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1073/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:56 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:40:57.081190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:57.093023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:57.100191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:57.100941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:57.101597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:57.103048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:57.104494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:57.105747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:57.319937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:57.335697 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-390f6cd0-3b7d-48dd-9b53-3978052825a2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1494 microversion: 2.1 time: 1.274265 Oct 12 22:40:57.399480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:57.400811 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1191/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:56 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1494 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:57.413410 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ac048f4-6ff5-4f46-aaec-254b38508a98 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1471 microversion: 2.1 time: 0.335915 Oct 12 22:40:57.414001 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1074/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:57 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1471 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:57.433804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:57.434686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:57.441305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:57.442096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:57.442694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:57.443570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:57.444202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:57.444784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:57.521748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:57.532245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:57.534745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:57.540820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e0a386c-0d8a-4ecb-9913-360809183367 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.112428 Oct 12 22:40:57.541984 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1075/2266] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:57 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:57.690039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-13d3b37e-441c-4830-be38-c690f2484806 req-a394760d-e0eb-4d51-9276-d3d84bcd5e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87453709-f447-4daa-9cdf-1bf7738bee87", "name": "network-vif-deleted", "tag": "7e20769c-28d0-4c51-9a50-3820e49d12ef"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:40:57.713798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-13d3b37e-441c-4830-be38-c690f2484806 req-a394760d-e0eb-4d51-9276-d3d84bcd5e3b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:57.714005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-13d3b37e-441c-4830-be38-c690f2484806 req-a394760d-e0eb-4d51-9276-d3d84bcd5e3b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:57.714765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-13d3b37e-441c-4830-be38-c690f2484806 req-a394760d-e0eb-4d51-9276-d3d84bcd5e3b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:57.748062 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-13d3b37e-441c-4830-be38-c690f2484806 req-a394760d-e0eb-4d51-9276-d3d84bcd5e3b service nova] Creating event network-vif-deleted:7e20769c-28d0-4c51-9a50-3820e49d12ef for instance 87453709-f447-4daa-9cdf-1bf7738bee87 on n-h2-860864-8 Oct 12 22:40:57.764917 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-13d3b37e-441c-4830-be38-c690f2484806 req-a394760d-e0eb-4d51-9276-d3d84bcd5e3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360765 Oct 12 22:40:57.778254 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1192/2267] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:40:58.101311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:58.102478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:58.117187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:58.118992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:58.120229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:58.122025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:58.125036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:58.125923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:58.369516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:58.370582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:58.387597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:58.388586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:58.400729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:58.404533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:58.409302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:58.410033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:58.513998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:58.518538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:58.519582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:58.524111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lazy-loading 'fault' on Instance uuid 87453709-f447-4daa-9cdf-1bf7738bee87 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:40:58.603690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:58.624755 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1be32487-0f21-4b41-ac61-9ade311c04be tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 0.529763 Oct 12 22:40:58.654451 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1076/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:58 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:58.665181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:58.669402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:58.693276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:58.697297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:58.699725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:58.700904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:58.701559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:58.702190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:59.119445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:59.143408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a49c0dc9-5482-496e-954c-cfaea8dbe9fa tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1471 microversion: 2.1 time: 0.486794 Oct 12 22:40:59.168857 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1077/2269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:58 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1471 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:59.177805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:59.178714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:59.185571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:59.195492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:59.199836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:59.200881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:59.202913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:59.204504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:59.240685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:59.254136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:40:59.257270 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af4bc8da-dfff-4c8d-a848-2d19063d146c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 200 len: 1298 microversion: 2.1 time: 0.894318 Oct 12 22:40:59.261163 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1193/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:58 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 1298 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:40:59.384842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:59.398396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:59.400971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:40:59.423885 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0cae42cd-7155-4119-90b4-0fbaaae52745 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.249498 Oct 12 22:40:59.430645 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1078/2271] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:40:59 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:40:59.655405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:40:59.659216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:40:59.669368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:59.670116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:59.670729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:40:59.671707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:40:59.672232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:40:59.673302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:00.173069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:00.173834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:00.205009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:00.205651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:00.206282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:00.207536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:00.208161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:00.208696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:00.335824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:00.348559 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aaf3e609-c9a9-45fb-9c8d-1d655cd043aa tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 0.693672 Oct 12 22:41:00.375098 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1194/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:40:59 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:00.390447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:00.395048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:00.411639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:00.412172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:00.412781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:00.414548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:00.415296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:00.415884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:00.457996 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 HTTP/1.1 Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '87453709-f447-4daa-9cdf-1bf7738bee87'} Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:00.462395 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:00.466690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:00.466690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:00.466690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:00.466690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:00.466690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:00.466690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:00.472269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:00.474988 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f003b192-924f-48cd-bc8a-20c382a1ba44 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 404 len: 111 microversion: 2.1 time: 0.098454 Oct 12 22:41:00.482695 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1195/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:00 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:00.495327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:00.498419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:00.514914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:00.515430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:00.517319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:00.518147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:00.521944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:00.522407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:00.682613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:00.695821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:00.697345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:00.716524 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96ba08c1-3b40-454b-b3ed-1f9b6ef4cd6e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.231195 Oct 12 22:41:00.717828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1196/2274] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:00 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:00.733360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-617133a7-42fb-4774-8a90-865e4c60436f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507c2c9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:01.347807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:01.372762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-337e96cc-abd0-4ae6-8b5d-55748da65f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1471 microversion: 2.1 time: 1.202015 Oct 12 22:41:01.388299 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1079/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:00 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1471 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:01.390340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-11dbe189-75f5-49b9-81a3-8aff9e0217ed req-ff039613-e92a-466a-b5b2-095adcfb61c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36885901-b37c-4864-ab4a-32d9c41b923e", "name": "network-vif-plugged", "status": "completed", "tag": "a23ac33d-f4d7-46c8-960c-5f6f9afc264a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:01.418602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-11dbe189-75f5-49b9-81a3-8aff9e0217ed req-ff039613-e92a-466a-b5b2-095adcfb61c4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:01.420611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-11dbe189-75f5-49b9-81a3-8aff9e0217ed req-ff039613-e92a-466a-b5b2-095adcfb61c4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:01.421475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-11dbe189-75f5-49b9-81a3-8aff9e0217ed req-ff039613-e92a-466a-b5b2-095adcfb61c4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:01.445198 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-11dbe189-75f5-49b9-81a3-8aff9e0217ed req-ff039613-e92a-466a-b5b2-095adcfb61c4 service nova] Creating event network-vif-plugged:a23ac33d-f4d7-46c8-960c-5f6f9afc264a for instance 36885901-b37c-4864-ab4a-32d9c41b923e on n-h1-860864-8 Oct 12 22:41:01.462775 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-11dbe189-75f5-49b9-81a3-8aff9e0217ed req-ff039613-e92a-466a-b5b2-095adcfb61c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079112 Oct 12 22:41:01.465368 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1080/2276] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:01.487997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:01.492288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:01.513456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:01.515447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:01.518403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:01.521395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:01.522107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:01.527660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:01.728630 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-617133a7-42fb-4774-8a90-865e4c60436f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 204 len: 0 microversion: 2.1 time: 1.009503 Oct 12 22:41:01.730057 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1197/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:00 2022] DELETE /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:01.738897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:01.739580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:01.765358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:01.770529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:01.773675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:01.774797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:01.775410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:01.776013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:01.827315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:41:01.939533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6eacd43-5d64-4d82-a223-3eea46b0b082 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 204 len: 0 microversion: 2.1 time: 0.204858 Oct 12 22:41:01.941943 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1198/2278] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:01 2022] DELETE /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:01.954428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:01.955357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:01.984123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:01.985076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:01.985579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:01.990504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:01.993016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:01.995061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:01.995512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:02.007197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-baaaa8c0-cc4e-4f65-a121-09ada748e2b5 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1313 microversion: 2.1 time: 0.538466 Oct 12 22:41:02.009283 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1081/2279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:01 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:02.108948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-3256824", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "25f09190-2cdc-41b9-9952-f833573da6b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:02.183447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:02.215218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] validate_networks() for [('25f09190-2cdc-41b9-9952-f833573da6b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:41:02.220337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:02.221975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:02.232623 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80a598d8-7b6a-446f-82cc-9a074e770f8c tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1531 microversion: 2.91 time: 0.287635 Oct 12 22:41:02.244828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1199/2280] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:01 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1531 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:02.262878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1825113099", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "01de95cb-24a5-46e3-afc8-ee4196a0a9b4"}], "security_groups": [{"name": "tempest-securitygroup--1660463899"}], "key_name": "tempest-keypair-934515603", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "8642221b-e150-4ea1-9124-649a6b715395", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:02.619184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] validate_networks() for [('01de95cb-24a5-46e3-afc8-ee4196a0a9b4', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:41:03.010206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:41:03.011969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:41:03.012666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:41:03.013298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:41:03.014216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:41:03.026491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:03.027336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:03.028191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:03.029283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:03.029984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:03.030668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:03.073244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:03.086778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Getting quotas for user 080644f7502346ed8ff64a026ac9d15b and project eacd9f81dd574deaa7986c986e944e0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:03.104002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:41:03.106967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:41:03.172883 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3850c928-2e18-4051-8984-b60a85c398da tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066263 Oct 12 22:41:03.181399 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1082/2281] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:41:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:41:03.187080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:03.188062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:03.197599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:03.198547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:03.199966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:03.201270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:03.202104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:03.203715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:03.361840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lazy-loading 'services' on Instance uuid 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:41:03.412182 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0527b984-1fa5-419e-90cd-6400b7a818ef tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1936 microversion: 2.91 time: 0.229117 Oct 12 22:41:03.413242 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1083/2282] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:03 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1936 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:03.428166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:03.429097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:03.443249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:03.446560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:03.447104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:03.449361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:03.452006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:03.452876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:03.989047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:04.002555 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae4e2381-4342-4322-9b32-e9eafe06e454 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.587605 Oct 12 22:41:04.004196 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1084/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:03 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:04.018074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:04.026271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:04.038190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:04.039513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:04.040231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:04.042716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:04.043953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:04.048774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:04.406956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:04.422684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53aa255d-884f-42a5-b54c-2d56d9f694a8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1499 microversion: 2.1 time: 0.415185 Oct 12 22:41:04.427884 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1085/2284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:04 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1499 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:04.434761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:04.435396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:04.468163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:04.468915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:04.469515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:04.478302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:04.479147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:04.479803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:04.648349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:04.663133 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4a5ee68-d950-4c3d-8710-0afdb5327903 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1257 microversion: 2.1 time: 0.233134 Oct 12 22:41:04.664183 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1086/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:04 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1257 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:04.674713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:04.676403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:04.694724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:04.696233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:04.697157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:04.698114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:04.698821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:04.700128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:04.704671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:04.738527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lazy-loading 'flavor' on Instance uuid 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:41:05.063644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Getting quotas for project 0eedb6331b634a7199cdd877e847c6db. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:05.086300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Getting quotas for user 6857ea19a8194e5680b1b376dcdbcb30 and project 0eedb6331b634a7199cdd877e847c6db. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:05.109493 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cee92447-df54-46ff-a7ea-1553c7ecf546 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action" status: 202 len: 0 microversion: 2.91 time: 0.443037 Oct 12 22:41:05.113556 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1087/2286] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:41:04 2022] POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:05.117698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:41:05.118396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:41:05.120795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:41:05.121265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:41:05.121937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:41:05.125127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:05.128916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:05.129139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:05.141863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.142638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.143387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.145568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.146197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.147083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.155563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.156665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.157061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.160655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.162462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.165650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.208909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lazy-loading 'flavor' on Instance uuid 36885901-b37c-4864-ab4a-32d9c41b923e {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:41:05.239124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Getting quotas for project 0eedb6331b634a7199cdd877e847c6db. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:05.255885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Getting quotas for user 6857ea19a8194e5680b1b376dcdbcb30 and project 0eedb6331b634a7199cdd877e847c6db. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:05.450720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:41:05.454688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8642221b-e150-4ea1-9124-649a6b715395',volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:41:05.465032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40ae06fb-b26e-41fa-a8fb-2157ab1a5c5b tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "POST /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e/action" status: 200 len: 32 microversion: 2.1 time: 0.349366 Oct 12 22:41:05.465716 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1088/2287] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:41:05 2022] POST /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:41:05.485815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2bd6896d-a174-446b-8f15-dd3d8e4640d5 req-a1cad39e-7033-4045-812f-c08128f5c1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23ffeb9-2df6-4806-a53f-597231c291a0", "name": "network-vif-deleted", "tag": "1a320b77-fd84-42ca-9ac6-b5a541475a0b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:05.547166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2bd6896d-a174-446b-8f15-dd3d8e4640d5 req-a1cad39e-7033-4045-812f-c08128f5c1bd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.548151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2bd6896d-a174-446b-8f15-dd3d8e4640d5 req-a1cad39e-7033-4045-812f-c08128f5c1bd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.548900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2bd6896d-a174-446b-8f15-dd3d8e4640d5 req-a1cad39e-7033-4045-812f-c08128f5c1bd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.580854 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2bd6896d-a174-446b-8f15-dd3d8e4640d5 req-a1cad39e-7033-4045-812f-c08128f5c1bd service nova] Creating event network-vif-deleted:1a320b77-fd84-42ca-9ac6-b5a541475a0b for instance f23ffeb9-2df6-4806-a53f-597231c291a0 on n-h2-860864-8 Oct 12 22:41:05.589130 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2bd6896d-a174-446b-8f15-dd3d8e4640d5 req-a1cad39e-7033-4045-812f-c08128f5c1bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115026 Oct 12 22:41:05.599312 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1089/2288] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:05.609919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:05.611573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:05.623221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.624399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.625145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.626803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.628462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.629195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.825921 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84e8f9c1-e6b0-4b3c-b90a-45b53dbf378c tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.579587 Oct 12 22:41:05.831414 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1200/2289] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:41:02 2022] POST /compute/v2.1/servers => generated 407 bytes in 3586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:41:05.847107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:05.848279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:05.870713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.873496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.874729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:05.876125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:05.879238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:05.883229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:06.047533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:06.056693 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d1a4d90-f2f7-477b-8979-6e3eae350348 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.455489 Oct 12 22:41:06.062385 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1090/2290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:05 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:06.067982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:06.073002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:06.089479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:06.089779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:06.091235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:06.092799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:06.094703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:06.095362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:06.398541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:06.407528 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-533ccd2b-1074-4e98-9818-3e9117fd4f06 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.343755 Oct 12 22:41:06.412788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:06.421331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:06.422782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:06.425036 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1091/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:06 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:06.433212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:06.435816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:06.440808 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4ab1723-bf44-4f70-8462-bb036927af36 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.606187 Oct 12 22:41:06.441800 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1201/2292] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:05 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:06.446786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2605a331-320f-4294-bdc7-95074bedb2c5 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:06.454864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2605a331-320f-4294-bdc7-95074bedb2c5 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:06.470483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:06.471326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:06.472231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:06.473304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:06.473944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:06.475007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:06.687978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2605a331-320f-4294-bdc7-95074bedb2c5 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:06.697972 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2605a331-320f-4294-bdc7-95074bedb2c5 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1121 microversion: 2.1 time: 0.254838 Oct 12 22:41:06.701327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1202/2293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:06 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1121 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:06.747411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:06.775756 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34d3d88a-7e4a-4e0d-8ad9-f8c2361b58c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1263 microversion: 2.1 time: 0.346182 Oct 12 22:41:06.776953 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1092/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:06 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1263 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:07.081866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:07.082673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:07.105730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:07.106554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:07.111520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:07.113284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:07.118547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:07.119358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:07.431954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:07.435123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:07.460648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:07.462886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:07.464753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:07.466314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:07.466935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:07.467689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:07.811382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:07.827176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-597b3201-dd74-4a9b-8d7f-716b67b3fe5f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.750242 Oct 12 22:41:07.829656 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1203/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:07 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:07.841350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:07.842821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:07.854663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:07.860229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:07.862596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:07.863519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:07.866504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:07.867174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.071605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:08.084819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:08.086695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:08.093881 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-91253664-ee76-4ef3-875e-d3f6e32fddd1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.261955 Oct 12 22:41:08.095284 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1204/2296] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:07 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:08.101000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:08.101967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:08.109747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.110519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.111218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.112427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.113723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.114964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.189329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:08.198874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7b76444-0107-4793-b6a7-79c279efcbee tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.771270 Oct 12 22:41:08.200091 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1093/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:07 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:08.204734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:08.206832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:08.220779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.222627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.223818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.230320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.231590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.232217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.232365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:08.241583 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1627263-f974-4f4b-8ccd-0b56669a5a8b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1237 microversion: 2.1 time: 0.144292 Oct 12 22:41:08.254795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1205/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:08 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:08.672706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:08.685909 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76333a7f-d51e-44b6-af3e-ea0d39c2f53b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 0.484584 Oct 12 22:41:08.687102 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1094/2299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:08 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:08.851049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:08.852272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:08.859103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.861103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.863090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:08.867828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:08.871252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:08.875342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:09.131159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:09.133378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:09.145152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.146149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.146819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:09.148090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.148806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.149733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:09.257604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:09.272189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5ce4fb65-6294-4327-b378-6d820e66e597 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.425326 Oct 12 22:41:09.273174 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1206/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:08 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:09.284095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:09.285084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:09.303814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.313202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.314038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:09.315168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.315868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.317093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:09.396183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:09.410899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:09.415569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:09.438197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57767593-15dd-4f1c-9a4f-ab8425ea18aa tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.313736 Oct 12 22:41:09.442714 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1095/2301] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:09 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:09.463789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:09.464452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:09.487779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.488600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.489204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:09.490193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:09.490810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:09.491440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.013441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.027070 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d952a713-6763-433a-9eca-2323b87ef61a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1237 microversion: 2.1 time: 0.582948 Oct 12 22:41:10.027968 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1096/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:09 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1237 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:10.037890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:10.050045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:10.054175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:10.065321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:10.081352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:10.082143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.083216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:10.085627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:10.089465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.247158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.259216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-785396fa-7636-41c5-a33e-e4c49410e42e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.984754 Oct 12 22:41:10.279589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1207/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:09 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:10.297922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:10.298822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:10.307724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:10.308471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:10.309052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.309932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:10.310525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:10.311358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.622825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.639577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-adca1adb-6ad3-4be5-945c-44f9e94d873a tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 0.609716 Oct 12 22:41:10.653445 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1097/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:10 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:10.659112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:10.659826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:10.691529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:10.693392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:10.694011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.709947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:10.712312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:10.714493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:10.871968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.885000 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-795fc9ac-758b-4ccf-80dc-3e71d71a3d80 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.590865 Oct 12 22:41:10.886146 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1208/2305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:10 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:10.936089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.950135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.951836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:10.964170 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-82d3e87a-4a45-45ac-8f57-915060bd3a17 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.309436 Oct 12 22:41:10.971924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1098/2306] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:10 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:11.050581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:11.050816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:11.056717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.057194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.057621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.058304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.058743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.059153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.234975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:11.242986 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8c2b867-9b18-4424-9777-532696339f54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1237 microversion: 2.1 time: 0.196720 Oct 12 22:41:11.243508 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1209/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:11 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1237 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:11.286645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:11.287267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:11.296811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.297194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.297635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.298342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.311577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.312410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.671059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:11.672778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:11.687040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.688424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.690257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:11.692282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:11.695135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:11.695736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.040168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:12.049887 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-411ddb11-8cdc-4056-8162-38a90cdca8ea tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.766489 Oct 12 22:41:12.071756 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1099/2308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:11 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:12.084639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:12.085332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:12.102477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.102982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.103424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.104176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.112707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.113308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.140665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:12.459707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:12.469925 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f555a7db-0524-419e-aa89-2ef70bb4837b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.396849 Oct 12 22:41:12.472175 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1100/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:12 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:12.482111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:12.482781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:12.498564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.500984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.501178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.503362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.505203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.505825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.736645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:12.750932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:12.752995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:12.764149 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e636cfbc-05f9-4315-a6ee-f8d80805465b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.290799 Oct 12 22:41:12.776858 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1101/2310] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:12 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:12.776858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:12.776858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:12.797475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.797968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.798405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.799152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.799609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.800063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.813422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:12.824584 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4edc86af-03fe-4f1e-b5f4-a929408e3428 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 1.157620 Oct 12 22:41:12.830124 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1210/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:11 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:12.840084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-68d4f09a-b962-43a1-9015-dc6361774d3a req-71abc9cd-0356-437a-9800-574c8c24dfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7824d9-b1c1-4331-99d5-21fb4e9516e2", "tag": "a93dd5fb-5c3d-4977-b15a-bff0134c7b14"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:12.870586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-68d4f09a-b962-43a1-9015-dc6361774d3a req-71abc9cd-0356-437a-9800-574c8c24dfe8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:12.876534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-68d4f09a-b962-43a1-9015-dc6361774d3a req-71abc9cd-0356-437a-9800-574c8c24dfe8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:12.877856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-68d4f09a-b962-43a1-9015-dc6361774d3a req-71abc9cd-0356-437a-9800-574c8c24dfe8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:12.894373 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-68d4f09a-b962-43a1-9015-dc6361774d3a req-71abc9cd-0356-437a-9800-574c8c24dfe8 service nova] Creating event network-changed:a93dd5fb-5c3d-4977-b15a-bff0134c7b14 for instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 on n-h2-860864-8 Oct 12 22:41:12.906726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-68d4f09a-b962-43a1-9015-dc6361774d3a req-71abc9cd-0356-437a-9800-574c8c24dfe8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074489 Oct 12 22:41:12.916974 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1211/2312] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:13.043326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:13.081032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:13.081734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:13.095547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:13.102550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.103340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.105825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:13.106677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.108091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.110811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:13.572416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:13.592089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:13.599070 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce9615f5-be50-491a-ae86-3438e4b300e0 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.523974 Oct 12 22:41:13.600545 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1212/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:13 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:13.638094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:13.655131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:13.657242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:13.660814 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34144fab-f599-48c4-9310-55b84ec7fd3b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1305 microversion: 2.1 time: 0.890274 Oct 12 22:41:13.675945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1102/2314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:12 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1305 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:13.683838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.685272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.685935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:13.686888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.687714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.688321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:13.795568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:13.796258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:13.805773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.808400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.815438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:13.816600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:13.817239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:13.817982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:14.073017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:14.087011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:14.096519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:14.107502 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-987c50e9-4f07-4cb4-8c08-cfdb9c24227d tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.315759 Oct 12 22:41:14.114149 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1103/2315] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:13 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:41:14.123171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:14.124222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:14.148857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:14.153780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:14.154934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:14.160157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:14.160896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:14.161624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:14.352299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:14.361329 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd83c268-88d6-4bdf-9ffb-814134bda9f4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.758773 Oct 12 22:41:14.364758 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1213/2316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:13 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:14.622837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:14.623413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:14.634882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:14.636099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:14.637996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:14.639355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:14.641310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:14.642296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:14.976055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:14.996509 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24a38200-7c9b-4f17-b6a5-56353632369f tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 0.879648 Oct 12 22:41:15.019205 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1104/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:14 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:15.031129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:15.034657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:15.051172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:15.053244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:15.053724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:15.054485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:15.054953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:15.055391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:15.155872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:15.172057 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-962dea7f-ee67-4772-9e6f-58a85f66b6bf tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.553099 Oct 12 22:41:15.174585 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1214/2318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:14 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:15.187766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:15.193965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:15.200379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:15.212933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:15.214072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:15.221256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:15.223481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:15.224787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:15.226279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:15.431990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:15.440856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:15.442329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:15.467784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dabcb347-db1e-404a-8788-0b03964bfcd5 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.291802 Oct 12 22:41:15.468325 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1215/2319] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:15 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:15.477113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:15.478068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:15.492362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:15.493097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:15.493840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:15.494740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:15.495348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:15.495975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:15.973548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:15.984094 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41d3eb32-42e2-4ae8-a55d-2a4dc5cfdda0 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.513940 Oct 12 22:41:15.990378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1216/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:15 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:16.011107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:16.024499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:16.025418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:16.032604 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d72575be-b343-4e93-9adf-e668455c82b6 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1305 microversion: 2.1 time: 1.011948 Oct 12 22:41:16.043935 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1105/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:15 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1305 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:16.044221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.044221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.044221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:16.053083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.053083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.053083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:16.199814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:16.200559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:16.212791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.213281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.213717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:16.214423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.214870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.215288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:16.664842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:16.682419 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5887ecd8-7035-4203-afa6-49709c863238 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 0.661796 Oct 12 22:41:16.683540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1217/2322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:16 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:16.694130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:16.696459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:16.727811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:16.730693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.731471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.732949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:16.734592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:16.738962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:16.740293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.164046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:17.176949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:17.179358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:17.194275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-43994bf2-e06d-4656-855b-b70b248d4ca6 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.505601 Oct 12 22:41:17.198952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:17.209057 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1218/2323] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:16 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:17.215570 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6951dc3-2744-4b7e-b113-d91e4da7c440 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 1.018017 Oct 12 22:41:17.221487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f63bcedc-f932-40f9-b228-889f56af7691 req-2bc71ed2-7476-46bb-824a-fbe707f664f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af2a4581-f5f4-4296-8090-fce824218b58", "tag": "ec81fc5d-031f-4eed-bfa8-025518cc5b7c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:17.230376 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1106/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:16 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:17.231209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f63bcedc-f932-40f9-b228-889f56af7691 req-2bc71ed2-7476-46bb-824a-fbe707f664f3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.232038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f63bcedc-f932-40f9-b228-889f56af7691 req-2bc71ed2-7476-46bb-824a-fbe707f664f3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.232753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f63bcedc-f932-40f9-b228-889f56af7691 req-2bc71ed2-7476-46bb-824a-fbe707f664f3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.246921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:17.247423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:17.257636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f63bcedc-f932-40f9-b228-889f56af7691 req-2bc71ed2-7476-46bb-824a-fbe707f664f3 service nova] Creating event network-changed:ec81fc5d-031f-4eed-bfa8-025518cc5b7c for instance af2a4581-f5f4-4296-8090-fce824218b58 on n-h2-860864-8 Oct 12 22:41:17.265113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f63bcedc-f932-40f9-b228-889f56af7691 req-2bc71ed2-7476-46bb-824a-fbe707f664f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054747 Oct 12 22:41:17.265288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.265790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.266216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.267011 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1219/2325] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:17.272828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.273317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.277052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.283743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:17.285238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:17.305944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.308825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.312767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.316575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.319163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.320204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.653571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:17.664012 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0468b290-bc67-4758-b5ad-3dd04c7f9155 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1476 microversion: 2.1 time: 0.430538 Oct 12 22:41:17.666846 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1107/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:17 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1476 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:17.675942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:17.691672 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-622672b5-a1e0-43ae-a46a-460c946e6533 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.422225 Oct 12 22:41:17.694008 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1220/2327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:17 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:17.715700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:17.716358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:17.724297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.724787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.725226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.725927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:17.726380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:17.726805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:17.791089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-165566069", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6d038ce6-8207-430e-9e62-1f91872f202e"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:17.866865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] validate_networks() for [('6d038ce6-8207-430e-9e62-1f91872f202e', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:41:18.059401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:18.070569 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-640f3584-6633-4c4b-82c4-7dc8eeab24b8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 0.362989 Oct 12 22:41:18.085807 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1221/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:17 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:18.225765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:18.226788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:18.240451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.241496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.242075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:18.243119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.245518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.246145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:18.402758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:18.414034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:18.425040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:18.441225 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca232c74-647b-4cb0-8349-6d6181b6ae38 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.219386 Oct 12 22:41:18.446725 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1222/2329] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:18 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:18.476878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:18.477845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:18.484550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.485414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.486192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:18.487665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.488358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.489004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:18.840255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:18.853399 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d058866b-1804-4375-8ef4-d8689adc6616 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.392127 Oct 12 22:41:18.855137 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1223/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:18 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:18.862271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:18.863612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:18.876051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.876828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.878116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:18.879768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:18.880479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:18.881118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:19.616834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:19.631886 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cdd5014-d12e-45a2-9200-c2bfd245b9d1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1475 microversion: 2.1 time: 0.772523 Oct 12 22:41:19.633685 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1224/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:18 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1475 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:19.648563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:19.649733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:19.681446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:19.681957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:19.682511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:19.683878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:19.684358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:19.684780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:19.720354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:41:19.722018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:41:19.723000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:41:19.723564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:41:19.724162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:41:19.745616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:19.746105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:19.746536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:19.752978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:19.753465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:19.756333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:19.806797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Getting quotas for project ef62b85484ce483b9d684052e84715e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:19.820879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Getting quotas for user 16cb60a7f0bf48d6b2af7e7b15e2388b and project ef62b85484ce483b9d684052e84715e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:19.860449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:41:19.865004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:41:19.971607 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37e41383-9fc1-46f7-abcb-f026e5adeefd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.302857 Oct 12 22:41:19.984309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1108/2332] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:41:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:41:20.003862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:20.014539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:20.026857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.027702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.028626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.033090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.034038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.034548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.139738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:20.158184 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-caada5d2-8b49-4e26-aeaa-8300a21fe624 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.521470 Oct 12 22:41:20.158807 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1225/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:19 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:20.185366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:20.185994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:20.205436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.212396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.213052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.213981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.214616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.223183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.497398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:20.517092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:20.519907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:20.532855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34e2e0a1-1a41-495b-b7d3-6fdca738d309 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.359586 Oct 12 22:41:20.545001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1226/2334] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:20 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:20.564341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:20.572029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:20.584338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.586746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.587415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.588568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:20.589282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:20.590096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:20.637277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:20.660995 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-39ea7a04-54f8-4732-83f9-30fc96e11134 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 0.675413 Oct 12 22:41:20.669914 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1109/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:19 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:20.678306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57ca861a-0ab8-4ba7-a8c5-cbe3f4e28bdd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:20.695592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57ca861a-0ab8-4ba7-a8c5-cbe3f4e28bdd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:21.057506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:21.083076 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a9f2121-aa3e-4b36-8a72-9962230a8c23 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.536566 Oct 12 22:41:21.084056 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1227/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:20 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:21.193531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c17a6c4f-38c1-4724-8777-9321581bba79 req-245503a4-22bb-4510-8bde-0b664ab21040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7824d9-b1c1-4331-99d5-21fb4e9516e2", "name": "network-vif-plugged", "status": "completed", "tag": "a93dd5fb-5c3d-4977-b15a-bff0134c7b14"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:21.215765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c17a6c4f-38c1-4724-8777-9321581bba79 req-245503a4-22bb-4510-8bde-0b664ab21040 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.216573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c17a6c4f-38c1-4724-8777-9321581bba79 req-245503a4-22bb-4510-8bde-0b664ab21040 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.217238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c17a6c4f-38c1-4724-8777-9321581bba79 req-245503a4-22bb-4510-8bde-0b664ab21040 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.242847 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c17a6c4f-38c1-4724-8777-9321581bba79 req-245503a4-22bb-4510-8bde-0b664ab21040 service nova] Creating event network-vif-plugged:a93dd5fb-5c3d-4977-b15a-bff0134c7b14 for instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 on n-h2-860864-8 Oct 12 22:41:21.250947 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c17a6c4f-38c1-4724-8777-9321581bba79 req-245503a4-22bb-4510-8bde-0b664ab21040 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165242 Oct 12 22:41:21.252782 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1228/2337] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:21.264334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:21.265947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:21.274884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.275470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.276108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.279674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.280528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.281178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.648915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-57ca861a-0ab8-4ba7-a8c5-cbe3f4e28bdd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:21.661976 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57ca861a-0ab8-4ba7-a8c5-cbe3f4e28bdd tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1216 microversion: 2.1 time: 0.989217 Oct 12 22:41:21.670479 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1110/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:20 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1216 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:21.676301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:21.677185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:21.688323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:21.691770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.694807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.695474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.697895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.698626 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62a0ffe0-484a-4d1c-9752-ca819cf179b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1475 microversion: 2.1 time: 0.444430 Oct 12 22:41:21.700052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.701095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.701688 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1229/2339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:21 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:21.709531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:21.710145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:21.729073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.729582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.731952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:21.733236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:21.734911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:21.736960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.033169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.052430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:22.067110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.071767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.080431 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b3faec5-a128-476b-ba4b-ccd90e4e887a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1558 microversion: 2.91 time: 0.377443 Oct 12 22:41:22.082113 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1230/2340] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:21 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1558 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:22.094688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:22.106304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:22.121583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.122885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.123443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.124805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.125364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.127021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.160001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.180535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-11e80de3-fac7-4737-9573-5134420cf0b9 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.508282 Oct 12 22:41:22.181473 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1111/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:21 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:22.186584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-25e9f871-75e9-4f93-9f26-b22e9d744292 req-e4a832c5-8e41-4c69-a256-ff2f50c1b842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bbf111-4479-4f63-b205-094fb84ab3c9", "name": "network-vif-unplugged", "status": "completed", "tag": "33396dab-3e25-41bf-a80c-4f7317e8f40d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:22.210301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-25e9f871-75e9-4f93-9f26-b22e9d744292 req-e4a832c5-8e41-4c69-a256-ff2f50c1b842 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.210979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-25e9f871-75e9-4f93-9f26-b22e9d744292 req-e4a832c5-8e41-4c69-a256-ff2f50c1b842 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.212141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-25e9f871-75e9-4f93-9f26-b22e9d744292 req-e4a832c5-8e41-4c69-a256-ff2f50c1b842 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.232514 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-25e9f871-75e9-4f93-9f26-b22e9d744292 req-e4a832c5-8e41-4c69-a256-ff2f50c1b842 service nova] Creating event network-vif-unplugged:33396dab-3e25-41bf-a80c-4f7317e8f40d for instance 33bbf111-4479-4f63-b205-094fb84ab3c9 on n-h2-860864-8 Oct 12 22:41:22.245705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-25e9f871-75e9-4f93-9f26-b22e9d744292 req-e4a832c5-8e41-4c69-a256-ff2f50c1b842 service nova] Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:41:22.262734 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-25e9f871-75e9-4f93-9f26-b22e9d744292 req-e4a832c5-8e41-4c69-a256-ff2f50c1b842 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078755 Oct 12 22:41:22.264234 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1112/2342] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:22.270506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:22.271574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:22.282600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.284018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.284621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.285869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.286994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.287725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.427216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.438049 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32767213-4d1b-4e42-a234-988f563c24f6 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1305 microversion: 2.1 time: 0.354573 Oct 12 22:41:22.452640 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1231/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:22 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1305 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:22.685493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:22.686749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:22.701431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.702114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.702705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.703569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.704193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.704762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.707822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.715932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00ea533f-875b-4de3-b026-afdea830873e tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.450309 Oct 12 22:41:22.736383 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1113/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:22 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:22.741847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:22.742463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:22.764337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.764852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.765304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.766021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:22.766729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:22.767268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:22.843052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:22.852879 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-33c9116d-3021-4e93-8842-3342be0cf557 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1274 microversion: 2.1 time: 0.171167 Oct 12 22:41:22.854358 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1232/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:22 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:23.115924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:23.116822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:23.135136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.136649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.139534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.140373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.140836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.141260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.198242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:23.216228 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-640b8dbd-5c54-40ab-8bfc-66cd6621f7d4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1475 microversion: 2.1 time: 0.477322 Oct 12 22:41:23.219427 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1114/2346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:22 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1475 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:23.232403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:23.235151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:23.244167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.244837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.245441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.246389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.246970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.247579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.271299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:23.296417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:23.303337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:23.332820 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9eaff4cd-0ba3-45a3-ad7b-6730bd860847 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.221874 Oct 12 22:41:23.337442 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1233/2347] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:23 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:41:23.462711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:23.464285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:23.473482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.477365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.478173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.479091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.483010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.483854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.907752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:23.918487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dcbfa0c7-734a-47cc-ac5d-204d9c1d9766 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.696479 Oct 12 22:41:23.936288 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1115/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:23 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:23.945601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:23.958091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:23.971420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.975744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.976432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.977440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:23.978725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:23.979416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:23.998339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:24.009381 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69450aaa-6ac7-4ade-927a-20346503d588 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1485 microversion: 2.1 time: 0.550805 Oct 12 22:41:24.010572 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1234/2349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:23 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1485 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:24.034299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:24.039588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:24.060444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:24.065665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.066818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.067429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:24.068347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.069501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.070139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:24.554593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:24.563112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:24.569571 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c33d8fe3-b5d1-4a18-bc45-30e01b46eae2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.631757 Oct 12 22:41:24.572605 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1116/2350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:23 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:24.576546 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4fe04ac9-6c02-4016-a318-53a453c91b96 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 0.563470 Oct 12 22:41:24.577658 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1235/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:24 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:24.592366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-537947150"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:24.594885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:24.599408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:24.617568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.618077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.618523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:24.619257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.619713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.620177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:24.620315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:24.633502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.634254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.635630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:24.638782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:24.639683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:24.642026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.037775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:25.086863 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-947dd11d-7de2-45ee-bfd6-5f940f3159f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "POST /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2/action" status: 202 len: 0 microversion: 2.1 time: 0.505741 Oct 12 22:41:25.090221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1117/2352] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:41:24 2022] POST /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:41:25.101923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f2fda228-e808-4fdc-8caf-14df36ff3fd6 req-7a1abeaa-ff6f-41e8-8ed1-77ca949c49bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bbf111-4479-4f63-b205-094fb84ab3c9", "tag": "33396dab-3e25-41bf-a80c-4f7317e8f40d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:25.131031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f2fda228-e808-4fdc-8caf-14df36ff3fd6 req-7a1abeaa-ff6f-41e8-8ed1-77ca949c49bf service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.136609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f2fda228-e808-4fdc-8caf-14df36ff3fd6 req-7a1abeaa-ff6f-41e8-8ed1-77ca949c49bf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.138894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f2fda228-e808-4fdc-8caf-14df36ff3fd6 req-7a1abeaa-ff6f-41e8-8ed1-77ca949c49bf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.170941 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f2fda228-e808-4fdc-8caf-14df36ff3fd6 req-7a1abeaa-ff6f-41e8-8ed1-77ca949c49bf service nova] Creating event network-changed:33396dab-3e25-41bf-a80c-4f7317e8f40d for instance 33bbf111-4479-4f63-b205-094fb84ab3c9 on n-h2-860864-8 Oct 12 22:41:25.188748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-f2fda228-e808-4fdc-8caf-14df36ff3fd6 req-7a1abeaa-ff6f-41e8-8ed1-77ca949c49bf service nova] Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:41:25.220185 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f2fda228-e808-4fdc-8caf-14df36ff3fd6 req-7a1abeaa-ff6f-41e8-8ed1-77ca949c49bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128219 Oct 12 22:41:25.226444 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1118/2353] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:25.237091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:25.238094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:25.253371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.254048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.254667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.258132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.258797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.259547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.370687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:25.380432 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac0dd3ca-f952-4f67-8204-a2fb03f7394d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1475 microversion: 2.1 time: 0.801282 Oct 12 22:41:25.381375 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1236/2354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:24 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1475 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:25.389484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:25.394704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:25.408286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.409734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.412025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.414920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.416772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.417451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.721587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:25.735653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:25.742242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:25.782204 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5cc0c425-0714-4931-8913-00a974133916 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.550809 Oct 12 22:41:25.792346 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1119/2355] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:25 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:25.812908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-61c23a99-32dd-4dfd-84d8-893a3eb5c35c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4b0b80>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:25.878913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:25.888566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c010e78-3f56-4c3e-a3c6-a4755d1f92cc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.505908 Oct 12 22:41:25.897588 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1237/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:25 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:25.906843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:25.907535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:25.916902 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-61c23a99-32dd-4dfd-84d8-893a3eb5c35c tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51" status: 200 len: 1411 microversion: 2.1 time: 0.122539 Oct 12 22:41:25.918110 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1120/2357] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:41:25 2022] GET /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51 => generated 1411 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:25.926128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.926882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.927541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.929595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:25.929849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.931708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:25.933612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.935444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.955928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.956589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.957103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:25.957829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:25.958283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:25.958708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:26.348601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:26.361793 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d18f5068-4c58-4dca-9548-2e93ecfe43d2 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 0.442166 Oct 12 22:41:26.376007 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1121/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:25 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:26.512603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-66c02795-5663-46de-9441-d02f83480c1d req-22102aba-4fac-489d-94cf-d8a513f5f921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9900adbf-6dfa-4945-ba58-125ccd2773fc", "tag": "ed8bd26d-f1ce-42cc-a09f-e2846309d977"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:26.545674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66c02795-5663-46de-9441-d02f83480c1d req-22102aba-4fac-489d-94cf-d8a513f5f921 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:26.546162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66c02795-5663-46de-9441-d02f83480c1d req-22102aba-4fac-489d-94cf-d8a513f5f921 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:26.546591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66c02795-5663-46de-9441-d02f83480c1d req-22102aba-4fac-489d-94cf-d8a513f5f921 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:26.573952 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-66c02795-5663-46de-9441-d02f83480c1d req-22102aba-4fac-489d-94cf-d8a513f5f921 service nova] Creating event network-changed:ed8bd26d-f1ce-42cc-a09f-e2846309d977 for instance 9900adbf-6dfa-4945-ba58-125ccd2773fc on n-h1-860864-8 Oct 12 22:41:26.579054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-66c02795-5663-46de-9441-d02f83480c1d req-22102aba-4fac-489d-94cf-d8a513f5f921 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208995 Oct 12 22:41:26.580107 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1122/2359] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:26.585839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e58fb0b8-c485-4e23-8247-3f2034973309 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4b0c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:26.687276 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e58fb0b8-c485-4e23-8247-3f2034973309 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51" status: 200 len: 1411 microversion: 2.1 time: 0.104580 Oct 12 22:41:26.698742 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1123/2360] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:41:26 2022] GET /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51 => generated 1411 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:26.719844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:26.721817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:26.750351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:26.750862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:26.751310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:26.770192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:26.771199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:26.772950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:26.784194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:26.794457 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fbb89618-2807-4d92-909c-5a34543c81e2 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.895761 Oct 12 22:41:26.820835 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1238/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:25 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:26.834076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e564eea-7934-4777-8c73-8a58417214c8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff4708b0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:27.146473 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e564eea-7934-4777-8c73-8a58417214c8 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51" status: 204 len: 0 microversion: 2.1 time: 0.324362 Oct 12 22:41:27.147683 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1239/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:26 2022] DELETE /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:27.153055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:27.154367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:27.169780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.170536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.171149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.172169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.172845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.173541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.350509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:27.363202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:27.364113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:27.366536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:27.377734 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7b2a1e3-063b-4c28-9479-79c24d404985 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1473 microversion: 2.1 time: 0.676234 Oct 12 22:41:27.378633 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1124/2363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:26 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1473 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:27.390067 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-820cd265-d490-4c91-adf8-4724be92ecf4 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.241034 Oct 12 22:41:27.394730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:27.397537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:27.412322 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1240/2364] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:27 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:27.417925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.423346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.424645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.425643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.430558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.431411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.433539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36391b56-bde7-423b-aaa4-2d6d9bcf373b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507c2c550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:27.459121 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-36391b56-bde7-423b-aaa4-2d6d9bcf373b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Image not found. Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36391b56-bde7-423b-aaa4-2d6d9bcf373b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51 HTTP/1.1 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'fb13b4ca-8272-4957-a9f5-2261ec58bb51'} Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fb13b4ca-8272-4957-a9f5-2261ec58bb51 Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 22:41:27.461321 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb13b4ca-8272-4957-a9f5-2261ec58bb51 could not be found. Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:41:27.465406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:27.469544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36391b56-bde7-423b-aaa4-2d6d9bcf373b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:27.470684 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36391b56-bde7-423b-aaa4-2d6d9bcf373b tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51" status: 404 len: 62 microversion: 2.1 time: 0.057273 Oct 12 22:41:27.472354 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1241/2365] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:41:27 2022] GET /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:41:27.485882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:27.486864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:27.496156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.501244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.502012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.502918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.503532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.504141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.821527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:27.829731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd7b7f20-7b36-43fa-90c4-8fb0a0a1bf4a tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 0.356108 Oct 12 22:41:27.831986 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1242/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:27 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:27.843682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:27.844598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:27.858101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.860377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.862235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:27.865381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:27.868226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:27.868844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.220946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:28.232884 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-61338041-bff0-432c-a26e-6b7c88a2c235 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.851686 Oct 12 22:41:28.234983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1125/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:27 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:28.279985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:28.280719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:28.310470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:28.320302 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d66b1e79-dcc0-4887-a75d-4da7deb24224 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1503 microversion: 2.1 time: 0.483141 Oct 12 22:41:28.324940 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1243/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:27 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1503 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:28.334741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.335252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.337065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.337820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.338284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.342989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.405007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:28.406241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:28.413171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.413938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.415867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.417149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.420634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.421536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.834110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:28.849459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8d9a13da-c720-42e3-a932-36f143b81010 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.613089 Oct 12 22:41:28.850052 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1126/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:28 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:28.891726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:28.894228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:28.928028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.928028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.928028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:28.928549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:28.928977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:28.931709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.147575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:29.166542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:29.172198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:29.208724 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9fe0b79d-7a7d-4dd3-99e1-77805b70fcba tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.338990 Oct 12 22:41:29.209963 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1127/2370] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:28 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:29.233539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:29.234604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:29.249303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.251574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.255052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.255953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.256546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.259490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.475741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:29.485531 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a761b26e-3e00-47ef-b627-5cb99127a45d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1470 microversion: 2.1 time: 1.084712 Oct 12 22:41:29.490554 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1244/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:28 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1470 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:29.495911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d57a5e64-f4ed-44cd-88ef-dc771375b859 req-eeea0313-b313-49e1-adbe-f830ca87e87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2a4581-f5f4-4296-8090-fce824218b58", "name": "network-vif-plugged", "status": "completed", "tag": "ec81fc5d-031f-4eed-bfa8-025518cc5b7c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:29.525062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d57a5e64-f4ed-44cd-88ef-dc771375b859 req-eeea0313-b313-49e1-adbe-f830ca87e87c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.530272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d57a5e64-f4ed-44cd-88ef-dc771375b859 req-eeea0313-b313-49e1-adbe-f830ca87e87c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.531188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d57a5e64-f4ed-44cd-88ef-dc771375b859 req-eeea0313-b313-49e1-adbe-f830ca87e87c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.570059 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d57a5e64-f4ed-44cd-88ef-dc771375b859 req-eeea0313-b313-49e1-adbe-f830ca87e87c service nova] Creating event network-vif-plugged:ec81fc5d-031f-4eed-bfa8-025518cc5b7c for instance af2a4581-f5f4-4296-8090-fce824218b58 on n-h2-860864-8 Oct 12 22:41:29.589125 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d57a5e64-f4ed-44cd-88ef-dc771375b859 req-eeea0313-b313-49e1-adbe-f830ca87e87c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096717 Oct 12 22:41:29.600850 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1245/2372] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:29.607059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:29.607767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:29.627713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.635088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.635588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.642270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.643315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.645951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.719118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:29.742651 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-354d061b-eaae-41e0-b52d-82bc617774cc tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 0.522176 Oct 12 22:41:29.770574 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1128/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:29 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:29.770574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:29.770574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:29.785582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.785582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.785582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.787674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:29.788302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:29.788752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:29.790715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:30.158013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:30.183813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ac9f674-4879-45b8-8c2b-f289b193ff54 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.581286 Oct 12 22:41:30.184970 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1246/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:29 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:30.202017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:30.202997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:30.224803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.234320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.234771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.235808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.236363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.237290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.415986 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-18a84371-89c1-4039-b53b-1fd36078816a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9/action" status: 204 len: 0 microversion: 2.1 time: 0.229678 Oct 12 22:41:30.417024 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1247/2375] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:41:30 2022] POST /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9/action => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:30.435296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:30.449134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:30.469480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.470238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.476768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.478203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.478832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.479413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.570837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:30.585378 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e57f21cf-1f09-4cfa-9e3c-7e943f3cc7e2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1485 microversion: 2.1 time: 0.822839 Oct 12 22:41:30.604070 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1129/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:29 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1485 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:30.613031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:30.620858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:30.630847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.631661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.632481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.635164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.635817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.636455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.886660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:30.900619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:30.911074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:30.917030 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2020f8f1-a9b5-415d-a4ef-3e5e527509a9 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.311540 Oct 12 22:41:30.920425 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1130/2377] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:30 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:30.936611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:30.937580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:30.949949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.951136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.951821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:30.962133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:30.962977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:30.963638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.115080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:31.126520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9fc9e2ea-5bf6-4bbf-a5be-5d0f44371818 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.706724 Oct 12 22:41:31.130424 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1248/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:30 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:31.151649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:31.153071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:31.173618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.175003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.175572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.176428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.177101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.177738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.182475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:31.222227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:41:31.416615 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d1467208-031c-42f2-9c50-076bdc2c4b80 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 204 len: 0 microversion: 2.1 time: 0.282221 Oct 12 22:41:31.419487 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1249/2379] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:31 2022] DELETE /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:31.454581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:31.462758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:31.479512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.480436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.482902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.490973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.491795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.492484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.620152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:31.629303 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cde77df6-b7ca-493b-b99f-0439fde6d3a3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1470 microversion: 2.1 time: 0.707509 Oct 12 22:41:31.631647 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1131/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:30 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1470 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:31.637044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:31.647602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:31.656369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:31.658106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.662084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.662748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.664267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:31.672340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:31.673011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:31.928176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:31.940858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab06c41e-8629-48d7-929e-b171d6beea59 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 0.518978 Oct 12 22:41:31.942287 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1250/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:31 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:31.947272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0259fcd-bead-485f-a849-6f01a47ee13e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44fee9a1f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:31.988884 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a0259fcd-bead-485f-a849-6f01a47ee13e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Image not found. Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0259fcd-bead-485f-a849-6f01a47ee13e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51 HTTP/1.1 Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'fb13b4ca-8272-4957-a9f5-2261ec58bb51'} Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fb13b4ca-8272-4957-a9f5-2261ec58bb51 to delete Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb13b4ca-8272-4957-a9f5-2261ec58bb51 could not be found. Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:31.991199 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0259fcd-bead-485f-a849-6f01a47ee13e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:31.996033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0259fcd-bead-485f-a849-6f01a47ee13e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51" status: 404 len: 62 microversion: 2.1 time: 0.049247 Oct 12 22:41:31.997637 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1251/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:31 2022] DELETE /compute/v2.1/images/fb13b4ca-8272-4957-a9f5-2261ec58bb51 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:41:32.002648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:32.003271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:32.011643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.012171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.013043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.013774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.014236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.014669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.154202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:32.156850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:32.166472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:32.167216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-84362c42-e649-47f2-96a8-08ad7d665f11 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1293 microversion: 2.1 time: 0.533745 Oct 12 22:41:32.167804 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1132/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:31 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1293 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:32.182777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:32.187218 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e1461f01-571b-4477-8aae-d70fd36e1a4f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.189079 Oct 12 22:41:32.187940 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1252/2384] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:31 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:32.191513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:32.192863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:32.206324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:32.206983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:32.208481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.212081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.212739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.214983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.215617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.216250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.223804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.224397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.224843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.228369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.228882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.229321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.271213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:41:32.362248 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Instance is already in deleting state, ignoring this request Oct 12 22:41:32.364158 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23825fd3-53a1-42ab-a941-8a5a641b8a25 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 204 len: 0 microversion: 2.1 time: 0.176801 Oct 12 22:41:32.365898 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1133/2385] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:32 2022] DELETE /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:32.378619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:32.380563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:32.395909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.396491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.396934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.400277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.400892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.401352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.730914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:32.744012 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb639d1f-aa55-4ac5-9af7-828fff995d9d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.554956 Oct 12 22:41:32.760208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1253/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:32 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:32.760208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:32.760208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:32.772174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.774088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.774524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:32.776571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:32.777035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:32.778615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.258339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:33.286978 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2188dafe-7420-4614-be7a-8dd44cc43bac tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1491 microversion: 2.1 time: 0.916176 Oct 12 22:41:33.287774 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1134/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:32 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1491 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:33.301700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:33.302699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:33.314151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:33.322990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.323679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.324486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.327597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.329036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.332771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.362722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:33.377673 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a181633f-b662-430e-b4bf-f0a1ef6e759c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1470 microversion: 2.1 time: 0.630644 Oct 12 22:41:33.380104 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1254/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:32 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1470 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:33.389655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:33.391557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:33.407345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.414212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.420298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:33.421268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:33.421943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:33.422513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.597402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.609386 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-136295d0-a7a9-45ad-9f17-5955edda876b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1484 microversion: 2.1 time: 1.225949 Oct 12 22:41:34.612167 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1255/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:33 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1484 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:34.618917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:34.632896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:34.647844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.648663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.651124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.655639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.660649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.662430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.827787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.841368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.843173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:34.866189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-733e92d9-a432-4ab2-8f5d-9c0f665594f3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.252722 Oct 12 22:41:34.878232 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1256/2390] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:34 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:34.895868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:34.896800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:34.912447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.914613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.916532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:34.921353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:34.922118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:34.922702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.390014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:35.412324 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d2a0619-c102-465e-af71-1988b012fd3a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.532675 Oct 12 22:41:35.416757 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1257/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:34 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:35.422449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:35.423258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:35.432639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.433487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.439012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.440520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.440996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.441429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.570518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:35.585040 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb8940c4-7758-4a32-bee5-c4f8886d0b64 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 2.294995 Oct 12 22:41:35.585929 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1135/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:33 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:35.660102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:35.660779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:35.682024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.684082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.684737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.686228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.688105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.688690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.700950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:35.962329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080644f7502346ed8ff64a026ac9d15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd9f81dd574deaa7986c986e944e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:35.969314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:35.980202 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f87fca79-3a14-4a72-a54f-3d5fe42970c1 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 200 len: 1449 microversion: 2.1 time: 0.562127 Oct 12 22:41:35.980608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e465945-cca9-414a-bcd6-c68f5c1fc673 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1462 microversion: 2.1 time: 0.355044 Oct 12 22:41:35.993933 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1258/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:35 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 1449 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:35.994121 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1136/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:35 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1462 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:35.994230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:35.994230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:35.994386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4e71ac71-a8cd-44e9-b224-43740906f43f req-df573975-2554-4ea3-98f6-2e026efdce02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bbf111-4479-4f63-b205-094fb84ab3c9", "name": "network-vif-plugged", "status": "completed", "tag": "33396dab-3e25-41bf-a80c-4f7317e8f40d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:35.994471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.994671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.995267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:35.996553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:35.997148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:35.997773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.022566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4e71ac71-a8cd-44e9-b224-43740906f43f req-df573975-2554-4ea3-98f6-2e026efdce02 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.023045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4e71ac71-a8cd-44e9-b224-43740906f43f req-df573975-2554-4ea3-98f6-2e026efdce02 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.023625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4e71ac71-a8cd-44e9-b224-43740906f43f req-df573975-2554-4ea3-98f6-2e026efdce02 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.050036 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4e71ac71-a8cd-44e9-b224-43740906f43f req-df573975-2554-4ea3-98f6-2e026efdce02 service nova] Creating event network-vif-plugged:33396dab-3e25-41bf-a80c-4f7317e8f40d for instance 33bbf111-4479-4f63-b205-094fb84ab3c9 on n-h2-860864-8 Oct 12 22:41:36.055237 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4e71ac71-a8cd-44e9-b224-43740906f43f req-df573975-2554-4ea3-98f6-2e026efdce02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071348 Oct 12 22:41:36.055860 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1137/2395] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:36.061444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ce95895c-1640-48ed-9096-44b297fdb9b1 req-0afb3c53-ab01-4ba4-a5de-54e24dc0ab23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7824d9-b1c1-4331-99d5-21fb4e9516e2", "name": "network-vif-deleted", "tag": "a93dd5fb-5c3d-4977-b15a-bff0134c7b14"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:36.073406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ce95895c-1640-48ed-9096-44b297fdb9b1 req-0afb3c53-ab01-4ba4-a5de-54e24dc0ab23 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.074159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ce95895c-1640-48ed-9096-44b297fdb9b1 req-0afb3c53-ab01-4ba4-a5de-54e24dc0ab23 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.074742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ce95895c-1640-48ed-9096-44b297fdb9b1 req-0afb3c53-ab01-4ba4-a5de-54e24dc0ab23 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.088194 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ce95895c-1640-48ed-9096-44b297fdb9b1 req-0afb3c53-ab01-4ba4-a5de-54e24dc0ab23 service nova] Creating event network-vif-deleted:a93dd5fb-5c3d-4977-b15a-bff0134c7b14 for instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 on n-h2-860864-8 Oct 12 22:41:36.093896 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ce95895c-1640-48ed-9096-44b297fdb9b1 req-0afb3c53-ab01-4ba4-a5de-54e24dc0ab23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036698 Oct 12 22:41:36.095026 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1138/2396] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:36.101044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:36.101915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:36.109057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.109762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.110370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.111070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.111551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.112182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.199108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:36.211487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:36.213522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:36.221056 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-acbede38-8555-499d-ae57-42e3c9fa4b60 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.124618 Oct 12 22:41:36.240976 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1139/2397] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:36 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:36.250582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:36.252527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:36.260377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.261328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.261916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.262874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.264269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.264920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.297426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d99cd059-b371-4cd5-96a5-d0fa0fb6a703 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.314950 Oct 12 22:41:36.298040 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1259/2398] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:41:35 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58/os-interface => generated 284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:36.442601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:36.444204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:36.452005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.452748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.468315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.469722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.471957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.472600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.694788 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-44963541-17fa-4cfa-8e45-f998c87dcc6f tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1613 microversion: 2.1 time: 0.451868 Oct 12 22:41:36.697893 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1140/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:36 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1613 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:36.707093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:36.710967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:36.729592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.733834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.738580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:36.739569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:36.742286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:36.745018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.124832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:37.144351 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5584c9c7-4feb-40fc-9575-7eecb1347866 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1505 microversion: 2.1 time: 0.706862 Oct 12 22:41:37.147605 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1260/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:36 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1505 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:37.155760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-604a4748-ff26-487a-9642-2ab6b758e974 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '.version_select at 0x7f44fee16280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.170544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-604a4748-ff26-487a-9642-2ab6b758e974 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.171361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-604a4748-ff26-487a-9642-2ab6b758e974 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.172093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-604a4748-ff26-487a-9642-2ab6b758e974 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.197789 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-604a4748-ff26-487a-9642-2ab6b758e974 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.048801 Oct 12 22:41:37.204304 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1261/2401] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:41:37 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:37.215332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.219057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: bd7824d9-b1c1-4331-99d5-21fb4e9516e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.239528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.242057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.244408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.245554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.247694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.249121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.275457 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 could not be found. Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 HTTP/1.1 Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 could not be found. Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'bd7824d9-b1c1-4331-99d5-21fb4e9516e2'} Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 could not be found. Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 could not be found. Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.278196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.281979 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.281979 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.281979 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:37.281979 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:37.281979 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 could not be found. Oct 12 22:41:37.281979 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.286163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance bd7824d9-b1c1-4331-99d5-21fb4e9516e2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:37.287272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7fe670bc-8346-468b-bf82-acb61f4912fa tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2" status: 404 len: 111 microversion: 2.1 time: 0.076896 Oct 12 22:41:37.292919 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1262/2402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:37 2022] GET /compute/v2.1/servers/bd7824d9-b1c1-4331-99d5-21fb4e9516e2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:37.298292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.299256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.306476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.307310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.308016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.308933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.309607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.310240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.476859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:37.485413 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52463e53-d4cc-4fca-b763-d69dfa14c0f4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 0.786075 Oct 12 22:41:37.493412 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1141/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:36 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:37.503618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.504506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.519662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.521380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.521695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:37.523327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.524195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.525146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.525772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.536450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:37.539253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:37.544891 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 HTTP/1.1 Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '87453709-f447-4daa-9cdf-1bf7738bee87'} Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:37.546986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.553393 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.554427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:37.555765 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f3b4b776-e73a-4415-a2d8-46c32d362633 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 404 len: 111 microversion: 2.1 time: 0.060816 Oct 12 22:41:37.556892 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1142/2404] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:37 2022] DELETE /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:37.563271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1061267365", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:37.563586 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce61079f-d805-457d-99b5-07761a0a3f49 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.268992 Oct 12 22:41:37.564385 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1263/2405] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:37 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:37.571434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.577313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 87453709-f447-4daa-9cdf-1bf7738bee87] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.588519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.593549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.594339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.595284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.596507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.600666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.632194 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 HTTP/1.1 Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '87453709-f447-4daa-9cdf-1bf7738bee87'} Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.633729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 87453709-f447-4daa-9cdf-1bf7738bee87 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:37.642838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa0f69a5-355d-4af7-b0a4-bfebeb71b9cb tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87" status: 404 len: 111 microversion: 2.1 time: 0.073150 Oct 12 22:41:37.644192 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1264/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:37 2022] GET /compute/v2.1/servers/87453709-f447-4daa-9cdf-1bf7738bee87 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:37.655940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:41:37.656198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cefd8c59-8cf4-45fe-876c-2b792337219e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44fee40b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.699918 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-cefd8c59-8cf4-45fe-876c-2b792337219e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Image not found. Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cefd8c59-8cf4-45fe-876c-2b792337219e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad HTTP/1.1 Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'cbbbe05b-b730-4be2-a1af-664e5eebd8ad'} Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cbbbe05b-b730-4be2-a1af-664e5eebd8ad to delete Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cbbbe05b-b730-4be2-a1af-664e5eebd8ad could not be found. Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.702037 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:41:37.706572 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.708920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cefd8c59-8cf4-45fe-876c-2b792337219e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:37.709951 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cefd8c59-8cf4-45fe-876c-2b792337219e tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad" status: 404 len: 62 microversion: 2.1 time: 0.064570 Oct 12 22:41:37.710836 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1265/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:37 2022] DELETE /compute/v2.1/images/cbbbe05b-b730-4be2-a1af-664e5eebd8ad => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:41:37.721840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.725959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.741974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.745602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.748082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.749321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.752214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.755113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.793366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 HTTP/1.1 Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f23ffeb9-2df6-4806-a53f-597231c291a0'} Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:37.795645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.799953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.806095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:37.807194 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9347d48-ab5a-4995-8e3c-2711212af288 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 404 len: 111 microversion: 2.1 time: 0.091995 Oct 12 22:41:37.810669 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1266/2408] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:37 2022] DELETE /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:41:37.823284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.824246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: f23ffeb9-2df6-4806-a53f-597231c291a0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.833413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.834062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.834983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.835693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.836395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.836915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.854727 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 HTTP/1.1 Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f23ffeb9-2df6-4806-a53f-597231c291a0'} Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.856690 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.861170 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.861170 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.861170 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:37.861170 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:37.861170 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. Oct 12 22:41:37.861170 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.864615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance f23ffeb9-2df6-4806-a53f-597231c291a0 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:37.870281 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1750ece7-812b-449c-a560-de7c409c21ce tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0" status: 404 len: 111 microversion: 2.1 time: 0.052395 Oct 12 22:41:37.873822 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1267/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:37 2022] GET /compute/v2.1/servers/f23ffeb9-2df6-4806-a53f-597231c291a0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:37.879669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8506918-8b95-4564-b9fa-5d3f30d80cb2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f4507c3a310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.919466 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f8506918-8b95-4564-b9fa-5d3f30d80cb2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Image not found. Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8506918-8b95-4564-b9fa-5d3f30d80cb2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 HTTP/1.1 Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9'} Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 to delete Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 could not be found. Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.922237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:37.925989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8506918-8b95-4564-b9fa-5d3f30d80cb2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:37.933810 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f8506918-8b95-4564-b9fa-5d3f30d80cb2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9" status: 404 len: 62 microversion: 2.1 time: 0.048783 Oct 12 22:41:37.935531 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1268/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:37 2022] DELETE /compute/v2.1/images/c5e8ac08-fe82-4c33-909b-dfbfdbe0c6d9 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:41:37.948466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:37.950821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:37.973282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.973876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.974327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:37.975065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:37.979622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:37.980153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.008064 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 HTTP/1.1 Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '65ba94be-a6bf-4bed-8644-0971210edb33'} Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:38.021524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:38.026816 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a7864e3-aef3-4bff-9bd6-23ab0c8f5770 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 404 len: 111 microversion: 2.1 time: 0.086288 Oct 12 22:41:38.031657 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1269/2411] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:37 2022] DELETE /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:38.047200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.047821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 65ba94be-a6bf-4bed-8644-0971210edb33] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.058088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.058652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.060322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.065897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.066669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.068342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.112611 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 HTTP/1.1 Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '65ba94be-a6bf-4bed-8644-0971210edb33'} Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.117394 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.121227 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.121227 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.121227 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:38.121227 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:38.121227 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. Oct 12 22:41:38.121227 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.125177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 65ba94be-a6bf-4bed-8644-0971210edb33 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:38.126716 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f095c1ac-c100-48e2-a83a-4efc80a5ca05 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33" status: 404 len: 111 microversion: 2.1 time: 0.094743 Oct 12 22:41:38.132962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1270/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:38 2022] GET /compute/v2.1/servers/65ba94be-a6bf-4bed-8644-0971210edb33 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:38.138881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5233835a-0c3f-4d98-911c-d6013a2fc419 req-d3ed936e-04e3-48ad-8e1b-20c447120312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900adbf-6dfa-4945-ba58-125ccd2773fc", "name": "network-vif-plugged", "status": "completed", "tag": "ed8bd26d-f1ce-42cc-a09f-e2846309d977"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:38.149917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5233835a-0c3f-4d98-911c-d6013a2fc419 req-d3ed936e-04e3-48ad-8e1b-20c447120312 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.150647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5233835a-0c3f-4d98-911c-d6013a2fc419 req-d3ed936e-04e3-48ad-8e1b-20c447120312 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.151400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5233835a-0c3f-4d98-911c-d6013a2fc419 req-d3ed936e-04e3-48ad-8e1b-20c447120312 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.166656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5233835a-0c3f-4d98-911c-d6013a2fc419 req-d3ed936e-04e3-48ad-8e1b-20c447120312 service nova] Creating event network-vif-plugged:ed8bd26d-f1ce-42cc-a09f-e2846309d977 for instance 9900adbf-6dfa-4945-ba58-125ccd2773fc on n-h1-860864-8 Oct 12 22:41:38.173914 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5233835a-0c3f-4d98-911c-d6013a2fc419 req-d3ed936e-04e3-48ad-8e1b-20c447120312 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037971 Oct 12 22:41:38.177882 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1271/2413] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:38.208970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc3b6402-0162-45fd-add3-6951b6888043 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44fee0eaf0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.240268 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-dc3b6402-0162-45fd-add3-6951b6888043 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Image not found. Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc3b6402-0162-45fd-add3-6951b6888043 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 HTTP/1.1 Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f1120beb-be7d-46ee-ae7a-882c6194f584'} Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1120beb-be7d-46ee-ae7a-882c6194f584 to delete Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1120beb-be7d-46ee-ae7a-882c6194f584 could not be found. Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.243783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.247458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc3b6402-0162-45fd-add3-6951b6888043 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:38.255463 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc3b6402-0162-45fd-add3-6951b6888043 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584" status: 404 len: 62 microversion: 2.1 time: 0.069278 Oct 12 22:41:38.255463 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1272/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:38 2022] DELETE /compute/v2.1/images/f1120beb-be7d-46ee-ae7a-882c6194f584 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:41:38.262927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.267282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.285607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.286390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.299242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.300536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.301169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.302465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.407631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:41:38.408201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:41:38.408724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:41:38.409243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:41:38.409777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:41:38.429410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.430055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.430591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.431592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.432301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.432973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.471988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:38.484406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for user 70dbe0c8a7784391a83066cb1cb74604 and project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:38.538638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:41:38.541407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:41:38.660195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8eb73db4-9291-49dc-a600-1266e9c83819 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.101943 Oct 12 22:41:38.667999 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1143/2415] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:41:38.676964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.677431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.697906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.698400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.698836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.699536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.700024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.700442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.731230 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c HTTP/1.1 Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '94ffeab8-5085-444f-a1c4-9ad3cd21853c'} Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:38.738515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:38.742765 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:38.745422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:38.746461 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a34fbec0-b31d-4839-93b3-3d120334dfff tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 404 len: 111 microversion: 2.1 time: 0.077239 Oct 12 22:41:38.753495 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1144/2416] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:38 2022] DELETE /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:38.760390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:38.763339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:38.789513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.790233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.790828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:38.791712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:38.792332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:38.792902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.041788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.049765 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23eb9da5-8eea-4421-b76d-3df25dab1ab7 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 0.295088 Oct 12 22:41:39.050356 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1145/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:38 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:39.056489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.057099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.079914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.090446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.091074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.097640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.098625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.099304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.156330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.159357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:39.170479 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ee9b88f-7397-434f-b649-6c4a3a8fb319 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1485 microversion: 2.1 time: 0.915598 Oct 12 22:41:39.178591 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1273/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:38 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1485 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:39.188444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.190148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.217919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.223221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.224809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.227583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.230051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.230785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.283733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.306243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.324819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.357566 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6ecfef1-43f0-4f26-a81f-a877e5b00148 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.305618 Oct 12 22:41:39.387151 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1146/2419] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:39 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:39.393254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8ff33dd0-a461-4c65-81e1-387e1a7e256b req-7ec5367c-6fa9-4b87-b8ae-b714da1a49a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af2a4581-f5f4-4296-8090-fce824218b58", "tag": "ec81fc5d-031f-4eed-bfa8-025518cc5b7c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:39.405367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8ff33dd0-a461-4c65-81e1-387e1a7e256b req-7ec5367c-6fa9-4b87-b8ae-b714da1a49a3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.406117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8ff33dd0-a461-4c65-81e1-387e1a7e256b req-7ec5367c-6fa9-4b87-b8ae-b714da1a49a3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.406867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8ff33dd0-a461-4c65-81e1-387e1a7e256b req-7ec5367c-6fa9-4b87-b8ae-b714da1a49a3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.420624 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8ff33dd0-a461-4c65-81e1-387e1a7e256b req-7ec5367c-6fa9-4b87-b8ae-b714da1a49a3 service nova] Creating event network-changed:ec81fc5d-031f-4eed-bfa8-025518cc5b7c for instance af2a4581-f5f4-4296-8090-fce824218b58 on n-h2-860864-8 Oct 12 22:41:39.428136 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8ff33dd0-a461-4c65-81e1-387e1a7e256b req-7ec5367c-6fa9-4b87-b8ae-b714da1a49a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038520 Oct 12 22:41:39.430008 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1147/2420] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:39.440108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a228387-08ed-4f4b-a0e8-c10f83796f85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.441143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a228387-08ed-4f4b-a0e8-c10f83796f85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.545022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.559619 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4fb4ec0f-d286-46cb-bb66-7562d2763976 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1484 microversion: 2.1 time: 0.379801 Oct 12 22:41:39.561665 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1274/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:39 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1484 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:39.567377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.579328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 94ffeab8-5085-444f-a1c4-9ad3cd21853c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.591179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.593651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.594325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.595495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.598896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.600141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.623200 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c HTTP/1.1 Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '94ffeab8-5085-444f-a1c4-9ad3cd21853c'} Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.625184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 94ffeab8-5085-444f-a1c4-9ad3cd21853c could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:39.629303 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71b7caf8-0eb8-48e5-b775-9e9ac23443dc tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c" status: 404 len: 111 microversion: 2.1 time: 0.063111 Oct 12 22:41:39.631002 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1275/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:39 2022] GET /compute/v2.1/servers/94ffeab8-5085-444f-a1c4-9ad3cd21853c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:39.637880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-106068682", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:39.729307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] validate_networks() for [('1643edd0-55e0-496c-9457-01f4988576a4', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:41:39.750062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a228387-08ed-4f4b-a0e8-c10f83796f85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:39.758580 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a228387-08ed-4f4b-a0e8-c10f83796f85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1213 microversion: 2.1 time: 0.327116 Oct 12 22:41:39.760496 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1148/2423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:39 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1213 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:39.774770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0ba3349-f0d5-48c7-aedf-c905392891f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '.version_select at 0x7f44ff447550>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.827460 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d0ba3349-f0d5-48c7-aedf-c905392891f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Image not found. Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0ba3349-f0d5-48c7-aedf-c905392891f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 HTTP/1.1 Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '51d87f5c-a853-4656-96ac-58e90d22e7a6'} Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 51d87f5c-a853-4656-96ac-58e90d22e7a6 to delete Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 51d87f5c-a853-4656-96ac-58e90d22e7a6 could not be found. Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.830816 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:41:39.837017 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.840524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0ba3349-f0d5-48c7-aedf-c905392891f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:39.841647 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0ba3349-f0d5-48c7-aedf-c905392891f9 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6" status: 404 len: 62 microversion: 2.1 time: 0.078814 Oct 12 22:41:39.845176 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1149/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:39 2022] DELETE /compute/v2.1/images/51d87f5c-a853-4656-96ac-58e90d22e7a6 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:41:39.851799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.865527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.885999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.888549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.889310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.890265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.893163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.893955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.929678 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 HTTP/1.1 Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7d7f70c3-9232-4994-b238-9556a5739b11'} Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:39.933565 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:39.937304 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:39.942547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:39.946103 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bde46d9a-d212-4ec0-932a-0a1aa9a3c6d2 tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 404 len: 111 microversion: 2.1 time: 0.097800 Oct 12 22:41:39.948230 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1150/2425] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:39 2022] DELETE /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:39.962155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:39.964505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] [instance: 7d7f70c3-9232-4994-b238-9556a5739b11] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:39.977705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.979023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.980843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:39.982170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:39.982963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:39.983690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.018068 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] HTTP exception thrown: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Request method failure captured: Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 HTTP/1.1 Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0E6QYg5R2_Rbe9ym5DYaCTv_bS_ZrxHpJc9WemUlWwp1aWLUrowuQX99mCxOu1XWaVaMpx8_3g0b9tVAOyQNTvQiBKNhWREYW8xkDCmdBb7NUl2sZQkAdAn52366dhfU8bZxjfz0NT7JP34zJMNxRxw6TeatiE5UshGL6e1cfDfLpE Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eacd9f81dd574deaa7986c986e944e0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eacd9f81dd574deaa7986c986e944e0e"}]}] Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesTestJSON-149517323 Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: eacd9f81dd574deaa7986c986e944e0e Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesTestJSON-149517323 Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 080644f7502346ed8ff64a026ac9d15b Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesTestJSON-149517323-project Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7d7f70c3-9232-4994-b238-9556a5739b11'} Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:40.020537 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:40.024447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:40.024447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:40.024447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:40.024447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:40.024447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. Oct 12 22:41:40.024447 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:41:40.029515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] Returning 404 to user: Instance 7d7f70c3-9232-4994-b238-9556a5739b11 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:40.031143 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c079c76d-d5d0-434f-ae53-ddaf757fc70d tempest-ImagesTestJSON-149517323 tempest-ImagesTestJSON-149517323-project] 10.222.0.20 "GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11" status: 404 len: 111 microversion: 2.1 time: 0.079337 Oct 12 22:41:40.032286 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1151/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:39 2022] GET /compute/v2.1/servers/7d7f70c3-9232-4994-b238-9556a5739b11 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:41:40.079508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:40.080689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:40.106355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.108525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.114011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.115167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.117225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.121254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.576675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:41:40.577685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:41:40.578304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:41:40.578914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:41:40.579774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:41:40.604957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.605794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.609150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.612640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.613337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.615246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.686905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Getting quotas for project c3ed4ff0893f449495446f3b50561c90. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:41:40.705574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Getting quotas for user a2d2288e0a284d94bc787491ccacd1e8 and project c3ed4ff0893f449495446f3b50561c90. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:41:40.731308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:41:40.739578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:41:40.883225 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6c2b3a42-39ba-4e06-9c64-f3deef564618 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.250307 Oct 12 22:41:40.886854 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1276/2427] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:41:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:41:40.918520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:40.919743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:40.939223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.941234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.941684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:40.944729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:40.946017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:40.948363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:41.170282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:41.184671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:41.187454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:41.191842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:41.196216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70266800-3193-4a8b-80f9-23c3927be853 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.306934 Oct 12 22:41:41.206070 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1277/2428] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:40 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:41.222644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:41.225353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:41.251046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:41.255245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:41.256792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:41.258202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:41.258202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:41.261075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:41.422352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:41.438722 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1c64464e-467e-4c53-bd05-05d93e411a65 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1271 microversion: 2.1 time: 0.229664 Oct 12 22:41:41.443558 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1278/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:41 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:41.493002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-963318aa-8f3e-4770-bb49-e5c3e08c2302 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:41.497007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-963318aa-8f3e-4770-bb49-e5c3e08c2302 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:41.599259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:41.614503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6991b21-73b9-458e-9895-757daf7acfdb tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1316 microversion: 2.1 time: 1.541680 Oct 12 22:41:41.618263 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1152/2430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:40 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1316 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:41.739861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-963318aa-8f3e-4770-bb49-e5c3e08c2302 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:41.750656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-963318aa-8f3e-4770-bb49-e5c3e08c2302 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1213 microversion: 2.1 time: 0.305504 Oct 12 22:41:41.751166 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1279/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:41 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1213 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:42.225107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:42.225912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:42.245429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.247276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.251625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.254155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.256827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.260312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.465682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:42.466300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:42.478893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.479646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.480350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.481824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.482476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.483157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.645696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:42.658547 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-312edc88-415a-4360-ae83-53a980753737 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1271 microversion: 2.1 time: 0.194012 Oct 12 22:41:42.659214 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1280/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:42 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:42.665881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:42.670005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:42.686543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.690901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.691547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.692494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.695536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.696284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.784002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:42.800800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:42.802609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:42.809904 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32a5778f-68a8-48b8-8d3a-06ba48edcc0b tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.589482 Oct 12 22:41:42.820672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1153/2433] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:42 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:42.835883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:42.836756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:42.842903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.856166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.856877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.857816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:42.858425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:42.859013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:42.990217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:43.001730 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b5b17227-c117-4548-a231-21c27c2a270d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1505 microversion: 2.1 time: 0.341144 Oct 12 22:41:43.021630 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1281/2434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:42 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:43.034365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.034796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.038111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:43.045971 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3e52e00-d0f4-414e-a359-0c87d64f9a58 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1265 microversion: 2.1 time: 0.223951 Oct 12 22:41:43.055819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.056382 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1154/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:42 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:43.056855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.058756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.060714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.064220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.064863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.134462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e390856-1247-4018-94c9-35f2c4501ef3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc/ips" status: 200 len: 109 microversion: 2.1 time: 0.111605 Oct 12 22:41:43.135105 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1282/2436] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc/ips => generated 109 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:43.147615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.148531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.166744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.169316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.170003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.170939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.171624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.173776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.214114 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d147ad6e-c461-4a65-8255-bc29a5e77fe4 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc/ips" status: 200 len: 109 microversion: 2.1 time: 0.066069 Oct 12 22:41:43.217780 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1155/2437] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc/ips => generated 109 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:41:43.233208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.234081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.240770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.241648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.244617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.245653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.246347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.247006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.298950 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4742231f-a487-42bc-91fa-f16e52cc63b1 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc/ips/tempest-ServerAddressesTestJSON-1209036336-network" status: 200 len: 94 microversion: 2.1 time: 0.072109 Oct 12 22:41:43.300411 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1283/2438] 10.222.0.20 () {58 vars in 1401 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc/ips/tempest-ServerAddressesTestJSON-1209036336-network => generated 94 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:41:43.313541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.314954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.326036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.328153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.329233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.332194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.333346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.335307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.403797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:41:43.575207 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5988b30-3206-4995-aac7-99753b7c8bb9 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 204 len: 0 microversion: 2.1 time: 0.259258 Oct 12 22:41:43.583392 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1156/2439] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:41:43 2022] DELETE /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:43.588565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.589214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.604383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.605147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.605788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.606734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.607380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.607997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.683658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.684766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.699241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.700950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.702116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.703062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.705876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.707142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.880835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:43.890643 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19e548ab-1901-4832-b25a-d72c15a17bdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1271 microversion: 2.1 time: 0.212702 Oct 12 22:41:43.904694 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1157/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:43.915434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:43.916327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:43.922620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.923318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.924029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:43.925398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:43.926110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:43.926760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.174276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:44.195828 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b7ce4a63-f357-40f8-9b7f-31122cd909f6 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1511 microversion: 2.1 time: 0.605964 Oct 12 22:41:44.196415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:44.198525 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1284/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:44.198917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:44.223762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:44.226093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:44.229498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:44.231591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:44.236342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.237700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.238334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.239295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.239998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.241407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.260549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7bbb0cf8-e873-4300-b4bf-16d6564e9594 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.344960 Oct 12 22:41:44.261549 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1158/2442] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:43 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:44.489071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:44.505311 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75b83d5e-05da-47de-b5bf-15f244e8de98 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1271 microversion: 2.1 time: 0.298237 Oct 12 22:41:44.509642 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1285/2443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:44 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:44.919525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:44.920910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:44.937220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.939233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.941129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:44.943922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:44.944641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:44.946819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.225076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:45.226388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:45.247241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.248462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.249414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.254248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.255104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.255765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.580862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:45.597431 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1fa6ecef-2a78-4ebf-88bb-9f8bab1cc074 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.682349 Oct 12 22:41:45.598935 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1159/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:44 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:45.605347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:45.606250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:45.615234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.615941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.616605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.617644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.620564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.620766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.812655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:45.827029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:45.831260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:45.866105 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ee8a4427-6e94-4e7b-baf4-d12aba424965 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.257660 Oct 12 22:41:45.868536 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1160/2445] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:45 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:45.882202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:45.887233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:45.909484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.910236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.910893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:45.913345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:45.916007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:45.916658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.210068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:46.228979 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a0599b0-f444-43e2-8fdb-aa4593c38bf3 tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1511 microversion: 2.1 time: 1.007862 Oct 12 22:41:46.230248 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1286/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:45 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1511 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:46.492158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:46.505186 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13f5bcec-4fc5-417e-9e14-05a7faafb20f tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1313 microversion: 2.1 time: 0.635279 Oct 12 22:41:46.506019 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1161/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:45 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1313 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:46.624975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:46.625596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:46.634099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.634582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.635013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.635715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.648465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.649233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.898649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:46.899614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:46.914854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.920159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.920731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:46.921597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:46.922295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:46.923143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:47.639062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:47.702433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:47.711324 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-337700d3-04f3-4647-a34b-598795ee67cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 1.038983 Oct 12 22:41:47.716474 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1287/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:46 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:47.733716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:47.735252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:47.737020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:47.740579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:47.753343 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f994680b-b9f4-4e6d-8a29-eb0f99972c61 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.859082 Oct 12 22:41:47.756793 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1162/2449] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:46 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:47.758687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:47.762401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:47.764927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:47.765927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:47.770119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:47.771627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:47.774052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:47.777159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:47.786843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:47.787630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:47.788297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:47.789293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:47.790518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:47.792225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:47.966147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cb60a7f0bf48d6b2af7e7b15e2388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef62b85484ce483b9d684052e84715e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:47.999023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a2980b2-1c34-4da6-afa9-ed790b43616b tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 200 len: 1469 microversion: 2.1 time: 0.276021 Oct 12 22:41:48.019472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1288/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:47 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:48.038555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-eb2c9d29-6d74-4c55-b595-ca7e72dc75d3 req-cb2acea9-ab56-4158-a9db-537ad4adde9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900adbf-6dfa-4945-ba58-125ccd2773fc", "name": "network-vif-deleted", "tag": "ed8bd26d-f1ce-42cc-a09f-e2846309d977"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:48.084240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-eb2c9d29-6d74-4c55-b595-ca7e72dc75d3 req-cb2acea9-ab56-4158-a9db-537ad4adde9d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:48.112781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-eb2c9d29-6d74-4c55-b595-ca7e72dc75d3 req-cb2acea9-ab56-4158-a9db-537ad4adde9d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:48.113553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-eb2c9d29-6d74-4c55-b595-ca7e72dc75d3 req-cb2acea9-ab56-4158-a9db-537ad4adde9d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:48.144835 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-eb2c9d29-6d74-4c55-b595-ca7e72dc75d3 req-cb2acea9-ab56-4158-a9db-537ad4adde9d service nova] Creating event network-vif-deleted:ed8bd26d-f1ce-42cc-a09f-e2846309d977 for instance 9900adbf-6dfa-4945-ba58-125ccd2773fc on n-h1-860864-8 Oct 12 22:41:48.171222 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-eb2c9d29-6d74-4c55-b595-ca7e72dc75d3 req-cb2acea9-ab56-4158-a9db-537ad4adde9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142708 Oct 12 22:41:48.172120 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1289/2451] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:48.453420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:48.521433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:48.534879 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-322284d0-ec08-437c-b4ad-4750180c7259 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1313 microversion: 2.1 time: 0.774656 Oct 12 22:41:48.535809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1163/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:47 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1313 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:48.740413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:48.741751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:48.763731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:48.764153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:48.764662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:48.771151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:48.771151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:48.771151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:48.786645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:48.787264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:48.794589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:48.795429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:48.796588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:48.798539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:48.799285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:48.800637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.137484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:49.150540 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f19a5557-a837-4f10-a401-b6d989908c77 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.414542 Oct 12 22:41:49.152622 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1290/2453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:48 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:49.160493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:49.168763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] [instance: 9900adbf-6dfa-4945-ba58-125ccd2773fc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:49.181297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.182006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.182122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.183928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.184481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.186230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.212251 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] HTTP exception thrown: Instance 9900adbf-6dfa-4945-ba58-125ccd2773fc could not be found. Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Request method failure captured: Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc HTTP/1.1 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0KNqTFaMr0AR4eh6J0AyRlyhF89qVYHK_OzWmsUecJvCS_vsfvt7MIwMyT7WCLhe8EnQx8mlOt4t5ggkNy0LQ6FPNDW5xnwo5dbPOm5K2sxzqb8X013IGqT2ga7skV-K83q--owvBuFHh8NjNGngIXY4RilyL01-sA3Un1rqAfCFvc Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ef62b85484ce483b9d684052e84715e8 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerAddressesTestJSON-2008953998 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef62b85484ce483b9d684052e84715e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef62b85484ce483b9d684052e84715e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef62b85484ce483b9d684052e84715e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef62b85484ce483b9d684052e84715e8"}]}] Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerAddressesTestJSON-2008953998 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ef62b85484ce483b9d684052e84715e8 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2008953998 Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerAddressesTestJSON-2008953998-project Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 16cb60a7f0bf48d6b2af7e7b15e2388b Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerAddressesTestJSON-2008953998-project Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 9900adbf-6dfa-4945-ba58-125ccd2773fc could not be found. Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '9900adbf-6dfa-4945-ba58-125ccd2773fc'} Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9900adbf-6dfa-4945-ba58-125ccd2773fc could not be found. Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9900adbf-6dfa-4945-ba58-125ccd2773fc could not be found. Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:41:49.214132 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9900adbf-6dfa-4945-ba58-125ccd2773fc could not be found. Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] Returning 404 to user: Instance 9900adbf-6dfa-4945-ba58-125ccd2773fc could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:41:49.218120 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f881e6e2-1e42-4dab-8042-7c1323d4775d tempest-ServerAddressesTestJSON-2008953998 tempest-ServerAddressesTestJSON-2008953998-project] 10.222.0.20 "GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc" status: 404 len: 111 microversion: 2.1 time: 0.061692 Oct 12 22:41:49.219629 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1291/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:49 2022] GET /compute/v2.1/servers/9900adbf-6dfa-4945-ba58-125ccd2773fc => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:41:49.272189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:49.283996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:49.285466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:49.301349 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-648bf7df-64ce-4bf2-afff-501d35ff26a1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.518511 Oct 12 22:41:49.328819 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1164/2455] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:48 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:49.561178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:49.562337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:49.572464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.573329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.575018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.577091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:49.578479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:49.579507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:49.947551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:49.957926 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-777244f6-eb6a-4606-8664-944b1573bb61 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1313 microversion: 2.1 time: 0.404014 Oct 12 22:41:49.962531 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1292/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:49 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:50.177424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:50.179085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:50.181519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:50.194145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.195008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.195757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.196738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.197352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.197932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.346972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:50.348421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:50.354083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.364283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.366660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.367685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.368425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.370481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.506512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:50.538661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:50.541555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:50.549856 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b30b8fa1-2bd5-4058-bf0f-6a799b950959 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1553 microversion: 2.91 time: 0.207243 Oct 12 22:41:50.550581 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1293/2457] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:50 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:50.555638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d689712d-1cd8-43bf-bbfc-17613ef50fdb req-a9811bb1-50b7-445a-8a57-f128d8c10b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6e20be-894c-4260-8ff1-63f563adf029", "tag": "6f516b63-aa2d-49e2-b55a-fdaf0ad25951"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:50.593382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d689712d-1cd8-43bf-bbfc-17613ef50fdb req-a9811bb1-50b7-445a-8a57-f128d8c10b2d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.594080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d689712d-1cd8-43bf-bbfc-17613ef50fdb req-a9811bb1-50b7-445a-8a57-f128d8c10b2d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.595248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d689712d-1cd8-43bf-bbfc-17613ef50fdb req-a9811bb1-50b7-445a-8a57-f128d8c10b2d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.628627 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d689712d-1cd8-43bf-bbfc-17613ef50fdb req-a9811bb1-50b7-445a-8a57-f128d8c10b2d service nova] Creating event network-changed:6f516b63-aa2d-49e2-b55a-fdaf0ad25951 for instance 6e6e20be-894c-4260-8ff1-63f563adf029 on n-h2-860864-8 Oct 12 22:41:50.634303 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d689712d-1cd8-43bf-bbfc-17613ef50fdb req-a9811bb1-50b7-445a-8a57-f128d8c10b2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082156 Oct 12 22:41:50.634910 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1294/2458] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:50.637010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:50.640469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:50.665587 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a3d45f3c-2481-4cb3-8118-38959c5a2bfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.492909 Oct 12 22:41:50.665832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fe892192-b650-420c-b777-6a7a02b1d2f2 req-8d80b320-4b18-4373-8c76-6d783c8db8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5082b3ef-e43c-4503-938b-e856b9c5a272", "tag": "11b8e391-b7ba-4cd7-b504-3bf4098f27bc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:50.683361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1165/2459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:50 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:50.688924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe892192-b650-420c-b777-6a7a02b1d2f2 req-8d80b320-4b18-4373-8c76-6d783c8db8d7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:50.696639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe892192-b650-420c-b777-6a7a02b1d2f2 req-8d80b320-4b18-4373-8c76-6d783c8db8d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:50.697373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe892192-b650-420c-b777-6a7a02b1d2f2 req-8d80b320-4b18-4373-8c76-6d783c8db8d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:50.734977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fe892192-b650-420c-b777-6a7a02b1d2f2 req-8d80b320-4b18-4373-8c76-6d783c8db8d7 service nova] Creating event network-changed:11b8e391-b7ba-4cd7-b504-3bf4098f27bc for instance 5082b3ef-e43c-4503-938b-e856b9c5a272 on n-h2-860864-8 Oct 12 22:41:50.742601 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fe892192-b650-420c-b777-6a7a02b1d2f2 req-8d80b320-4b18-4373-8c76-6d783c8db8d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106111 Oct 12 22:41:50.743941 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1295/2460] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:50.984785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:50.985373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:50.996999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.007541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.008036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:51.009630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.010111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.010570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:51.585367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:51.587193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:51.598185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.600919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.604037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:51.605270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.605958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.607028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:51.610604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:51.744559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:51.776905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:51.808102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:51.809616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:51.844614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-309223b8-082c-43ba-a986-3806d8914c51 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1535 microversion: 2.91 time: 0.263116 Oct 12 22:41:51.858865 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1296/2461] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:51 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1535 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:51.879943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:51.881564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:51.893809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.894591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.896244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:51.898643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:51.899352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:51.901173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:52.038316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:52.056533 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57023cf7-fdcf-416f-abc1-dc15d2d9dba8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1313 microversion: 2.1 time: 1.075484 Oct 12 22:41:52.069121 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1166/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:50 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1313 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:52.299538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:52.322863 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-777265bf-cd59-4bd7-b946-ba9a15579b25 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.457467 Oct 12 22:41:52.331977 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1297/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:51 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:52.881759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:52.883124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:52.898481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:52.898987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:52.900290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:52.906406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:52.909794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:52.910469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:53.093015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:53.094562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:53.108354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:53.109416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:53.110091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:53.111756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:53.112730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:53.113660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:53.147570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:53.166643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:53.168152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:53.186045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:53.193982 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f9f3c71f-5692-4f78-9ff9-12e893f1431a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1535 microversion: 2.91 time: 0.316662 Oct 12 22:41:53.195925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1167/2464] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:52 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1535 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:53.432087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:53.432873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:53.445773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:53.446352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:53.446874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:53.456461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:53.457057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:53.457571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:53.531199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:53.546951 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37e4f4c6-b594-4f19-b36b-34222a0ec7fd tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1313 microversion: 2.1 time: 0.458344 Oct 12 22:41:53.562035 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1298/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:53 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:53.811443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:53.830577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1cb50012-9dd4-43de-a098-5eb1d11be42b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.403267 Oct 12 22:41:53.833110 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1168/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:53 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:41:54.231702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:54.233050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:54.246221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.247104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.247838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.249571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.251584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.252319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.386456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:54.395654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:54.399849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:54.405782 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21d391a4-c118-4725-9871-cd99b0bd93e1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1535 microversion: 2.91 time: 0.178145 Oct 12 22:41:54.420304 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1299/2467] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:54 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1535 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:54.569198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:54.569819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:54.580677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.592686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.593156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.593963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.594426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.594858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.854873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:54.855496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:54.866621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.867356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.870280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:54.871211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:54.877977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:54.878736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:55.845872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:55.866683 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ddb8cd59-f018-48ab-8b87-93e1c8d7cf6f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 1.005897 Oct 12 22:41:55.866683 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1300/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:54 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:55.871329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:55.872081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:55.897742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:55.897888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:55.898384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:55.898767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:55.899482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:55.899962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:55.900396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:55.918362 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e0174714-2098-4a3b-892b-872754c8fb82 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1313 microversion: 2.1 time: 1.352394 Oct 12 22:41:55.944024 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1169/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:54 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1313 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:56.415110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:56.425716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:56.427281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:56.433156 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-521c57e5-232c-4772-8f91-4401678e7ef1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1478 microversion: 2.91 time: 0.571852 Oct 12 22:41:56.437151 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1301/2470] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:55 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1478 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:56.462307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:56.465800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:56.480448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.483759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.484563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.487065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.487830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.488641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.683682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860864-8". {{(pid=120543) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 22:41:56.821688 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-06641b50-d7af-417b-9898-dbc0b383183d tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action" status: 202 len: 0 microversion: 2.91 time: 0.361609 Oct 12 22:41:56.825671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1170/2471] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:41:56 2022] POST /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:41:56.832520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:56.833414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:56.842275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.844414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.846273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.859786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.877806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.879916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.884985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:56.886505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:56.906266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.906819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.907225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:56.913531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:56.914017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:56.914475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.168848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:57.179630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:57.181101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:57.215134 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3f3f7a1d-e59d-464c-a193-561293c5e66e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1486 microversion: 2.91 time: 0.387520 Oct 12 22:41:57.225891 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1302/2472] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:56 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1486 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:57.256104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:57.262702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:57.282558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:57.283091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:57.292148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.293437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:57.294265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:57.294983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.337863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:57.349066 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7b86fb64-11b1-4376-977d-48e2adfad825 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.469203 Oct 12 22:41:57.351411 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1171/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:56 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:57.364296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4c567722-efce-4f7a-bfa2-afcee73e8d48 req-2d4f892e-ff22-49c5-bd15-b0f986b8f612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6e20be-894c-4260-8ff1-63f563adf029", "name": "network-vif-plugged", "status": "completed", "tag": "6f516b63-aa2d-49e2-b55a-fdaf0ad25951"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:57.387471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4c567722-efce-4f7a-bfa2-afcee73e8d48 req-2d4f892e-ff22-49c5-bd15-b0f986b8f612 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:57.389768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4c567722-efce-4f7a-bfa2-afcee73e8d48 req-2d4f892e-ff22-49c5-bd15-b0f986b8f612 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:57.390436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4c567722-efce-4f7a-bfa2-afcee73e8d48 req-2d4f892e-ff22-49c5-bd15-b0f986b8f612 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:57.409010 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4c567722-efce-4f7a-bfa2-afcee73e8d48 req-2d4f892e-ff22-49c5-bd15-b0f986b8f612 service nova] Creating event network-vif-plugged:6f516b63-aa2d-49e2-b55a-fdaf0ad25951 for instance 6e6e20be-894c-4260-8ff1-63f563adf029 on n-h2-860864-8 Oct 12 22:41:57.427045 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4c567722-efce-4f7a-bfa2-afcee73e8d48 req-2d4f892e-ff22-49c5-bd15-b0f986b8f612 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073977 Oct 12 22:41:57.431547 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1172/2474] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:58.049374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:58.068883 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3ab09f2-afe5-4f05-afa0-533d75db551d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1313 microversion: 2.1 time: 0.840665 Oct 12 22:41:58.070832 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1303/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:57 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:58.258855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:58.261759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:58.273069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.274027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.274703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:58.275909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.276587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.277277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:58.381457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:58.385806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:58.399376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.400281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.401649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:58.402631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:58.403584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:58.405155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:58.418724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:58.437494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:58.442651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:58.456807 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f9cda48-e7f0-45ce-9087-a35b200174bc tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.202803 Oct 12 22:41:58.461432 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1173/2476] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:58 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:41:58.956226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:58.976305 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-435a4e8b-abaf-4568-baf1-f88059c29041 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.596883 Oct 12 22:41:58.989207 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1304/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:58 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:59.097538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:59.099777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:59.115689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.120144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.120144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.122252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.127784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.128986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.469594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5e1ec532-7392-436b-9b5b-1f453d7a4a97 req-23d9a949-0e7a-402a-9adc-53adcc36d9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5082b3ef-e43c-4503-938b-e856b9c5a272", "name": "network-vif-plugged", "status": "completed", "tag": "11b8e391-b7ba-4cd7-b504-3bf4098f27bc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:59.496045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5e1ec532-7392-436b-9b5b-1f453d7a4a97 req-23d9a949-0e7a-402a-9adc-53adcc36d9a1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.497008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5e1ec532-7392-436b-9b5b-1f453d7a4a97 req-23d9a949-0e7a-402a-9adc-53adcc36d9a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.497463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5e1ec532-7392-436b-9b5b-1f453d7a4a97 req-23d9a949-0e7a-402a-9adc-53adcc36d9a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.512990 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5e1ec532-7392-436b-9b5b-1f453d7a4a97 req-23d9a949-0e7a-402a-9adc-53adcc36d9a1 service nova] Creating event network-vif-plugged:11b8e391-b7ba-4cd7-b504-3bf4098f27bc for instance 5082b3ef-e43c-4503-938b-e856b9c5a272 on n-h2-860864-8 Oct 12 22:41:59.538172 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5e1ec532-7392-436b-9b5b-1f453d7a4a97 req-23d9a949-0e7a-402a-9adc-53adcc36d9a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068676 Oct 12 22:41:59.543523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:41:59.546349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:41:59.556936 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1305/2478] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:41:59.567504 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7beda79d-8740-4274-a873-275efdca8eec tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1498 microversion: 2.1 time: 0.475312 Oct 12 22:41:59.568387 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1174/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:59 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1498 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:41:59.569454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:41:59.570411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:59.597549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:41:59.610433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.614751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:41:59.618019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.619066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.624982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.625659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.631846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.640891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.644006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.645359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.648002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:41:59.648553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:41:59.653833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:41:59.736274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lazy-loading 'flavor' on Instance uuid 6e6e20be-894c-4260-8ff1-63f563adf029 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:41:59.975293 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3dbb835-2f07-4143-a933-607be361c38c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "POST /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029/action" status: 200 len: 32 microversion: 2.1 time: 0.381860 Oct 12 22:41:59.979094 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1175/2480] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:41:59 2022] POST /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029/action => generated 32 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:41:59.997862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:00.001528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:00.025880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:00.026809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:00.027710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:00.029088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:00.029952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:00.031308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:00.447587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:00.465459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:00.473613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:00.497481 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2dc6989b-59f3-4949-865f-5b81beef0248 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.937370 Oct 12 22:42:00.498510 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1306/2481] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:41:59 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:00.522694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:00.523648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:00.542053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:00.543312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:00.551362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:00.552759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:00.553623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:00.554965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.145075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:01.162662 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0916e98c-e0c4-47f4-abbb-25b5222da499 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 1.177769 Oct 12 22:42:01.176597 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1176/2482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:41:59 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:01.250168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:01.273649 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b9a6198-d6a7-4b3e-b48b-4ea4a546c884 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.772377 Oct 12 22:42:01.281337 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1307/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:00 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:01.534908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:01.535836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:01.548413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:01.551514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:01.552200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.556217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:01.557032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:01.557648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:01.753033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:01.784745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:01.793073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:01.813673 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d9c2e088-2d3b-4331-aa82-372cffde9f77 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.287655 Oct 12 22:42:01.839182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1177/2484] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:01 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:02.187256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:02.188598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:02.215784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.216427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.216875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:02.217607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.218062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.218484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:02.305060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:02.305683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:02.318692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.319184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.319629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:02.320387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:02.320844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:02.321273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:03.094800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:03.104030 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-969aafa7-beb6-4120-be04-543d83921ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1313 microversion: 2.1 time: 0.802938 Oct 12 22:42:03.110706 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1178/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:02 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1313 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:03.116162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:03.125555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:03.141612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:03.142274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:03.142726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:03.143458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:03.143944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:03.144382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:03.179327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:03.187924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7848c065-bfed-442f-b243-2155e68abd05 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 1.004822 Oct 12 22:42:03.189590 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1308/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:02 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:03.354014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:03.370087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:03.373864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:03.387845 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea51dec9-b0d9-445e-8b39-f9d28826a5c7 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.272901 Oct 12 22:42:03.399919 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1179/2487] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:03 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:04.138792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:04.139677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:04.168165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.168953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.169401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.170301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.170912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.171493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.217812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:04.218927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:04.233437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.234333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.236839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.239977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.240632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.241274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.835157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:04.844459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:04.859027 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ad8294ec-391f-4236-9d8e-83cd41ebdd80 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.646686 Oct 12 22:42:04.859983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1180/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:04 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:04.872365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:04.881178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:04.895759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.896432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.896975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.897809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.898326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.898818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.906116 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e17ae24-34d1-4f99-8d6c-f21c7c4d8581 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1463 microversion: 2.1 time: 0.779117 Oct 12 22:42:04.910094 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1309/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:04 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1463 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:04.943154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:04.946284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:04.972829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.976188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.978411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:04.980410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:04.985109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:04.986749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:05.116507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:05.142805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:05.149945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:05.163983 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ada4d8b-abe4-4bb9-b193-e4c978419b7f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.301579 Oct 12 22:42:05.185770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1181/2490] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:04 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:05.888227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:05.888897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:05.900906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:05.903324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:05.904659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:05.907492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:05.909855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:05.911781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:05.953732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:05.963714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Old instance type m1.heat2, new instance type m1.heat {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:42:06.002236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:42:06.006418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:42:06.011132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:42:06.012623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:42:06.015222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:42:06.261997 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-105458a9-4a10-44f0-89fb-8ab190c82078 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272/action" status: 202 len: 0 microversion: 2.1 time: 1.323128 Oct 12 22:42:06.267419 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1310/2491] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:42:04 2022] POST /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272/action => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:42:06.306887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:06.309001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:06.329261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:06.332013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:06.332732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.336211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:06.337132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:06.338367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.508076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:06.522419 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ad9c50c-cab5-4d37-b56f-bfaa530b1663 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.638056 Oct 12 22:42:06.524680 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1182/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:05 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:06.539267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:06.540476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:06.556798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:06.558390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:06.559755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.562719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:06.566119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:06.567718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:06.723807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:06.769711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:06.785937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:06.792709 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61dec8a6-8a8b-488e-91d6-0c993e84e697 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.521985 Oct 12 22:42:06.794507 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1311/2493] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:06 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:06.999312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:07.009393 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58a380f5-d760-488d-bc60-dad5878d0ed4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1472 microversion: 2.1 time: 0.482886 Oct 12 22:42:07.013118 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1183/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:06 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:07.555295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:07.556567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:07.596628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:07.597175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:07.597627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:07.598369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:07.604745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:07.605588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:07.627650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:07.830356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:07.830983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:07.852508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:07.853018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:07.853524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:07.854253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:07.854717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:07.855202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:08.054214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:08.077373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:08.080658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:08.110717 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce4583b2-7948-4546-a7e7-2406fd753478 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.283279 Oct 12 22:42:08.112686 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1184/2495] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:07 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:42:08.130791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:08.143693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:08.162940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:08.166433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:08.167282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:08.170348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:08.171072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:08.171729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:08.914729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:08.934830 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aac31b95-8f9f-4ec2-a88e-a73bd2c09e91 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 1.378004 Oct 12 22:42:08.937440 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1312/2496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:07 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:09.148370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:09.149440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:09.177019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:09.177802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:09.178405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:09.181542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:09.183226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:09.183842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:09.308530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:09.328592 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f8c7995-9d28-4e47-9882-cccfefebed8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1472 microversion: 2.1 time: 1.214594 Oct 12 22:42:09.352598 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1185/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:08 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1472 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:09.450527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:09.462451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:09.468676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:09.494708 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e78e033e-c1cd-480f-bd07-6717af6c081e tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.345056 Oct 12 22:42:09.495429 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1313/2498] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:09 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:42:09.967278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:09.968416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:09.989265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:09.992473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:09.993734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:09.999399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:09.999947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:10.000358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:10.360303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:10.362309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:10.396584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:10.404414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:10.409175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:10.412048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:10.417822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:10.419786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:11.337044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:11.362649 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c89de35e-3dff-4ea3-9625-faa816c73247 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1472 microversion: 2.1 time: 1.002409 Oct 12 22:42:11.384005 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1314/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:10 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1472 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:11.384005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:11.384005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:11.408136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:11.415466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=98 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:11.422009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:11.423975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-839ce2db-db5e-43ba-92c8-2c11fcbb04df tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 1.459762 Oct 12 22:42:11.435925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1186/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:09 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:11.438183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:11.439594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:11.451978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:11.452841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:11.453518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:11.649781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:11.670930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:11.682568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:11.698637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bb572157-f25c-481f-8907-0ec55c662d82 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.327837 Oct 12 22:42:11.705145 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1315/2501] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:11 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:12.398278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:12.398809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:12.409482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.410123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.410407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:12.411124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.411576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.412056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:12.455196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:12.456590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:12.472900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.474623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.476793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:12.479796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.484374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.485576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:12.846683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:12.861366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:12.870261 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b044b015-0ab2-439f-bfb5-1862dc8cbfdc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1472 microversion: 2.1 time: 0.475895 Oct 12 22:42:12.871437 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1187/2502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:12 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1472 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:12.882410 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-488b290f-dcb2-4ff6-8cab-e491daf4fc1a tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.427331 Oct 12 22:42:12.883253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:12.884817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:12.885499 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1316/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:12 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:12.925189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.925683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.926118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:12.933289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:12.934015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:12.934659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:13.200782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:13.209896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:13.216888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:13.231615 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7212b2fc-0b7b-48bf-8973-99015b5032d3 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.358662 Oct 12 22:42:13.232943 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1188/2504] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:12 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:13.909589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:13.910185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:13.910610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:13.912842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:13.921381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:13.921883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:13.922327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:13.923030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:13.927025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:13.927884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:13.928712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:13.929092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:13.929610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:13.930616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:13.931622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:13.932796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:13.978378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:14.482427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:14.499845 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5bcd717-e3a8-49ed-a327-a87bb673ef4e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1472 microversion: 2.1 time: 0.602568 Oct 12 22:42:14.501690 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1317/2505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:13 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:14.508126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:14.508981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:14.522019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:14.523146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:14.524662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:14.526267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:14.527126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:14.528979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:14.745245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:14.771132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:14.775078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:14.782631 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5f2b7f97-f517-4ed2-b59b-cb4a7211fe1a tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.278888 Oct 12 22:42:14.784134 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1318/2506] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:14 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:14.844103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:14.865773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f4352db-d8b1-44d8-bf1d-bc2209a7a230 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.953621 Oct 12 22:42:14.880000 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1189/2507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:13 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:15.531600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:15.533002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:15.547835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:15.552419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:15.554980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:15.555934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:15.562401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:15.563178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:15.815950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:15.817792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:15.854534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:15.855035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:15.855480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:15.860642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:15.862052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:15.862711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:16.252456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:16.269895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:16.280001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:16.288732 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0b9228e-2fae-4837-95a1-630e33678953 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1544 microversion: 2.91 time: 0.476441 Oct 12 22:42:16.290017 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1190/2508] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:15 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1544 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:16.297595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:16.298544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:16.321396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:16.322392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:16.323976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:16.325369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:16.327546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:16.330378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:16.764353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:16.776649 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ef88ca7-e835-49a0-bd5f-f3c50f0ef3be tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 1.250881 Oct 12 22:42:16.780980 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1319/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:15 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:16.790959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:16.797142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:16.798181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Searching by: {'deleted': False, 'project_id': '0eedb6331b634a7199cdd877e847c6db'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:42:16.842518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:16.843014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:16.843472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:16.847847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:16.849122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:16.850717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:16.911520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:42:16.974220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49c80fff-dcfb-469c-abb6-7f75571b018e tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.191828 Oct 12 22:42:16.975192 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1320/2510] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:42:16 2022] GET /compute/v2.1/servers => generated 344 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:16.988396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:16.993219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:16.993981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Searching by: {'deleted': False, 'project_id': '0eedb6331b634a7199cdd877e847c6db'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:42:17.009617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.010142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.010522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.011245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.011697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.012153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.055545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:42:17.091382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:17.102329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:17.103237 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32b9fe8f-4876-45f7-8106-de2bf04d233d tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.811848 Oct 12 22:42:17.105899 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1191/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:16 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:17.130665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.131463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.131695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.318997 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8073bbae-91fe-405e-a209-9a074881254a tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.334968 Oct 12 22:42:17.319637 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1321/2512] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:42:16 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:17.321895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:17.322636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:17.339629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.340474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.342515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.343319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.345829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39fc1f62-d592-4400-b9c8-17e6eba2d01b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:17.346149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.346639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.354459 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39fc1f62-d592-4400-b9c8-17e6eba2d01b tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013021 Oct 12 22:42:17.360219 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1322/2513] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:42:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:42:17.520092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:17.555668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:17.558145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:17.576955 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c106e88a-a88e-4c15-b063-d1c435203a78 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1531 microversion: 2.91 time: 0.261081 Oct 12 22:42:17.578009 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1192/2514] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:17 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1531 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:17.609520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:17.610724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:17.618343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.619193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.619996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.621144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:17.621825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:17.622502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:17.716909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1165506338", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "cbf67783-fc5c-4e6d-8cc9-01e6ccb5a285"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:17.811824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] validate_networks() for [('cbf67783-fc5c-4e6d-8cc9-01e6ccb5a285', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:42:18.119130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] Lazy-loading 'services' on Instance uuid 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:42:18.149986 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4f9360b-96ee-40b2-96cd-d36ddd1754a0 tempest-UnshelveToHostMultiNodesTest-1546084407 tempest-UnshelveToHostMultiNodesTest-1546084407-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1936 microversion: 2.91 time: 0.545038 Oct 12 22:42:18.150752 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1193/2515] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:17 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1936 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:18.156653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:18.157653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:18.164913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.165823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.166581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.167560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.168284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.168957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.486349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:42:18.486970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:42:18.487444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:42:18.487975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:42:18.488463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:42:18.508737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.509615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.510205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.511233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.511864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.512510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.534460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Getting quotas for project 5cb36be1d153411baf8bb0b7bb5582cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:42:18.541291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Getting quotas for user a93dd797a41544c59fbcfb4fc7453803 and project 5cb36be1d153411baf8bb0b7bb5582cf. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:42:18.558940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:42:18.561653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:42:18.641463 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f9c31fc6-96ab-4e96-bb01-8f4911cbac87 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046267 Oct 12 22:42:18.649219 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1323/2516] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:42:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:42:18.655337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:18.656229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:18.665370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.666180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.666770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.667688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.668315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.668917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.711772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:42:18.866818 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82d03a8b-e362-4363-a261-b40cb9b38427 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 204 len: 0 microversion: 2.1 time: 0.215602 Oct 12 22:42:18.880647 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1324/2517] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:42:18 2022] DELETE /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:42:18.890250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:18.892002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:18.903434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.905455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.907827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:18.909972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:18.910687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:18.912339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:19.012732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:19.031768 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5844011-96b8-4015-beb3-87ebe264b442 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.879217 Oct 12 22:42:19.032942 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1194/2518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:18 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:19.046178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:19.046684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:19.056495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:19.057219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:19.060651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:19.061699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:19.062601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:19.065041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:19.137447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:42:19.360378 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e0f2ac1d-d730-42e0-a6fd-5999c4e0172f tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 204 len: 0 microversion: 2.91 time: 0.325306 Oct 12 22:42:19.367447 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1195/2519] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:42:19 2022] DELETE /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:42:19.376183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80306e60-d5b5-44a4-8633-c5379c6af493 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:19.378378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80306e60-d5b5-44a4-8633-c5379c6af493 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:19.556584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:19.565164 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3fdff436-c7bf-4cb3-bb72-aa0087f06893 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.680995 Oct 12 22:42:19.584673 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1325/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:18 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:19.591652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:19.597041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:19.616274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:19.618121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:19.619435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:19.622243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:19.625086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:19.625843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.122982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.137221 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a2c878f-8030-426a-8115-1c582f5abe29 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1609 microversion: 2.1 time: 0.551002 Oct 12 22:42:20.139585 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1326/2521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:19 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1609 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:20.147164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:20.149426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:20.164493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:20.168614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:20.169386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.170359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:20.180657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:20.181471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.196500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-80306e60-d5b5-44a4-8633-c5379c6af493 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.205548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80306e60-d5b5-44a4-8633-c5379c6af493 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1216 microversion: 2.1 time: 0.836629 Oct 12 22:42:20.240390 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1196/2522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:19 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1216 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:20.251255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:20.252670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:20.268125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:20.268753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:20.269307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.270204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:20.270777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:20.271207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.334214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.337406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:20.361659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.368558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.391097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c319ab75-b37f-4482-8ef9-b4d5b7598ac1 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.249167 Oct 12 22:42:20.392712 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1327/2523] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:20 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:20.590718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:20.591344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:20.603833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:20.604263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:20.604879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.605736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:20.610010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:20.610835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:20.656486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.668049 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-81cc7c85-b52e-4bbe-94c4-13bdc2cc42a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.426438 Oct 12 22:42:20.674149 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1197/2524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:20 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:20.937294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:20.948305 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b386044d-a5c9-47c0-b5fe-41a1ae99efa1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.361400 Oct 12 22:42:20.965023 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1328/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:20 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:21.170029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:21.170945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:21.193805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.194618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.195285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.196908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.198564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.199527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.233250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:21.233916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:21.251142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.252072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.252691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.253567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.254166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.254736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.504107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:21.516706 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80a37e2a-7989-455b-8ee7-79ee71041edc tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1268 microversion: 2.1 time: 0.290800 Oct 12 22:42:21.518007 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1329/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:21 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:21.527719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:21.530667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:21.538844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.539718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.540997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.541991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.542691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.543340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.840733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:21.860649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:21.865084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fe78f8ea83749af8b040f6538a30710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f1521906ca40218765a847b473f003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:21.872916 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d5ae5cf-7b13-4b67-a5f7-7245d4fe5993 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 200 len: 1537 microversion: 2.91 time: 0.352767 Oct 12 22:42:21.914379 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1330/2527] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:21 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 1537 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:42:21.927494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:21.928448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:21.935761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.936515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.938215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:21.939884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:21.940680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:21.941252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.378347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:22.388266 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77360905-16ca-4ea2-98cb-a2107a081216 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1609 microversion: 2.1 time: 1.231128 Oct 12 22:42:22.409107 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1198/2528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:21 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1609 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:22.415909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:22.416780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:22.430991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.431780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.432408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.433308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.433940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.434596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.575059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:22.586183 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72c47fa0-db1e-432e-b242-3c3b8088b484 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.670253 Oct 12 22:42:22.587755 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1331/2529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:21 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:22.601836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:22.603627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:22.610951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.611824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.622213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.623884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.628721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.629687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.810113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:22.818851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:22.821644 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5028917e-bd77-46f1-86fa-24682e10e832 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1274 microversion: 2.1 time: 0.232506 Oct 12 22:42:22.836697 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56941846-5dbf-4979-9c9a-3ad972f15537 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.426154 Oct 12 22:42:22.840406 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1332/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:22 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:22.842216 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1199/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:22 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:22.917386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:22.918647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] [instance: 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:22.934654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.935186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.938537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.942021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:22.943212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:22.949845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:22.979306 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] HTTP exception thrown: Instance 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce could not be found. Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Request method failure captured: Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce HTTP/1.1 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ITERksVqnfd12Vg_6YsPb5GqM49kkyikL1vkMN86k5Te8Gaa3wUBYVtcD4WQs-Sha_FTTl4ZluqD8psYsixHxADWdIssEn3O-BQkijJHFzoflRVGxqzaaC5zaI4FlwNTzUDQPjSXNu1cfCALZl5BfUDGwc2gYwo69uLLm_ABcbakU Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.91 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 43f1521906ca40218765a847b473f003 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1093839332 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43f1521906ca40218765a847b473f003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43f1521906ca40218765a847b473f003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43f1521906ca40218765a847b473f003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43f1521906ca40218765a847b473f003"}]}] Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1093839332 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 43f1521906ca40218765a847b473f003 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1093839332 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-UnshelveToHostMultiNodesTest-1093839332-project Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4fe78f8ea83749af8b040f6538a30710 Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1093839332-project Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce could not be found. Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4c8b44ee-5dd8-42d1-996d-4a0b39a596ce'} Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce could not be found. Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce could not be found. Oct 12 22:42:22.984704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce could not be found. Oct 12 22:42:22.990188 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:22.992935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] Returning 404 to user: Instance 4c8b44ee-5dd8-42d1-996d-4a0b39a596ce could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:22.993830 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7694b9fe-ddc0-4354-9aed-6f95bf9acc91 tempest-UnshelveToHostMultiNodesTest-1093839332 tempest-UnshelveToHostMultiNodesTest-1093839332-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce" status: 404 len: 111 microversion: 2.91 time: 0.087042 Oct 12 22:42:22.994426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1333/2532] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:42:22 2022] GET /compute/v2.1/servers/4c8b44ee-5dd8-42d1-996d-4a0b39a596ce => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:42:23.417404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:23.418030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:23.434615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:23.435128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:23.435580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:23.436888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:23.437373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:23.438139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:23.613168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:23.614583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:23.630001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:23.647510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:23.648213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:23.649121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:23.649705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:23.650276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:24.330318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:24.345116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a9d837a-a142-463b-8f6e-4a7099076256 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1609 microversion: 2.1 time: 0.933601 Oct 12 22:42:24.346284 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1200/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:23 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1609 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:24.355260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:24.356263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:24.362840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:24.364536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:24.365189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:24.365760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:24.366628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:24.367229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:24.367798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:24.538375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:24.569581 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d58ce0c8-091f-4248-9d9e-256d2c945341 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1274 microversion: 2.1 time: 0.221128 Oct 12 22:42:24.570559 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1201/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:24 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:24.607626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:24.608610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:24.617743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:24.618683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:24.619287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:24.620636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:24.621249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:24.622301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:24.849356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:24.878263 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dec497de-6361-4571-95fe-54a958178461 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 1.269991 Oct 12 22:42:24.898444 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1334/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:23 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:25.372434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:25.374535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:25.377257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:25.398650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.399147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.399579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:25.400954 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a099e4c-3745-4202-8217-0e300e702258 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.806107 Oct 12 22:42:25.401599 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1202/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:24 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:25.402841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.403375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.404097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:25.587513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:25.594582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:25.598809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:25.617152 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-803fa224-68b1-4f74-9d4d-56555b2e8b18 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1541 microversion: 2.1 time: 0.248533 Oct 12 22:42:25.621225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.621765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.622143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:25.622856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.623303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.624274 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1335/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:25 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1541 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:25.624596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:25.905654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:25.906247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:25.916331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.916809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.921362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:25.924805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:25.926298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:25.928252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.432438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:26.439704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:26.451125 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-201df504-d8d8-40e7-94b7-290a2b723bed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 0.860350 Oct 12 22:42:26.457524 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-704f40e2-b46c-4986-bbf8-e3495120cbe6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.560092 Oct 12 22:42:26.458110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1336/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:25 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:26.462642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c8295a7e-106d-4072-9dcf-07131eb1e3e7 req-96ddf5a1-6c24-45a4-a37c-3b653f32e9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2a4581-f5f4-4296-8090-fce824218b58", "name": "network-vif-deleted", "tag": "ec81fc5d-031f-4eed-bfa8-025518cc5b7c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:26.464640 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1203/2539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:25 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:26.481333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:26.485330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:26.515852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:26.516369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:26.516806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.517545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:26.529724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:26.530738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c8295a7e-106d-4072-9dcf-07131eb1e3e7 req-96ddf5a1-6c24-45a4-a37c-3b653f32e9b2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:26.532453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.540652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c8295a7e-106d-4072-9dcf-07131eb1e3e7 req-96ddf5a1-6c24-45a4-a37c-3b653f32e9b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:26.541260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c8295a7e-106d-4072-9dcf-07131eb1e3e7 req-96ddf5a1-6c24-45a4-a37c-3b653f32e9b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.600751 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c8295a7e-106d-4072-9dcf-07131eb1e3e7 req-96ddf5a1-6c24-45a4-a37c-3b653f32e9b2 service nova] Creating event network-vif-deleted:ec81fc5d-031f-4eed-bfa8-025518cc5b7c for instance af2a4581-f5f4-4296-8090-fce824218b58 on n-h2-860864-8 Oct 12 22:42:26.621667 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c8295a7e-106d-4072-9dcf-07131eb1e3e7 req-96ddf5a1-6c24-45a4-a37c-3b653f32e9b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162210 Oct 12 22:42:26.631220 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1337/2540] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:26.656073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:26.658815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:26.685648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:26.686197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:26.690896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.692447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:26.694964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:26.695468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:26.910127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:26.924258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b149e13b-e4e8-4988-a5cf-ed7d4dac153f tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1252 microversion: 2.1 time: 0.274715 Oct 12 22:42:26.944463 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1338/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:26 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1252 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:27.136721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:27.155820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cda3c0d2-7be7-4737-b78b-01387f368b49 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.678292 Oct 12 22:42:27.161799 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1204/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:26 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:27.487380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:27.488100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:27.488569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:27.489841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:27.504407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:27.507358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:27.508063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:27.513156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:27.514007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:27.514453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:27.514888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:27.515656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:27.517023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:27.520611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:27.521577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:27.522267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:27.530561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:27.807588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:27.818552 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59928dee-fcdb-47b2-968f-9fab3a93d3c9 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 0.335499 Oct 12 22:42:27.828301 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1205/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:27 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:28.094285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-607607210", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "74e86b17-b468-4254-a856-eb8dd023ff72"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:28.195481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] validate_networks() for [('74e86b17-b468-4254-a856-eb8dd023ff72', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:42:28.521841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:28.552992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:29.187784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:29.198430 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3568eda5-1f6a-4b4c-a567-42d41b656c97 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 1.715524 Oct 12 22:42:29.200278 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1339/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:27 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:29.206472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:29.217260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:29.226150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.228764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.231460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.232966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.233597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.235170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.412814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:29.422999 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11ac75de-5e41-47a1-8acf-90d5d3f1bc25 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1252 microversion: 2.1 time: 0.220478 Oct 12 22:42:29.425828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:42:29.426797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:42:29.427453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:42:29.428052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:42:29.428653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:42:29.443423 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1340/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:29 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1252 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:29.453531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.454475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:29.455341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:29.458367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.458782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.459957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.460572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.461784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.470966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.472477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.474042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.475117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.477200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.478001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.509041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Getting quotas for project 4a3f7aab59114811b56a3816b561c0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:42:29.519255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Getting quotas for user c881d79e28d74c5183ddc025b55d342f and project 4a3f7aab59114811b56a3816b561c0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:42:29.560044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:42:29.563526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:42:29.691206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ff95eaf-8e53-4f63-b3e6-d5f24f7acde3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.861384 Oct 12 22:42:29.691924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1206/2546] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:42:29.707434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:29.713632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:29.721668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.722375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.723550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:29.724504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:29.725124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:29.725885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.039132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:30.055363 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e453c33-e749-4421-af95-5ea66bca1caa tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 0.352162 Oct 12 22:42:30.059821 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1207/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:29 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:30.070351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ad31bb76-e647-42a1-8fb7-fe733c6fc1f2 req-97eb1915-4851-433a-938f-602bdbaa2b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3df06b8-edf1-44e2-992f-1ee55ec985c2", "tag": "28131679-78a1-436f-81ab-7fa1b6f2ae39"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:30.089660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ad31bb76-e647-42a1-8fb7-fe733c6fc1f2 req-97eb1915-4851-433a-938f-602bdbaa2b8d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.090149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ad31bb76-e647-42a1-8fb7-fe733c6fc1f2 req-97eb1915-4851-433a-938f-602bdbaa2b8d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.090629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ad31bb76-e647-42a1-8fb7-fe733c6fc1f2 req-97eb1915-4851-433a-938f-602bdbaa2b8d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.139332 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ad31bb76-e647-42a1-8fb7-fe733c6fc1f2 req-97eb1915-4851-433a-938f-602bdbaa2b8d service nova] Creating event network-changed:28131679-78a1-436f-81ab-7fa1b6f2ae39 for instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 on n-h1-860864-8 Oct 12 22:42:30.164313 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ad31bb76-e647-42a1-8fb7-fe733c6fc1f2 req-97eb1915-4851-433a-938f-602bdbaa2b8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094531 Oct 12 22:42:30.165470 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1208/2548] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:30.173700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d502694e-369f-4740-9845-894a44e3fd18 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:30.176140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d502694e-369f-4740-9845-894a44e3fd18 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:30.265970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d502694e-369f-4740-9845-894a44e3fd18 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:30.282416 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d502694e-369f-4740-9845-894a44e3fd18 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1215 microversion: 2.1 time: 0.114332 Oct 12 22:42:30.283084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1209/2549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:30 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:30.324152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:30.324945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:30.343777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.344639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.345344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.346333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.347052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.347643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.563411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:30.579156 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c9a4931-ca9b-47ff-8d4d-e48dd2b586dd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.277783 Oct 12 22:42:30.584255 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1210/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:30 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:30.614419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:30.615097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:30.632883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.633393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.633837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.636893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:30.638316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:30.640398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:30.847796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:30.872529 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e615f06f-c8b0-4863-a4e2-e67b15f124fc tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1252 microversion: 2.1 time: 0.264538 Oct 12 22:42:30.875809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1211/2551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:30 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1252 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:31.023029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:31.033793 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa17f2ed-2a41-4f64-912c-b7e9297141e8 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 1.588909 Oct 12 22:42:31.053319 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1341/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:29 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:31.083241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:31.083878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:31.098292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.098895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.099356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.100780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.101261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.102307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.306589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:31.307773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:31.317430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:31.330802 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-44c33116-001a-4d2c-9a13-7ee88f2cecda tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 0.252215 Oct 12 22:42:31.331400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1212/2553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:31 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:31.339669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.340218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.340669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.341392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.343387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.343840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.507765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:31.527139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-473c3cd4-defe-4f9a-b6bb-1297dca76edb tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1267 microversion: 2.1 time: 0.224842 Oct 12 22:42:31.533817 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1342/2554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:31 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:31.608340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:31.609217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:31.620435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.622965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.624405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.625698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.627535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.631515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.731717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:31.735456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.736010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.736455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.737199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.737658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.741429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.809155 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f3e5a9b2-8c5e-4e38-ac7a-21e7007d01e9 tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.339383 Oct 12 22:42:31.810355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1213/2555] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:42:31 2022] GET /compute/v2.1/os-services => generated 944 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:42:31.829133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:31.838899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.839630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.840265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.845355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.846087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.846691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.911216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-defd3d7e-f940-41e3-b195-f6a7b049ff9f tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-860864-8" status: 200 len: 578 microversion: 2.1 time: 0.091246 Oct 12 22:42:31.914444 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1214/2556] 10.222.0.20 () {58 vars in 1172 bytes} [Wed Oct 12 22:42:31 2022] GET /compute/v2.1/os-services?host=n-d-860864-8 => generated 578 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:31.925323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:31.927767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:31.939934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.940437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.940861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:31.941580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:31.942029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:31.942459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.039062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:32.073300 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3300ef84-01f2-4da3-b95a-15f4545f2d5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.460243 Oct 12 22:42:32.086856 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1343/2557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:31 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:32.105323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:32.108841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:32.129399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.130077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.130902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.132097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.132809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.133498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.133832 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-868ae273-e6d2-4f58-a0f1-1ecf857cf451 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1252 microversion: 2.1 time: 0.216508 Oct 12 22:42:32.135721 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1215/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:31 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1252 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:32.145267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:32.147535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:32.166821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.167579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.168211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.169158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.169777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.170379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.184525 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec266cba-80bf-4e97-9d2a-6fd1b771828e tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.096414 Oct 12 22:42:32.185795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1344/2559] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 22:42:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:32.200952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:32.206271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.207108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.207752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.208720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.209386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.210031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.244165 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-550cd4e9-afa6-4b7b-96e5-b7be64ccd60d tempest-ServicesAdminTestJSON-941794566 tempest-ServicesAdminTestJSON-941794566-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048617 Oct 12 22:42:32.255685 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1345/2560] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:42:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:32.358280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:32.359733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:32.371095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.375268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.376322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.380110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.383502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.384312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.649319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:32.663653 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-921141da-bb74-471b-8261-26862c9e00f7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1484 microversion: 2.1 time: 0.526511 Oct 12 22:42:32.664447 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1216/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:32 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1484 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:32.672449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:32.678991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:32.691690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.692459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.693957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.697042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.698206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.700136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.931609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:32.942335 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a0a81588-91db-4f3c-afb2-b1bb64adf8ac tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1275 microversion: 2.1 time: 0.276594 Oct 12 22:42:32.959770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1217/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:32 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:32.959770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:32.959770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:32.985931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.986650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.987107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:32.989853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:32.996306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:32.996770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.150440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:33.165828 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4bd68ca-7885-446f-9417-4c200fe73424 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 0.811970 Oct 12 22:42:33.168836 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1346/2563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:32 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:33.175445 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7bbccc4-3bc4-4bdd-8820-e80796f45446 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "POST /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029/action" status: 202 len: 0 microversion: 2.1 time: 0.227225 Oct 12 22:42:33.176855 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1218/2564] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:42:32 2022] POST /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:42:33.183307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:33.184301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:33.208022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:33.208378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.210950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.212768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:33.218369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.222863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.223882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.225293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.232212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.232968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.234823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.235974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.239993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.240623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.273211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:33.537916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:33.550984 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76911c58-b8d8-4490-b10b-b45fe0466208 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1252 microversion: 2.1 time: 0.369637 Oct 12 22:42:33.552924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1219/2565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:33 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1252 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:33.564763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:33.565458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:33.579703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.580241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.580919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.581517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.581975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.582526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.903355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:33.916266 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-220373d6-39b3-4f21-9e3b-144fd097668f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.745253 Oct 12 22:42:33.919972 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1347/2566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:33 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:33.967408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:33.968448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:33.977615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:33.984307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.987170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.987925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:33.991515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:33.994471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:33.995269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:34.634441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:34.650882 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ff2634a1-465a-41f0-8f99-4b48569e2ed7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1492 microversion: 2.1 time: 1.092869 Oct 12 22:42:34.652690 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1220/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:33 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1492 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:34.668963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:34.671300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:34.690297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:34.694521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:34.695356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:34.697571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:34.703509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:34.704467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:34.943371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:34.954592 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-94e68336-d968-45e8-aad5-e10dd94fcb5c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1273 microversion: 2.1 time: 0.991092 Oct 12 22:42:34.956232 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1348/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:33 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1273 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:34.962341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:34.963298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:34.972756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:34.973563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:34.974161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:34.975061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:34.975813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:34.976708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:35.282112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:35.295521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e177cc1-9ccc-44ff-a242-69e8721e0bf1 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1252 microversion: 2.1 time: 0.337968 Oct 12 22:42:35.296599 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1349/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:34 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1252 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:35.307696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:35.308737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:35.339386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:35.341215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:35.341987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:35.343266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:35.344189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:35.345830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:35.896161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:35.904780 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a57d4c2-bf82-4a8f-a061-ba954fe36b63 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 1.246002 Oct 12 22:42:35.905433 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1221/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:34 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:35.922412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:35.923666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:35.936868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:35.937440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:35.944946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:35.945822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:35.946252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:35.946694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:36.375431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:36.400238 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec1335f6-9df3-44e1-a6a8-b04ea75c6b73 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1492 microversion: 2.1 time: 0.479337 Oct 12 22:42:36.405667 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1222/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:35 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1492 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:36.427351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:36.428924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:36.461946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:36.466862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:36.467269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:36.472600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:36.473193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:36.476410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:36.593207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:36.612671 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ef094a2-c3c2-4161-bdb4-f990d8cf26b9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 1.312860 Oct 12 22:42:36.615382 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1350/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:35 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:36.627624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:36.629365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:36.641231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:36.645552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:36.646847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:36.648246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:36.650417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:36.652325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:36.719676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:36.720707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:36.724063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:36.725212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lazy-loading 'fault' on Instance uuid af2a4581-f5f4-4296-8090-fce824218b58 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:42:36.802767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:36.814380 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-168be343-e460-46ed-b3d2-f47a759ca980 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.405011 Oct 12 22:42:36.815717 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1223/2573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:36 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:36.935092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6857ea19a8194e5680b1b376dcdbcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedb6331b634a7199cdd877e847c6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:36.937823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:36.939317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:36.948079 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d373b8f1-23e8-41c2-8481-817400f5c243 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 200 len: 1257 microversion: 2.1 time: 0.326096 Oct 12 22:42:36.948942 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1351/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:36 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 1257 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:36.950699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:36.954024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:36.955770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:36.956540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:36.957004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:36.962118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:37.044987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:37.431467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:37.432116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:37.440751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:37.448270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:37.451570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:37.452465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:37.452953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:37.453389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:37.940154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:37.955659 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60227c41-44be-48a4-b256-58f099da24b2 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 1.021774 Oct 12 22:42:37.975298 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1224/2575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:36 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:37.987118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:37.991980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:38.009944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.010452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.012141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.014947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.017169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.018773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.399202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:38.417832 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ceadbf7f-8006-41d1-8369-36763306fa8a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1477 microversion: 2.1 time: 0.439638 Oct 12 22:42:38.419864 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1225/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:37 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1477 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:38.429790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:38.430663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:38.452978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.453799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.455924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.457094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.461362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.462082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.596142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:38.633343 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b9acc1fb-d8d0-4cdb-9b40-291b68925b26 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1492 microversion: 2.1 time: 1.182786 Oct 12 22:42:38.653832 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1352/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:37 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1492 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:38.659397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:38.676940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] [instance: af2a4581-f5f4-4296-8090-fce824218b58] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:38.702040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.702846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.703438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.704396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.705007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.712719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.750157 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] HTTP exception thrown: Instance af2a4581-f5f4-4296-8090-fce824218b58 could not be found. Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Request method failure captured: Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 HTTP/1.1 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0JM86wfrLEIwqf0C1dx2lLBc9KC378ofu0K9APL0-r3asoc2x-dDUO4_WFcGVN974rqT53wlRiJP0NFlCLLDGhFWWZI3SGdG12uK_wTezaQyA2UDQ3sPneXqUk2lU23GaJsQLdKxsSFOOW9-VdvQjoHOFP1Ynn2vLtUid7HhCRraZ0 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0eedb6331b634a7199cdd877e847c6db Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestBootFromVolume-1101834670 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0eedb6331b634a7199cdd877e847c6db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0eedb6331b634a7199cdd877e847c6db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0eedb6331b634a7199cdd877e847c6db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0eedb6331b634a7199cdd877e847c6db"}]}] Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestBootFromVolume-1101834670 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0eedb6331b634a7199cdd877e847c6db Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1101834670 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestBootFromVolume-1101834670-project Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 6857ea19a8194e5680b1b376dcdbcb30 Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestBootFromVolume-1101834670-project Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance af2a4581-f5f4-4296-8090-fce824218b58 could not be found. Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'af2a4581-f5f4-4296-8090-fce824218b58'} Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af2a4581-f5f4-4296-8090-fce824218b58 could not be found. Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af2a4581-f5f4-4296-8090-fce824218b58 could not be found. Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:38.762988 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af2a4581-f5f4-4296-8090-fce824218b58 could not be found. Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Returning 404 to user: Instance af2a4581-f5f4-4296-8090-fce824218b58 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f379e62-5008-4fca-94b3-136b1081c7a3 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58" status: 404 len: 111 microversion: 2.1 time: 0.109513 Oct 12 22:42:38.767794 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1353/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:38 2022] GET /compute/v2.1/servers/af2a4581-f5f4-4296-8090-fce824218b58 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:38.774189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cbbd140c-a02d-4682-8a23-c392846be854 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] Calling method '.version_select at 0x7f44fee40820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:38.819421 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cbbd140c-a02d-4682-8a23-c392846be854 tempest-ServersTestBootFromVolume-1101834670 tempest-ServersTestBootFromVolume-1101834670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934515603" status: 202 len: 0 microversion: 2.1 time: 0.048201 Oct 12 22:42:38.820971 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1354/2579] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 22:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934515603 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:42:38.840054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-81243099-ef49-4a95-ad5c-96fdc605f055 req-0c7be2e1-489d-4a80-9fe4-f273ffa41723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa4c9f9-4424-4ed0-8929-0d566470c66a", "tag": "c4a1c0a1-fa7b-4a72-bfaa-eb6bc0b1d0bc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:38.885141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-81243099-ef49-4a95-ad5c-96fdc605f055 req-0c7be2e1-489d-4a80-9fe4-f273ffa41723 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.885623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-81243099-ef49-4a95-ad5c-96fdc605f055 req-0c7be2e1-489d-4a80-9fe4-f273ffa41723 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:38.886056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-81243099-ef49-4a95-ad5c-96fdc605f055 req-0c7be2e1-489d-4a80-9fe4-f273ffa41723 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:38.914283 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-81243099-ef49-4a95-ad5c-96fdc605f055 req-0c7be2e1-489d-4a80-9fe4-f273ffa41723 service nova] Creating event network-changed:c4a1c0a1-fa7b-4a72-bfaa-eb6bc0b1d0bc for instance dfa4c9f9-4424-4ed0-8929-0d566470c66a on n-h1-860864-8 Oct 12 22:42:38.928019 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-81243099-ef49-4a95-ad5c-96fdc605f055 req-0c7be2e1-489d-4a80-9fe4-f273ffa41723 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098323 Oct 12 22:42:38.933102 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1355/2580] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:38.981847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:38.982981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:38.998064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:38.999740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.002171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:39.003827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:39.005608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.009043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:39.394604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:39.409161 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bcd7efae-11b0-404a-8a96-4b3655d8977c tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.984538 Oct 12 22:42:39.410186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1226/2581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:38 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:39.424166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-553b00fc-b2c4-4540-a456-ccd956abd943 req-ee9056d2-08dc-46a9-9977-ef42c32f4163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3df06b8-edf1-44e2-992f-1ee55ec985c2", "name": "network-vif-plugged", "status": "completed", "tag": "28131679-78a1-436f-81ab-7fa1b6f2ae39"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:39.448163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-553b00fc-b2c4-4540-a456-ccd956abd943 req-ee9056d2-08dc-46a9-9977-ef42c32f4163 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:39.451120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-553b00fc-b2c4-4540-a456-ccd956abd943 req-ee9056d2-08dc-46a9-9977-ef42c32f4163 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.452393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-553b00fc-b2c4-4540-a456-ccd956abd943 req-ee9056d2-08dc-46a9-9977-ef42c32f4163 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:39.477725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-553b00fc-b2c4-4540-a456-ccd956abd943 req-ee9056d2-08dc-46a9-9977-ef42c32f4163 service nova] Creating event network-vif-plugged:28131679-78a1-436f-81ab-7fa1b6f2ae39 for instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 on n-h1-860864-8 Oct 12 22:42:39.494705 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-553b00fc-b2c4-4540-a456-ccd956abd943 req-ee9056d2-08dc-46a9-9977-ef42c32f4163 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083043 Oct 12 22:42:39.496004 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1227/2582] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:39.521006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:39.522223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:39.563786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:39.564874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.569314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:39.571232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:39.572136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:39.572885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.042357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:40.050447 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0751c6cd-1587-4757-b23a-8f1a1a7e632a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1476 microversion: 2.1 time: 0.540705 Oct 12 22:42:40.051027 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1228/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:39 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1476 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:40.066258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:40.067175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:40.082220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.082982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.083426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.084333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.084942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.085549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.163219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:40.170889 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2dcbcd22-abfe-4c15-9115-901ab94af09f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1316 microversion: 2.1 time: 1.193231 Oct 12 22:42:40.171464 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1356/2584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:38 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1316 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:40.277898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:40.431740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:40.432367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:40.442562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.450268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.454016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.455137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.458514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.459121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.838345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:40.847007 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe941f0d-9434-42f3-8a17-f08a0d7e7beb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1498 microversion: 2.1 time: 0.785112 Oct 12 22:42:40.848140 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1229/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:40 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1498 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:40.877527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:40.878035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:40.884692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.885185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.885622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.886329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:40.886855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:40.887254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:40.944918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:42:40.989978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:41.009852 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1666870d-fe2e-43e2-b6ca-ceb0d6ba153b tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.575735 Oct 12 22:42:41.011401 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1357/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:40 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:41.087788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:41.088498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:41.102302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.102837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.104015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.105776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.106253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.108828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.140562 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e52b5f3a-f67f-478b-9571-83162fb92fc7 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 204 len: 0 microversion: 2.1 time: 0.268042 Oct 12 22:42:41.141223 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1230/2587] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:42:40 2022] DELETE /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:42:41.151116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:41.152266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:41.162561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.163446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.164144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.165084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.166225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.167019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.406998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:41.415526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38a5da7a-c31e-4df6-a5bf-f222f55c2d30 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.268651 Oct 12 22:42:41.437965 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1231/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:41 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:41.443607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:41.444241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:41.464030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.466399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.468363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.475579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.476341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.476930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.828898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:41.833437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:41.858371 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb5e10b4-b832-4818-8c27-d038e984e4ae tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1476 microversion: 2.1 time: 0.781872 Oct 12 22:42:41.860197 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1358/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:41 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1476 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:41.862122 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c3fda9e-7d9b-4f72-93fe-b967feb5365b tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1504 microversion: 2.1 time: 0.422201 Oct 12 22:42:41.865746 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1232/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:41 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:41.889456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9887c076-5598-45ba-b5c9-90d4be5c69de req-63ddbd06-b94e-4141-863c-a2d2cdfe27e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5082b3ef-e43c-4503-938b-e856b9c5a272", "name": "network-vif-unplugged", "status": "completed", "tag": "11b8e391-b7ba-4cd7-b504-3bf4098f27bc"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:41.896605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:41.904587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9887c076-5598-45ba-b5c9-90d4be5c69de req-63ddbd06-b94e-4141-863c-a2d2cdfe27e8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.905565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9887c076-5598-45ba-b5c9-90d4be5c69de req-63ddbd06-b94e-4141-863c-a2d2cdfe27e8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.908438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9887c076-5598-45ba-b5c9-90d4be5c69de req-63ddbd06-b94e-4141-863c-a2d2cdfe27e8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.927155 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9887c076-5598-45ba-b5c9-90d4be5c69de req-63ddbd06-b94e-4141-863c-a2d2cdfe27e8 service nova] Creating event network-vif-unplugged:11b8e391-b7ba-4cd7-b504-3bf4098f27bc for instance 5082b3ef-e43c-4503-938b-e856b9c5a272 on n-h1-860864-8 Oct 12 22:42:41.936271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-9887c076-5598-45ba-b5c9-90d4be5c69de req-63ddbd06-b94e-4141-863c-a2d2cdfe27e8 service nova] Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:42:41.949522 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9887c076-5598-45ba-b5c9-90d4be5c69de req-63ddbd06-b94e-4141-863c-a2d2cdfe27e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082296 Oct 12 22:42:41.950551 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1233/2591] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:41.963440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:41.967344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:41.976940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.977909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.978644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:41.979521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:41.980273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:41.980860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.021078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:42:42.182578 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2c03c44-f965-49d7-9c1b-9f5405f08f0e tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 204 len: 0 microversion: 2.1 time: 0.229559 Oct 12 22:42:42.185221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1234/2592] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:42:41 2022] DELETE /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:42:42.196281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.198111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.198984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:42.201645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.202722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.203446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.205180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.205944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.206688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:42.206985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.208341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.208833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.209270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.210152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.210612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.211266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.242025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-94e20530-4eca-45f8-8c8d-c4b3f00389ca tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.378487 Oct 12 22:42:42.252757 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1359/2593] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:42:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:42.258137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.259477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:42.271074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.271821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.272491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.273438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.274546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.275247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.479420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:42.493212 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec079f8c-318f-4d43-b1c1-a67939f768db tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.305577 Oct 12 22:42:42.493807 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1235/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:42 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:42.522564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.538738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.541144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.542489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.549715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.554275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.555022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.608386 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57a37152-4eaf-4f49-b987-51b62bdfd7ce tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091933 Oct 12 22:42:42.611458 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1236/2595] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 12 22:42:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:42.618760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.619632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:42.627706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.628703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.629317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.630192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.631096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.632148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.804524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:42.825307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d14dc37b-5e4b-4624-b231-723f037aa6ed tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1510 microversion: 2.1 time: 0.570146 Oct 12 22:42:42.830195 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1360/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:42 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:42.836551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.841301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.841947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.842543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.843437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.846805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.861257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.915359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:42.921963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-142f33cb-c52a-426f-b43f-2bf9e1452edb tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.090521 Oct 12 22:42:42.932429 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7e765ade-f58d-43b9-a26a-0805a1a826b1 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.314184 Oct 12 22:42:42.932429 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1237/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:42 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:42.932963 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1361/2598] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:42:42 2022] GET /compute/v2.1/os-services => generated 944 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:42.945343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.946229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:42.947275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:42.951698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.953736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.954571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.959506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.960266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.961038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.965370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.966849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.967213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:42.968080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:42.970900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:42.971909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.019876 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e3170156-7488-419a-9cba-229bddc09c8b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-860864-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.076577 Oct 12 22:42:43.030338 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1362/2599] 10.222.0.20 () {58 vars in 1194 bytes} [Wed Oct 12 22:42:42 2022] GET /compute/v2.1/os-services?host=n-d-860864-8&binary=xxx => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:42:43.037975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:43.045291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.049514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.052503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.053483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.054128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.054718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.086011 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-53559794-7626-4044-86e5-45af666d5f1b tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053997 Oct 12 22:42:43.094507 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1363/2600] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:42:43 2022] GET /compute/v2.1/os-services => generated 944 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:43.100459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:43.105703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.106690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.107393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.108796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.109591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.111080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.144073 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1c2b9ee7-5004-4640-8066-4484843c9be5 tempest-ServicesAdminNegativeTestJSON-307941598 tempest-ServicesAdminNegativeTestJSON-307941598-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.047502 Oct 12 22:42:43.144692 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1364/2601] 10.222.0.20 () {58 vars in 1198 bytes} [Wed Oct 12 22:42:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:42:43.362512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:43.376928 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0124fba5-e841-4bda-b1fc-b87eed1f2e7c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1476 microversion: 2.1 time: 0.445721 Oct 12 22:42:43.378022 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1238/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:42 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:43.402460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8c9d0df-ef43-48ba-bd20-9bdbc24011ea tempest-ServicesAdminNegativeTestJSON-1231586926 tempest-ServicesAdminNegativeTestJSON-1231586926-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:43.407964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b8c9d0df-ef43-48ba-bd20-9bdbc24011ea tempest-ServicesAdminNegativeTestJSON-1231586926 tempest-ServicesAdminNegativeTestJSON-1231586926-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1a70c87022d44793850fc8c799b79ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b34677e293443f0bd2eb2b1685374b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8c9d0df-ef43-48ba-bd20-9bdbc24011ea tempest-ServicesAdminNegativeTestJSON-1231586926 tempest-ServicesAdminNegativeTestJSON-1231586926-project] Request method failure captured: Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0LgIjSxRZtPv3qlJxYUw_LUZCIUOnaKZNyYXJ03WFufmAajlBAXSKZqekB3jziPACisHWMDXQY6LQOm1v1Zd3s_ut5jif7uD4PzlIqC52cGwMEgzFFitks4fOfuN4UUDyo6ypHEAKd8sYpEr7gmMvyCeBVM3Z1iyWqCnRRn5vUy7jY Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 1b34677e293443f0bd2eb2b1685374b5 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1231586926 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b34677e293443f0bd2eb2b1685374b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b34677e293443f0bd2eb2b1685374b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b34677e293443f0bd2eb2b1685374b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b34677e293443f0bd2eb2b1685374b5"}]}] Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1231586926 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 1b34677e293443f0bd2eb2b1685374b5 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1231586926 Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServicesAdminNegativeTestJSON-1231586926-project Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1a70c87022d44793850fc8c799b79ebb Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1231586926-project Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:42:43.417354 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8c9d0df-ef43-48ba-bd20-9bdbc24011ea tempest-ServicesAdminNegativeTestJSON-1231586926 tempest-ServicesAdminNegativeTestJSON-1231586926-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8c9d0df-ef43-48ba-bd20-9bdbc24011ea tempest-ServicesAdminNegativeTestJSON-1231586926 tempest-ServicesAdminNegativeTestJSON-1231586926-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.264616 Oct 12 22:42:43.421596 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1365/2603] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:42:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:43.518578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:43.519222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:43.525690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.526528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.527178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.528140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.528799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.529502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.557990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:43.854721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:43.860244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:43.899109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.899603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.900073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.900778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.904551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.906714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.909469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:43.919762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-115f6071-1aa4-44ba-bd00-2571daf70d85 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.405015 Oct 12 22:42:43.931984 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1239/2604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:43 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:43.953967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:43.955584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:43.965209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.968798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.971548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:43.974116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:43.978784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:43.979418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:44.787716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:44.799562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab0a9e95-1b1a-4904-96fa-5af9c0af1b5d tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1510 microversion: 2.1 time: 0.952196 Oct 12 22:42:44.813609 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1366/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:43 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1510 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:44.829021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9a2c5c64-c21d-4199-8e1f-6c54ada9fc0c req-06d40dcc-cea5-4d2d-92f3-f1eebfce98c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5082b3ef-e43c-4503-938b-e856b9c5a272", "tag": "11b8e391-b7ba-4cd7-b504-3bf4098f27bc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:44.840522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9a2c5c64-c21d-4199-8e1f-6c54ada9fc0c req-06d40dcc-cea5-4d2d-92f3-f1eebfce98c2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:44.841355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9a2c5c64-c21d-4199-8e1f-6c54ada9fc0c req-06d40dcc-cea5-4d2d-92f3-f1eebfce98c2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:44.841973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9a2c5c64-c21d-4199-8e1f-6c54ada9fc0c req-06d40dcc-cea5-4d2d-92f3-f1eebfce98c2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:44.862931 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9a2c5c64-c21d-4199-8e1f-6c54ada9fc0c req-06d40dcc-cea5-4d2d-92f3-f1eebfce98c2 service nova] Creating event network-changed:11b8e391-b7ba-4cd7-b504-3bf4098f27bc for instance 5082b3ef-e43c-4503-938b-e856b9c5a272 on n-h1-860864-8 Oct 12 22:42:44.879570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-9a2c5c64-c21d-4199-8e1f-6c54ada9fc0c req-06d40dcc-cea5-4d2d-92f3-f1eebfce98c2 service nova] Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:42:44.881895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:44.898390 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9a2c5c64-c21d-4199-8e1f-6c54ada9fc0c req-06d40dcc-cea5-4d2d-92f3-f1eebfce98c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078228 Oct 12 22:42:44.899820 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1367/2606] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:44.906961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:44.907998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:44.916875 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f89d3431-64b9-4baf-9ac5-3c351117a4ad tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1504 microversion: 2.1 time: 0.965109 Oct 12 22:42:44.918104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:44.918650 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1240/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:43 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1504 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:44.919049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:44.919706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:44.920702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:44.921313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:44.921925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:44.946801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:44.947486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:44.954919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:44.955412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:44.955910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:44.956713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:44.957223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:44.957817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:45.584180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:45.597057 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea932502-136c-4fdc-8032-4f43265773b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1476 microversion: 2.1 time: 0.694924 Oct 12 22:42:45.599148 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1368/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:44 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1476 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:45.690132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:45.709770 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7f77c71-720a-4fcb-b40f-bab95d25c073 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.767684 Oct 12 22:42:45.713862 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1241/2609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:44 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:45.826648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:45.827563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:45.836137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:45.836924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:45.837511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:45.838589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:45.839751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:45.840356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:45.899596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:45.902788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:45.906964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:45.907592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lazy-loading 'fault' on Instance uuid a3df06b8-edf1-44e2-992f-1ee55ec985c2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:42:45.943861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:45.944562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:45.953548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:45.954749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:45.955148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:45.960867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:45.962470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:45.982335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:46.135957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:46.144924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e04a11d-8d6a-469d-8737-709413be4120 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1306 microversion: 2.1 time: 0.323561 Oct 12 22:42:46.158307 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1369/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:45 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1306 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:46.294453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:46.306257 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33e17ab5-5405-43e7-9143-cfbb1959066c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 200 len: 1462 microversion: 2.1 time: 0.368645 Oct 12 22:42:46.312648 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1242/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:45 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 1462 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:46.620626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:46.621240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:46.637514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:46.638012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:46.638453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:46.639193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:46.639623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:46.640077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:46.644640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:46.737143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:46.737757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:46.743873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:46.744618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:46.745223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:46.746092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:46.746714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:46.747280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.003876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:47.013479 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c291da7-b5ce-45ba-83f5-23d85e4625b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1474 microversion: 2.1 time: 0.396597 Oct 12 22:42:47.019800 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1370/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:46 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:47.039033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a77b233a-acef-45aa-811c-24593a07d4d7 req-fc15d6aa-3e8d-495e-bf44-17d1eb970d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa4c9f9-4424-4ed0-8929-0d566470c66a", "name": "network-vif-plugged", "status": "completed", "tag": "c4a1c0a1-fa7b-4a72-bfaa-eb6bc0b1d0bc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:47.067745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a77b233a-acef-45aa-811c-24593a07d4d7 req-fc15d6aa-3e8d-495e-bf44-17d1eb970d97 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.069914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a77b233a-acef-45aa-811c-24593a07d4d7 req-fc15d6aa-3e8d-495e-bf44-17d1eb970d97 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.072749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a77b233a-acef-45aa-811c-24593a07d4d7 req-fc15d6aa-3e8d-495e-bf44-17d1eb970d97 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.106727 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a77b233a-acef-45aa-811c-24593a07d4d7 req-fc15d6aa-3e8d-495e-bf44-17d1eb970d97 service nova] Creating event network-vif-plugged:c4a1c0a1-fa7b-4a72-bfaa-eb6bc0b1d0bc for instance dfa4c9f9-4424-4ed0-8929-0d566470c66a on n-h1-860864-8 Oct 12 22:42:47.128890 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a77b233a-acef-45aa-811c-24593a07d4d7 req-fc15d6aa-3e8d-495e-bf44-17d1eb970d97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104569 Oct 12 22:42:47.129827 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1371/2613] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:47.135720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e89a97c6-c790-4584-abb2-c3a6bac80168 req-1bc2c8d1-9692-4f35-96dc-fc046ff4c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3df06b8-edf1-44e2-992f-1ee55ec985c2", "name": "network-vif-deleted", "tag": "28131679-78a1-436f-81ab-7fa1b6f2ae39"}, {"server_uuid": "6e6e20be-894c-4260-8ff1-63f563adf029", "name": "network-vif-deleted", "tag": "6f516b63-aa2d-49e2-b55a-fdaf0ad25951"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:47.147548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e89a97c6-c790-4584-abb2-c3a6bac80168 req-1bc2c8d1-9692-4f35-96dc-fc046ff4c1d4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.147996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e89a97c6-c790-4584-abb2-c3a6bac80168 req-1bc2c8d1-9692-4f35-96dc-fc046ff4c1d4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.148433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e89a97c6-c790-4584-abb2-c3a6bac80168 req-1bc2c8d1-9692-4f35-96dc-fc046ff4c1d4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.163377 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e89a97c6-c790-4584-abb2-c3a6bac80168 req-1bc2c8d1-9692-4f35-96dc-fc046ff4c1d4 service nova] Creating event network-vif-deleted:28131679-78a1-436f-81ab-7fa1b6f2ae39 for instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 on n-h1-860864-8 Oct 12 22:42:47.163915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e89a97c6-c790-4584-abb2-c3a6bac80168 req-1bc2c8d1-9692-4f35-96dc-fc046ff4c1d4 service nova] Creating event network-vif-deleted:6f516b63-aa2d-49e2-b55a-fdaf0ad25951 for instance 6e6e20be-894c-4260-8ff1-63f563adf029 on n-h2-860864-8 Oct 12 22:42:47.175146 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e89a97c6-c790-4584-abb2-c3a6bac80168 req-1bc2c8d1-9692-4f35-96dc-fc046ff4c1d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043917 Oct 12 22:42:47.175939 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1372/2614] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:47.181590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:47.182785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:47.192281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.193067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.193804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.194919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.195659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.197329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.242916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.243500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.244051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.244584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lazy-loading 'fault' on Instance uuid a3df06b8-edf1-44e2-992f-1ee55ec985c2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:42:47.258235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:47.272982 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a934099a-c5b4-47e6-93a9-e7f66966ec1a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.540276 Oct 12 22:42:47.274047 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1243/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:46 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:47.306210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93dd797a41544c59fbcfb4fc7453803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb36be1d153411baf8bb0b7bb5582cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:47.315209 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7610f6c5-ab9b-4110-9df9-89a57f81ba73 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 200 len: 1306 microversion: 2.1 time: 0.137823 Oct 12 22:42:47.315985 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1373/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:47 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 1306 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:47.341792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:47.342789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 6e6e20be-894c-4260-8ff1-63f563adf029] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:47.353052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.354193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.354832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.355718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.356634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.357246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.374908 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] HTTP exception thrown: Instance 6e6e20be-894c-4260-8ff1-63f563adf029 could not be found. Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Request method failure captured: Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 HTTP/1.1 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0JkKuJpis7kMfrrU7Fannb-T86bSEk3tJuKikORSYKw_a0BgPbZI3evoTaX0mcS70OaM4fWTzHbjPsKemirjeCHbDJcMYG4DKpsegCIukXDqULU2i5QNEa1NEmzoy3OCkq22w8EIkZpVSdp9MwhvrR_DEnf5gSYonOd9Mw2_ei1L9w Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c3ed4ff0893f449495446f3b50561c90 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueTestJSON-1780115555 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3ed4ff0893f449495446f3b50561c90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3ed4ff0893f449495446f3b50561c90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3ed4ff0893f449495446f3b50561c90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3ed4ff0893f449495446f3b50561c90"}]}] Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueTestJSON-1780115555 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c3ed4ff0893f449495446f3b50561c90 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueTestJSON-1780115555 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerRescueTestJSON-1780115555-project Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a2d2288e0a284d94bc787491ccacd1e8 Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueTestJSON-1780115555-project Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 6e6e20be-894c-4260-8ff1-63f563adf029 could not be found. Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '6e6e20be-894c-4260-8ff1-63f563adf029'} Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6e20be-894c-4260-8ff1-63f563adf029 could not be found. Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6e20be-894c-4260-8ff1-63f563adf029 could not be found. Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:47.378481 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:47.382706 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:47.382706 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:47.382706 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:47.382706 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:47.382706 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:47.382706 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6e20be-894c-4260-8ff1-63f563adf029 could not be found. Oct 12 22:42:47.382706 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:47.386190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Returning 404 to user: Instance 6e6e20be-894c-4260-8ff1-63f563adf029 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:47.387515 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e50a8b82-04bd-4e90-8966-efd601f335d3 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029" status: 404 len: 111 microversion: 2.1 time: 0.050643 Oct 12 22:42:47.388797 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1244/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:47 2022] GET /compute/v2.1/servers/6e6e20be-894c-4260-8ff1-63f563adf029 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:47.401307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:47.402100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:47.410726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.410726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.411986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.413576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.414729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.415181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.500881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:42:47.723164 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38a045d5-afe0-4586-b25f-2a593349bddb tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 204 len: 0 microversion: 2.1 time: 0.328204 Oct 12 22:42:47.728245 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1374/2618] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:42:47 2022] DELETE /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:42:47.733023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:47.733805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:47.747877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.748403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.748869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:47.749673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:47.750132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:47.750544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.046607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:48.048701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:48.062053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.063074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.066507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.067572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.069426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.070068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.462260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:48.473832 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0ee19e9-46d1-43cd-a7e4-2c64d6007ab5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1474 microversion: 2.1 time: 0.432328 Oct 12 22:42:48.475068 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1375/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:48 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1474 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:48.495124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:48.496141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:48.503215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.504071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.504884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.505856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.506558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.507649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.639208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:48.654643 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5a0592c-5391-4e05-ad05-d39b3b09b4b4 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1491 microversion: 2.1 time: 0.926077 Oct 12 22:42:48.657747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1245/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:47 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1491 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:48.693309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:48.697729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:48.710744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.714334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.714981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.716217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.717656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.720177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.778722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] HTTP exception thrown: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Request method failure captured: Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 HTTP/1.1 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LJk1MGmnARyg-EV1iusjADgP1ZpB0M2xUdOs1cHLsiUOz7TIYWEVIBvNWXwd3yBmy65eVwYpPU4fwh5m9tJUPFsz-nflF_nuQD9x-lOk_oyr87W_WjFOiTVFNxnqbneYG1GlMKV94FuCosGye5Ju3JXWdX41YBFOF1XDZGO7gPuXg Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}] Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a93dd797a41544c59fbcfb4fc7453803 Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a3df06b8-edf1-44e2-992f-1ee55ec985c2'} Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.781061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.786336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.786336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.786336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.786336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:48.786336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:48.786336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.786336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.788878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Returning 404 to user: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:48.790363 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32ef0255-ccb9-47b3-bd25-6e1ae15039a3 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 404 len: 111 microversion: 2.1 time: 0.121006 Oct 12 22:42:48.793122 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1246/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:48 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:48.803864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-729326766", "metadata": {"image_type": "test"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:48.807127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:48.816203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.817089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.817764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.818705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.819398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.821357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.869756 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] HTTP exception thrown: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Request method failure captured: Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2/action HTTP/1.1 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 111 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LJk1MGmnARyg-EV1iusjADgP1ZpB0M2xUdOs1cHLsiUOz7TIYWEVIBvNWXwd3yBmy65eVwYpPU4fwh5m9tJUPFsz-nflF_nuQD9x-lOk_oyr87W_WjFOiTVFNxnqbneYG1GlMKV94FuCosGye5Ju3JXWdX41YBFOF1XDZGO7gPuXg Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}] Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a93dd797a41544c59fbcfb4fc7453803 Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-729326766", "metadata": {"image_type": "test"}}} Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a3df06b8-edf1-44e2-992f-1ee55ec985c2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-729326766', 'metadata': {'image_type': 'test'}}}} Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:42:48.872461 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.877093 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.879428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Returning 404 to user: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:48.880862 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a37b0083-bfde-4950-bd8f-6cad7345f084 tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "POST /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2/action" status: 404 len: 111 microversion: 2.1 time: 0.083204 Oct 12 22:42:48.887104 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1247/2622] 10.222.0.20 () {60 vars in 1279 bytes} [Wed Oct 12 22:42:48 2022] POST /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:42:48.892881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff04543c-de36-4246-9dae-84c307309cba tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1503359808", "metadata": {"image_type": "test"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:48.896776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ff04543c-de36-4246-9dae-84c307309cba tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Failed to fetch instance by id tempest-invalid-927863929 {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:42:48.897840 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ff04543c-de36-4246-9dae-84c307309cba tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] HTTP exception thrown: Instance tempest-invalid-927863929 could not be found. Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff04543c-de36-4246-9dae-84c307309cba tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Request method failure captured: Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/tempest-invalid-927863929/action HTTP/1.1 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 112 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LJk1MGmnARyg-EV1iusjADgP1ZpB0M2xUdOs1cHLsiUOz7TIYWEVIBvNWXwd3yBmy65eVwYpPU4fwh5m9tJUPFsz-nflF_nuQD9x-lOk_oyr87W_WjFOiTVFNxnqbneYG1GlMKV94FuCosGye5Ju3JXWdX41YBFOF1XDZGO7gPuXg Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}] Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a93dd797a41544c59fbcfb4fc7453803 Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1503359808", "metadata": {"image_type": "test"}}} Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance tempest-invalid-927863929 could not be found. Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'tempest-invalid-927863929', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1503359808', 'metadata': {'image_type': 'test'}}}} Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-927863929 could not be found. Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:48.899489 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-927863929 could not be found. Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-927863929 could not be found. Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff04543c-de36-4246-9dae-84c307309cba tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Returning 404 to user: Instance tempest-invalid-927863929 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:48.903437 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ff04543c-de36-4246-9dae-84c307309cba tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-927863929/action" status: 404 len: 100 microversion: 2.1 time: 0.012511 Oct 12 22:42:48.908289 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1248/2623] 10.222.0.20 () {60 vars in 1246 bytes} [Wed Oct 12 22:42:48 2022] POST /compute/v2.1/servers/tempest-invalid-927863929/action => generated 100 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:48.913285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bfef16e1-a159-4b56-9c30-d4f4db88b0eb tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1149331660"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:48.915839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bfef16e1-a159-4b56-9c30-d4f4db88b0eb tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:42:48.916403 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-bfef16e1-a159-4b56-9c30-d4f4db88b0eb tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bfef16e1-a159-4b56-9c30-d4f4db88b0eb tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Request method failure captured: Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 57 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LJk1MGmnARyg-EV1iusjADgP1ZpB0M2xUdOs1cHLsiUOz7TIYWEVIBvNWXwd3yBmy65eVwYpPU4fwh5m9tJUPFsz-nflF_nuQD9x-lOk_oyr87W_WjFOiTVFNxnqbneYG1GlMKV94FuCosGye5Ju3JXWdX41YBFOF1XDZGO7gPuXg Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}] Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a93dd797a41544c59fbcfb4fc7453803 Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: {"createImage": {"name": "tempest-test-snap-1149331660"}} Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1149331660'}}} Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.917955 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bfef16e1-a159-4b56-9c30-d4f4db88b0eb tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bfef16e1-a159-4b56-9c30-d4f4db88b0eb tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010922 Oct 12 22:42:48.925685 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1249/2624] 10.222.0.20 () {60 vars in 1275 bytes} [Wed Oct 12 22:42:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:48.931270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c04390f0-eb1c-440e-b7b5-a5ad553d42db tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-620149648"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:48.933805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c04390f0-eb1c-440e-b7b5-a5ad553d42db tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:42:48.934246 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c04390f0-eb1c-440e-b7b5-a5ad553d42db tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c04390f0-eb1c-440e-b7b5-a5ad553d42db tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Request method failure captured: Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 56 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LJk1MGmnARyg-EV1iusjADgP1ZpB0M2xUdOs1cHLsiUOz7TIYWEVIBvNWXwd3yBmy65eVwYpPU4fwh5m9tJUPFsz-nflF_nuQD9x-lOk_oyr87W_WjFOiTVFNxnqbneYG1GlMKV94FuCosGye5Ju3JXWdX41YBFOF1XDZGO7gPuXg Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}] Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a93dd797a41544c59fbcfb4fc7453803 Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: {"createImage": {"name": "tempest-test-snap-620149648"}} Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-620149648'}}} Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.936086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c04390f0-eb1c-440e-b7b5-a5ad553d42db tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c04390f0-eb1c-440e-b7b5-a5ad553d42db tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011479 Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1250/2625] 10.222.0.20 () {60 vars in 1281 bytes} [Wed Oct 12 22:42:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:48.949005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:48.962086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.963164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.963842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.964907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:48.965615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:48.966247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:48.982934 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] HTTP exception thrown: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Request method failure captured: Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 HTTP/1.1 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LJk1MGmnARyg-EV1iusjADgP1ZpB0M2xUdOs1cHLsiUOz7TIYWEVIBvNWXwd3yBmy65eVwYpPU4fwh5m9tJUPFsz-nflF_nuQD9x-lOk_oyr87W_WjFOiTVFNxnqbneYG1GlMKV94FuCosGye5Ju3JXWdX41YBFOF1XDZGO7gPuXg Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}] Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a93dd797a41544c59fbcfb4fc7453803 Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a3df06b8-edf1-44e2-992f-1ee55ec985c2'} Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:48.984554 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Returning 404 to user: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-205998fa-e221-42d5-b3c2-81ae7e36d45f tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 404 len: 111 microversion: 2.1 time: 0.042989 Oct 12 22:42:48.990770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1251/2626] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:42:48 2022] DELETE /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:48.995828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:48.996496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] [instance: a3df06b8-edf1-44e2-992f-1ee55ec985c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:48.997260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:49.002818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.003321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.003764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:49.004521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.005142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.005581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:49.008690 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c8d98abd-5cbe-4ff8-8c81-9f00a0cbcd4a tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.531325 Oct 12 22:42:49.009895 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1376/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:48 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:49.036060 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] HTTP exception thrown: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Request method failure captured: Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 HTTP/1.1 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LJk1MGmnARyg-EV1iusjADgP1ZpB0M2xUdOs1cHLsiUOz7TIYWEVIBvNWXwd3yBmy65eVwYpPU4fwh5m9tJUPFsz-nflF_nuQD9x-lOk_oyr87W_WjFOiTVFNxnqbneYG1GlMKV94FuCosGye5Ju3JXWdX41YBFOF1XDZGO7gPuXg Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cb36be1d153411baf8bb0b7bb5582cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cb36be1d153411baf8bb0b7bb5582cf"}]}] Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5cb36be1d153411baf8bb0b7bb5582cf Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-837811364 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a93dd797a41544c59fbcfb4fc7453803 Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesNegativeTestJSON-837811364-project Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a3df06b8-edf1-44e2-992f-1ee55ec985c2'} Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:49.037658 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] Returning 404 to user: Instance a3df06b8-edf1-44e2-992f-1ee55ec985c2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:49.041532 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36c7498e-65ae-4124-a4f7-58390373962c tempest-ImagesNegativeTestJSON-837811364 tempest-ImagesNegativeTestJSON-837811364-project] 10.222.0.20 "GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2" status: 404 len: 111 microversion: 2.1 time: 0.047492 Oct 12 22:42:49.043264 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1252/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:48 2022] GET /compute/v2.1/servers/a3df06b8-edf1-44e2-992f-1ee55ec985c2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:49.497236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:49.498522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:49.506340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.507140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.507832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:49.508825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.509495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.510141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:49.684692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:49.686266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:49.704975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.705954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.706494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:49.708532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:49.709185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:49.709632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:50.242314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:50.302678 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5930c7e6-4df2-48dc-88e2-e4aaa06c04a6 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1491 microversion: 2.1 time: 0.624941 Oct 12 22:42:50.318735 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1253/2629] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:49 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1491 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:50.327390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:50.330327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:50.356953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:50.364800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:50.365507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:50.366454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:50.369968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:50.372095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:50.879857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:50.892065 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5c7c787-9c1b-446b-b74b-d0ee6542bf12 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1474 microversion: 2.1 time: 1.396580 Oct 12 22:42:50.896068 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1377/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:49 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1474 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:51.169464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:51.182876 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a735375-ddff-45a8-8704-e0cac5161355 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1315 microversion: 2.1 time: 0.862634 Oct 12 22:42:51.183955 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1254/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:50 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1315 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:51.343244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:51.344161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:51.364901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:51.366326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:51.367007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:51.367976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:51.368652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:51.370449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:51.924503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:51.925673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:51.942300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:51.942996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:51.945434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:51.946190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:51.946656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:51.947090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.014036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:52.028466 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-138515ed-966e-43b1-84c6-d8cd6d547939 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1491 microversion: 2.1 time: 0.690160 Oct 12 22:42:52.029060 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1378/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:51 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1491 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:52.207648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:52.208575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:52.225889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.226714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.227444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.228545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.229217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.229837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.388641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:52.408167 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d97913e-172b-4918-b4cf-1f14fd37d5a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1471 microversion: 2.1 time: 0.489465 Oct 12 22:42:52.425562 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1255/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:51 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1471 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:52.433117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:52.434866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:52.442778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.443741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.444413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.445355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.446850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.447948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.583682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:52.636050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe5a86b4-49df-47e9-8419-db183ab8bbd7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272/action" status: 204 len: 0 microversion: 2.1 time: 0.206966 Oct 12 22:42:52.636811 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1256/2634] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:42:52 2022] POST /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272/action => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:42:52.674760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:52.677879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:52.717288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.720871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.724550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.725537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.726240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.727674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.859821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:52.875029 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c92271ac-7d10-41bf-ba9b-19a49008cf80 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1503 microversion: 2.1 time: 0.671856 Oct 12 22:42:52.899632 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1379/2635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:52 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1503 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:52.911019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8a69b0cc-0c2c-4fd3-b65b-77ab84463c35 req-f5a686e3-fdf2-4db6-9e3a-d8202cd6fea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5082b3ef-e43c-4503-938b-e856b9c5a272", "name": "network-vif-plugged", "status": "completed", "tag": "11b8e391-b7ba-4cd7-b504-3bf4098f27bc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:52.925711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8a69b0cc-0c2c-4fd3-b65b-77ab84463c35 req-f5a686e3-fdf2-4db6-9e3a-d8202cd6fea6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:52.926195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8a69b0cc-0c2c-4fd3-b65b-77ab84463c35 req-f5a686e3-fdf2-4db6-9e3a-d8202cd6fea6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:52.926957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8a69b0cc-0c2c-4fd3-b65b-77ab84463c35 req-f5a686e3-fdf2-4db6-9e3a-d8202cd6fea6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:52.973719 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8a69b0cc-0c2c-4fd3-b65b-77ab84463c35 req-f5a686e3-fdf2-4db6-9e3a-d8202cd6fea6 service nova] Creating event network-vif-plugged:11b8e391-b7ba-4cd7-b504-3bf4098f27bc for instance 5082b3ef-e43c-4503-938b-e856b9c5a272 on n-h1-860864-8 Oct 12 22:42:52.990931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-8a69b0cc-0c2c-4fd3-b65b-77ab84463c35 req-f5a686e3-fdf2-4db6-9e3a-d8202cd6fea6 service nova] Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:42:53.006443 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8a69b0cc-0c2c-4fd3-b65b-77ab84463c35 req-f5a686e3-fdf2-4db6-9e3a-d8202cd6fea6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105348 Oct 12 22:42:53.007648 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1380/2636] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:53.017765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:53.019196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:53.026354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.027047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.027685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.028588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.029498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.030152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.123438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=14 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:53.230602 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ee2c515-c268-482b-9f68-cb6e7be7c4e0 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.216535 Oct 12 22:42:53.234357 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1381/2637] 10.222.0.20 () {58 vars in 1296 bytes} [Wed Oct 12 22:42:53 2022] DELETE /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a/os-server-password => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:42:53.241912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1ef0815f-a4c2-46c0-b85b-696bdf81fbc0 req-7a3a23bb-bb2c-4d5e-8703-bd0dad888c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36885901-b37c-4864-ab4a-32d9c41b923e", "name": "network-vif-deleted", "tag": "a23ac33d-f4d7-46c8-960c-5f6f9afc264a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:53.270041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ef0815f-a4c2-46c0-b85b-696bdf81fbc0 req-7a3a23bb-bb2c-4d5e-8703-bd0dad888c37 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.270607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ef0815f-a4c2-46c0-b85b-696bdf81fbc0 req-7a3a23bb-bb2c-4d5e-8703-bd0dad888c37 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.272812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ef0815f-a4c2-46c0-b85b-696bdf81fbc0 req-7a3a23bb-bb2c-4d5e-8703-bd0dad888c37 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.297521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1ef0815f-a4c2-46c0-b85b-696bdf81fbc0 req-7a3a23bb-bb2c-4d5e-8703-bd0dad888c37 service nova] Creating event network-vif-deleted:a23ac33d-f4d7-46c8-960c-5f6f9afc264a for instance 36885901-b37c-4864-ab4a-32d9c41b923e on n-h1-860864-8 Oct 12 22:42:53.307312 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1ef0815f-a4c2-46c0-b85b-696bdf81fbc0 req-7a3a23bb-bb2c-4d5e-8703-bd0dad888c37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070549 Oct 12 22:42:53.308636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1382/2638] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:53.315552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:53.317071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:53.324466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.325723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.326335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.327480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.329258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.331207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.379875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.380392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.380833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.381342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lazy-loading 'fault' on Instance uuid 36885901-b37c-4864-ab4a-32d9c41b923e {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:42:53.517925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d2288e0a284d94bc787491ccacd1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ed4ff0893f449495446f3b50561c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:53.526411 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ae2da7a-b8c6-40cc-8b84-3c95052ce47c tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 200 len: 1303 microversion: 2.1 time: 0.215999 Oct 12 22:42:53.536784 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1383/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:53 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:53.551524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:53.552251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:53.575424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.577525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.578077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.580055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.585992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.587771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.663242 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6859b709-bbbd-4d2e-85b2-6ee63c64f304 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.115384 Oct 12 22:42:53.666436 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1384/2640] 10.222.0.20 () {58 vars in 1293 bytes} [Wed Oct 12 22:42:53 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a/os-server-password => generated 16 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:42:53.674027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:53.684330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:53.694705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.695472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.696154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.709007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.709592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.710085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.758840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:42:53.770257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:53.937228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:53.968987 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cf1d54e-2519-4c7f-9b6a-df109933c85f tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 204 len: 0 microversion: 2.1 time: 0.298603 Oct 12 22:42:53.970260 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1385/2641] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:42:53 2022] DELETE /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:42:53.979466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:53.980288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:53.986677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.987176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.987613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:53.988368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:53.988821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:53.989245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:54.422073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:54.438397 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a3523c9-8ac3-43d3-abd7-d50d733f85b8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1471 microversion: 2.1 time: 1.775389 Oct 12 22:42:54.439506 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1257/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:52 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1471 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:54.561500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:54.562189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] [instance: 36885901-b37c-4864-ab4a-32d9c41b923e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:54.571486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:54.576717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:54.577430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:54.577717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:54.578384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:54.579043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:54.580932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:54.586735 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a8725bb-0732-4535-be39-b1d727c5ade5 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1509 microversion: 2.1 time: 0.612109 Oct 12 22:42:54.592238 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1386/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:53 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1509 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:54.607819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] HTTP exception thrown: Instance 36885901-b37c-4864-ab4a-32d9c41b923e could not be found. Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Request method failure captured: Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e HTTP/1.1 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0JkKuJpis7kMfrrU7Fannb-T86bSEk3tJuKikORSYKw_a0BgPbZI3evoTaX0mcS70OaM4fWTzHbjPsKemirjeCHbDJcMYG4DKpsegCIukXDqULU2i5QNEa1NEmzoy3OCkq22w8EIkZpVSdp9MwhvrR_DEnf5gSYonOd9Mw2_ei1L9w Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c3ed4ff0893f449495446f3b50561c90 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueTestJSON-1780115555 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3ed4ff0893f449495446f3b50561c90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3ed4ff0893f449495446f3b50561c90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3ed4ff0893f449495446f3b50561c90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3ed4ff0893f449495446f3b50561c90"}]}] Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueTestJSON-1780115555 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c3ed4ff0893f449495446f3b50561c90 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueTestJSON-1780115555 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerRescueTestJSON-1780115555-project Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: a2d2288e0a284d94bc787491ccacd1e8 Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueTestJSON-1780115555-project Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 36885901-b37c-4864-ab4a-32d9c41b923e could not be found. Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '36885901-b37c-4864-ab4a-32d9c41b923e'} Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36885901-b37c-4864-ab4a-32d9c41b923e could not be found. Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36885901-b37c-4864-ab4a-32d9c41b923e could not be found. Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:42:54.615782 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36885901-b37c-4864-ab4a-32d9c41b923e could not be found. Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] Returning 404 to user: Instance 36885901-b37c-4864-ab4a-32d9c41b923e could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d991fda1-167a-486a-b094-2257cecedf52 tempest-ServerRescueTestJSON-1780115555 tempest-ServerRescueTestJSON-1780115555-project] 10.222.0.20 "GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e" status: 404 len: 111 microversion: 2.1 time: 0.059971 Oct 12 22:42:54.621632 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1258/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:54 2022] GET /compute/v2.1/servers/36885901-b37c-4864-ab4a-32d9c41b923e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:42:55.463674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:55.464145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:55.478774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:55.479185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:55.479617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:55.480351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:55.480807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:55.481225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:55.612428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:55.613711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:55.620825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:55.621532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:55.622129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:55.623026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:55.623640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:55.624347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:55.870584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:55.880594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e600e187-cec1-4c55-9de0-83758bf43f45 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1509 microversion: 2.1 time: 0.273451 Oct 12 22:42:55.896138 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1259/2645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:55 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:56.871314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:56.882974 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5854cd85-d8e1-4f29-b573-280607ecf3e1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1471 microversion: 2.1 time: 1.423789 Oct 12 22:42:56.883570 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1387/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:55 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1471 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:56.906732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:56.907527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:56.926926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.927531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.928147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:56.928894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:56.929346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:56.929993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:57.265131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:57.273729 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ee1d89b1-f624-4067-a1f6-01d80f7f4371 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1509 microversion: 2.1 time: 0.370901 Oct 12 22:42:57.288308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1260/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:56 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:57.906847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:57.907514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:57.923354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:57.923852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:57.924297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:57.925561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:57.926168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:57.926753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:58.299228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:58.301313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:58.311218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:58.312275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:58.313175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:58.314932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:58.315755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:58.330182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:58.730489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:58.736972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:42:58.754503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc96a87f-4ce1-48f9-a298-6a094255c008 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1467 microversion: 2.1 time: 0.459834 Oct 12 22:42:58.768726 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1261/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:58 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1467 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:42:59.054934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:59.065046 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f8e35eaa-728d-4102-a062-0a38de3ceef6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1463 microversion: 2.1 time: 1.162269 Oct 12 22:42:59.083835 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1388/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:57 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1463 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:59.088946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:59.089566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:59.096664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.097159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.097601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.098316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.098770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.099196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.280551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:42:59.302634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e5c67155-3606-4e82-a06b-6d64fd77c7ca req-b6793c51-72ab-40b7-9c47-f326e521507f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa4c9f9-4424-4ed0-8929-0d566470c66a", "name": "network-vif-deleted", "tag": "c4a1c0a1-fa7b-4a72-bfaa-eb6bc0b1d0bc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:59.315670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e5c67155-3606-4e82-a06b-6d64fd77c7ca req-b6793c51-72ab-40b7-9c47-f326e521507f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.316646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e5c67155-3606-4e82-a06b-6d64fd77c7ca req-b6793c51-72ab-40b7-9c47-f326e521507f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.318067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e5c67155-3606-4e82-a06b-6d64fd77c7ca req-b6793c51-72ab-40b7-9c47-f326e521507f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.323841 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65589c87-9ab7-44f1-9123-b52319854ea7 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1463 microversion: 2.1 time: 0.216983 Oct 12 22:42:59.331989 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1262/2650] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:59 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:42:59.333012 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e5c67155-3606-4e82-a06b-6d64fd77c7ca req-b6793c51-72ab-40b7-9c47-f326e521507f service nova] Creating event network-vif-deleted:c4a1c0a1-fa7b-4a72-bfaa-eb6bc0b1d0bc for instance dfa4c9f9-4424-4ed0-8929-0d566470c66a on n-h1-860864-8 Oct 12 22:42:59.344903 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e5c67155-3606-4e82-a06b-6d64fd77c7ca req-b6793c51-72ab-40b7-9c47-f326e521507f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052009 Oct 12 22:42:59.348450 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1389/2651] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:59.359486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90ce04d7-629c-4e74-a4d6-baf59f1281dc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'create', calling method: .version_select at 0x7f44ff89bc10>, body: {"keypair": {"name": "tempest-keypair-986030539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFuecCLO78VUpSCokhOTQ9RESpw4I1m5kzXj3XBq9cdiya+BkA9tBR45EsDZzj6T7M9g2aBZ8iQjEWpCgRlbfYtvEPihJWrC4Q89aL15xCFhpLdbqB1tnw7nSpUmMBO9g=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:42:59.410201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-90ce04d7-629c-4e74-a4d6-baf59f1281dc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:42:59.418096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-90ce04d7-629c-4e74-a4d6-baf59f1281dc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for user 70dbe0c8a7784391a83066cb1cb74604 and project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:42:59.462608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90ce04d7-629c-4e74-a4d6-baf59f1281dc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107963 Oct 12 22:42:59.463566 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1263/2652] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:42:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:42:59.783379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:42:59.783775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:42:59.796692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.797247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.798340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.799125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.799649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.800171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.879630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:42:59.880158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:42:59.880594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:42:59.884058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lazy-loading 'fault' on Instance uuid dfa4c9f9-4424-4ed0-8929-0d566470c66a {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:43:00.073129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c881d79e28d74c5183ddc025b55d342f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3f7aab59114811b56a3816b561c0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:00.083976 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b6254e3-a4d0-45bc-9b97-c7cb455b6541 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 200 len: 1305 microversion: 2.1 time: 0.308969 Oct 12 22:43:00.086373 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1390/2653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:42:59 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 1305 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:01.114048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:01.114925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] [instance: dfa4c9f9-4424-4ed0-8929-0d566470c66a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:01.128883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:01.129730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:01.130390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:01.131354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:01.132239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:01.132889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:01.158671 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] HTTP exception thrown: Instance dfa4c9f9-4424-4ed0-8929-0d566470c66a could not be found. Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Request method failure captured: Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a HTTP/1.1 Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0LTEnjjMQceOoKGudDO5Zv9sJftMY02NKrjAEQMuWWxrwSw2DpjGEo_xNvpNGD-cpnv4x4OlcZjWtfWlNsAyo6y-ZO5OY2Hf3JT9EVHN94Cc--KyWEi0Xpze8iY8i8MRQeI6wajhlFWp-x2y70lt587OuQBdqG92EBWGazlMwGCZ2U Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 4a3f7aab59114811b56a3816b561c0aa Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerPasswordTestJSON-1779435139 Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a3f7aab59114811b56a3816b561c0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a3f7aab59114811b56a3816b561c0aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a3f7aab59114811b56a3816b561c0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a3f7aab59114811b56a3816b561c0aa"}]}] Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerPasswordTestJSON-1779435139 Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 4a3f7aab59114811b56a3816b561c0aa Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1779435139 Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerPasswordTestJSON-1779435139-project Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: c881d79e28d74c5183ddc025b55d342f Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerPasswordTestJSON-1779435139-project Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance dfa4c9f9-4424-4ed0-8929-0d566470c66a could not be found. Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'dfa4c9f9-4424-4ed0-8929-0d566470c66a'} Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa4c9f9-4424-4ed0-8929-0d566470c66a could not be found. Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa4c9f9-4424-4ed0-8929-0d566470c66a could not be found. Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:43:01.160408 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:43:01.165078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:43:01.165078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:43:01.165078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:43:01.165078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:43:01.165078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:43:01.165078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa4c9f9-4424-4ed0-8929-0d566470c66a could not be found. Oct 12 22:43:01.165078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:43:01.166446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] Returning 404 to user: Instance dfa4c9f9-4424-4ed0-8929-0d566470c66a could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:43:01.167560 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3411de97-c836-491c-a13a-c386e58aecc3 tempest-ServerPasswordTestJSON-1779435139 tempest-ServerPasswordTestJSON-1779435139-project] 10.222.0.20 "GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a" status: 404 len: 111 microversion: 2.1 time: 0.060255 Oct 12 22:43:01.168732 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1264/2654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:01 2022] GET /compute/v2.1/servers/dfa4c9f9-4424-4ed0-8929-0d566470c66a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:43:01.981656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5949ac88-ce3a-4981-95ab-76eda1721a8d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '.version_select at 0x7f44fee0e4c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:01.988038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5949ac88-ce3a-4981-95ab-76eda1721a8d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:01.989468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5949ac88-ce3a-4981-95ab-76eda1721a8d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:01.991841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5949ac88-ce3a-4981-95ab-76eda1721a8d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:02.023806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5949ac88-ce3a-4981-95ab-76eda1721a8d tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.047515 Oct 12 22:43:02.026036 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1391/2655] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 22:43:01 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:02.045615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9da0c174-07a8-4c97-b3c0-5be815dcce69 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:02.054414 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9da0c174-07a8-4c97-b3c0-5be815dcce69 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012429 Oct 12 22:43:02.058667 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1265/2656] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:43:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:02.067277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dca95901-b336-4b4e-a1f5-94cf6674280a tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1866752123", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:02.095963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dca95901-b336-4b4e-a1f5-94cf6674280a tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.032848 Oct 12 22:43:02.097186 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1392/2657] 10.222.0.20 () {60 vars in 1146 bytes} [Wed Oct 12 22:43:02 2022] POST /compute/v2.1/flavors => generated 499 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:02.112055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f1a3a36-50a6-4b23-87e7-739d395badb9 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:02.128341 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f1a3a36-50a6-4b23-87e7-739d395badb9 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021219 Oct 12 22:43:02.129643 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1266/2658] 10.222.0.20 () {58 vars in 1182 bytes} [Wed Oct 12 22:43:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:43:02.297455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1197501533", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "f613ebae-a485-4023-9597-aa23ecfb4ebc"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:02.405392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:43:02.620064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc863e1d-dfeb-4cb8-9474-1277e58625a1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7b7790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:02.697498 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc863e1d-dfeb-4cb8-9474-1277e58625a1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/8af52094-f055-41a8-a434-2a4c02f163f8" status: 200 len: 662 microversion: 2.1 time: 0.082177 Oct 12 22:43:02.698325 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1267/2659] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:02 2022] GET /compute/v2.1/images/8af52094-f055-41a8-a434-2a4c02f163f8 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:02.712738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93156ce1-2552-432f-b848-cb71e659d901 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7c0280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:02.776531 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93156ce1-2552-432f-b848-cb71e659d901 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/8af52094-f055-41a8-a434-2a4c02f163f8" status: 200 len: 662 microversion: 2.1 time: 0.067408 Oct 12 22:43:02.787502 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1268/2660] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:02 2022] GET /compute/v2.1/images/8af52094-f055-41a8-a434-2a4c02f163f8 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:03.670034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:03.671044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:03.671820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:03.672595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:03.673184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:03.727012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.728240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.728848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.729959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:03.730597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:03.731492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:03.798875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:03.806497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for user 70dbe0c8a7784391a83066cb1cb74604 and project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:03.858940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:43:03.861788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:43:04.001656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47e15789-af1a-4f73-a7a4-2195f89d83b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.710468 Oct 12 22:43:04.008520 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1393/2661] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:43:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:43:04.016323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6edf818a-80a7-4cf7-87f1-fd948afe9e20 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:04.018288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6edf818a-80a7-4cf7-87f1-fd948afe9e20 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:04.212688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6edf818a-80a7-4cf7-87f1-fd948afe9e20 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:04.228824 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6edf818a-80a7-4cf7-87f1-fd948afe9e20 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1279 microversion: 2.1 time: 0.216675 Oct 12 22:43:04.232822 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1269/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:04 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1279 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:04.555147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5dacc953-27f8-452f-9b9e-b40dead239fa tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6969d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:04.633253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5dacc953-27f8-452f-9b9e-b40dead239fa tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/fa8ca348-1ee3-45a2-b647-7768b0df181b" status: 200 len: 662 microversion: 2.1 time: 0.083509 Oct 12 22:43:04.639978 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1394/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:04 2022] GET /compute/v2.1/images/fa8ca348-1ee3-45a2-b647-7768b0df181b => generated 662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:04.649680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b50fff9-28a3-4b1d-af8d-4d071729e9ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff5471f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:04.707728 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b50fff9-28a3-4b1d-af8d-4d071729e9ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/fa8ca348-1ee3-45a2-b647-7768b0df181b" status: 200 len: 662 microversion: 2.1 time: 0.060804 Oct 12 22:43:04.710066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1270/2664] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:04 2022] GET /compute/v2.1/images/fa8ca348-1ee3-45a2-b647-7768b0df181b => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:05.261844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:05.262821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:05.276321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:05.277170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:05.277605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:05.278502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:05.280800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:05.290135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:05.472818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:05.481461 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb1b5e65-d973-4157-9c21-2a3bca9ac57e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1331 microversion: 2.1 time: 0.226040 Oct 12 22:43:05.501301 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1395/2665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:05 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1331 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:06.429334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5399891-796b-4f7a-8e7a-c3dd9fba9480 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7c0700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:06.496623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5399891-796b-4f7a-8e7a-c3dd9fba9480 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/ced75165-1b63-4715-9c4e-cb65adb2a59d" status: 200 len: 662 microversion: 2.1 time: 0.073637 Oct 12 22:43:06.498111 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1271/2666] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:06 2022] GET /compute/v2.1/images/ced75165-1b63-4715-9c4e-cb65adb2a59d => generated 662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:06.513868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb6969e0-1e10-4ac8-b65b-76a9a26e96a4 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44fee9d820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:06.523635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:06.524350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:06.536593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.537090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.537524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.539466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:06.540177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:06.541097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:06.581986 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb6969e0-1e10-4ac8-b65b-76a9a26e96a4 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/ced75165-1b63-4715-9c4e-cb65adb2a59d" status: 200 len: 662 microversion: 2.1 time: 0.073217 Oct 12 22:43:06.583190 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1396/2667] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:06 2022] GET /compute/v2.1/images/ced75165-1b63-4715-9c4e-cb65adb2a59d => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:06.656494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1879001218", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:06.700992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:06.718593 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c76358b2-c713-41c4-94fb-c4483a41532c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1337 microversion: 2.1 time: 0.196456 Oct 12 22:43:06.719247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1272/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:06 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1337 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:06.773990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:43:07.661255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:07.661847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:07.662235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:07.662961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:07.663383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:07.715472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.716346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.716937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.717919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.718440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.718872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.746797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:07.747415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:07.760360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Getting quotas for project cbe05abae9e944028fff1f2d5d9e0c3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:07.767291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.767789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.772446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Getting quotas for user 211d2c11280a4cbab2a1fb2596ffa688 and project cbe05abae9e944028fff1f2d5d9e0c3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:07.773223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.774068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:07.774549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:07.775038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:07.808270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:43:07.810598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:43:07.950154 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a80d783-6185-4fc7-965c-699386214f6c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298007 Oct 12 22:43:07.954914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1397/2669] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:43:07.959359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:07.978849 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c51ee98-f94e-45ef-8e68-0a6288255072 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1337 microversion: 2.1 time: 0.235331 Oct 12 22:43:07.992203 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1273/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:07 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1337 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:08.046510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-482943337", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:08.139989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:43:09.006576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:09.007195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:09.025840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.026345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.026788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.027565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:09.027986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:09.028413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:09.252830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:09.262598 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-affa28f9-3998-4ceb-9646-51baed43b8bd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1337 microversion: 2.1 time: 0.259848 Oct 12 22:43:09.267973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1274/2671] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:09 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1337 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:10.147394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:10.147864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:10.149347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:10.149347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:10.149347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:10.167960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.168824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.169285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:10.170117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.170745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.171176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:10.221887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Getting quotas for project cbe05abae9e944028fff1f2d5d9e0c3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:10.231526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Getting quotas for user 211d2c11280a4cbab2a1fb2596ffa688 and project cbe05abae9e944028fff1f2d5d9e0c3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:10.264883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:43:10.267652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:43:10.289125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:10.290293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:10.305914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.309093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.309729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:10.314161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:10.317125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:10.317582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:10.390413 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-73056daf-92a9-4e14-b5ef-6cf7e47fe046 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.354350 Oct 12 22:43:10.405302 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1398/2672] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:43:10.412316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-017b35cf-a957-4ad4-85c5-969e257f3714 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:10.413180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-017b35cf-a957-4ad4-85c5-969e257f3714 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:10.778013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-017b35cf-a957-4ad4-85c5-969e257f3714 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:10.786659 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-017b35cf-a957-4ad4-85c5-969e257f3714 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1217 microversion: 2.1 time: 0.379911 Oct 12 22:43:10.793994 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1399/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:10 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1217 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:11.822024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:11.823383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:11.837981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:11.838847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:11.841186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:11.842897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:11.845910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:11.847529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:11.853020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:11.878884 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4339e8a4-90a0-426a-af17-807db8fe9b4b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 1.591290 Oct 12 22:43:11.885048 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1275/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:10 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:12.541076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:12.552202 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c30dd015-b9c7-4d68-ae03-eb897253add1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1269 microversion: 2.1 time: 0.733930 Oct 12 22:43:12.557525 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1400/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:11 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1269 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:12.916093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:12.918169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:12.931661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:12.957660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:12.974374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:12.975246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:12.977513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:12.981385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:12.982490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:13.579319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:13.580638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:13.605553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:13.607511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:13.608255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:13.614973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:13.619034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:13.619915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:14.107364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:14.120565 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f437ab67-d661-4d67-bd15-19816813da9e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1275 microversion: 2.1 time: 0.545637 Oct 12 22:43:14.121916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1401/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:13 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1275 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:14.228614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:14.460160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:14.476325 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-50da8df3-cbf4-4fea-83d3-32cc569ab2de tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 1.568212 Oct 12 22:43:14.479221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1276/2677] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:12 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:15.165049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:15.165668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:15.193992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:15.195143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:15.195866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:15.196797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:15.197261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:15.197784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:15.504348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:15.505571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:15.566952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:15.572236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:15.572753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:15.573523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:15.575323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:15.575780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:16.194800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:16.222947 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dbb3cc3f-ec0d-4b0c-8733-96dc48d3f967 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 0.723991 Oct 12 22:43:16.237207 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1277/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:15 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:16.359704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:16.377229 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a937895-f297-4a12-b207-c3e4f485e836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1275 microversion: 2.1 time: 1.235687 Oct 12 22:43:16.389562 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1402/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:15 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1275 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:17.264492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:17.265778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:17.280987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.282576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.283908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.286747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.288174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.289145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.416038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:17.416662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:17.431739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.432932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.437782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.438689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.441147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.442191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.772218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:17.786750 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-20fdf4b8-3547-4a60-9450-f3368bf297c8 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1275 microversion: 2.1 time: 0.379536 Oct 12 22:43:17.804796 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1403/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:17 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1275 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:17.826285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c0ce1ec7-579c-4aa8-834e-913b9bbd6aa5 req-1140cb1d-2352-4d36-b9ec-a9d7b22251f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530192e6-0cfe-4dc6-96ce-063b4e5fbbbc", "tag": "799765a4-d098-4fb2-a9ac-f48d7065be51"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:17.851845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c0ce1ec7-579c-4aa8-834e-913b9bbd6aa5 req-1140cb1d-2352-4d36-b9ec-a9d7b22251f2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:17.852928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c0ce1ec7-579c-4aa8-834e-913b9bbd6aa5 req-1140cb1d-2352-4d36-b9ec-a9d7b22251f2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:17.856309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c0ce1ec7-579c-4aa8-834e-913b9bbd6aa5 req-1140cb1d-2352-4d36-b9ec-a9d7b22251f2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:17.886302 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c0ce1ec7-579c-4aa8-834e-913b9bbd6aa5 req-1140cb1d-2352-4d36-b9ec-a9d7b22251f2 service nova] Creating event network-changed:799765a4-d098-4fb2-a9ac-f48d7065be51 for instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc on n-h1-860864-8 Oct 12 22:43:17.913676 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c0ce1ec7-579c-4aa8-834e-913b9bbd6aa5 req-1140cb1d-2352-4d36-b9ec-a9d7b22251f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089232 Oct 12 22:43:17.918427 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1404/2681] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:18.078133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:18.095010 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01eabce5-123c-4603-91d2-b3ccb2f38ace tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 0.840026 Oct 12 22:43:18.101391 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1278/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:17 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:18.328371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-338818052", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": "none"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:18.430393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:18.431046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:18.431281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:18.431689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:18.432133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:18.452314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.452812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.453247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.454027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.454473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.464647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.501019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Getting quotas for project 5ba17a0161b746ffb28f9dc9476927ff. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:18.511556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Getting quotas for user ddb383649c8a419893b91fcdafc96a50 and project 5ba17a0161b746ffb28f9dc9476927ff. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:18.539746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:43:18.542219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:43:18.628048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:18.668822 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-969db535-5ae0-49b5-8cda-934972273551 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.550537 Oct 12 22:43:18.670200 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1405/2683] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:43:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:43:18.683379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2dd707c9-1330-4785-8e90-2bab75e1d2ae tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:18.684648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2dd707c9-1330-4785-8e90-2bab75e1d2ae tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:18.816153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:18.816923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:18.827639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.829918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.831849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.833915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:18.835775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:18.836946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:18.950621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dd707c9-1330-4785-8e90-2bab75e1d2ae tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:18.963545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dd707c9-1330-4785-8e90-2bab75e1d2ae tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:18.965334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dd707c9-1330-4785-8e90-2bab75e1d2ae tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:18.972602 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2dd707c9-1330-4785-8e90-2bab75e1d2ae tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1277 microversion: 2.54 time: 0.291627 Oct 12 22:43:18.974447 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1279/2684] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:18 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1277 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:19.121959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:19.122921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:19.138593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:19.139355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:19.140351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:19.141809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:19.142446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:19.143040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:19.699550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:19.708689 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08c10238-e44c-4d1b-aa51-a3653ed61548 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 0.590599 Oct 12 22:43:19.719774 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1280/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:19 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:19.747403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:19.764779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-146fe80e-8fba-496b-888c-41d3c4d83b76 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 0.957233 Oct 12 22:43:19.780789 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1406/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:18 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:20.004805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:20.005677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:20.017926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.018856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.019490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.020445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.028127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.028873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.221321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:20.230952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:20.237155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:20.238587 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99668ed4-4db3-42c0-b50b-2f433e9af17c tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1329 microversion: 2.54 time: 0.239292 Oct 12 22:43:20.248265 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1281/2687] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:19 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1329 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:20.745166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:20.745799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:20.765391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.774739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.775212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.776798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.777264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.777698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.789638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:20.790326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:20.809664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.810879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.811430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:20.815051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:20.816192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:20.818295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:21.574233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:21.587387 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1dcbf306-2f45-45f5-92b5-12fc5e2230c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 0.802373 Oct 12 22:43:21.608664 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1282/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:20 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:21.617133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:21.618049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:21.628733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:21.629670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:21.630290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:21.631190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:21.631819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:21.632441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:21.914294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:21.937413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:21.943501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:21.946469 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b6954b7b-0804-4bc5-808a-b788e8a653bb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1335 microversion: 2.54 time: 0.335249 Oct 12 22:43:21.949486 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1283/2689] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:21 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1335 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:22.112992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7b5286dc-ad91-4b66-88cc-fa649227de8d req-cc1737d4-3679-49a6-be68-ffb418a37e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cd245f-3ada-4388-b3a8-a26da4e123bd", "tag": "4154fce7-7027-4f18-a941-c4e185fbb63b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:22.136580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7b5286dc-ad91-4b66-88cc-fa649227de8d req-cc1737d4-3679-49a6-be68-ffb418a37e25 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:22.137108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7b5286dc-ad91-4b66-88cc-fa649227de8d req-cc1737d4-3679-49a6-be68-ffb418a37e25 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:22.137548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7b5286dc-ad91-4b66-88cc-fa649227de8d req-cc1737d4-3679-49a6-be68-ffb418a37e25 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:22.178134 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7b5286dc-ad91-4b66-88cc-fa649227de8d req-cc1737d4-3679-49a6-be68-ffb418a37e25 service nova] Creating event network-changed:4154fce7-7027-4f18-a941-c4e185fbb63b for instance e9cd245f-3ada-4388-b3a8-a26da4e123bd on n-h2-860864-8 Oct 12 22:43:22.187775 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7b5286dc-ad91-4b66-88cc-fa649227de8d req-cc1737d4-3679-49a6-be68-ffb418a37e25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080064 Oct 12 22:43:22.188914 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1284/2690] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:22.227012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:22.241969 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca731264-4183-4771-a239-d9d31e667290 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 1.503784 Oct 12 22:43:22.242906 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1407/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:20 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:22.616524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:22.617801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:22.648654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:22.649432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:22.650384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:22.651670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:22.653967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:22.654940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:22.985946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:22.987549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:22.998997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:22.999998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:23.003348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:23.004729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:23.005506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:23.007125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:23.050249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:23.061881 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f9c8c890-a9d0-41eb-bc05-a3a1d2e964d7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 0.450485 Oct 12 22:43:23.082224 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1285/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:22 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:23.274377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:23.276025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:23.295043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:23.296815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:23.304541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:23.305641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:23.306322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:23.306986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:23.481373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:23.508648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:23.516782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:23.521160 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ed7960e-1f8f-4153-8139-f925f7499106 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1356 microversion: 2.54 time: 0.543812 Oct 12 22:43:23.554951 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1408/2693] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:22 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1356 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:43:23.568869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d41e1ac6-2ea6-4853-9040-af7aad433b09 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Action: 'create', calling method: .version_select at 0x7f44fedc6c10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-438188602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCwkcSYhPrYOzq2jJ6Cj/3WiKIAn+o3YMVFjk918m2m3h3jAQmaIwe5ylVl4Aahu7ZJBNHGNiU4Td2C7tL+77fqO44XRCkN2RPiInEarueafyhzMk1q/Ro/LtPPWDSnrw=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:23.600806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d41e1ac6-2ea6-4853-9040-af7aad433b09 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Getting quotas for project 5ba17a0161b746ffb28f9dc9476927ff. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:23.607252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d41e1ac6-2ea6-4853-9040-af7aad433b09 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Getting quotas for user ddb383649c8a419893b91fcdafc96a50 and project 5ba17a0161b746ffb28f9dc9476927ff. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:23.661187 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d41e1ac6-2ea6-4853-9040-af7aad433b09 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.100129 Oct 12 22:43:23.669152 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1409/2694] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:43:23 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 22:43:23.677373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-438188602", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:23.682679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:23.692023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:23.693480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:23.694365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:23.695326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:23.696004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:23.696589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:23.705779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:23.915383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:23.916069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:23.916702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:23.917328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:23.917929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:24.168677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:24.190078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:24.193224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:24.194735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:24.197727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:24.198479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:24.205865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:24.302766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb0e87e1-09c2-4832-a388-a70d72de2be8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "POST /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93/action" status: 202 len: 1138 microversion: 2.54 time: 0.631439 Oct 12 22:43:24.307677 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1410/2695] 10.222.0.20 () {62 vars in 1320 bytes} [Wed Oct 12 22:43:23 2022] POST /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93/action => generated 1138 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:43:24.321371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:24.322871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:24.337663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:24.339773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:24.340315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:24.341175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:24.341717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:24.342228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:24.372526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:24.397183 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0fd08422-6a64-448d-83f1-86434ab740c5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 1.125780 Oct 12 22:43:24.412680 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1286/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:23 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:24.422730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:24.423796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:24.430739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:24.431574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:24.432184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:24.432958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:24.433500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:24.433989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:24.530065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:24.544096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:24.545316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:24.550915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-06e0e8a8-6b87-4558-8d2d-21ed26153d5b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.135478 Oct 12 22:43:24.552612 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1287/2697] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:24 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:25.426266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:25.426942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:25.446424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.446922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.447563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:25.448881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.450849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.458294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:25.717225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:25.721022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:25.731216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a10dcf6a-1749-4d6d-9189-cfb96158c099 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 0.308314 Oct 12 22:43:25.732128 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1288/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:25 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:25.744351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:25.749734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:25.765656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.767153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.769780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:25.771352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.774290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.775498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:25.872798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:25.890824 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6c768766-d2e1-44ff-8ff6-1f6952a46647 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 1.575664 Oct 12 22:43:25.892908 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1411/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:24 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:25.917062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4298be5f-9ebb-4236-aea9-7dbbaeedf8ec req-eb195502-9493-4b7e-9457-8d83ff30115a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530192e6-0cfe-4dc6-96ce-063b4e5fbbbc", "name": "network-vif-plugged", "status": "completed", "tag": "799765a4-d098-4fb2-a9ac-f48d7065be51"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:25.964015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4298be5f-9ebb-4236-aea9-7dbbaeedf8ec req-eb195502-9493-4b7e-9457-8d83ff30115a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:25.964903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4298be5f-9ebb-4236-aea9-7dbbaeedf8ec req-eb195502-9493-4b7e-9457-8d83ff30115a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:25.965343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4298be5f-9ebb-4236-aea9-7dbbaeedf8ec req-eb195502-9493-4b7e-9457-8d83ff30115a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:26.028234 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4298be5f-9ebb-4236-aea9-7dbbaeedf8ec req-eb195502-9493-4b7e-9457-8d83ff30115a service nova] Creating event network-vif-plugged:799765a4-d098-4fb2-a9ac-f48d7065be51 for instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc on n-h1-860864-8 Oct 12 22:43:26.059362 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4298be5f-9ebb-4236-aea9-7dbbaeedf8ec req-eb195502-9493-4b7e-9457-8d83ff30115a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164684 Oct 12 22:43:26.064162 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1412/2700] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:26.110552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6441319e-dfaa-434d-8672-13f4ee6920d8 req-6efc1938-a91e-4681-b962-60da8e181388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e532a39-5484-411d-a9d2-cdd0563b2598", "tag": "b9177795-35b3-49c5-b902-52e7fe47daf4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:26.154254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6441319e-dfaa-434d-8672-13f4ee6920d8 req-6efc1938-a91e-4681-b962-60da8e181388 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:26.157812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6441319e-dfaa-434d-8672-13f4ee6920d8 req-6efc1938-a91e-4681-b962-60da8e181388 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:26.158279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6441319e-dfaa-434d-8672-13f4ee6920d8 req-6efc1938-a91e-4681-b962-60da8e181388 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:26.184080 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6441319e-dfaa-434d-8672-13f4ee6920d8 req-6efc1938-a91e-4681-b962-60da8e181388 service nova] Creating event network-changed:b9177795-35b3-49c5-b902-52e7fe47daf4 for instance 4e532a39-5484-411d-a9d2-cdd0563b2598 on n-h1-860864-8 Oct 12 22:43:26.189687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:26.200797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6441319e-dfaa-434d-8672-13f4ee6920d8 req-6efc1938-a91e-4681-b962-60da8e181388 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132696 Oct 12 22:43:26.202960 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1413/2701] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:26.209672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:26.211136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:26.220887 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-67dcf5fb-8f80-4ba8-af17-461ff14ae6a3 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.481983 Oct 12 22:43:26.226125 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1289/2702] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:25 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:26.766578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:26.767488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:26.776580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:26.777080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:26.777522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:26.783280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:26.783958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:26.784424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:26.918653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:26.920007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:26.930856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:26.940731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:26.941482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:26.942451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:26.943097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:26.943706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:27.447656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:27.471138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c879061-c922-4958-aca8-9bc7430cdcd9 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 0.556510 Oct 12 22:43:27.477287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1290/2703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:26 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:27.491336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:27.492009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:27.498597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:27.499375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:27.500041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:27.501056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:27.501737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:27.502385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:27.700248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:27.733840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:27.737753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:27.744072 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d788b1ad-e510-4270-b1aa-4d5ed7903cc1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.263475 Oct 12 22:43:27.753218 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1291/2704] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:27 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:27.784253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:27.793405 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a77e324-d2f5-4225-8b3e-5f92a9e4e675 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1379 microversion: 2.1 time: 1.042621 Oct 12 22:43:27.795481 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1414/2705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:26 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1379 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:28.498534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:28.499678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:28.510592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:28.514436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:28.514885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:28.515608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:28.517816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:28.518270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:28.769690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:28.774904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:28.775774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:28.786340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:28.787003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:28.787244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:28.788192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:28.788795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:28.789366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:28.933824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:28.945906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:28.950451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:28.952259 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82363656-d0a1-4bde-aace-cee7c7db1460 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.184230 Oct 12 22:43:28.955106 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1415/2706] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:28 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:28.955679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:28.977230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:28.992561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:28.994480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:28.995609 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7819965-c242-43fa-81d5-6c33528277a0 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 0.501361 Oct 12 22:43:28.996482 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1292/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:28 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:29.028983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.029479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.030179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.030890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.031343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.032344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.116861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f08a507f-521b-4939-be89-ca24cbf6c3ee req-a24058dc-60e8-4524-a5bb-739922b4b7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd245f-3ada-4388-b3a8-a26da4e123bd", "name": "network-vif-plugged", "status": "completed", "tag": "4154fce7-7027-4f18-a941-c4e185fbb63b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:29.135584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f08a507f-521b-4939-be89-ca24cbf6c3ee req-a24058dc-60e8-4524-a5bb-739922b4b7a7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.141760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f08a507f-521b-4939-be89-ca24cbf6c3ee req-a24058dc-60e8-4524-a5bb-739922b4b7a7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.142240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f08a507f-521b-4939-be89-ca24cbf6c3ee req-a24058dc-60e8-4524-a5bb-739922b4b7a7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.165794 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f08a507f-521b-4939-be89-ca24cbf6c3ee req-a24058dc-60e8-4524-a5bb-739922b4b7a7 service nova] Creating event network-vif-plugged:4154fce7-7027-4f18-a941-c4e185fbb63b for instance e9cd245f-3ada-4388-b3a8-a26da4e123bd on n-h2-860864-8 Oct 12 22:43:29.173107 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f08a507f-521b-4939-be89-ca24cbf6c3ee req-a24058dc-60e8-4524-a5bb-739922b4b7a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061495 Oct 12 22:43:29.174381 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1293/2708] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:43:29.907235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:29.925520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b4b042f-8805-43a2-83d9-034399864f0d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1529 microversion: 2.1 time: 0.964079 Oct 12 22:43:29.927181 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1416/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:28 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1529 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:29.951524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:29.952421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:29.961014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.961732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.962333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.963275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.963908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.964488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:29.981421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:29.982303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:29.990454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:29.992597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:29.993239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.001534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.002261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.002866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.136726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.148403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.150272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.151587 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bcfbd1c4-5973-456a-9b55-518148727357 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.174070 Oct 12 22:43:30.152421 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1417/2710] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:29 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:43:30.157601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:30.158485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:30.165333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.166101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.166750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.167654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.168383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.169061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.355515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.404592 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03a14efb-4c51-428a-b52d-b936b56d0dde tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1529 microversion: 2.1 time: 0.457089 Oct 12 22:43:30.407675 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1294/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:29 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1529 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:30.438761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c178eb52-7fd7-4805-8057-0d84d3a2f0f8 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:30.460958 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c178eb52-7fd7-4805-8057-0d84d3a2f0f8 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/f613ebae-a485-4023-9597-aa23ecfb4ebc" status: 202 len: 0 microversion: 2.1 time: 0.025672 Oct 12 22:43:30.467648 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1295/2712] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:43:30 2022] DELETE /compute/v2.1/flavors/f613ebae-a485-4023-9597-aa23ecfb4ebc => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:43:30.481248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c9747b3-7d92-49c9-85bb-4b88d72d4c60 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:30.517151 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c9747b3-7d92-49c9-85bb-4b88d72d4c60 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045597 Oct 12 22:43:30.524137 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1296/2713] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:43:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:30.545948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:30.550547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:30.557419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.558316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.558755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.559451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.560119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.560824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.674343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.681442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Old instance type tempest-test_resize_flavor_-1866752123, new instance type m1.heat {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:43:30.689020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:30.689451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:30.690086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:30.690699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:30.691130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:30.754750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:30.766415 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a55be5e6-bc7f-4c29-bafc-6994707541ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 0.612024 Oct 12 22:43:30.772262 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1418/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:30 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:30.882361 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78072c46-2555-4fa3-8f8b-550eee2848a9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc/action" status: 202 len: 0 microversion: 2.1 time: 0.345402 Oct 12 22:43:30.885555 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1297/2715] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:43:30 2022] POST /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:43:30.893613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:30.894455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:30.913226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.918930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.921163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:30.922291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:30.937322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:30.939111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:31.183106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:31.183845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:31.204158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.204660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.208134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:31.210716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.211503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.213635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:31.477898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:31.492862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:31.495435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:31.496828 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87a9272d-2b5c-4c30-9e1a-4fcf7ea4dc4b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.318926 Oct 12 22:43:31.498580 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1298/2716] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:31 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:43:31.666055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:31.679428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bde48737-4199-4830-a936-a53a52f7a2e8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1538 microversion: 2.1 time: 0.790410 Oct 12 22:43:31.684753 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1419/2717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:30 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1538 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:31.795065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:31.795938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:31.810499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.812252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.814657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:31.816018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:31.818164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:31.818861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:32.189274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:32.199034 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-113ab381-ea8f-48e4-8796-486af6906332 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 0.410699 Oct 12 22:43:32.213077 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1299/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:31 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:32.525706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:32.526391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:32.537872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:32.541204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:32.543144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:32.544116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:32.547268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:32.549164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:32.710413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:32.711377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:32.720254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:32.728327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:32.729109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:32.730070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:32.730777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:32.732889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:33.042707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:33.053786 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0883b7d8-ffbd-4530-b1ca-089b2a6d7d66 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1538 microversion: 2.1 time: 0.347226 Oct 12 22:43:33.058304 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1300/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:32 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1538 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:33.239448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:33.241045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:33.252706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:33.258466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:33.259166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:33.260126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:33.260938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:33.262543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:33.312002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:33.321103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:33.328055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:33.329332 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0bbb0dea-6669-4f56-bfdc-5070f79fabeb tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.808338 Oct 12 22:43:33.329876 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1420/2720] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:32 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:34.083110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:34.084961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:34.096736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=30 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:34.103167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.103755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.104265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.115292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.115825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.116306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.602261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:34.628583 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d4674f4-a18f-4d30-8d85-3d81009bc28f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 1.392305 Oct 12 22:43:34.632239 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1301/2721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:33 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:34.649264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:34.653025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:34.676317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.677164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.677849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.678800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:34.679489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:34.680278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:34.846746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:34.861784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:34.863328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:34.872930 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa2988f4-18ac-41fd-aaca-5d2a79b58f5a tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.239157 Oct 12 22:43:34.873734 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1302/2722] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:34 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:35.178019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:35.190022 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93320d28-0c83-48de-9299-b97ae6941526 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1538 microversion: 2.1 time: 1.108603 Oct 12 22:43:35.213399 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1421/2723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:34 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1538 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:35.496534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-72a931da-6f46-4d8e-af6b-2af1a411004a req-abf2ead5-eebe-42e6-89fc-9f5c1c166792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e532a39-5484-411d-a9d2-cdd0563b2598", "name": "network-vif-plugged", "status": "completed", "tag": "b9177795-35b3-49c5-b902-52e7fe47daf4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:35.516771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-72a931da-6f46-4d8e-af6b-2af1a411004a req-abf2ead5-eebe-42e6-89fc-9f5c1c166792 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.518094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-72a931da-6f46-4d8e-af6b-2af1a411004a req-abf2ead5-eebe-42e6-89fc-9f5c1c166792 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.522362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-72a931da-6f46-4d8e-af6b-2af1a411004a req-abf2ead5-eebe-42e6-89fc-9f5c1c166792 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:35.551112 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-72a931da-6f46-4d8e-af6b-2af1a411004a req-abf2ead5-eebe-42e6-89fc-9f5c1c166792 service nova] Creating event network-vif-plugged:b9177795-35b3-49c5-b902-52e7fe47daf4 for instance 4e532a39-5484-411d-a9d2-cdd0563b2598 on n-h1-860864-8 Oct 12 22:43:35.569297 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-72a931da-6f46-4d8e-af6b-2af1a411004a req-abf2ead5-eebe-42e6-89fc-9f5c1c166792 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071700 Oct 12 22:43:35.570631 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1303/2724] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:35.657964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:35.658703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:35.669376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.670033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.670890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:35.671754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.672936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.673473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:35.907216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:35.909879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:35.926380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.927055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.931008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:35.931873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:35.932652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:35.934656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:36.328999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:36.338478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:36.349613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:36.351566 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fda99bf7-e68f-4591-a230-5f6684113439 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.449790 Oct 12 22:43:36.360851 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1304/2725] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:35 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:43:36.375841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:36.376927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:36.396043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:36.396903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:36.397571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:36.398522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:36.399234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:36.399930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:36.725468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:36.813180 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-862bf448-ebd8-45ec-b24c-a27840960a90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1317 microversion: 2.1 time: 1.140608 Oct 12 22:43:36.821054 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1422/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:35 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1317 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:37.101947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:37.144086 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65bc7b56-1e5c-42de-b867-de836f476181 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1538 microversion: 2.1 time: 0.776696 Oct 12 22:43:37.145256 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1305/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:36 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1538 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:37.389499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:37.390297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:37.406314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:37.407266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:37.407713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:37.408473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:37.408915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:37.409343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:37.764143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:37.783449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:37.793822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:37.796414 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc286f7d-43cd-44b1-bccd-47de1364a124 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.409679 Oct 12 22:43:37.801982 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1423/2728] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:37 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:37.846902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:37.847522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:37.865812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:37.866281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:37.866731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:37.867455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:37.867932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:37.870358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:38.170271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:38.171183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:38.191638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:38.194221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:38.194944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:38.197017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:38.197879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:38.200221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:38.513860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:38.524239 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40257f82-355c-454c-9e51-54b33dd85834 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1467 microversion: 2.1 time: 0.681358 Oct 12 22:43:38.524840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1306/2729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:37 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1467 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:38.552186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:38.552798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:38.573774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:38.573774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:38.573774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:38.573774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:38.574096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:38.578181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:38.636888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:39.435138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:39.450216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c44b2375-efd6-444f-a3b9-6ef07943d30b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1468 microversion: 2.1 time: 0.901854 Oct 12 22:43:39.465491 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1307/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:38 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1468 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:39.465491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:39.465491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:39.482677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:39.483314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:39.483803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:39.484740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:39.485346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:39.485857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:39.772500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:39.788701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:39.797060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:39.798415 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-55f8d970-d212-43ea-9be9-0dc9aeca5ec1 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.342862 Oct 12 22:43:39.803872 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1308/2731] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:39 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:39.815560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1973121721"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:39.832354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:39.869159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:39.875848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:39.876483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:39.877325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:39.877893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:39.878421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:40.235844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:40.248324 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e82b2662-3aff-4b58-bb4b-d7a7d4a18633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 2.082806 Oct 12 22:43:40.254499 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1424/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:38 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:40.383116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1db1853b-6cb3-4d2b-b1f3-b5d441fdf57e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "POST /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd/action" status: 202 len: 0 microversion: 2.1 time: 0.577535 Oct 12 22:43:40.386372 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1309/2733] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:43:39 2022] POST /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:43:40.415058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b80443b-ffb8-46f6-9a66-1766886dc375 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4504127c10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:40.646240 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b80443b-ffb8-46f6-9a66-1766886dc375 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 200 len: 1455 microversion: 2.1 time: 0.253310 Oct 12 22:43:40.661701 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1425/2734] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:40 2022] GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 1455 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:40.839675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:40.840416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:40.857297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:40.859178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:40.862038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:40.862792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:40.867792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:40.870214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.278689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:41.286189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:41.290634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:41.323204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.323873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.324259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:41.326385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.328799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:41.329918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:41.332967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:41.335600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:41.338042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5cec317c-f1a6-4ab9-bc8a-e9f7faca09c8 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.500426 Oct 12 22:43:41.344530 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1310/2735] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:40 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:41.674977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-caad3ab2-031c-4651-97e8-5dda288012ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff8ac430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:41.786426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-caad3ab2-031c-4651-97e8-5dda288012ad tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 200 len: 1455 microversion: 2.1 time: 0.121587 Oct 12 22:43:41.791983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1311/2736] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:41 2022] GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:42.090445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:42.098268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:42.108994 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-64b82818-9afc-4b4b-9a88-796affbdbab4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 0.836960 Oct 12 22:43:42.110338 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1426/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:41 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:42.371473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:42.372258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:42.405539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:42.408012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:42.417377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:42.423180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:42.428727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:42.430510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:42.802970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9365ffd2-044a-4a93-a037-abbf14b3bb72 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4507a35280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:42.960343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:42.981844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:42.984021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:42.990366 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37b71af6-3186-4d90-97c4-55173584473b tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.622450 Oct 12 22:43:42.992220 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1312/2738] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:42 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:43.134211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:43.134821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:43.146930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:43.148914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:43.152225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:43.155735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:43.158181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:43.159927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:43.162000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:43.267802 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9365ffd2-044a-4a93-a037-abbf14b3bb72 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 200 len: 1455 microversion: 2.1 time: 0.468540 Oct 12 22:43:43.269140 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1427/2739] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:42 2022] GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 1455 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:43.940772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:43.956809 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2db6b8e5-950a-47f3-b057-fec5f41df6f8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 0.826632 Oct 12 22:43:43.965445 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1313/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:43 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:43:44.033725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:44.035009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:44.054058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:44.054828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:44.056763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:44.058124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:44.062239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:44.064268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:44.286319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-abc771e3-e4ca-4dc2-9d75-b9ae2440057a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff547e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:44.398576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-abc771e3-e4ca-4dc2-9d75-b9ae2440057a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 200 len: 1455 microversion: 2.1 time: 0.118441 Oct 12 22:43:44.408392 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1314/2741] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:44 2022] GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:44.952735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1425922390", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:45.275636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:45.286496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] validate_networks() for [('f64c6777-c07a-466a-865f-0101a7f11e5e', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:43:45.311949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:45.323491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:45.326920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b8540eb-6988-4f29-bdad-bbb359c0b42d tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 1.299869 Oct 12 22:43:45.345607 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1428/2742] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:44 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:45.399924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:45.407841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:45.431929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:45.439144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:45.441854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:45.446226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:45.450007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:45.450813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:45.945471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:45.959447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0bb7be0c-a588-4dcf-81a5-edad9213405e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 0.606108 Oct 12 22:43:45.960069 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1429/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:45 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:46.007513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0d28665-635a-4ede-98bf-b221446b7940 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44fee9d820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:46.558956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:43:46.559595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:43:46.560227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:43:46.563965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:43:46.564544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:43:46.601823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:46.606013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:46.607407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:46.612374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:46.614586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:46.617637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:46.695631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Getting quotas for project ee4b81ebc34440298a0313bb30010af2. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:43:46.713999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Getting quotas for user ad039e3f5e944c7c9c190188c1e71bb6 and project ee4b81ebc34440298a0313bb30010af2. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:43:46.749783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:43:46.754699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:43:46.877724 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a15deb6-5f44-47bb-8bf8-b2e1a35df821 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.262215 Oct 12 22:43:46.889984 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1315/2744] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:43:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:43:46.903333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:46.905314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:46.936764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:46.938357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:46.940250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:46.942931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:46.943719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:46.944406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:47.152875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:47.174526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:47.186490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:47.192655 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90052851-d936-4036-9c9b-a30182ad7b1e tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.297537 Oct 12 22:43:47.193274 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1316/2745] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:46 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:47.223422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-344be9d7-a003-4aea-aad5-08835199b827 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:47.224964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-344be9d7-a003-4aea-aad5-08835199b827 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:47.435655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-344be9d7-a003-4aea-aad5-08835199b827 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:47.445114 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-344be9d7-a003-4aea-aad5-08835199b827 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1223 microversion: 2.1 time: 0.240927 Oct 12 22:43:47.455300 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1317/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:47 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1223 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:47.467317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:47.481867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:47.528977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:47.530511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:47.535986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:47.549652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:47.554264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:47.557349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:48.405253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:48.418122 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-678f671b-b299-4d43-bba5-346b4b289630 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 0.961389 Oct 12 22:43:48.444511 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1318/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:47 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:48.487390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:48.494709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:48.520957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:48.521453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:48.521889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:48.541378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:48.542439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:48.543507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:48.798577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:48.864251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:48.869072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:48.870319 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f729879-0969-496b-9196-23047d5dc1f9 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.418576 Oct 12 22:43:48.879514 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1319/2748] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:48 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:48.912575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:48.919698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:48.966932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:48.968974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:48.969686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:48.976683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:48.980253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:48.985078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:49.780377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:49.804972 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94b0b6ab-766c-45d9-b0b0-c25ab51ee19d tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1219 microversion: 2.1 time: 0.922265 Oct 12 22:43:49.809553 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1320/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:48 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1219 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:49.855993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:49.857492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:49.886801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:49.888135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:49.890069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:49.893832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:49.894985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:49.897247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:51.222376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:51.233854 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fbd519c3-d0ce-41bd-8d7d-9b77f26c17bc tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 1.418189 Oct 12 22:43:51.241275 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1321/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:49 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:51.249299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:51.254924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:51.281480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:51.281995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:51.286630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:51.287409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:51.287882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:51.288339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:52.030345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:52.042771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:52.049043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:52.053371 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7bf6e6ca-8a5c-436e-9c03-560b3248c4fd tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1407 microversion: 2.54 time: 0.810104 Oct 12 22:43:52.066333 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1322/2751] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:51 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1407 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:52.092877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:52.097311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:52.124641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:52.131376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:52.132142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:52.137578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:52.138766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:52.141857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:52.684721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:52.695539 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c7c6635-88ef-40af-8c34-772bad5ef48b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1281 microversion: 2.1 time: 0.626520 Oct 12 22:43:52.696233 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1323/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:52 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1281 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:52.718081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:52.726390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:52.750665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:52.751158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:52.751600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:52.759586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:52.760106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:52.760549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:53.221005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:53.231656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ac963e2-9b79-4448-962c-599522e21dfe tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 0.534374 Oct 12 22:43:53.240941 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1324/2753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:52 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:53.245991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:53.246783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:53.261969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:53.262823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:53.263424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:53.264445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:53.266810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:53.267407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:54.299193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:54.325631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:54.335348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:54.341335 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4467b907-cbc1-431c-9257-a5ffa566a217 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1413 microversion: 2.54 time: 1.099076 Oct 12 22:43:54.348689 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1325/2754] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:53 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1413 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:54.353610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2363c84c-4430-4e8f-bfea-ad81a8a2c41e req-0f328c73-824d-45c7-a65a-4f5459d39194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd245f-3ada-4388-b3a8-a26da4e123bd", "name": "network-vif-plugged", "status": "completed", "tag": "4154fce7-7027-4f18-a941-c4e185fbb63b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:54.457440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2363c84c-4430-4e8f-bfea-ad81a8a2c41e req-0f328c73-824d-45c7-a65a-4f5459d39194 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:54.457934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2363c84c-4430-4e8f-bfea-ad81a8a2c41e req-0f328c73-824d-45c7-a65a-4f5459d39194 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:54.458368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2363c84c-4430-4e8f-bfea-ad81a8a2c41e req-0f328c73-824d-45c7-a65a-4f5459d39194 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:54.553222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2363c84c-4430-4e8f-bfea-ad81a8a2c41e req-0f328c73-824d-45c7-a65a-4f5459d39194 service nova] Creating event network-vif-plugged:4154fce7-7027-4f18-a941-c4e185fbb63b for instance e9cd245f-3ada-4388-b3a8-a26da4e123bd on n-h2-860864-8 Oct 12 22:43:54.572567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2363c84c-4430-4e8f-bfea-ad81a8a2c41e req-0f328c73-824d-45c7-a65a-4f5459d39194 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222279 Oct 12 22:43:54.573195 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1326/2755] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:54.598498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:54.599203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:54.661213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:54.662013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:54.664087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:54.665048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:54.667958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:54.669488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:54.686153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:55.431507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=59 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:55.649490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:55.665235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a37185a6-f7f0-4c02-bb55-356bbc2ca0f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 1.089718 Oct 12 22:43:55.683859 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1327/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:54 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:55.692789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:55.693522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:55.715988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:55.729583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:55.733429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:55.734826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:55.739818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:55.740882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:55.950565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=13 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:56.456407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:56.473773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ed9c3c82-04f7-4cde-9733-03953e437d91 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 0.798361 Oct 12 22:43:56.476309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1328/2757] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:55 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:56.491656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:56.492570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:56.513847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.513847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.514132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:56.515052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.515542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.516004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:56.630191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:56.641522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:56.647233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:56.652195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-991a54ac-c4b7-4642-b89e-9f513d5fb521 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1398 microversion: 2.54 time: 0.171065 Oct 12 22:43:56.668273 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1329/2758] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:56 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1398 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:56.681792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc2c453d-2ed9-4817-884d-f1c96d58c397 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '.version_select at 0x7f44ff64b8b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:56.690198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:56.725866 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc2c453d-2ed9-4817-884d-f1c96d58c397 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-438188602" status: 204 len: 0 microversion: 2.54 time: 0.048499 Oct 12 22:43:56.732707 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1330/2759] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 22:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-438188602 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:43:56.741226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:56.742157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:56.749670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.751214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.751835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:56.752968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:56.754026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:56.771185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:57.445488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:43:57.535090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:57.553785 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e04ad06a-7d89-48d2-9b98-7a67daa1cfea tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 0.819463 Oct 12 22:43:57.555112 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1331/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:56 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:57.564723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:57.573219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:57.626028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:57.626777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:57.628103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:57.633812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:57.641109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:57.642200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:57.701482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:43:57.910416 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-48a8dd17-37aa-4ed2-8d79-d90085ff66b7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 204 len: 0 microversion: 2.54 time: 0.349928 Oct 12 22:43:57.911571 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1332/2761] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:43:57 2022] DELETE /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:43:57.917406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:57.918329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:57.933689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:57.934514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:57.935196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:57.936158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:57.936867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:57.937530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:58.741623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:58.788424 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c7d0990-70bf-473c-afdc-2820721a5765 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1543 microversion: 2.1 time: 0.874625 Oct 12 22:43:58.789892 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1333/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:57 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1543 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:58.803027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:58.808194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:58.822008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:58.825587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:58.827277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:58.829153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:58.830333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:58.831550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:58.989594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:59.005654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:59.007129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:59.014181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec66913c-b774-4253-9287-985b9f7dd8ad tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1404 microversion: 2.54 time: 0.221648 Oct 12 22:43:59.014981 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1334/2763] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:43:58 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:43:59.031669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-36b52bc3-be45-47b5-857f-de90e5cdff71 req-b02bc139-adcd-4aa3-bd00-53025f4800a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee03cca8-8cf9-441d-bc35-706e1f84a7b7", "tag": "87e2c5f7-4b7b-4c50-991c-25981789b40b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:43:59.054682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-36b52bc3-be45-47b5-857f-de90e5cdff71 req-b02bc139-adcd-4aa3-bd00-53025f4800a3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.059293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-36b52bc3-be45-47b5-857f-de90e5cdff71 req-b02bc139-adcd-4aa3-bd00-53025f4800a3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.061002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-36b52bc3-be45-47b5-857f-de90e5cdff71 req-b02bc139-adcd-4aa3-bd00-53025f4800a3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:59.088018 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-36b52bc3-be45-47b5-857f-de90e5cdff71 req-b02bc139-adcd-4aa3-bd00-53025f4800a3 service nova] Creating event network-changed:87e2c5f7-4b7b-4c50-991c-25981789b40b for instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 on n-h2-860864-8 Oct 12 22:43:59.101810 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-36b52bc3-be45-47b5-857f-de90e5cdff71 req-b02bc139-adcd-4aa3-bd00-53025f4800a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084059 Oct 12 22:43:59.108208 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1335/2764] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:43:59.120173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:59.121079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:59.140632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.141395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.142027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:59.143266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.144499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.147556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:59.859678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:43:59.867517 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46011cc3-d543-47cc-bc6d-30f11bd0a84c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 0.757059 Oct 12 22:43:59.883635 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1336/2765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:59 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:43:59.892773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:43:59.893401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:43:59.944636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.959440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.960631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:43:59.964016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:43:59.971922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:43:59.972739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:00.510527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:00.527675 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fbbcb2b0-7743-43ae-b945-b79341f3efc6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1542 microversion: 2.1 time: 0.651574 Oct 12 22:44:00.542136 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1337/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:43:59 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1542 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:00.563817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:00.565069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:00.581973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:00.583423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:00.585917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:00.586909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:00.588438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:00.589787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:00.922466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:00.936297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:00.937994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:00.951671 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d13f1f4d-18a3-425f-97db-fc924b94cba7 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1404 microversion: 2.54 time: 0.388217 Oct 12 22:44:00.954368 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1338/2767] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:44:00 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:44:00.980910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:00.983310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:00.999843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:01.003038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:01.006160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:01.008110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:01.008605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:01.009047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:02.141989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:02.160281 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f26dcef-c74e-4f49-80af-d18d0789c0aa tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 1.183977 Oct 12 22:44:02.161311 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1339/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:00 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:02.173986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:02.176657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:02.190845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:02.191346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:02.191794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:02.192529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:02.196734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:02.197734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:02.644607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:02.668056 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6addcb1-0218-488a-b23c-2993e26e1a5c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1474 microversion: 2.1 time: 0.505364 Oct 12 22:44:02.685428 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1340/2769] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:02 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1474 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:02.691272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:02.692178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:02.701125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:02.701902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:02.702512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:02.703433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:02.704109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:02.704693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:02.764706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:02.765478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:02.766711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:02.767342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lazy-loading 'fault' on Instance uuid acbaeaf6-b227-4b2b-b374-a3f88aa88c93 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:44:03.007640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:03.017289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:03.027056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb383649c8a419893b91fcdafc96a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba17a0161b746ffb28f9dc9476927ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:03.028687 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bda9133d-7fae-42d2-a1ef-b4d47d446304 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 200 len: 1409 microversion: 2.54 time: 0.341905 Oct 12 22:44:03.032161 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1341/2770] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:44:02 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 1409 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:44:03.183561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:03.185179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:03.196396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:03.206968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:03.207736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:03.208757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:03.210604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:03.211331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:04.478614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:04.493400 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-769d4ac9-7915-474b-ae4f-99e3ac180d80 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 1.313979 Oct 12 22:44:04.497816 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1342/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:03 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:04.505932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:04.506775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:04.515568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:04.516971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:04.517842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:04.519564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:04.520291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:04.521125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:04.590041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:04.868437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:04.890966 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e164974b-5629-4852-b7fd-510960f063e6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1471 microversion: 2.1 time: 0.390734 Oct 12 22:44:04.895388 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1343/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:04 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:04.900543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:04.901168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] [instance: acbaeaf6-b227-4b2b-b374-a3f88aa88c93] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:04.930666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:04.931096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:04.937599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:04.940993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:04.945814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:04.946745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.003545 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] HTTP exception thrown: Instance acbaeaf6-b227-4b2b-b374-a3f88aa88c93 could not be found. Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Request method failure captured: Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 HTTP/1.1 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0MFbh85SeFWgJT_mzgM-grhaU8YGByAzCcxFO62dm9X2lAhpV28XUejdEqFQoXp2RjDcbyz5TSDxOUBmW3FmGXHlFfEMWabD9TF7I-m9VSXaPelHf5HkKXgr66cOA90kyiXeeeHt05DtaWCf7dn8TRZ9A5PvzjB8Ra6Y_JtEV5w0cU Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.54 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5ba17a0161b746ffb28f9dc9476927ff Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerShowV254Test-1838220759 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ba17a0161b746ffb28f9dc9476927ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ba17a0161b746ffb28f9dc9476927ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ba17a0161b746ffb28f9dc9476927ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ba17a0161b746ffb28f9dc9476927ff"}]}] Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerShowV254Test-1838220759 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5ba17a0161b746ffb28f9dc9476927ff Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerShowV254Test-1838220759 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerShowV254Test-1838220759-project Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: ddb383649c8a419893b91fcdafc96a50 Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerShowV254Test-1838220759-project Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance acbaeaf6-b227-4b2b-b374-a3f88aa88c93 could not be found. Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'acbaeaf6-b227-4b2b-b374-a3f88aa88c93'} Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbaeaf6-b227-4b2b-b374-a3f88aa88c93 could not be found. Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbaeaf6-b227-4b2b-b374-a3f88aa88c93 could not be found. Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:44:05.005308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbaeaf6-b227-4b2b-b374-a3f88aa88c93 could not be found. Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] Returning 404 to user: Instance acbaeaf6-b227-4b2b-b374-a3f88aa88c93 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:44:05.010768 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57a40103-b7be-4286-add1-5c2d265a5b86 tempest-ServerShowV254Test-1838220759 tempest-ServerShowV254Test-1838220759-project] 10.222.0.20 "GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93" status: 404 len: 111 microversion: 2.54 time: 0.109971 Oct 12 22:44:05.036950 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1344/2773] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:44:04 2022] GET /compute/v2.1/servers/acbaeaf6-b227-4b2b-b374-a3f88aa88c93 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:44:05.050381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-701a3de7-80b8-41a7-b3a8-d36231b89a7c req-6f6eb9a6-7438-41a8-9bfc-6531ca66615f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530192e6-0cfe-4dc6-96ce-063b4e5fbbbc", "name": "network-vif-unplugged", "status": "completed", "tag": "799765a4-d098-4fb2-a9ac-f48d7065be51"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:05.083821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-701a3de7-80b8-41a7-b3a8-d36231b89a7c req-6f6eb9a6-7438-41a8-9bfc-6531ca66615f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.084528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-701a3de7-80b8-41a7-b3a8-d36231b89a7c req-6f6eb9a6-7438-41a8-9bfc-6531ca66615f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.085141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-701a3de7-80b8-41a7-b3a8-d36231b89a7c req-6f6eb9a6-7438-41a8-9bfc-6531ca66615f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.116142 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-701a3de7-80b8-41a7-b3a8-d36231b89a7c req-6f6eb9a6-7438-41a8-9bfc-6531ca66615f service nova] Creating event network-vif-unplugged:799765a4-d098-4fb2-a9ac-f48d7065be51 for instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc on n-h1-860864-8 Oct 12 22:44:05.127535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-701a3de7-80b8-41a7-b3a8-d36231b89a7c req-6f6eb9a6-7438-41a8-9bfc-6531ca66615f service nova] Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:44:05.144727 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-701a3de7-80b8-41a7-b3a8-d36231b89a7c req-6f6eb9a6-7438-41a8-9bfc-6531ca66615f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103358 Oct 12 22:44:05.148296 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1345/2774] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:05.159508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:05.162617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:05.177195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.180522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.181180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.182068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.185883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.186573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.311472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.312546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.312983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.313729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.314189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.314614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.387577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:44:05.413594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for user 70dbe0c8a7784391a83066cb1cb74604 and project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:44:05.442988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:05.740009 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-474b26af-2abb-40da-bfc6-b160be0c29a8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc/action" status: 202 len: 0 microversion: 2.1 time: 0.589120 Oct 12 22:44:05.746022 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1346/2775] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:05 2022] POST /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:44:05.752616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:05.753931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:05.766062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.766938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.767624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.768757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.770681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.775216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.912731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0d28665-635a-4ede-98bf-b221446b7940 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 200 len: 1455 microversion: 2.1 time: 19.930429 Oct 12 22:44:05.915580 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1430/2776] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:43:45 2022] GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 1455 bytes in 19935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:05.920330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:05.920947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:05.958529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.959022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.959464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:05.981432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:05.981987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:05.982443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:06.356490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:06.370043 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eaf3d63f-7988-4848-9e5b-93990786459b tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 0.619544 Oct 12 22:44:06.387577 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1347/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:05 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:06.534147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:06.545890 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0e2f604-3d86-4c96-9577-bfd7637b9ca1 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1470 microversion: 2.1 time: 0.629169 Oct 12 22:44:06.561045 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1431/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:05 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1470 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:06.928453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58f117d7-32d2-4292-a1c9-03af7877a18d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6bea60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:07.395027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:07.395652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:07.417753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:07.425358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:07.425831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:07.426580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:07.427034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:07.427464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:08.302327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:08.321446 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa592518-0919-4d0d-bbe4-aace6e697641 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 0.921128 Oct 12 22:44:08.325953 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1432/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:07 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:08.348822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:08.356806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:08.413271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:08.414253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:08.414702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:08.419242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:08.421011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:08.421532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:08.952779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:08.970737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32d9d9b4-0c27-4658-9b5c-15de6c5d6f17 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1470 microversion: 2.1 time: 0.635238 Oct 12 22:44:09.016352 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1433/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:08 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1470 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:09.050033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fdc7081c-950c-48fd-b696-06694a98c16f req-9d384438-5c01-4c7f-a64f-fd3736de782a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee03cca8-8cf9-441d-bc35-706e1f84a7b7", "name": "network-vif-plugged", "status": "completed", "tag": "87e2c5f7-4b7b-4c50-991c-25981789b40b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:09.094245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fdc7081c-950c-48fd-b696-06694a98c16f req-9d384438-5c01-4c7f-a64f-fd3736de782a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:09.095355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fdc7081c-950c-48fd-b696-06694a98c16f req-9d384438-5c01-4c7f-a64f-fd3736de782a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:09.098251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fdc7081c-950c-48fd-b696-06694a98c16f req-9d384438-5c01-4c7f-a64f-fd3736de782a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:09.148430 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fdc7081c-950c-48fd-b696-06694a98c16f req-9d384438-5c01-4c7f-a64f-fd3736de782a service nova] Creating event network-vif-plugged:87e2c5f7-4b7b-4c50-991c-25981789b40b for instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 on n-h2-860864-8 Oct 12 22:44:09.169539 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fdc7081c-950c-48fd-b696-06694a98c16f req-9d384438-5c01-4c7f-a64f-fd3736de782a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150562 Oct 12 22:44:09.176690 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1434/2781] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:09.351668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:09.352629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:09.363822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:09.387352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:09.388268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:09.393001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:09.394359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:09.400795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:09.734990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:09.748601 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7dd41c10-e672-4edd-a7ab-6d8a380dd6ff tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 0.401521 Oct 12 22:44:09.751486 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1435/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:09 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:10.006832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:10.007851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:10.028829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:10.030455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:10.032537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:10.034605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:10.036042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:10.038873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:10.894758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:10.903061 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd980e64-a1ce-415d-b3da-6a11be315c46 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1470 microversion: 2.1 time: 0.900073 Oct 12 22:44:10.941122 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1436/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:10 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1470 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:10.953484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:10.962625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:10.991318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:11.001651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:11.002307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:11.003267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:11.006900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:11.007652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:12.825867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:12.843822 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4382276b-17b0-4c93-88b4-b1245678b4bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1323 microversion: 2.1 time: 1.897507 Oct 12 22:44:12.844900 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1437/2784] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:10 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1323 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:12.851952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4669cb52-3a13-4ecf-876b-f624a57efe93 req-e6073dad-67e7-479f-b794-0aa92e68081f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530192e6-0cfe-4dc6-96ce-063b4e5fbbbc", "name": "network-vif-plugged", "status": "completed", "tag": "799765a4-d098-4fb2-a9ac-f48d7065be51"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:12.879722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4669cb52-3a13-4ecf-876b-f624a57efe93 req-e6073dad-67e7-479f-b794-0aa92e68081f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:12.880687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4669cb52-3a13-4ecf-876b-f624a57efe93 req-e6073dad-67e7-479f-b794-0aa92e68081f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:12.881291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4669cb52-3a13-4ecf-876b-f624a57efe93 req-e6073dad-67e7-479f-b794-0aa92e68081f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:12.938504 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4669cb52-3a13-4ecf-876b-f624a57efe93 req-e6073dad-67e7-479f-b794-0aa92e68081f service nova] Creating event network-vif-plugged:799765a4-d098-4fb2-a9ac-f48d7065be51 for instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc on n-h1-860864-8 Oct 12 22:44:12.965517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-4669cb52-3a13-4ecf-876b-f624a57efe93 req-e6073dad-67e7-479f-b794-0aa92e68081f service nova] Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:44:12.972821 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4669cb52-3a13-4ecf-876b-f624a57efe93 req-e6073dad-67e7-479f-b794-0aa92e68081f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126150 Oct 12 22:44:12.974204 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1438/2785] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:12.995668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:12.996515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:13.013334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.013972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.013972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.014515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.015579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.016192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.328746 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58f117d7-32d2-4292-a1c9-03af7877a18d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 200 len: 1464 microversion: 2.1 time: 6.404058 Oct 12 22:44:13.335383 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1348/2786] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:06 2022] GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 1464 bytes in 6411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:13.357965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-324d1a63-b394-421e-9d72-9de7c630849b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6fb700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:13.413823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-324d1a63-b394-421e-9d72-9de7c630849b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 200 len: 1464 microversion: 2.1 time: 0.067022 Oct 12 22:44:13.425192 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1349/2787] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:13 2022] GET /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:13.430431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:13.431247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:13.438486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.439185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.439795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.440698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.441315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.441894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.566009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:13.574822 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75ad4cca-eb77-48b2-bfc9-aa377955f5bb tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1536 microversion: 2.1 time: 0.599090 Oct 12 22:44:13.580642 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1439/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:12 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1536 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:13.868071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:13.868750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:13.882667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.883166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.883607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:13.884344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:13.884798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:13.885220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:14.139056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:14.146922 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-69582dda-98cb-4f3f-81dc-24d6c8d3cfb7 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1481 microversion: 2.1 time: 0.720441 Oct 12 22:44:14.155680 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1350/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:13 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1481 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:14.375928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:14.386135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb6e5b42-bb8d-4698-b0b4-03290417aa65 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1518 microversion: 2.1 time: 0.522017 Oct 12 22:44:14.407875 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1440/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:13 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1518 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:14.418309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:14.420692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:14.434027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.434719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.435324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:14.437213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.440601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.441787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:14.517522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lazy-loading 'flavor' on Instance uuid ee03cca8-8cf9-441d-bc35-706e1f84a7b7 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:44:14.612239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:14.615270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:14.629877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.631877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.632599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:14.634019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.637316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.638178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:14.717092 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a700a4f9-7f9f-49f0-abfb-accc22a5c036 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action" status: 200 len: 32 microversion: 2.1 time: 0.302652 Oct 12 22:44:14.723008 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1351/2791] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:14 2022] POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:44:14.731281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:14.732609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:14.743083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.743921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.745911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:14.746852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:14.747541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:14.748790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:15.302365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:15.317084 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a42d08a9-371b-4558-88a1-2e05e1ec251c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1536 microversion: 2.1 time: 0.711390 Oct 12 22:44:15.338554 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1441/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:14 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1536 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:15.348630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:15.365152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:15.365972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:15.381882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:15.382398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:15.382838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:15.385757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:15.386231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:15.386665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:15.459480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:15.468430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e583fe77-ce67-403b-9bbb-3d1bae8c26c6 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.742748 Oct 12 22:44:15.472175 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1352/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:14 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:15.592962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d94ca19b-3cda-4e3e-9a67-46b6711184f6 req-e20ed043-8ddf-47f1-8026-c48908189d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530192e6-0cfe-4dc6-96ce-063b4e5fbbbc", "name": "network-vif-unplugged", "status": "completed", "tag": "799765a4-d098-4fb2-a9ac-f48d7065be51"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:15.634265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d94ca19b-3cda-4e3e-9a67-46b6711184f6 req-e20ed043-8ddf-47f1-8026-c48908189d42 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:15.636605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d94ca19b-3cda-4e3e-9a67-46b6711184f6 req-e20ed043-8ddf-47f1-8026-c48908189d42 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:15.641244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d94ca19b-3cda-4e3e-9a67-46b6711184f6 req-e20ed043-8ddf-47f1-8026-c48908189d42 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:15.691291 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d94ca19b-3cda-4e3e-9a67-46b6711184f6 req-e20ed043-8ddf-47f1-8026-c48908189d42 service nova] Creating event network-vif-unplugged:799765a4-d098-4fb2-a9ac-f48d7065be51 for instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc on n-h1-860864-8 Oct 12 22:44:15.710427 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d94ca19b-3cda-4e3e-9a67-46b6711184f6 req-e20ed043-8ddf-47f1-8026-c48908189d42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119817 Oct 12 22:44:15.711113 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1353/2794] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:44:16.188085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:16.207809 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8e09916-4988-43d4-a091-66afb05810ac tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1468 microversion: 2.1 time: 0.862622 Oct 12 22:44:16.219923 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1442/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:15 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1468 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:16.238191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-843508952"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:16.253843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:16.289622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.290475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.291636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.294382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.295042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.296878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.357882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:16.359099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:16.373129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.373910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.374630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.375505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.376146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.376725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.832281 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-843d9057-a3b7-42af-b1b6-85d41118d3b1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "POST /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598/action" status: 202 len: 0 microversion: 2.1 time: 0.599042 Oct 12 22:44:16.842134 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1354/2796] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:16 2022] POST /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:44:16.862006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:16.864776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:16.875832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.876353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.876793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.877497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:16.877949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:16.878450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:16.984238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:16.996201 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca90de30-7a0b-4574-8c3d-9fc584c63da4 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1529 microversion: 2.1 time: 0.642952 Oct 12 22:44:17.003605 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1443/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:16 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1529 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:17.013663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42b20da9-bd81-4f44-a681-c5dca248dcc5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffca34c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:17.110426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42b20da9-bd81-4f44-a681-c5dca248dcc5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.104490 Oct 12 22:44:17.110426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1444/2798] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:17 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:17.127058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:17.138961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:17.150709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:17.151591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:17.152271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:17.153213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:17.153882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:17.154516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:17.671083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:17.684470 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-032d9fc5-7f93-4cb7-b942-da9656b56a10 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1529 microversion: 2.1 time: 0.565043 Oct 12 22:44:17.685063 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1445/2799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:17 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1529 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:17.712609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55bc87fe-d7d5-4222-8544-b67500e8e337 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:17.726460 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-55bc87fe-d7d5-4222-8544-b67500e8e337 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] HTTP exception thrown: Flavor f613ebae-a485-4023-9597-aa23ecfb4ebc could not be found. Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55bc87fe-d7d5-4222-8544-b67500e8e337 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Request method failure captured: Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/flavors/f613ebae-a485-4023-9597-aa23ecfb4ebc HTTP/1.1 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0JMChN5b_H5UTjg2A8DmPFpbCeAnTvE4cSsluFpbnzZhAg4-5PnQUmtoO3tyqxJOLs3HGevsXn8nmMglF006EUGpRhHOX_xdx_bTD6-uwl3s-uyHF-QBjjdOh1vOpuNy3t5goCqY82T0nz5_CS_KV1lhGp0Q-ePRlXCqd_epgFwyO0 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6142d017e3224e08af7e88d8ebbb1cac Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-MigrationsAdminTest-353225102 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6142d017e3224e08af7e88d8ebbb1cac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6142d017e3224e08af7e88d8ebbb1cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6142d017e3224e08af7e88d8ebbb1cac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6142d017e3224e08af7e88d8ebbb1cac"}]}] Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-MigrationsAdminTest-353225102 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6142d017e3224e08af7e88d8ebbb1cac Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-MigrationsAdminTest-353225102 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-MigrationsAdminTest-353225102-project-admin Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 8b640e03bd0841b69243c130353a16a5 Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-MigrationsAdminTest-353225102-project-admin Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: exception: Flavor f613ebae-a485-4023-9597-aa23ecfb4ebc could not be found. Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f613ebae-a485-4023-9597-aa23ecfb4ebc'} Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f613ebae-a485-4023-9597-aa23ecfb4ebc could not be found. Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f613ebae-a485-4023-9597-aa23ecfb4ebc could not be found. Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:44:17.737174 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f613ebae-a485-4023-9597-aa23ecfb4ebc could not be found. Oct 12 22:44:17.742030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:44:17.743475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55bc87fe-d7d5-4222-8544-b67500e8e337 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Returning 404 to user: Flavor f613ebae-a485-4023-9597-aa23ecfb4ebc could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:44:17.744592 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-55bc87fe-d7d5-4222-8544-b67500e8e337 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/f613ebae-a485-4023-9597-aa23ecfb4ebc" status: 404 len: 109 microversion: 2.1 time: 0.036182 Oct 12 22:44:17.745685 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1446/2800] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:44:17 2022] DELETE /compute/v2.1/flavors/f613ebae-a485-4023-9597-aa23ecfb4ebc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:44:17.979740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1551825519", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:18.116239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:18.129341 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b277edda-1f44-4cc0-92ce-5d23fc8fd3dc tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 1.284689 Oct 12 22:44:18.131680 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1355/2801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:16 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:18.147134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:44:18.160817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35ab3c0b-b7a1-4209-8dc2-6b2adec2aead tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff468a60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:18.414917 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35ab3c0b-b7a1-4209-8dc2-6b2adec2aead tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.281632 Oct 12 22:44:18.420586 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1356/2802] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:18 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:18.726359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:44:18.728150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:44:18.728897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:44:18.729482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:44:18.730140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:44:18.750342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:18.752087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:18.752719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:18.754586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:18.756439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:18.757050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:18.819185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:44:18.834136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Getting quotas for user 70dbe0c8a7784391a83066cb1cb74604 and project 8cf9e980a91540259cee1eb11016cfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:44:18.870662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:44:18.887289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:44:19.017631 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82a69095-0dad-4e5b-bfe6-344764b79ad3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040896 Oct 12 22:44:19.022391 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1447/2803] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:44:19.042787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e8b146d-7022-4665-9e4a-05880948aea5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:19.043704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e8b146d-7022-4665-9e4a-05880948aea5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:19.149006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a67dcb0a-d211-4e5e-b9d3-c2b2296cc420 req-37131f80-2169-446d-a609-a0dfb237b73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd245f-3ada-4388-b3a8-a26da4e123bd", "name": "network-vif-unplugged", "status": "completed", "tag": "4154fce7-7027-4f18-a941-c4e185fbb63b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:19.181579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a67dcb0a-d211-4e5e-b9d3-c2b2296cc420 req-37131f80-2169-446d-a609-a0dfb237b73b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:19.183791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a67dcb0a-d211-4e5e-b9d3-c2b2296cc420 req-37131f80-2169-446d-a609-a0dfb237b73b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:19.186525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a67dcb0a-d211-4e5e-b9d3-c2b2296cc420 req-37131f80-2169-446d-a609-a0dfb237b73b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:19.229097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a67dcb0a-d211-4e5e-b9d3-c2b2296cc420 req-37131f80-2169-446d-a609-a0dfb237b73b service nova] Creating event network-vif-unplugged:4154fce7-7027-4f18-a941-c4e185fbb63b for instance e9cd245f-3ada-4388-b3a8-a26da4e123bd on n-h2-860864-8 Oct 12 22:44:19.273898 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a67dcb0a-d211-4e5e-b9d3-c2b2296cc420 req-37131f80-2169-446d-a609-a0dfb237b73b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128648 Oct 12 22:44:19.276617 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1448/2804] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:19.293835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:19.295435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:19.309968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:19.310467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:19.310905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:19.312224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:19.312672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:19.313099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:19.331693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e8b146d-7022-4665-9e4a-05880948aea5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:19.340771 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e8b146d-7022-4665-9e4a-05880948aea5 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1213 microversion: 2.1 time: 0.310712 Oct 12 22:44:19.344644 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1357/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:19 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1213 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:19.437971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cba37a0b-e8b7-4c82-a355-3dd3e895da0a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6e78b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:19.525607 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cba37a0b-e8b7-4c82-a355-3dd3e895da0a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.092913 Oct 12 22:44:19.526837 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1358/2806] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:19 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:19.965764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:19.987701 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04b97bf4-b995-4dbb-9697-58b751721aa9 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.708312 Oct 12 22:44:19.996240 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1449/2807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:19 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:20.370249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:20.371120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:20.386136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:20.393147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:20.396206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:20.397347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:20.398046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:20.403535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:20.543326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9319f5b8-a287-418b-976f-9230a514ba3a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44feeb8b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:20.616359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:20.642859 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9319f5b8-a287-418b-976f-9230a514ba3a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.100748 Oct 12 22:44:20.643520 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1450/2808] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:20 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:20.645088 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09775195-4367-442e-8e8e-e3e70e56ccb9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1209 microversion: 2.1 time: 0.276622 Oct 12 22:44:20.647154 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1359/2809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:20 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1209 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:21.020329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:21.021038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:21.036206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:21.044580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:21.045340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:21.046413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:21.047205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:21.047823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:21.669316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d37fe19e-158a-4e28-b33c-953f7ff60769 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6df820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:21.825907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:21.837859 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4359778d-7142-40af-90e2-e06f64e55abe tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.821403 Oct 12 22:44:21.847073 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1451/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:21 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:21.852246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:21.853116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:21.880492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:21.890293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:21.891460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:21.892545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:21.893233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:21.893878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:22.086586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:22.090456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:22.104531 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90de3e9d-f2d9-4e1f-a052-2ef76b5c43c3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1271 microversion: 2.1 time: 0.255943 Oct 12 22:44:22.109820 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1452/2811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:21 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:22.877286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:22.878439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:22.891064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:22.894170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:22.896854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:22.898029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:22.901192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:22.901935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:23.699424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:23.726325 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d8f97908-ff9d-4abc-8d40-c47af3bcde1a tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.855417 Oct 12 22:44:23.744974 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1453/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:22 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:23.752365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:23.756006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:23.770791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:23.771521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:23.772303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:23.773199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:23.774418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:23.779196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:26.244900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:26.256417 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a88398e9-3cce-496f-87af-50d079c53196 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 2.516430 Oct 12 22:44:26.258056 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1454/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:23 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 2518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:26.278070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:26.282002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:26.309855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:26.310356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:26.316640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:26.317690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:26.320347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:26.328537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:26.777855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:26.794325 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a4b901e-247b-4ec2-81bb-e8433b91ce17 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.535127 Oct 12 22:44:26.794923 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1455/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:26 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:26.799960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a810e040-dd70-469d-a5d9-16ed9d28a26c req-f80ca9a5-f5fd-4895-947a-7780bbd3191d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530192e6-0cfe-4dc6-96ce-063b4e5fbbbc", "name": "network-vif-plugged", "status": "completed", "tag": "799765a4-d098-4fb2-a9ac-f48d7065be51"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:26.836228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a810e040-dd70-469d-a5d9-16ed9d28a26c req-f80ca9a5-f5fd-4895-947a-7780bbd3191d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:26.837935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a810e040-dd70-469d-a5d9-16ed9d28a26c req-f80ca9a5-f5fd-4895-947a-7780bbd3191d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:26.840694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a810e040-dd70-469d-a5d9-16ed9d28a26c req-f80ca9a5-f5fd-4895-947a-7780bbd3191d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:26.878861 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a810e040-dd70-469d-a5d9-16ed9d28a26c req-f80ca9a5-f5fd-4895-947a-7780bbd3191d service nova] Creating event network-vif-plugged:799765a4-d098-4fb2-a9ac-f48d7065be51 for instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc on n-h1-860864-8 Oct 12 22:44:26.899139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a810e040-dd70-469d-a5d9-16ed9d28a26c req-f80ca9a5-f5fd-4895-947a-7780bbd3191d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102392 Oct 12 22:44:26.900431 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1456/2815] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:27.279129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:27.279846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:27.294009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:27.294497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:27.294927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:27.295637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:27.296146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:27.296750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:27.927586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:27.935566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69996700-aef4-414a-81c6-f347e1b17552 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 0.660553 Oct 12 22:44:27.943413 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1457/2816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:27 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:27.952713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:27.956731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:27.969711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:27.970449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:27.971073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:27.971976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:27.972582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:27.979922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:28.179029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:28.190091 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58772f42-0814-4d01-923a-787990748626 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.244078 Oct 12 22:44:28.206021 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1458/2817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:27 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:28.889209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-bd1da75a-fe33-48f4-a0cd-a7be4c138281 req-34fd19b7-73a0-43a1-af99-e30af5ba8131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:28.912744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:28.924502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:28.941433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bd1da75a-fe33-48f4-a0cd-a7be4c138281 req-34fd19b7-73a0-43a1-af99-e30af5ba8131 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:28.941792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bd1da75a-fe33-48f4-a0cd-a7be4c138281 req-34fd19b7-73a0-43a1-af99-e30af5ba8131 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:28.942436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bd1da75a-fe33-48f4-a0cd-a7be4c138281 req-34fd19b7-73a0-43a1-af99-e30af5ba8131 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:28.993311 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-bd1da75a-fe33-48f4-a0cd-a7be4c138281 req-34fd19b7-73a0-43a1-af99-e30af5ba8131 service nova] Creating event network-changed:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h1-860864-8 Oct 12 22:44:29.010530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-bd1da75a-fe33-48f4-a0cd-a7be4c138281 req-34fd19b7-73a0-43a1-af99-e30af5ba8131 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124876 Oct 12 22:44:29.023168 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1459/2818] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:44:29.047770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:29.053013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:29.094570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:29.100487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:29.101172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:29.102071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:29.102685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:29.104467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:29.340611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:30.379197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:30.466920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:30.475211 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8d684d59-7242-406e-9bac-a464ab453130 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 1.443881 Oct 12 22:44:30.488715 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1460/2819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:29 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:30.497026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:30.497886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:30.525653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:30.526419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:30.527033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:30.527945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:30.535121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:30.535854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:30.623703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:31.175708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:31.183573 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f76fd636-d616-411c-95cc-cb7d48f61ebb tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.693404 Oct 12 22:44:31.203919 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1461/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:30 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:31.515614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:31.516319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:31.525482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:31.525981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:31.528624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:31.529391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:31.539608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:31.541258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:32.205707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:32.214021 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56322c25-3557-4a8f-8165-6e5c95ca23ef tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 0.702423 Oct 12 22:44:32.239777 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1462/2821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:31 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:32.244761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-690f028e-f322-4a41-aa2b-fa9a9e0e0030 req-a22e46ad-0394-4094-85c1-039e59f09bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e532a39-5484-411d-a9d2-cdd0563b2598", "name": "network-vif-plugged", "status": "completed", "tag": "b9177795-35b3-49c5-b902-52e7fe47daf4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:32.305872 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d37fe19e-158a-4e28-b33c-953f7ff60769 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 10.640251 Oct 12 22:44:32.307186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1360/2822] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:21 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 10642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:32.313619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:32.314528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:32.322144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:32.323035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:32.324300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:32.325785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:32.326490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:32.327434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:32.340624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-690f028e-f322-4a41-aa2b-fa9a9e0e0030 req-a22e46ad-0394-4094-85c1-039e59f09bd3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:32.341177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-690f028e-f322-4a41-aa2b-fa9a9e0e0030 req-a22e46ad-0394-4094-85c1-039e59f09bd3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:32.341630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-690f028e-f322-4a41-aa2b-fa9a9e0e0030 req-a22e46ad-0394-4094-85c1-039e59f09bd3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:32.381351 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-690f028e-f322-4a41-aa2b-fa9a9e0e0030 req-a22e46ad-0394-4094-85c1-039e59f09bd3 service nova] Creating event network-vif-plugged:b9177795-35b3-49c5-b902-52e7fe47daf4 for instance 4e532a39-5484-411d-a9d2-cdd0563b2598 on n-h1-860864-8 Oct 12 22:44:32.390824 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-690f028e-f322-4a41-aa2b-fa9a9e0e0030 req-a22e46ad-0394-4094-85c1-039e59f09bd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149423 Oct 12 22:44:32.392877 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1463/2823] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:32.730971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:32.748534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-122a1493-f260-44dc-abb5-3b3fd9946ca0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.437062 Oct 12 22:44:32.750948 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1361/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:32 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:33.137671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b439fcb3-72b6-4acc-8f07-eae1f7232b65 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Action: 'create', calling method: .version_select at 0x7f44fedc6790>, body: {"keypair": {"name": "tempest-keypair-49801077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2tDgygInbMdpEFL50NSvHqf8393QQ2ifQHUFmy5wCElyqEbIx6lyOyx4FxFK3HeiyGqJiuf35y31xrd6pguF+eaclEZgjuudktfReYwyCZDWAcwfr9ZyRRR8D4iuarhQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:33.174145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b439fcb3-72b6-4acc-8f07-eae1f7232b65 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Getting quotas for project f47fcb444af0489bbabd823baf7b0fe8. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:44:33.185803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b439fcb3-72b6-4acc-8f07-eae1f7232b65 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Getting quotas for user 7db9db3a17de41708a9071e44c1624a7 and project f47fcb444af0489bbabd823baf7b0fe8. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:44:33.242514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:33.243823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:33.263490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:33.267010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:33.268478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:33.269452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:33.272290 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b439fcb3-72b6-4acc-8f07-eae1f7232b65 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.876633 Oct 12 22:44:33.273434 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1464/2825] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:44:32 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:33.274298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:33.274772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:33.326298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a687f2d-70fa-4a57-adbf-c811444b5d0f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffe66040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:33.427283 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a687f2d-70fa-4a57-adbf-c811444b5d0f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.108329 Oct 12 22:44:33.431026 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1465/2826] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:33 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:33.774080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:33.774942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:33.799130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:33.813139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:33.817270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:33.824791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:33.825975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:33.826797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:34.360125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:34.370033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2afb7ba8-026b-459e-aab7-ebd44f52c186 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 0.600139 Oct 12 22:44:34.384155 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1466/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:33 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:34.459287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9baa7cbd-3996-48c5-b0c7-df2f9b304e30 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7698b0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:34.574165 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9baa7cbd-3996-48c5-b0c7-df2f9b304e30 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.116885 Oct 12 22:44:34.587092 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1467/2828] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:34 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:34.827636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:34.846468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76e18a3f-e8f6-4923-9e40-6dfb6b028953 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 1.609106 Oct 12 22:44:34.863168 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1362/2829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:33 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:35.401831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:35.403035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:35.419353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:35.420187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:35.431597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:35.433876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:35.435589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:35.438100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:35.602641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ca59f25-2ba5-43b7-ac4a-3b607b698836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff671e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:35.686899 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ca59f25-2ba5-43b7-ac4a-3b607b698836 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.094815 Oct 12 22:44:35.688694 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1363/2830] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:35 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:35.875544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:35.877063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:35.904601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:35.910182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:35.911532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:35.919480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:35.926252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:35.928419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:36.751991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:36.764606 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-de152990-7859-4f6a-8c9e-e9b63f5cb778 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 0.899242 Oct 12 22:44:36.767361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1364/2831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:35 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:36.778085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-791124fa-21bf-4dd0-a409-7f2409df78d3 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff4688b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:36.871048 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-791124fa-21bf-4dd0-a409-7f2409df78d3 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.102158 Oct 12 22:44:36.881810 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1365/2832] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:36 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:37.310878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:37.323866 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6263933b-79b6-4da0-8ed1-ddbdf532ac23 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 1.928583 Oct 12 22:44:37.328031 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1468/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:35 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:37.792488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:37.793119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:37.816198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:37.816808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:37.817197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:37.820379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:37.820852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:37.821282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:37.887461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f54c483e-fad4-40f9-84f2-f9406b3fa51d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffcab820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:37.962758 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f54c483e-fad4-40f9-84f2-f9406b3fa51d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.079203 Oct 12 22:44:37.963356 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1469/2834] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:37 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:38.347457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:38.348885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:38.351169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:38.370680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:38.376440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:38.379628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:38.382423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:38.385900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:38.387828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:39.056161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:39.073103 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b6ab12bc-5ca0-4fc5-8047-da780ae70b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 1.286094 Oct 12 22:44:39.075926 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1366/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:37 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:39.088204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-10d1174d-41a9-473f-b869-4972447b5ced tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff671820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:39.207171 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-10d1174d-41a9-473f-b869-4972447b5ced tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.128788 Oct 12 22:44:39.215493 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1367/2836] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:39 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:39.786649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4d413127-c0c2-419d-97fe-8b9c60f248a3 req-51a525f1-032d-4600-81aa-e0359238222e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "name": "network-vif-plugged", "status": "completed", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:39.840871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4d413127-c0c2-419d-97fe-8b9c60f248a3 req-51a525f1-032d-4600-81aa-e0359238222e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:39.846011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4d413127-c0c2-419d-97fe-8b9c60f248a3 req-51a525f1-032d-4600-81aa-e0359238222e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:39.849562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4d413127-c0c2-419d-97fe-8b9c60f248a3 req-51a525f1-032d-4600-81aa-e0359238222e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:39.891597 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4d413127-c0c2-419d-97fe-8b9c60f248a3 req-51a525f1-032d-4600-81aa-e0359238222e service nova] Creating event network-vif-plugged:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h1-860864-8 Oct 12 22:44:39.914901 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4d413127-c0c2-419d-97fe-8b9c60f248a3 req-51a525f1-032d-4600-81aa-e0359238222e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134211 Oct 12 22:44:39.916097 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1368/2837] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:40.102350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:40.103768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:40.117797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:40.118301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:40.119082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:40.122747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:40.123722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:40.123722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:40.568546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:40.577678 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78f2ee7b-4ecd-4293-8006-1531a75dcd6e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 2.234390 Oct 12 22:44:40.579705 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1470/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:38 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:40.592368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2df418c6-6999-4bd6-9849-d32287a95199 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44fee5cdc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:40.687443 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2df418c6-6999-4bd6-9849-d32287a95199 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.106377 Oct 12 22:44:40.688076 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1471/2839] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:40 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:40.722779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:40.735164 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bafcb712-2e1d-41da-a75c-1d261bf57da2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 0.632908 Oct 12 22:44:40.754567 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1369/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:40 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:41.606426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:41.607313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:41.641863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:41.643527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:41.644995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:41.646541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:41.648614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:41.658610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:41.703169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-854c73b1-12e8-4d5f-a154-92788e398cfb tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff60b1f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:41.777682 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-854c73b1-12e8-4d5f-a154-92788e398cfb tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.078815 Oct 12 22:44:41.786904 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1370/2841] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:41 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:41.802677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:41.807619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:41.830611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:41.831347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:41.831553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:41.832295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:41.832747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:41.833170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:42.555839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:42.573247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef217f39-4fd0-4c0f-816d-a0ac59ab4633 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1313 microversion: 2.1 time: 0.784625 Oct 12 22:44:42.577736 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1371/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:41 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1313 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:42.664008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1478225114", "imageRef": "f8115a85-a629-4376-abed-e94dc5332b78", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "eac605fa-99c3-41e4-98ab-faabd3066216"}], "security_groups": [{"name": "tempest-securitygroup--669446213"}], "key_name": "tempest-keypair-49801077", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:42.701169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:42.718303 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09fd7306-67af-40db-9d48-69fa57b2f807 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1524 microversion: 2.1 time: 1.115398 Oct 12 22:44:42.719286 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1472/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:41 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1524 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:42.800805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dca733af-0e06-43d5-ac50-480f51ba4c0d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffc1e430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:42.889847 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dca733af-0e06-43d5-ac50-480f51ba4c0d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.098827 Oct 12 22:44:42.892125 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1473/2844] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:42 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:43.241370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] validate_networks() for [('eac605fa-99c3-41e4-98ab-faabd3066216', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:44:43.601624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:43.606626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:43.607426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:43.626027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:43.628078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:43.632786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:43.633722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:43.634316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:43.634871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:44.163328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:44.183236 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc9491de-ef19-480e-a065-3cdcc954434f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1463 microversion: 2.1 time: 0.582177 Oct 12 22:44:44.185545 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1474/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:43 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1463 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:44.198221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:44.201306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:44.224994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:44.226332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:44.226332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:44.229826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:44.230312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:44.230757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:44.787278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:44.813553 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cac53f4c-04b0-41f7-ac22-a7bb316c32c5 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1504 microversion: 2.1 time: 0.625702 Oct 12 22:44:44.830996 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1475/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:44 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1504 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:44.838593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd8e3414-b076-4c79-8130-c01424d3b699 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4507b27280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:44.957534 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd8e3414-b076-4c79-8130-c01424d3b699 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.124956 Oct 12 22:44:44.958294 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1476/2847] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:44 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:44.963028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:44.974981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:44.998509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:45.003475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:45.014329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:45.015995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:45.021787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:45.026649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:45.510772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:44:45.511306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:44:45.516400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:44:45.516947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:44:45.517477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:44:45.534360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23331e6a-7b53-47ea-97d2-71f0d36cbd27 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1614 microversion: 2.1 time: 0.568215 Oct 12 22:44:45.537893 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1477/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:44 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1614 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:45.546025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-060ff544-e8d1-43c8-9b28-163d361969a0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'create', calling method: .version_select at 0x7f44ffc88550>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-469053730", "description": "tempest-description-1295262874"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:45.555326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:45.561777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:45.564924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:45.567221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:45.571392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:45.578496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:45.667255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Getting quotas for project f47fcb444af0489bbabd823baf7b0fe8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:44:45.676360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Getting quotas for user 7db9db3a17de41708a9071e44c1624a7 and project f47fcb444af0489bbabd823baf7b0fe8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:44:45.702666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:44:45.708832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8115a85-a629-4376-abed-e94dc5332b78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:44:45.857401 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e12ad12a-2270-490f-90fc-a54ee608f342 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.205880 Oct 12 22:44:45.865638 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1372/2849] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:44:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:44:45.871930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:45.872690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:45.880432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:45.880933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:45.881439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:45.882256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:45.882709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:45.883137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:46.052516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8b640e03bd0841b69243c130353a16a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6142d017e3224e08af7e88d8ebbb1cac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:46.053182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] flavor_id is None. Assuming migration. {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 22:44:46.053568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 22:44:46.473001 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-060ff544-e8d1-43c8-9b28-163d361969a0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.930448 Oct 12 22:44:46.474224 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1478/2850] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:44:45 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:46.479823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7242a4ba-9634-4f6c-84d6-e883df0540ed tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:46.480865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7242a4ba-9634-4f6c-84d6-e883df0540ed tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:46.654973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7242a4ba-9634-4f6c-84d6-e883df0540ed tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:46.666691 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7242a4ba-9634-4f6c-84d6-e883df0540ed tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1244 microversion: 2.1 time: 0.191094 Oct 12 22:44:46.668802 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1479/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:46 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:46.679242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4c4277a-5860-4990-9e55-f534106ebae3 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffb17820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:46.724061 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe1e196c-08ee-40e7-a1d3-2ec926d094df tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293/action" status: 202 len: 0 microversion: 2.1 time: 0.857027 Oct 12 22:44:46.727910 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1373/2852] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:45 2022] POST /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:44:46.741056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-469053730"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:46.741891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:46.767192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:46.767692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:46.768153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:46.768857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:46.769298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:46.774222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:46.789952 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e4c4277a-5860-4990-9e55-f534106ebae3 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.119589 Oct 12 22:44:46.794449 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1480/2853] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:46 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:46.805324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:46.806355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:46.832210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:46.834143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:46.837521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:46.838594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:46.840424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:46.841118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:46.895593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:47.364818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:47.373005 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4145dcf7-937d-4529-ade7-281be718bd2c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1472 microversion: 2.1 time: 0.577106 Oct 12 22:44:47.381540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1481/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:46 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1472 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:47.545250 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.network.security_group_api [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Adding security group d623b09c-181f-49ff-9396-6e454e1d725b to port 87e2c5f7-4b7b-4c50-991c-25981789b40b Oct 12 22:44:47.697733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:47.701391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:47.733913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:47.733913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:47.733913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:47.738259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:47.738741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:47.739169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:48.172637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:48.189130 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0a412498-4a5e-4268-ad94-2021e629631f tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1296 microversion: 2.1 time: 0.494752 Oct 12 22:44:48.207344 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1482/2855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:47 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1296 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:48.207344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d96ce2d1-882c-4b8b-b9d3-92aa558ffaae tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f450402ae50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:48.302227 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d96ce2d1-882c-4b8b-b9d3-92aa558ffaae tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1454 microversion: 2.1 time: 0.105770 Oct 12 22:44:48.305745 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1483/2856] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:48 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:48.410769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:48.411953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:48.423159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:48.428850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:48.431381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:48.433915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:48.437564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:48.440212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:48.976097 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-abdd58f1-dd07-4631-b0b4-fc75a12748e2 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action" status: 202 len: 0 microversion: 2.1 time: 2.245768 Oct 12 22:44:48.976704 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1374/2857] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:46 2022] POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action => generated 0 bytes in 2248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:44:48.985380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-469053730"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:48.988326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:49.005271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:49.006369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:49.006968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:49.013330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:49.018245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:49.018919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:49.819613 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.network.security_group_api [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Removing security group d623b09c-181f-49ff-9396-6e454e1d725b from port 87e2c5f7-4b7b-4c50-991c-25981789b40b Oct 12 22:44:50.423767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:50.432094 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a4cd25c-4e38-4070-878b-5d238f90051d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1472 microversion: 2.1 time: 2.025069 Oct 12 22:44:50.456295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1484/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:48 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1472 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:50.468887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a2b28579-4b55-42fd-9514-a89b596b1808 req-dd8c166e-e403-4ca3-8939-a41221af9d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee03cca8-8cf9-441d-bc35-706e1f84a7b7", "tag": "87e2c5f7-4b7b-4c50-991c-25981789b40b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:50.489350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2b28579-4b55-42fd-9514-a89b596b1808 req-dd8c166e-e403-4ca3-8939-a41221af9d90 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.490207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2b28579-4b55-42fd-9514-a89b596b1808 req-dd8c166e-e403-4ca3-8939-a41221af9d90 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.490869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2b28579-4b55-42fd-9514-a89b596b1808 req-dd8c166e-e403-4ca3-8939-a41221af9d90 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.519494 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a2b28579-4b55-42fd-9514-a89b596b1808 req-dd8c166e-e403-4ca3-8939-a41221af9d90 service nova] Creating event network-changed:87e2c5f7-4b7b-4c50-991c-25981789b40b for instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 on n-h2-860864-8 Oct 12 22:44:50.538842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a2b28579-4b55-42fd-9514-a89b596b1808 req-dd8c166e-e403-4ca3-8939-a41221af9d90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080260 Oct 12 22:44:50.540025 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1485/2859] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:50.545732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:50.550165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:50.564852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.565736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.566720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.567697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:50.572305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:50.573192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:50.731556 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-305f1c69-9997-4de6-9b49-22bd34ffd3f0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action" status: 202 len: 0 microversion: 2.1 time: 1.749651 Oct 12 22:44:50.733517 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1375/2860] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:48 2022] POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action => generated 0 bytes in 1753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:44:50.751485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c2edb2d3-45dc-4f07-b0c3-0953100fec71 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff671430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:51.038516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:51.056175 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1bf0c0f6-9478-46ea-b131-1a869f0d2348 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1302 microversion: 2.1 time: 0.514612 Oct 12 22:44:51.060213 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1486/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:50 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1302 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:51.083592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff5e95ac-10f7-4769-947f-30ea03409207 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'create', calling method: .version_select at 0x7f44ff769b80>, body: {"pool": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:51.487974 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c2edb2d3-45dc-4f07-b0c3-0953100fec71 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1463 microversion: 2.1 time: 0.744683 Oct 12 22:44:51.490353 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1376/2862] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:50 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1463 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:51.497813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:51.500937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:51.511595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:51.513325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:51.515148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:51.516110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:51.516929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:51.517633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:52.882409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:52.897261 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2803a30-d9c2-4848-b545-6ffce42c8d85 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1472 microversion: 2.1 time: 1.405801 Oct 12 22:44:52.897933 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1377/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:51 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1472 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:52.916499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac92351d-d9a4-46d4-9062-3a7f69703723 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6be4c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:53.002215 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac92351d-d9a4-46d4-9062-3a7f69703723 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 200 len: 1463 microversion: 2.1 time: 0.093087 Oct 12 22:44:53.020921 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1378/2864] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:52 2022] GET /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:53.026380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:53.027432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:53.042560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.043481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.044205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.051286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.052141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.052891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.216545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:53.229397 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-908bfcdd-f696-46e5-9b86-0e328d7cf0ca tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1302 microversion: 2.1 time: 0.206983 Oct 12 22:44:53.247095 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1379/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:53 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1302 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:53.253530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7b774295-c617-4a6d-a16d-edbee7768b9e req-fe52f4c5-5c2b-487e-a118-c12ab9168cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee03cca8-8cf9-441d-bc35-706e1f84a7b7", "tag": "87e2c5f7-4b7b-4c50-991c-25981789b40b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:53.264476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7b774295-c617-4a6d-a16d-edbee7768b9e req-fe52f4c5-5c2b-487e-a118-c12ab9168cfc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.265365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7b774295-c617-4a6d-a16d-edbee7768b9e req-fe52f4c5-5c2b-487e-a118-c12ab9168cfc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.266023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7b774295-c617-4a6d-a16d-edbee7768b9e req-fe52f4c5-5c2b-487e-a118-c12ab9168cfc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.278710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7b774295-c617-4a6d-a16d-edbee7768b9e req-fe52f4c5-5c2b-487e-a118-c12ab9168cfc service nova] Creating event network-changed:87e2c5f7-4b7b-4c50-991c-25981789b40b for instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 on n-h2-860864-8 Oct 12 22:44:53.285757 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7b774295-c617-4a6d-a16d-edbee7768b9e req-fe52f4c5-5c2b-487e-a118-c12ab9168cfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036878 Oct 12 22:44:53.287518 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1380/2866] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:53.293496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:53.294570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:53.302904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.303836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.304612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.305813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.307113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.308686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.690669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:53.703197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eec3948d-ae4a-4001-ba0a-e470d2a678d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1467 microversion: 2.1 time: 0.413830 Oct 12 22:44:53.707040 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1381/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:53 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1467 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:53.732820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-108585944"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:53.735606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:53.749406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.752585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.754655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:53.756535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:53.757990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:53.759408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.202027 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd6fbdf0-6aa7-48d5-9646-bf1b6664bf07 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "POST /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd/action" status: 202 len: 0 microversion: 2.1 time: 0.473125 Oct 12 22:44:54.220293 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1382/2868] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:53 2022] POST /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:44:54.226476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:54.227503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:54.242316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:54.243265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:54.246699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.247618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:54.248856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:54.250076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:54.260417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:55.270928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:55.285379 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a390a17-16f3-4324-b861-6c0885fd6518 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1472 microversion: 2.1 time: 1.063307 Oct 12 22:44:55.296416 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1383/2869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:54 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1472 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:55.315939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52a807dd-5b42-41cf-a5d0-e2484060ca90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4507c1bb80>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:55.468510 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52a807dd-5b42-41cf-a5d0-e2484060ca90 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.162463 Oct 12 22:44:55.478395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1384/2870] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:55 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:55.500051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:55.501030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:55.525163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:55.531698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:55.532471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:55.534028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:55.540687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:55.541469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:55.616454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:55.684360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:56.099035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:56.112618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c88b9c16-f0b6-4a5f-96c1-8d692dd3661e tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1302 microversion: 2.1 time: 0.622787 Oct 12 22:44:56.121225 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1385/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:55 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1302 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:56.315135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:56.316898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:56.330912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:56.331774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:56.332593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:56.333587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:56.334260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:56.347756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:56.666351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:44:57.535574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:57.536125 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff5e95ac-10f7-4769-947f-30ea03409207 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.473062 Oct 12 22:44:57.537421 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1487/2872] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:44:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:57.551526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0361351-1570-4fe8-9cb7-3145359d7671 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff57a4c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:57.554465 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b7a22dd7-1edf-4c26-a918-f330e750ea8c tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1472 microversion: 2.1 time: 1.243642 Oct 12 22:44:57.565993 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1386/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:56 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1472 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:44:57.598423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65f6f53f-8485-4254-887c-937bec525092 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Action: 'create', calling method: .version_select at 0x7f44ff7735e0>, body: {"keypair": {"name": "tempest-keypair-249118699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhqPKMZzcqsiF5nBN28RQ6E4Z7xq7idsjD1n760z3azw2q9jcVqI89pm6Cir72g5YnyX6/DV1QhrdfygnGcK2XlcmzNEsosE2Ieve32LZu2gMzR8usb8IBz68QNAw3mfg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:57.680032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-65f6f53f-8485-4254-887c-937bec525092 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Getting quotas for project 81c2331d1e204eea916beba9eec9acf1. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:44:57.691121 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0361351-1570-4fe8-9cb7-3145359d7671 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.144154 Oct 12 22:44:57.703243 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1488/2874] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:44:57 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:57.722659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-65f6f53f-8485-4254-887c-937bec525092 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Getting quotas for user 4f0b7c499c1d4dd894483b19308e0439 and project 81c2331d1e204eea916beba9eec9acf1. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:44:57.723753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:57.729900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:57.753209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:57.776392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:57.777113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:57.783495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:57.784542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:57.785493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:57.824738 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65f6f53f-8485-4254-887c-937bec525092 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.237075 Oct 12 22:44:57.826230 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1387/2875] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:44:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:44:57.832854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'action', calling method: .version_select at 0x7f4505f578b0>, body: {"addFloatingIp": {"address": "172.25.6.99"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:57.838914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:57.867726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:57.868485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:57.869332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:57.870496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:57.871170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:57.871829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:57.955071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "refresh_cache-ee03cca8-8cf9-441d-bc35-706e1f84a7b7" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:44:57.955772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquired lock "refresh_cache-ee03cca8-8cf9-441d-bc35-706e1f84a7b7" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:44:59.003116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:44:59.022038 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-638c216d-eb07-4ed0-beea-e321c16be136 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1369 microversion: 2.1 time: 1.315507 Oct 12 22:44:59.024818 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1489/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:57 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1369 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:44:59.042721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-93dc443c-c773-45ea-82a8-654dd4d9e9cd req-def1461a-1176-48c2-a1e3-e19a446014c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e532a39-5484-411d-a9d2-cdd0563b2598", "name": "network-vif-unplugged", "status": "completed", "tag": "b9177795-35b3-49c5-b902-52e7fe47daf4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:44:59.102502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93dc443c-c773-45ea-82a8-654dd4d9e9cd req-def1461a-1176-48c2-a1e3-e19a446014c6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:59.102991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93dc443c-c773-45ea-82a8-654dd4d9e9cd req-def1461a-1176-48c2-a1e3-e19a446014c6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:59.103417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93dc443c-c773-45ea-82a8-654dd4d9e9cd req-def1461a-1176-48c2-a1e3-e19a446014c6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:59.189964 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-93dc443c-c773-45ea-82a8-654dd4d9e9cd req-def1461a-1176-48c2-a1e3-e19a446014c6 service nova] Creating event network-vif-unplugged:b9177795-35b3-49c5-b902-52e7fe47daf4 for instance 4e532a39-5484-411d-a9d2-cdd0563b2598 on n-h1-860864-8 Oct 12 22:44:59.218854 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-93dc443c-c773-45ea-82a8-654dd4d9e9cd req-def1461a-1176-48c2-a1e3-e19a446014c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.191564 Oct 12 22:44:59.220112 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1490/2877] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:44:59.225550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:44:59.251005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:44:59.289767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:59.294258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:59.297666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:44:59.298823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:44:59.301276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:44:59.311230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:00.311903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:00.353004 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b8304d4-39cf-4760-8662-1b23a1290d2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1477 microversion: 2.1 time: 1.131366 Oct 12 22:45:00.360795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1491/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:44:59 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1477 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:00.401553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-464adc5b-ece8-40ce-9f07-ace5839ad4dc tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffdbbc10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:04.353650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:45:05.430483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Updating instance_info_cache with network_info: [{"id": "87e2c5f7-4b7b-4c50-991c-25981789b40b", "address": "fa:16:3e:52:71:61", "network": {"id": "f64c6777-c07a-466a-865f-0101a7f11e5e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-590207325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee4b81ebc34440298a0313bb30010af2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap87e2c5f7-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:45:05.483611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Releasing lock "refresh_cache-ee03cca8-8cf9-441d-bc35-706e1f84a7b7" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:45:05.486078 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d177a2b9-2d79-49a1-b480-d82c09dc0e60 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action" status: 202 len: 0 microversion: 2.1 time: 7.657800 Oct 12 22:45:05.490219 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1388/2879] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:44:57 2022] POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action => generated 0 bytes in 7663 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:45:05.513383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:05.515670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:05.535097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:05.545230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.547023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.547663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:05.548686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:05.549299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:05.549895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.314075 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-464adc5b-ece8-40ce-9f07-ace5839ad4dc tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 5.945803 Oct 12 22:45:06.316500 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1492/2880] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:00 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 5950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:06.381300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:06.398848 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e46dee65-51c7-4714-8f9e-d8b37824c050 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1369 microversion: 2.1 time: 0.898522 Oct 12 22:45:06.399525 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1389/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:05 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1369 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:06.417298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:06.419599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:06.425647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1160587859", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "ee4cba06-8dfc-4ce7-b0a5-7bc11680e005"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:06.439138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.439711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.440087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.440794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.441247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.441665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.502861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] validate_networks() for [('ee4cba06-8dfc-4ce7-b0a5-7bc11680e005', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:45:06.806600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:06.834858 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dda7ba7e-e5d7-4857-93fc-7668c4754c0b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1477 microversion: 2.1 time: 0.434130 Oct 12 22:45:06.836956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1390/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:06 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1477 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:06.843776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ea911555-8638-4423-9ecd-d334c90483bf req-09a8840f-9af2-4a97-9d44-5f89fd0ec687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee03cca8-8cf9-441d-bc35-706e1f84a7b7", "tag": "87e2c5f7-4b7b-4c50-991c-25981789b40b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:06.859056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ea911555-8638-4423-9ecd-d334c90483bf req-09a8840f-9af2-4a97-9d44-5f89fd0ec687 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:06.860305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ea911555-8638-4423-9ecd-d334c90483bf req-09a8840f-9af2-4a97-9d44-5f89fd0ec687 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:06.860932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ea911555-8638-4423-9ecd-d334c90483bf req-09a8840f-9af2-4a97-9d44-5f89fd0ec687 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:06.880307 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ea911555-8638-4423-9ecd-d334c90483bf req-09a8840f-9af2-4a97-9d44-5f89fd0ec687 service nova] Creating event network-changed:87e2c5f7-4b7b-4c50-991c-25981789b40b for instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 on n-h2-860864-8 Oct 12 22:45:06.889428 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ea911555-8638-4423-9ecd-d334c90483bf req-09a8840f-9af2-4a97-9d44-5f89fd0ec687 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050430 Oct 12 22:45:06.890508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1391/2883] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:06.897718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Action: 'action', calling method: .version_select at 0x7f4505f579d0>, body: {"removeFloatingIp": {"address": "172.25.6.99"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:07.604132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:07.616153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.619050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.623817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.624837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:07.625568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:07.626225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:07.745599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:08.202665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:45:08.206036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:45:08.209171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:45:08.210412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:45:08.211640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:45:08.234711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.236230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.236885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.237882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.238524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.239126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.275407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Getting quotas for project 2a5cfa214fb4470097e017319bd2721a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:45:08.293937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Getting quotas for user 2bfbbae1c72d450ab45ad0ceacbd132e and project 2a5cfa214fb4470097e017319bd2721a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:45:08.329776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:45:08.332122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:45:08.456278 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d818a91d-d391-49dc-a36b-7c0d4e61db05 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138400 Oct 12 22:45:08.466102 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1493/2884] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:45:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:45:08.481763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-b7e5dc10-292c-4cda-b02f-db4e373aea07 req-dbef13f1-3f56-4abe-8107-01cf20818af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62825a95-dac3-4250-b030-3f848dd6505a", "tag": "7e51d1d9-0754-4b09-a8da-4ebe928c84b0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:08.505614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b7e5dc10-292c-4cda-b02f-db4e373aea07 req-dbef13f1-3f56-4abe-8107-01cf20818af1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.506271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b7e5dc10-292c-4cda-b02f-db4e373aea07 req-dbef13f1-3f56-4abe-8107-01cf20818af1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.506696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b7e5dc10-292c-4cda-b02f-db4e373aea07 req-dbef13f1-3f56-4abe-8107-01cf20818af1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.521166 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-b7e5dc10-292c-4cda-b02f-db4e373aea07 req-dbef13f1-3f56-4abe-8107-01cf20818af1 service nova] Creating event network-changed:7e51d1d9-0754-4b09-a8da-4ebe928c84b0 for instance 62825a95-dac3-4250-b030-3f848dd6505a on n-h2-860864-8 Oct 12 22:45:08.527179 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-b7e5dc10-292c-4cda-b02f-db4e373aea07 req-dbef13f1-3f56-4abe-8107-01cf20818af1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058495 Oct 12 22:45:08.531935 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1494/2885] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:08.543163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-de38ab49-d409-42a1-a701-8e5e54a0b8e3 req-fe8be36b-513b-44b4-863c-8c59392d68aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd245f-3ada-4388-b3a8-a26da4e123bd", "name": "network-vif-plugged", "status": "completed", "tag": "4154fce7-7027-4f18-a941-c4e185fbb63b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:08.565028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:08.567476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-de38ab49-d409-42a1-a701-8e5e54a0b8e3 req-fe8be36b-513b-44b4-863c-8c59392d68aa service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.573238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-de38ab49-d409-42a1-a701-8e5e54a0b8e3 req-fe8be36b-513b-44b4-863c-8c59392d68aa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.573917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-de38ab49-d409-42a1-a701-8e5e54a0b8e3 req-fe8be36b-513b-44b4-863c-8c59392d68aa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.603278 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-de38ab49-d409-42a1-a701-8e5e54a0b8e3 req-fe8be36b-513b-44b4-863c-8c59392d68aa service nova] Creating event network-vif-plugged:4154fce7-7027-4f18-a941-c4e185fbb63b for instance e9cd245f-3ada-4388-b3a8-a26da4e123bd on n-h2-860864-8 Oct 12 22:45:08.621259 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-de38ab49-d409-42a1-a701-8e5e54a0b8e3 req-fe8be36b-513b-44b4-863c-8c59392d68aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087616 Oct 12 22:45:08.622144 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1495/2886] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:08.630471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b27f2ded-797b-4074-9a9a-5ce3f34a1f17 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7bf0d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:08.736719 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b27f2ded-797b-4074-9a9a-5ce3f34a1f17 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.111230 Oct 12 22:45:08.747358 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1496/2887] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:08 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:08.753190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:08.753956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:08.792137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.792631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.793066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.793765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:08.804571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:08.805025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:08.948311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "refresh_cache-ee03cca8-8cf9-441d-bc35-706e1f84a7b7" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:45:08.948797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquired lock "refresh_cache-ee03cca8-8cf9-441d-bc35-706e1f84a7b7" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:45:09.144370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:09.152577 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e2f3401-2d52-41de-b9a7-bea21a0497e6 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1369 microversion: 2.1 time: 0.403435 Oct 12 22:45:09.153162 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1497/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:08 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1369 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:09.169146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:09.170094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:09.187332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:09.188072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:09.188681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:09.189536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:09.190127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:09.190700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:09.567540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:09.577112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9dfbbdae-32ac-422f-9212-375562f5d6d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1477 microversion: 2.1 time: 0.419847 Oct 12 22:45:09.583589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1498/2889] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:09 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1477 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:09.598409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-152721071", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "47e3c059-72c7-4ff2-b5bc-345cf19c8858"}, {"port": "6940aca1-b7be-4fa9-b75f-3b146a851a4b", "tag": "port-1"}, {"port": "c6ee8a46-c164-4f82-8d33-fe913c0d99ca", "tag": "port-2"}, {"uuid": "eedb5be1-98f9-4759-a8aa-004003a1770d", "tag": "net-1"}, {"uuid": "eedb5be1-98f9-4759-a8aa-004003a1770d"}, {"uuid": "3563379d-5cb4-4cb5-8c44-91591d2ab0a0", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3563379d-5cb4-4cb5-8c44-91591d2ab0a0", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ea01103e-4d22-4e6b-98a8-868763c81296", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "11cd936d-647f-477c-85d6-4826daab8094", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d5dc6338-d055-4d7a-bdae-57303ea200f6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1237925643"}], "key_name": "tempest-keypair-249118699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:09.959637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] validate_networks() for [('47e3c059-72c7-4ff2-b5bc-345cf19c8858', None, None, None, None, None), (None, None, '6940aca1-b7be-4fa9-b75f-3b146a851a4b', None, None, None), (None, None, 'c6ee8a46-c164-4f82-8d33-fe913c0d99ca', None, None, None), ('eedb5be1-98f9-4759-a8aa-004003a1770d', None, None, None, None, None), ('eedb5be1-98f9-4759-a8aa-004003a1770d', None, None, None, None, None), ('3563379d-5cb4-4cb5-8c44-91591d2ab0a0', '10.2.2.100', None, None, None, None), ('3563379d-5cb4-4cb5-8c44-91591d2ab0a0', '10.2.2.200', None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:45:11.421924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:45:13.356567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Updating instance_info_cache with network_info: [{"id": "87e2c5f7-4b7b-4c50-991c-25981789b40b", "address": "fa:16:3e:52:71:61", "network": {"id": "f64c6777-c07a-466a-865f-0101a7f11e5e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-590207325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee4b81ebc34440298a0313bb30010af2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap87e2c5f7-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:45:13.383373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Releasing lock "refresh_cache-ee03cca8-8cf9-441d-bc35-706e1f84a7b7" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:45:13.384336 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-768cf67a-81b3-4ef3-8eb7-9f83c2bb257f tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action" status: 202 len: 0 microversion: 2.1 time: 6.492508 Oct 12 22:45:13.385306 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1392/2890] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:45:06 2022] POST /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7/action => generated 0 bytes in 6494 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:45:13.390527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:13.394460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:13.411664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.422158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.424471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.427421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.430208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.432310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.571643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:13.590503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b24970f-d1b3-443c-bd79-861225d8daa0 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1286 microversion: 2.1 time: 0.200458 Oct 12 22:45:13.596078 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1393/2891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:13 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:13.607673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21426977-8740-48dd-a73a-608563cac720 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4507af0f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:13.681769 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21426977-8740-48dd-a73a-608563cac720 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.083453 Oct 12 22:45:13.683678 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1394/2892] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:13 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:13.690205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:13.691547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:13.702020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.703145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.704258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.705461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:13.706071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:13.706880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:13.975559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:13.991804 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a3398386-7c49-48db-8934-32412bfda90d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1369 microversion: 2.1 time: 0.306122 Oct 12 22:45:13.991804 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1395/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:13 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1369 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:14.208442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:14.209558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:14.225613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:14.226417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:14.227041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:14.229373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:14.235132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:14.235862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:15.122916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:15.138439 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36bc728c-0931-423a-85fb-282b02a743b3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1477 microversion: 2.1 time: 1.145446 Oct 12 22:45:15.152922 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1396/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:13 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1477 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:15.152922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d9286a17-a1d9-4e1d-b106-5549a8a63b41 req-70aa5f9b-f05e-4f2a-9487-9eeb59a32640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee03cca8-8cf9-441d-bc35-706e1f84a7b7", "tag": "87e2c5f7-4b7b-4c50-991c-25981789b40b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:15.174111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d9286a17-a1d9-4e1d-b106-5549a8a63b41 req-70aa5f9b-f05e-4f2a-9487-9eeb59a32640 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:15.174586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d9286a17-a1d9-4e1d-b106-5549a8a63b41 req-70aa5f9b-f05e-4f2a-9487-9eeb59a32640 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:15.176368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d9286a17-a1d9-4e1d-b106-5549a8a63b41 req-70aa5f9b-f05e-4f2a-9487-9eeb59a32640 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:15.204889 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d9286a17-a1d9-4e1d-b106-5549a8a63b41 req-70aa5f9b-f05e-4f2a-9487-9eeb59a32640 service nova] Creating event network-changed:87e2c5f7-4b7b-4c50-991c-25981789b40b for instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 on n-h2-860864-8 Oct 12 22:45:15.214313 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d9286a17-a1d9-4e1d-b106-5549a8a63b41 req-70aa5f9b-f05e-4f2a-9487-9eeb59a32640 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073392 Oct 12 22:45:15.220848 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1397/2895] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:15.227837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8a6a0ea-d669-432b-82d3-813089fa99bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '.version_select at 0x7f4507c10700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:18.255413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:18.315278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:19.210888 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8a6a0ea-d669-432b-82d3-813089fa99bf tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/fe59681c-1487-42f7-aa6d-341ef87af485" status: 202 len: 0 microversion: 2.1 time: 3.988994 Oct 12 22:45:19.211647 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1398/2896] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:45:15 2022] DELETE /compute/v2.1/os-floating-ips/fe59681c-1487-42f7-aa6d-341ef87af485 => generated 0 bytes in 3991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:19.221416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:19.222329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:19.239287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.250222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.252291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.255873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.256982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.258273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.572540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=54 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:19.954363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:45:19.954664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:45:19.955190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:45:19.955600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:45:19.956106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:45:19.956718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:19.967289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ee4f2b7-e457-4274-89ae-eeddc10d531b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1328 microversion: 2.1 time: 0.753918 Oct 12 22:45:19.971161 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1399/2897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:19 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1328 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:19.971843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.976568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.977242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.978176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:19.979581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:19.980249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:19.985530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56cec14e-f15d-4a82-955b-bb4e2e4ff2fc tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6a11f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:20.048936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Getting quotas for project 81c2331d1e204eea916beba9eec9acf1. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:45:20.068671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Getting quotas for user 4f0b7c499c1d4dd894483b19308e0439 and project 81c2331d1e204eea916beba9eec9acf1. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:45:20.081254 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56cec14e-f15d-4a82-955b-bb4e2e4ff2fc tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.108191 Oct 12 22:45:20.082071 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1400/2898] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:19 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:20.095987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:20.096936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:20.135523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:20.136279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:20.137062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:20.140632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:20.142571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:20.143184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:20.434581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:45:20.437553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ea01103e-4d22-4e6b-98a8-868763c81296',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='11cd936d-647f-477c-85d6-4826daab8094',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5dc6338-d055-4d7a-bdae-57303ea200f6',volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:45:20.538181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:20.548929 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b99862f2-9919-4a39-bb5d-14a5c3b4c222 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1369 microversion: 2.1 time: 0.465027 Oct 12 22:45:20.559500 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1401/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:20 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1369 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:20.564529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-00a8db54-5cd9-4841-95e3-6cba127982c4 req-eade3d82-0b2a-4c0b-aaa9-f68108986440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62825a95-dac3-4250-b030-3f848dd6505a", "name": "network-vif-plugged", "status": "completed", "tag": "7e51d1d9-0754-4b09-a8da-4ebe928c84b0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:20.585982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-00a8db54-5cd9-4841-95e3-6cba127982c4 req-eade3d82-0b2a-4c0b-aaa9-f68108986440 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:20.586748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-00a8db54-5cd9-4841-95e3-6cba127982c4 req-eade3d82-0b2a-4c0b-aaa9-f68108986440 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:20.587409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-00a8db54-5cd9-4841-95e3-6cba127982c4 req-eade3d82-0b2a-4c0b-aaa9-f68108986440 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:20.609167 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-00a8db54-5cd9-4841-95e3-6cba127982c4 req-eade3d82-0b2a-4c0b-aaa9-f68108986440 service nova] Creating event network-vif-plugged:7e51d1d9-0754-4b09-a8da-4ebe928c84b0 for instance 62825a95-dac3-4250-b030-3f848dd6505a on n-h2-860864-8 Oct 12 22:45:20.620711 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-00a8db54-5cd9-4841-95e3-6cba127982c4 req-eade3d82-0b2a-4c0b-aaa9-f68108986440 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059413 Oct 12 22:45:20.625544 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1402/2900] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:20.637115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:20.641640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:20.669865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:20.673400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:20.675911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:20.678582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:20.682044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:20.682506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:21.067840 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1cbbb916-bde6-43f9-bec9-46ba345c3394 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 11.480581 Oct 12 22:45:21.068937 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1499/2901] 10.222.0.20 () {62 vars in 1189 bytes} [Wed Oct 12 22:45:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 11482 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:45:21.079319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-dce8d4ea-0145-4256-8788-ef4c5653e28f req-9698b631-ca7f-42a5-aa0a-8e2cbd7cad2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "name": "network-vif-unplugged", "status": "completed", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:21.098478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:21.103049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dce8d4ea-0145-4256-8788-ef4c5653e28f req-9698b631-ca7f-42a5-aa0a-8e2cbd7cad2d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:21.103789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dce8d4ea-0145-4256-8788-ef4c5653e28f req-9698b631-ca7f-42a5-aa0a-8e2cbd7cad2d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:21.104511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dce8d4ea-0145-4256-8788-ef4c5653e28f req-9698b631-ca7f-42a5-aa0a-8e2cbd7cad2d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:21.110471 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b7555b6-5bf8-4b14-a27d-778a52e30648 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1476 microversion: 2.1 time: 0.482833 Oct 12 22:45:21.129830 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1403/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:20 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1476 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:21.135608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34c9ea9a-85b2-4d44-984d-1b96e9fee74e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '.version_select at 0x7f44ff6e75e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:21.161017 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-dce8d4ea-0145-4256-8788-ef4c5653e28f req-9698b631-ca7f-42a5-aa0a-8e2cbd7cad2d service nova] Creating event network-vif-unplugged:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h2-860864-8 Oct 12 22:45:21.175076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-dce8d4ea-0145-4256-8788-ef4c5653e28f req-9698b631-ca7f-42a5-aa0a-8e2cbd7cad2d service nova] Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:45:21.196913 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-dce8d4ea-0145-4256-8788-ef4c5653e28f req-9698b631-ca7f-42a5-aa0a-8e2cbd7cad2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126195 Oct 12 22:45:21.197878 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1500/2903] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:21.206330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:21.207603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:21.221637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:21.223884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:21.224530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:21.229009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:21.230409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:21.231034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:21.706928 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34c9ea9a-85b2-4d44-984d-1b96e9fee74e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d623b09c-181f-49ff-9396-6e454e1d725b" status: 202 len: 0 microversion: 2.1 time: 0.574928 Oct 12 22:45:21.707919 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1404/2904] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:45:21 2022] DELETE /compute/v2.1/os-security-groups/d623b09c-181f-49ff-9396-6e454e1d725b => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:21.721035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f19dd14-edd2-43be-b3a3-2bfc7966a2f8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:21.723599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f19dd14-edd2-43be-b3a3-2bfc7966a2f8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:21.989478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f19dd14-edd2-43be-b3a3-2bfc7966a2f8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:22.014943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f19dd14-edd2-43be-b3a3-2bfc7966a2f8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:22.017771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f19dd14-edd2-43be-b3a3-2bfc7966a2f8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:22.021850 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f19dd14-edd2-43be-b3a3-2bfc7966a2f8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1284 microversion: 2.42 time: 0.312775 Oct 12 22:45:22.024228 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1405/2905] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:21 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:22.042764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d41514db-f210-4277-8915-0b5a16b236ec tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6e78b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:22.178408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d41514db-f210-4277-8915-0b5a16b236ec tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.150600 Oct 12 22:45:22.179049 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1406/2906] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:22 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:22.192335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:22.193038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:22.202329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.203104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.203753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.204733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.205335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.205992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.305827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:22.323765 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d515261e-b6c9-4fd0-ba71-25c49f6b1168 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1328 microversion: 2.1 time: 1.121351 Oct 12 22:45:22.327001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1501/2907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:21 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1328 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:22.343186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:22.344055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:22.357820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.358317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.358754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.359461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.359928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.360355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.431929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:22.510866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:22.531829 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04e58eb3-6772-4eb1-92e9-6b4cc2e6fe6a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1369 microversion: 2.1 time: 0.351524 Oct 12 22:45:22.532963 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1407/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:22 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1369 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:22.538444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:22.539180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:22.562761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.563341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.563849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.576498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.576928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.580426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.594050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:22.622278 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f523a21b-7daf-4b4a-9ae0-49cf38b0df44 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 204 len: 0 microversion: 2.1 time: 0.293694 Oct 12 22:45:22.630515 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1502/2909] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:22 2022] DELETE /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:22.660352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:22.662275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:22.699061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.704831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.707236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.708247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:22.708889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:22.709729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:22.837476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:22.848289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f179ce8-e70b-479b-8516-1a7e59c4728f tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1476 microversion: 2.1 time: 0.314187 Oct 12 22:45:22.849413 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1408/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:22 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:23.055035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:23.055866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:23.071508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.072353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.073104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.074286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.074767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.075191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.174452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:23.193027 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2269a05-1abd-4faf-b750-d237d524a8c0 tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1510 microversion: 2.1 time: 0.560209 Oct 12 22:45:23.196692 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1503/2911] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:22 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1510 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:23.213118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-feb8b89c-4ddd-457f-a3bc-98364482e8b4 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffe66ee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:23.215281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:23.250197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:23.251663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:23.263811 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-174ef963-ef87-4ab8-9e96-8f9090937f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1574 microversion: 2.42 time: 0.213734 Oct 12 22:45:23.267765 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1409/2912] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:23 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:23.274014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}, {"name": "network-changed", "server_uuid": "29e272b2-1b0c-4f1c-9600-44fa1f0a51cc", "tag": "5cfa9842-c09e-4799-9935-03fae8e64903"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:23.286690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.287474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.288096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.316031 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-feb8b89c-4ddd-457f-a3bc-98364482e8b4 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.116061 Oct 12 22:45:23.318498 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1504/2913] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:23 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:23.364535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] Creating event network-changed:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h2-860864-8 Oct 12 22:45:23.364883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:23.365053 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] Creating event network-changed:5cfa9842-c09e-4799-9935-03fae8e64903 for instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc on n-h1-860864-8 Oct 12 22:45:23.366707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:23.372017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:45:23.378883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.379621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.380434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.381891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.382885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.383662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.387431 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ac6ec4c3-46e7-4426-8923-07eb1d3c9857 req-d43ec3cd-0a84-43d8-8936-e33402ef9c4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.117485 Oct 12 22:45:23.389047 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1410/2914] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:23.558717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:23.559531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:23.584217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.589686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.590592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.592039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.592736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.593432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.842337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:23.889303 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a0c78d7-71c4-467f-bb96-cafc9af49614 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1555 microversion: 2.1 time: 0.335306 Oct 12 22:45:23.913733 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1411/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:23 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1555 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:23.930259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:23.933450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:23.945464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.946874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.947531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:23.954461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:23.955359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:23.957136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:24.692959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:24.711144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08003786-7f14-4242-8f19-da0d043bc185 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1476 microversion: 2.1 time: 0.795094 Oct 12 22:45:24.713174 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1412/2916] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:23 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1476 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:24.724034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:24.730191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:24.730583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:24.733945 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8fa30a13-d7d3-44cf-babe-a0c5a713b07e tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1328 microversion: 2.1 time: 1.381072 Oct 12 22:45:24.734650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1505/2917] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:23 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1328 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:24.744117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:24.744740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:24.750014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:24.750747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:24.753263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:24.754498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:24.755122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:24.756557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:24.775836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:24.784599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:24.785313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:24.786262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:24.787042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:24.787322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.045772 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46f977fd-bffc-4b82-a109-f9a23c82cec7 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.330469 Oct 12 22:45:25.047296 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1413/2918] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:45:24 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-interface => generated 284 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:25.052615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:25.053457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:25.065662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.069346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.070023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.070927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.074812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.075467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.357755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:25.397135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:25.401395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:25.403365 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5377ad5e-9d03-45bb-9365-a2a9cbd1f3c3 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1592 microversion: 2.42 time: 0.354925 Oct 12 22:45:25.408065 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1414/2919] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:25 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1592 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:25.417491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7df03a3c-4f65-4a33-8d93-84534524dcaf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7c7af0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:25.498696 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7df03a3c-4f65-4a33-8d93-84534524dcaf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1454 microversion: 2.1 time: 0.088221 Oct 12 22:45:25.501483 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1415/2920] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:25 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:25.547505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:25.557989 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-afd16f7e-079e-43fe-b62c-acfacef4a94c tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1510 microversion: 2.1 time: 0.822351 Oct 12 22:45:25.558599 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1506/2921] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:24 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1510 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:25.742608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:25.743201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:25.762564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:25.763920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:25.779280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.780051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.780961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.781885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.782537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.783193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.788742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.789470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.790071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:25.790972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:25.791590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:25.792199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:26.288336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:26.300028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b88102c-fb5e-4dd2-8f0e-e9859ace5fcd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1474 microversion: 2.1 time: 0.564199 Oct 12 22:45:26.300624 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1416/2922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:25 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1474 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:26.437928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:26.439109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:26.457360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:26.457883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:26.459210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:26.461298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:26.461752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:26.462367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:26.962924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:26.975604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:26.987056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:26.988564 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1334758-7974-41d2-a4ff-f1ca4a66c601 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1592 microversion: 2.42 time: 0.556354 Oct 12 22:45:26.989343 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1417/2923] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:26 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1592 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:26.994201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-045237b6-6eff-4087-831f-6a097ce7d49f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff774ca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:27.060933 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-045237b6-6eff-4087-831f-6a097ce7d49f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1463 microversion: 2.1 time: 0.070310 Oct 12 22:45:27.061534 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1418/2924] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:26 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1463 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:27.066606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:27.067234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:27.078956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.079467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.079976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:27.080714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.081250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.081719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:27.239302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad039e3f5e944c7c9c190188c1e71bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4b81ebc34440298a0313bb30010af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:27.261134 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-587012f7-16f4-4945-90f1-be086438f63e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 200 len: 1468 microversion: 2.1 time: 0.198146 Oct 12 22:45:27.262770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1419/2925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:27 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 1468 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:27.270516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c9cfc843-4a67-49fc-9434-8d8ee3d19133 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4507c03ee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:27.327682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:27.345377 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7993c210-3201-428d-a75f-16881fe0f05d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1328 microversion: 2.1 time: 1.586726 Oct 12 22:45:27.346895 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1507/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:25 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1328 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:27.355543 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c9cfc843-4a67-49fc-9434-8d8ee3d19133 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 200 len: 1463 microversion: 2.1 time: 0.090518 Oct 12 22:45:27.356685 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1420/2927] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:27 2022] GET /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 1463 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:27.362167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:27.362964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:27.370408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.371129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.372007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:27.372171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:27.373387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:27.373808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.374441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.375213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:27.387451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.388519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.388965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:27.389679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:27.390135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:27.396280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.169665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:28.186442 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67b0d872-a2d8-47ff-993c-7e2608aeee1c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1468 microversion: 2.1 time: 0.819466 Oct 12 22:45:28.190605 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1508/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:27 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1468 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:28.207383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ed67a405-736b-4cc1-beb2-fcd145cf7059 req-4131f76c-a6e9-4cc4-8ffc-00250f5fefdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee03cca8-8cf9-441d-bc35-706e1f84a7b7", "name": "network-vif-deleted", "tag": "87e2c5f7-4b7b-4c50-991c-25981789b40b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:28.250095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ed67a405-736b-4cc1-beb2-fcd145cf7059 req-4131f76c-a6e9-4cc4-8ffc-00250f5fefdd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.250761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ed67a405-736b-4cc1-beb2-fcd145cf7059 req-4131f76c-a6e9-4cc4-8ffc-00250f5fefdd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.251350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ed67a405-736b-4cc1-beb2-fcd145cf7059 req-4131f76c-a6e9-4cc4-8ffc-00250f5fefdd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.260232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:28.273333 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f8abdc31-1967-4b89-b6c3-57e7d9797861 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1471 microversion: 2.1 time: 0.915422 Oct 12 22:45:28.273575 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ed67a405-736b-4cc1-beb2-fcd145cf7059 req-4131f76c-a6e9-4cc4-8ffc-00250f5fefdd service nova] Creating event network-vif-deleted:87e2c5f7-4b7b-4c50-991c-25981789b40b for instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 on n-h2-860864-8 Oct 12 22:45:28.276471 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1421/2929] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:27 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1471 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:28.290885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:28.291666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:28.310690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.311345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.311997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.312554 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ed67a405-736b-4cc1-beb2-fcd145cf7059 req-4131f76c-a6e9-4cc4-8ffc-00250f5fefdd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118882 Oct 12 22:45:28.312893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.313160 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1509/2930] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:28.314239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.314806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.328980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba217be1-5ab2-4491-9cc5-7c4002d06b8c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffc88940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:28.541239 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ba217be1-5ab2-4491-9cc5-7c4002d06b8c tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-10-12T22%3A43%3A05Z" status: 200 len: 2328 microversion: 2.1 time: 0.220361 Oct 12 22:45:28.542275 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1510/2931] 10.222.0.20 () {58 vars in 1199 bytes} [Wed Oct 12 22:45:28 2022] GET /compute/v2.1/images?changes-since=2022-10-12T22%3A43%3A05Z => generated 2328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:28.547663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:28.548658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] [instance: ee03cca8-8cf9-441d-bc35-706e1f84a7b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:28.564284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.569894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.569894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.571013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.571639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.573533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.620449 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] HTTP exception thrown: Instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 could not be found. Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Request method failure captured: Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 HTTP/1.1 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0MgE5j1Xmw6JnILeSL4p_ujIAZcZ_pI6WBszYNQL_KsXQt5Kdc9tqpho0fI2luWVE_BKHHZMqL35uYOxh2UFf4x02cKHmDEH7JBOYi5pKGgeKeTgXcf2pKXmMiusyhfFKqJlq0kNHheUrXAgf_76GNqlB9HWrtFASxwDIR1lsndxk8 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ee4b81ebc34440298a0313bb30010af2 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1564157566 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee4b81ebc34440298a0313bb30010af2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee4b81ebc34440298a0313bb30010af2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee4b81ebc34440298a0313bb30010af2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee4b81ebc34440298a0313bb30010af2"}]}] Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1564157566 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ee4b81ebc34440298a0313bb30010af2 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1564157566 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerRescueTestJSONUnderV235-1564157566-project Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: ad039e3f5e944c7c9c190188c1e71bb6 Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1564157566-project Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 could not be found. Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ee03cca8-8cf9-441d-bc35-706e1f84a7b7'} Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 could not be found. Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 could not be found. Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:28.622149 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 could not be found. Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] Returning 404 to user: Instance ee03cca8-8cf9-441d-bc35-706e1f84a7b7 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:28.632861 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a4d03dc-07e4-4dea-a6b6-607efed1898e tempest-ServerRescueTestJSONUnderV235-1564157566 tempest-ServerRescueTestJSONUnderV235-1564157566-project] 10.222.0.20 "GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7" status: 404 len: 111 microversion: 2.1 time: 0.080373 Oct 12 22:45:28.635966 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1511/2932] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:28 2022] GET /compute/v2.1/servers/ee03cca8-8cf9-441d-bc35-706e1f84a7b7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:28.641045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:28.641566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:28.654543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.654962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.655402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.660537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.661017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.661456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.922353 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c21ccd0-e8ba-4e93-86a2-6cbfe0140284 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "POST /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293/action" status: 202 len: 0 microversion: 2.1 time: 0.283198 Oct 12 22:45:28.925213 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1512/2933] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:45:28 2022] POST /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:28.940055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:28.942861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:28.961330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.962708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.964092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:28.965606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:28.968799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:28.969506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:29.121828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:29.144455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:29.151837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:29.154695 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9508542d-cb8b-4879-a607-c3cfc975f21e tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1660 microversion: 2.42 time: 0.877051 Oct 12 22:45:29.158037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1422/2934] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:28 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1660 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:29.171523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-da88a415-ae84-4467-a59f-5cd795f942bd tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7bf940>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:29.310799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-da88a415-ae84-4467-a59f-5cd795f942bd tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1106866174" status: 200 len: 485 microversion: 2.1 time: 0.151053 Oct 12 22:45:29.311409 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1423/2935] 10.222.0.20 () {58 vars in 1231 bytes} [Wed Oct 12 22:45:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1106866174 => generated 485 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:29.325437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:29.326906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:29.351153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:29.353195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:29.353713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:29.354451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:29.354912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:29.355339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:29.671955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:29.683143 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e7873e06-201f-42eb-ad0d-2385f82b4caa tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1328 microversion: 2.1 time: 0.756475 Oct 12 22:45:29.684948 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1513/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:28 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1328 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:29.721285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8eedaca3-6165-4279-93bc-e66ad378fb0b req-c740e4ff-850b-4f1c-931a-5074a7b9925f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "name": "network-vif-plugged", "status": "completed", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:29.741515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8eedaca3-6165-4279-93bc-e66ad378fb0b req-c740e4ff-850b-4f1c-931a-5074a7b9925f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:29.742209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8eedaca3-6165-4279-93bc-e66ad378fb0b req-c740e4ff-850b-4f1c-931a-5074a7b9925f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:29.742838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8eedaca3-6165-4279-93bc-e66ad378fb0b req-c740e4ff-850b-4f1c-931a-5074a7b9925f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:29.773150 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8eedaca3-6165-4279-93bc-e66ad378fb0b req-c740e4ff-850b-4f1c-931a-5074a7b9925f service nova] Creating event network-vif-plugged:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h2-860864-8 Oct 12 22:45:29.787525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-8eedaca3-6165-4279-93bc-e66ad378fb0b req-c740e4ff-850b-4f1c-931a-5074a7b9925f service nova] Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:45:29.806466 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8eedaca3-6165-4279-93bc-e66ad378fb0b req-c740e4ff-850b-4f1c-931a-5074a7b9925f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102424 Oct 12 22:45:29.807090 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1514/2937] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:29.816351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f5b9bb7-255f-458c-b852-1002daef5c3d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffb17430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:29.857353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:29.865352 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33e786f3-0fef-4b8d-8dde-5d148a1b93d8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1470 microversion: 2.1 time: 0.552444 Oct 12 22:45:29.883155 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1424/2938] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:29 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1470 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:29.897988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0872288b-f8c2-456a-809c-fd837c084bf3 req-8efc7627-8817-4468-8ad6-8c9f65b554a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62825a95-dac3-4250-b030-3f848dd6505a", "tag": "7e51d1d9-0754-4b09-a8da-4ebe928c84b0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:29.919923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0872288b-f8c2-456a-809c-fd837c084bf3 req-8efc7627-8817-4468-8ad6-8c9f65b554a5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:29.920405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0872288b-f8c2-456a-809c-fd837c084bf3 req-8efc7627-8817-4468-8ad6-8c9f65b554a5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:29.920838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0872288b-f8c2-456a-809c-fd837c084bf3 req-8efc7627-8817-4468-8ad6-8c9f65b554a5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:29.944163 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0872288b-f8c2-456a-809c-fd837c084bf3 req-8efc7627-8817-4468-8ad6-8c9f65b554a5 service nova] Creating event network-changed:7e51d1d9-0754-4b09-a8da-4ebe928c84b0 for instance 62825a95-dac3-4250-b030-3f848dd6505a on n-h2-860864-8 Oct 12 22:45:29.965089 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0872288b-f8c2-456a-809c-fd837c084bf3 req-8efc7627-8817-4468-8ad6-8c9f65b554a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079544 Oct 12 22:45:29.965877 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1425/2939] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:29.993706 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f5b9bb7-255f-458c-b852-1002daef5c3d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?server=e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 957 microversion: 2.1 time: 0.185366 Oct 12 22:45:30.008972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-298c5f4b-f575-49a6-bcb1-c420fae88679 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7bf280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.015996 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1515/2940] 10.222.0.20 () {58 vars in 1209 bytes} [Wed Oct 12 22:45:29 2022] GET /compute/v2.1/images?server=e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 957 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:30.069637 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-298c5f4b-f575-49a6-bcb1-c420fae88679 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 484 microversion: 2.1 time: 0.064858 Oct 12 22:45:30.070228 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1426/2941] 10.222.0.20 () {58 vars in 1317 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 484 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:30.083473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4160b91-8ed4-4ced-b48d-e41ff966c8dc tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f45040f1ee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.089514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:30.090285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:30.158929 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4160b91-8ed4-4ced-b48d-e41ff966c8dc tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 484 microversion: 2.1 time: 0.079394 Oct 12 22:45:30.159545 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1516/2942] 10.222.0.20 () {58 vars in 1303 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 484 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:30.174688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e0d101f-042d-4ef6-90b1-474a05bc79a2 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6fb3a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.191742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.192802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:30.204955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:30.205719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:30.206478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:30.207378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:30.212061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:30.212736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:30.398824 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e0d101f-042d-4ef6-90b1-474a05bc79a2 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.227901 Oct 12 22:45:30.400158 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1427/2943] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:30.422414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-653c6711-3c5d-4744-9f13-0addc8fe36d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7afc10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.534315 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-653c6711-3c5d-4744-9f13-0addc8fe36d5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.116392 Oct 12 22:45:30.548671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1428/2944] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:30.565967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-832fbf05-8e85-4302-af59-f813b98255f1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7c70d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.689375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-832fbf05-8e85-4302-af59-f813b98255f1 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.127390 Oct 12 22:45:30.700154 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1429/2945] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:30.709953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ccbf581-5ad3-4d4a-9884-b6675970589f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7c74c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.845134 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ccbf581-5ad3-4d4a-9884-b6675970589f tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-10-12T22%3A43%3A01Z" status: 200 len: 7022 microversion: 2.1 time: 0.138921 Oct 12 22:45:30.845996 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1430/2946] 10.222.0.20 () {58 vars in 1220 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-12T22%3A43%3A01Z => generated 7022 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:30.850617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:30.851351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:30.867963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:30.868468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:30.868913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:30.869645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:30.870096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:30.881040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:31.561536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:31.571610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:31.573107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:31.583173 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-885b51de-ba0c-426d-8398-d53697fcda5d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1660 microversion: 2.42 time: 1.395147 Oct 12 22:45:31.594534 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1517/2947] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1660 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:31.599647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3026421-3a2d-499f-a196-4ae9627a5f87 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffbae670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:31.658870 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3026421-3a2d-499f-a196-4ae9627a5f87 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1106866174" status: 200 len: 665 microversion: 2.1 time: 0.062999 Oct 12 22:45:31.662841 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1518/2948] 10.222.0.20 () {58 vars in 1252 bytes} [Wed Oct 12 22:45:31 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1106866174 => generated 665 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:31.667800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:31.668760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:31.678869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:31.679707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:31.681180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:31.682141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:31.682823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:31.683469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:31.749942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:31.768370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a9fe4957-043b-4bb6-adf3-4255118823fb tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1328 microversion: 2.1 time: 0.917493 Oct 12 22:45:31.769343 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1431/2949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:30 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1328 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:31.792686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2bff5d0-8fc9-4b15-9b54-404315f39581 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4507c103a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:31.907911 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2bff5d0-8fc9-4b15-9b54-404315f39581 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1466 microversion: 2.1 time: 0.133182 Oct 12 22:45:31.910592 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1432/2950] 10.222.0.20 () {58 vars in 1338 bytes} [Wed Oct 12 22:45:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:31.925678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6c024ecb-a2a6-4dca-b882-894d9a66fd81 req-62730776-d621-432b-a0e0-74dc7a5e071b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd245f-3ada-4388-b3a8-a26da4e123bd", "name": "network-vif-unplugged", "status": "completed", "tag": "4154fce7-7027-4f18-a941-c4e185fbb63b"}, {"server_uuid": "29e272b2-1b0c-4f1c-9600-44fa1f0a51cc", "name": "network-vif-plugged", "status": "completed", "tag": "5cfa9842-c09e-4799-9935-03fae8e64903"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:31.954622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6c024ecb-a2a6-4dca-b882-894d9a66fd81 req-62730776-d621-432b-a0e0-74dc7a5e071b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:31.955235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6c024ecb-a2a6-4dca-b882-894d9a66fd81 req-62730776-d621-432b-a0e0-74dc7a5e071b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:31.955781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6c024ecb-a2a6-4dca-b882-894d9a66fd81 req-62730776-d621-432b-a0e0-74dc7a5e071b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:31.987058 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6c024ecb-a2a6-4dca-b882-894d9a66fd81 req-62730776-d621-432b-a0e0-74dc7a5e071b service nova] Creating event network-vif-unplugged:4154fce7-7027-4f18-a941-c4e185fbb63b for instance e9cd245f-3ada-4388-b3a8-a26da4e123bd on n-h2-860864-8 Oct 12 22:45:31.987789 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6c024ecb-a2a6-4dca-b882-894d9a66fd81 req-62730776-d621-432b-a0e0-74dc7a5e071b service nova] Creating event network-vif-plugged:5cfa9842-c09e-4799-9935-03fae8e64903 for instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc on n-h1-860864-8 Oct 12 22:45:32.001288 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6c024ecb-a2a6-4dca-b882-894d9a66fd81 req-62730776-d621-432b-a0e0-74dc7a5e071b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.087137 Oct 12 22:45:32.002982 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1433/2951] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:32.025671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c8a47a6-928c-4cef-a34b-3c771676ce1d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7bf0d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.044790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:32.113375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c8a47a6-928c-4cef-a34b-3c771676ce1d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1466 microversion: 2.1 time: 0.108696 Oct 12 22:45:32.114726 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1434/2952] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1466 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:32.151562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc33d0d7-2c2e-4140-90b6-6e75741404cf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6fba60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.188153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:32.194780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:32.203211 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0bf14432-44dd-4127-9c13-e6fe102e5450 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1470 microversion: 2.1 time: 0.539009 Oct 12 22:45:32.204842 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1519/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:31 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1470 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:32.353667 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc33d0d7-2c2e-4140-90b6-6e75741404cf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7797 microversion: 2.1 time: 0.225221 Oct 12 22:45:32.367940 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1435/2954] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7797 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:32.390011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc433f65-9fb3-4ce2-9e1a-e9ee82ef3fb2 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f45040f1160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.505831 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc433f65-9fb3-4ce2-9e1a-e9ee82ef3fb2 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.123547 Oct 12 22:45:32.518913 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1520/2955] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:32.529859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bebfb58e-187b-4346-b430-e67da5b789eb tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f4507a7dc10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.629654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.630287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:32.646549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:32.647060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:32.647501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:32.651267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:32.654769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:32.654920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:32.665554 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bebfb58e-187b-4346-b430-e67da5b789eb tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/d8a76847-f2a3-4e2c-96d3-13bb62ec0d50" status: 200 len: 784 microversion: 2.1 time: 0.144014 Oct 12 22:45:32.676204 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1436/2956] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/images/d8a76847-f2a3-4e2c-96d3-13bb62ec0d50 => generated 784 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:32.682708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e0aa3a7f-f1b0-43e9-968c-b7632c72dcba tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff64b040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.792747 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e0aa3a7f-f1b0-43e9-968c-b7632c72dcba tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.114173 Oct 12 22:45:32.795497 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1437/2957] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:32.802188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:32.803216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:32.819114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:32.820127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:32.820854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:32.821785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:32.822491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:32.823120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:33.232093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:33.244699 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-83957da0-4fab-4f0a-b7ef-5a1b8f0f419a tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1328 microversion: 2.1 time: 0.447578 Oct 12 22:45:33.246591 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1438/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1328 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:33.254391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-92285a1a-99c0-4ffd-a414-f2db4b268000 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff7c7e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:33.375645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:33.389115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:33.394036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:33.398723 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9926a305-a1de-42e7-a2bc-eff0b6e49c7f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1707 microversion: 2.42 time: 0.777358 Oct 12 22:45:33.401021 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1521/2959] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:32 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1707 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:45:33.409975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:33.413175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:33.434080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:33.434987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:33.435628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:33.436585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:33.437237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:33.437861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:33.894189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:33.903218 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b86809c-78f3-4895-9228-c7af6c3e17b6 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1470 microversion: 2.1 time: 0.496890 Oct 12 22:45:33.904637 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1522/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:33 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1470 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:34.105360 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-92285a1a-99c0-4ffd-a414-f2db4b268000 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057" status: 204 len: 0 microversion: 2.1 time: 0.855742 Oct 12 22:45:34.106289 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1439/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:33 2022] DELETE /compute/v2.1/images/31627602-95f9-452c-8c2e-1d4fb0071057 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:34.114856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb227200-6116-4f44-871b-21dd69b6b0c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff6de550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:34.272987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:34.273857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:34.287558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:34.291025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:34.291833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:34.292939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:34.293570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:34.294721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.057170 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb227200-6116-4f44-871b-21dd69b6b0c5 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a" status: 204 len: 0 microversion: 2.1 time: 0.946051 Oct 12 22:45:35.058339 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1523/2962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:34 2022] DELETE /compute/v2.1/images/33057b3c-f10c-48c6-ab1b-1f2516f0698a => generated 0 bytes in 948 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:35.063820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:35.064478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:35.080020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:35.080924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:35.084073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.085127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:35.086807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:35.088667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.343387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:35.366782 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-28b92ce2-de18-4d57-986f-3d8bb1b5277d tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1527 microversion: 2.1 time: 1.098467 Oct 12 22:45:35.375221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1440/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:34 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1527 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:35.382248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:35.388953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:35.401797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:35.403940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:35.404598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.406979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:35.408622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:35.411882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:35.505899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:35.528063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:35.537987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:35.548497 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-945fa9ad-d8ee-4837-85d6-f166d079a867 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1754 microversion: 2.42 time: 0.481817 Oct 12 22:45:35.552586 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1524/2964] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:35 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1754 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:35.570141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c220df62-0da3-4578-9163-6e687e14713d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff4ec160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:36.514336 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c220df62-0da3-4578-9163-6e687e14713d tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587" status: 204 len: 0 microversion: 2.1 time: 0.959009 Oct 12 22:45:36.518116 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1525/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:35 2022] DELETE /compute/v2.1/images/d471bdd9-465c-462e-8f63-d870c1b59587 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:36.520831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:36.521787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:36.541009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:36.542497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:36.542956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:36.543684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:36.544228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:36.544633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.455011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:37.468767 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-220a2d6c-aa51-4e4a-8414-0760569e38c5 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1527 microversion: 2.1 time: 0.952082 Oct 12 22:45:37.469356 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1526/2966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:36 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1527 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:37.491838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:37.498903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:37.520995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.522267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.522922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.524053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.524774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.525443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.575438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:37.622418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:37.629244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:37.634124 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ba3d014-4429-43a6-a5d8-aad9debce734 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1470 microversion: 2.1 time: 2.257420 Oct 12 22:45:37.638507 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1441/2967] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:35 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1470 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:37.669690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:37.670963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:37.686014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=68 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:37.691123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.693490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.694130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.695855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.697571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.699014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.782179 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42c7abc0-457e-4a43-8876-6fd19bff264b tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 204 len: 0 microversion: 2.1 time: 0.294261 Oct 12 22:45:37.783390 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1527/2968] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:37 2022] DELETE /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:37.870903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:37.873139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:37.879843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.881158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.885101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.886117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.886780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.887378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.925128 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] HTTP exception thrown: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Request method failure captured: Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc HTTP/1.1 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0NrYuKoFgMHe9TbktAAS7X97n1PtBUpflSDP34SL-PKR0CSFpB3n0K7aCoTEVCG6oKPWP4wAHMhM6p9mfYizB6EBrkph8BbJGzvsnGpNd2cWllqwzCSXrVdPMRZ5GGwly6L9dQHYy6fK_Hg0_tLjPidQ3FiVKVyb4UH7WxPK6A7tWQ Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ed6ba42ec2ac4290a1afb629f07c3720 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-70107197 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed6ba42ec2ac4290a1afb629f07c3720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed6ba42ec2ac4290a1afb629f07c3720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed6ba42ec2ac4290a1afb629f07c3720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed6ba42ec2ac4290a1afb629f07c3720"}]}] Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-70107197 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ed6ba42ec2ac4290a1afb629f07c3720 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-70107197 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestMultiTenantJSON-70107197-project Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b09e90f467604629a9ef1d99039dcc56 Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-70107197-project Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '29e272b2-1b0c-4f1c-9600-44fa1f0a51cc'} Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:37.939177 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Returning 404 to user: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b51aa737-7a36-4e79-8ad5-281b15fe9f75 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 404 len: 111 microversion: 2.1 time: 0.156760 Oct 12 22:45:37.945548 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1528/2969] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:37 2022] DELETE /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:37.948221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:37.949375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:37.960759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.961588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.962456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:37.963338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:37.964286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:37.964885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:38.486023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:38.511041 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5aac0f3-7584-42c5-8358-57dfd423d271 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1473 microversion: 2.1 time: 0.564131 Oct 12 22:45:38.514334 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1529/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:37 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1473 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:38.524875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:38.528347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:38.543072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:38.547305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:38.550098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:38.551532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:38.554603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:38.556795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:38.797153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:38.810819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:38.818236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:38.819327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d28d68d4-f08f-4614-94b5-9a8438511e1a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1801 microversion: 2.42 time: 1.161143 Oct 12 22:45:38.819924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1442/2971] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:37 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1801 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:38.831723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:38.832406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:38.850737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:38.857446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:38.857957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:38.858912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:38.862951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:38.864529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.304703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:39.315423 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-efd28f38-0ec5-4424-9b74-499d65396533 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1527 microversion: 2.1 time: 0.799922 Oct 12 22:45:39.319137 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1530/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:38 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1527 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:39.324042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3ea0f0cd-2449-4663-9822-620fa625dee1 req-1518fe12-e24e-4dbe-94f3-afaaa2e3575c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "name": "network-vif-unplugged", "status": "completed", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:39.333174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:39.350624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3ea0f0cd-2449-4663-9822-620fa625dee1 req-1518fe12-e24e-4dbe-94f3-afaaa2e3575c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.351485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3ea0f0cd-2449-4663-9822-620fa625dee1 req-1518fe12-e24e-4dbe-94f3-afaaa2e3575c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.352121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3ea0f0cd-2449-4663-9822-620fa625dee1 req-1518fe12-e24e-4dbe-94f3-afaaa2e3575c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.383924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3ea0f0cd-2449-4663-9822-620fa625dee1 req-1518fe12-e24e-4dbe-94f3-afaaa2e3575c service nova] Creating event network-vif-unplugged:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h1-860864-8 Oct 12 22:45:39.391510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-3ea0f0cd-2449-4663-9822-620fa625dee1 req-1518fe12-e24e-4dbe-94f3-afaaa2e3575c service nova] Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:45:39.429181 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3ea0f0cd-2449-4663-9822-620fa625dee1 req-1518fe12-e24e-4dbe-94f3-afaaa2e3575c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108581 Oct 12 22:45:39.430294 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1531/2973] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:39.437117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Action: 'update', calling method: >, body: {"server": {"name": "29e272b2-1b0c-4f1c-9600-44fa1f0a51cc_new"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:39.443863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:39.448648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:39.455250 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f9f00da-896c-45ad-bd97-8385d8dcfe9d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1470 microversion: 2.1 time: 0.627371 Oct 12 22:45:39.457115 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1443/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:38 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1470 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:39.465496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.466805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.467410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.468317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.468932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.474205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.504204 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] HTTP exception thrown: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Request method failure captured: Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc HTTP/1.1 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 64 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0NrYuKoFgMHe9TbktAAS7X97n1PtBUpflSDP34SL-PKR0CSFpB3n0K7aCoTEVCG6oKPWP4wAHMhM6p9mfYizB6EBrkph8BbJGzvsnGpNd2cWllqwzCSXrVdPMRZ5GGwly6L9dQHYy6fK_Hg0_tLjPidQ3FiVKVyb4UH7WxPK6A7tWQ Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ed6ba42ec2ac4290a1afb629f07c3720 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-70107197 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed6ba42ec2ac4290a1afb629f07c3720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed6ba42ec2ac4290a1afb629f07c3720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed6ba42ec2ac4290a1afb629f07c3720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed6ba42ec2ac4290a1afb629f07c3720"}]}] Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-70107197 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ed6ba42ec2ac4290a1afb629f07c3720 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-70107197 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestMultiTenantJSON-70107197-project Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b09e90f467604629a9ef1d99039dcc56 Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-70107197-project Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "29e272b2-1b0c-4f1c-9600-44fa1f0a51cc_new"}} Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '29e272b2-1b0c-4f1c-9600-44fa1f0a51cc', 'body': {'server': {'name': '29e272b2-1b0c-4f1c-9600-44fa1f0a51cc_new'}}} Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 22:45:39.510421 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] Returning 404 to user: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e7485c81-e35e-4b18-a32c-d50ed05b65b7 tempest-ServersNegativeTestMultiTenantJSON-70107197 tempest-ServersNegativeTestMultiTenantJSON-70107197-project] 10.222.0.20 "PUT /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 404 len: 111 microversion: 2.1 time: 0.080375 Oct 12 22:45:39.515573 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1532/2975] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:45:39 2022] PUT /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:39.524655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:39.525177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:39.539554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.540719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.541486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.542544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.543281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.544736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.545066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:39.545703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:39.559144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.559667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.572450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.573785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.582758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.583405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.589955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:39.798430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7da7d02-cd1f-49f2-b7be-f88cb00c9629 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 204 len: 0 microversion: 2.1 time: 0.277406 Oct 12 22:45:39.799918 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1444/2976] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:39 2022] DELETE /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:39.812905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:39.814599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:39.833657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.834724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.834841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:39.835495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:39.836072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:39.836505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:40.416959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:40.424987 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5fda24e3-0d40-4f47-82e8-85e336365fa6 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1473 microversion: 2.1 time: 0.891197 Oct 12 22:45:40.429019 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1533/2977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:39 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1473 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:40.436935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:40.441954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:40.459860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:40.460492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:40.461009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:40.465114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:40.466330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:40.467022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:40.649997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:40.663630 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d87f8da-95bd-45ce-b8cc-94a1b478215f tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1533 microversion: 2.1 time: 0.858479 Oct 12 22:45:40.665012 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1445/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:39 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1533 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:40.677799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:40.678674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:40.699514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:40.701888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:40.703979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:40.706811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:40.708448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:40.710257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:41.605271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:41.642361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:41.652482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:41.658388 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb87f327-9026-4546-9d71-c98f32839422 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1801 microversion: 2.42 time: 1.227999 Oct 12 22:45:41.663943 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1534/2979] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:40 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1801 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:41.674141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:41.676417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:41.723413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:41.724518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:41.726188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:41.728286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:41.731064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:41.732142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:42.194165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:42.219139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d905a13e-3b22-47a2-a380-680c6ef28c75 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 200 len: 1431 microversion: 2.1 time: 0.546813 Oct 12 22:45:42.219841 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1535/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:41 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 1431 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:42.224961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1b39f947-8315-4c14-ab95-fb2b3f08a90c req-dc74881e-342f-461c-aeaf-d8f96e8d6929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:42.248607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1b39f947-8315-4c14-ab95-fb2b3f08a90c req-dc74881e-342f-461c-aeaf-d8f96e8d6929 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:42.249388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1b39f947-8315-4c14-ab95-fb2b3f08a90c req-dc74881e-342f-461c-aeaf-d8f96e8d6929 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:42.250189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1b39f947-8315-4c14-ab95-fb2b3f08a90c req-dc74881e-342f-461c-aeaf-d8f96e8d6929 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:42.282302 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1b39f947-8315-4c14-ab95-fb2b3f08a90c req-dc74881e-342f-461c-aeaf-d8f96e8d6929 service nova] Creating event network-changed:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h1-860864-8 Oct 12 22:45:42.305613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-1b39f947-8315-4c14-ab95-fb2b3f08a90c req-dc74881e-342f-461c-aeaf-d8f96e8d6929 service nova] Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 22:45:42.326090 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1b39f947-8315-4c14-ab95-fb2b3f08a90c req-dc74881e-342f-461c-aeaf-d8f96e8d6929 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103982 Oct 12 22:45:42.327413 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1536/2981] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:42.333323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:42.334518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:42.345948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:42.346691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:42.348050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:42.348936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:42.352635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:42.353281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:42.521647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:42.536114 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f3e2c9fe-c280-4732-bd24-4c53d4f57060 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1470 microversion: 2.1 time: 1.868151 Oct 12 22:45:42.560260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1446/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:40 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1470 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:42.694254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:42.694956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:42.708057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:42.710902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:42.713412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:42.714517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:42.715341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:42.717390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:42.986034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:43.012047 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-132ba4df-f473-416d-8bdb-2106a8c8545b tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1533 microversion: 2.1 time: 0.683071 Oct 12 22:45:43.029528 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1537/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:42 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1533 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:43.253008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:43.254341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: 4e532a39-5484-411d-a9d2-cdd0563b2598] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:43.275461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.276711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.277329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.281043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.282157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.282788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.305500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] HTTP exception thrown: Instance 4e532a39-5484-411d-a9d2-cdd0563b2598 could not be found. Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Request method failure captured: Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 HTTP/1.1 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0L01IG9QpgL8RtkgVjnMw2cIRHrjI1nRj8fN1WO5Fjl5Vn5NyaTGNVl82vQYzRiQ8mQSfazKm-2-YaUZqTqlVrliDTjXbi2wZ1olJCF5V_JZ-PvWIi_fTXUPLMS8sonQua3XezBGpY4eEOVQBwhZ20nXs-7y5i712kMs-wgdKr3nqQ Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: cbe05abae9e944028fff1f2d5d9e0c3f Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListImageFiltersTestJSON-1763151006 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbe05abae9e944028fff1f2d5d9e0c3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbe05abae9e944028fff1f2d5d9e0c3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbe05abae9e944028fff1f2d5d9e0c3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbe05abae9e944028fff1f2d5d9e0c3f"}]}] Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListImageFiltersTestJSON-1763151006 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: cbe05abae9e944028fff1f2d5d9e0c3f Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1763151006 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListImageFiltersTestJSON-1763151006-project Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 211d2c11280a4cbab2a1fb2596ffa688 Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListImageFiltersTestJSON-1763151006-project Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4e532a39-5484-411d-a9d2-cdd0563b2598 could not be found. Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4e532a39-5484-411d-a9d2-cdd0563b2598'} Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e532a39-5484-411d-a9d2-cdd0563b2598 could not be found. Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e532a39-5484-411d-a9d2-cdd0563b2598 could not be found. Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:43.308365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:43.314431 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:43.314431 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:43.314431 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:43.314431 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:43.314431 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:43.314431 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e532a39-5484-411d-a9d2-cdd0563b2598 could not be found. Oct 12 22:45:43.314431 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:43.322223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Returning 404 to user: Instance 4e532a39-5484-411d-a9d2-cdd0563b2598 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:43.323879 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6064d5d8-58b2-49d4-a1fc-5da8eb873cfe tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598" status: 404 len: 111 microversion: 2.1 time: 0.081027 Oct 12 22:45:43.326437 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1538/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:43 2022] GET /compute/v2.1/servers/4e532a39-5484-411d-a9d2-cdd0563b2598 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:43.343211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:43.343702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:43.360806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.361359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.361820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.362506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.362952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.363367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.410679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:43.440724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:43.534680 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bda6046-dc13-4b39-925d-3f9893cc9192 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 204 len: 0 microversion: 2.1 time: 0.203071 Oct 12 22:45:43.535284 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1539/2985] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:43 2022] DELETE /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:43.547729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:43.551420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:43.567028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.567768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.568397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.569267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.569894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.570479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.652631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:43.684535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:43.686734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:43.689253 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-55702e68-710e-4e54-b702-716f96b29155 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1848 microversion: 2.42 time: 0.999993 Oct 12 22:45:43.691720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1447/2986] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:42 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1848 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:45:43.710330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:43.711129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:43.725047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.725539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.725982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.727033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:43.727495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:43.728286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:43.837099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:43.845704 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-880f2567-14d0-4d98-9677-37ed355920ce tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1474 microversion: 2.1 time: 0.302959 Oct 12 22:45:43.846615 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1540/2987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:43 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:44.036991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:44.038239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:44.053225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.053929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.055800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:44.058743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.059478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.060255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:44.091288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:44.106138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6d8b294-2d26-41ad-a8e3-232f3638852d tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1470 microversion: 2.1 time: 0.412914 Oct 12 22:45:44.106800 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1448/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:43 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:44.210784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:44.242920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cb222db-a744-4489-b587-4e071933d6a1 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1491 microversion: 2.1 time: 0.210845 Oct 12 22:45:44.245124 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1541/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:44 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1491 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:44.294228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9a3e8e1e-6762-48f0-bb72-c6ccd5ecdf64 req-f282ad42-7a4c-49f7-945d-c775b9ab083c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e272b2-1b0c-4f1c-9600-44fa1f0a51cc", "name": "network-vif-deleted", "tag": "5cfa9842-c09e-4799-9935-03fae8e64903"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:44.310228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9a3e8e1e-6762-48f0-bb72-c6ccd5ecdf64 req-f282ad42-7a4c-49f7-945d-c775b9ab083c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.313450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9a3e8e1e-6762-48f0-bb72-c6ccd5ecdf64 req-f282ad42-7a4c-49f7-945d-c775b9ab083c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.314179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9a3e8e1e-6762-48f0-bb72-c6ccd5ecdf64 req-f282ad42-7a4c-49f7-945d-c775b9ab083c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:44.329733 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9a3e8e1e-6762-48f0-bb72-c6ccd5ecdf64 req-f282ad42-7a4c-49f7-945d-c775b9ab083c service nova] Creating event network-vif-deleted:5cfa9842-c09e-4799-9935-03fae8e64903 for instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc on n-h1-860864-8 Oct 12 22:45:44.336973 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9a3e8e1e-6762-48f0-bb72-c6ccd5ecdf64 req-f282ad42-7a4c-49f7-945d-c775b9ab083c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046259 Oct 12 22:45:44.338398 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1449/2990] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:44.533702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f489345f-0ed6-4ea4-8aa6-2e46c102d037 req-2865f04a-0ef1-4522-93c7-ca0aed5c2b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e532a39-5484-411d-a9d2-cdd0563b2598", "name": "network-vif-deleted", "tag": "b9177795-35b3-49c5-b902-52e7fe47daf4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:44.561019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f489345f-0ed6-4ea4-8aa6-2e46c102d037 req-2865f04a-0ef1-4522-93c7-ca0aed5c2b07 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.561685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f489345f-0ed6-4ea4-8aa6-2e46c102d037 req-2865f04a-0ef1-4522-93c7-ca0aed5c2b07 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.564446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f489345f-0ed6-4ea4-8aa6-2e46c102d037 req-2865f04a-0ef1-4522-93c7-ca0aed5c2b07 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:44.581819 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f489345f-0ed6-4ea4-8aa6-2e46c102d037 req-2865f04a-0ef1-4522-93c7-ca0aed5c2b07 service nova] Creating event network-vif-deleted:b9177795-35b3-49c5-b902-52e7fe47daf4 for instance 4e532a39-5484-411d-a9d2-cdd0563b2598 on n-h1-860864-8 Oct 12 22:45:44.587803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f489345f-0ed6-4ea4-8aa6-2e46c102d037 req-2865f04a-0ef1-4522-93c7-ca0aed5c2b07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059006 Oct 12 22:45:44.589100 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1542/2991] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:44.720039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:44.720887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:44.750075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.755877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.756462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:44.759623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.760417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.761043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:44.881343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:44.883432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:44.901125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.904195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.907234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:44.908093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:44.909524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:44.909974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:45.429621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:45.435802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:45.445318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:45.448747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:45.450277 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b4b5e22-11b8-4917-a567-a399dd70434a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1848 microversion: 2.42 time: 0.737115 Oct 12 22:45:45.454076 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1be01380-964a-401d-ac49-28dbb6464baf tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1474 microversion: 2.1 time: 0.583997 Oct 12 22:45:45.464966 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1450/2992] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:44 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1848 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:45:45.466316 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1543/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:44 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1474 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:45.476537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:45.479624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:45.480513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:45.485586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:45.497850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:45.500871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:45.501333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:45.502065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:45.502528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:45.502961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:45.514833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:45.515346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:45.515791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:45.516684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:45.517321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:45.517899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:45.581808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:45.582508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:45.583094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:45.583749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lazy-loading 'fault' on Instance uuid 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:45:45.678989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfbbae1c72d450ab45ad0ceacbd132e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5cfa214fb4470097e017319bd2721a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:45.694928 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c328ce11-1633-4ae3-bf34-378d4b3b7257 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 200 len: 1318 microversion: 2.1 time: 0.227606 Oct 12 22:45:45.696183 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1544/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:45 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:46.482970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:46.484318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:46.497172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:46.501598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:46.502662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:46.503617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:46.505790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:46.506415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:46.584028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:46.592202 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3d685db-c800-471e-964a-09257f0f47e3 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1463 microversion: 2.1 time: 1.125983 Oct 12 22:45:46.592787 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1451/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:45 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1463 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:46.605767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:46.608864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:46.625480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:46.631554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:46.632312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:46.633221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:46.633833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:46.634434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:46.999424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:47.010787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:47.017837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:47.019869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c0127148-7714-46ba-acf8-df5eee8a8e1f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1848 microversion: 2.42 time: 0.542295 Oct 12 22:45:47.020669 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1545/2996] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:46 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1848 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:45:47.045007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:47.045007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:47.058385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:47.059153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:47.059932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:47.061372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:47.061972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:47.062580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:47.507844 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a44acad9-442d-449d-948c-82956d665a46 tempest-MigrationsAdminTest-353225102 tempest-MigrationsAdminTest-353225102-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1614 microversion: 2.1 time: 0.486092 Oct 12 22:45:47.509296 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1546/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:47 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1614 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:47.681328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:47.690674 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd58e2fc-426b-48d1-b6d8-107360da8170 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1474 microversion: 2.1 time: 1.088848 Oct 12 22:45:47.695933 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1452/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:46 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1474 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:47.703249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:47.704093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] [instance: 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:47.717311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:47.718225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:47.718862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:47.719767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:47.720419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:47.720996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:47.724264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54d3130d-ee3e-4337-8026-8db7497d0fd5 tempest-ExtensionsTest-1465232095 tempest-ExtensionsTest-1465232095-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:47.727034 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54d3130d-ee3e-4337-8026-8db7497d0fd5 tempest-ExtensionsTest-1465232095 tempest-ExtensionsTest-1465232095-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.215447 Oct 12 22:45:47.727034 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1547/2999] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 12 22:45:47 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:47.736256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c10c9605-a5a1-40fc-9ffd-9c32a42f2e54 req-3b0e24b8-ebf7-4bae-bea9-6824556aff8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "d69e65b4-1b49-4f2c-9d37-671a6c603a4b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:47.741074 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] HTTP exception thrown: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Request method failure captured: Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc HTTP/1.1 Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0NPac_IBN8fVdgg-4yI6aXUkFPp3BvvkeFrXy2eOBP5NsjgF-nSi5l9lOq2oSpw9QqBDmLXUnVkmB6L6LmJ7XcqPzrei6avkq9--nAHRRJ-o56SYgzZd_AcTNyY1RSmbypSMlj7-VdWySj3_QCC-TU8p8c-9xlgYCEdYUUF2gyL3vA Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 2a5cfa214fb4470097e017319bd2721a Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1055783496 Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a5cfa214fb4470097e017319bd2721a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a5cfa214fb4470097e017319bd2721a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a5cfa214fb4470097e017319bd2721a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a5cfa214fb4470097e017319bd2721a"}]}] Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1055783496 Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 2a5cfa214fb4470097e017319bd2721a Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1055783496 Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1055783496-project Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 2bfbbae1c72d450ab45ad0ceacbd132e Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1055783496-project Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '29e272b2-1b0c-4f1c-9600-44fa1f0a51cc'} Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:47.742962 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. Oct 12 22:45:47.748586 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:47.750347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] Returning 404 to user: Instance 29e272b2-1b0c-4f1c-9600-44fa1f0a51cc could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:47.751713 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-84783677-4aa5-4794-86f2-995821b35f59 tempest-ServersNegativeTestMultiTenantJSON-1055783496 tempest-ServersNegativeTestMultiTenantJSON-1055783496-project] 10.222.0.20 "GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc" status: 404 len: 111 microversion: 2.1 time: 0.053043 Oct 12 22:45:47.762304 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1453/3000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:47 2022] GET /compute/v2.1/servers/29e272b2-1b0c-4f1c-9600-44fa1f0a51cc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:47.767591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:47.768489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:47.777705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:47.778425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:47.779019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:47.780219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:47.781266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:47.781857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:47.785275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c10c9605-a5a1-40fc-9ffd-9c32a42f2e54 req-3b0e24b8-ebf7-4bae-bea9-6824556aff8c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:47.785909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c10c9605-a5a1-40fc-9ffd-9c32a42f2e54 req-3b0e24b8-ebf7-4bae-bea9-6824556aff8c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:47.790992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c10c9605-a5a1-40fc-9ffd-9c32a42f2e54 req-3b0e24b8-ebf7-4bae-bea9-6824556aff8c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:47.816695 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c10c9605-a5a1-40fc-9ffd-9c32a42f2e54 req-3b0e24b8-ebf7-4bae-bea9-6824556aff8c service nova] Creating event network-changed:d69e65b4-1b49-4f2c-9d37-671a6c603a4b for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:45:47.819777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:47.826322 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c10c9605-a5a1-40fc-9ffd-9c32a42f2e54 req-3b0e24b8-ebf7-4bae-bea9-6824556aff8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097848 Oct 12 22:45:47.834190 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1548/3001] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:47.841854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11d9775b-8903-4899-998b-5a1cb09522fd tempest-ExtensionsTest-1465232095 tempest-ExtensionsTest-1465232095-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:47.846180 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11d9775b-8903-4899-998b-5a1cb09522fd tempest-ExtensionsTest-1465232095 tempest-ExtensionsTest-1465232095-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010521 Oct 12 22:45:47.853025 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1549/3002] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Oct 12 22:45:47 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:45:47.983212 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1191b601-161e-4dda-b8ef-402ffd848e2e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 204 len: 0 microversion: 2.1 time: 0.219050 Oct 12 22:45:47.987861 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1454/3003] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:47 2022] DELETE /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:47.997647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:48.003854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:48.017135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:48.020647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:48.024348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:48.025383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:48.026059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:48.027614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:48.056400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:48.057787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:48.071722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:48.074212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:48.076306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:48.084459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:48.085836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:48.086434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:48.521217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:48.533489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e622dbc-99d5-4807-adfb-2be7ef506293 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1469 microversion: 2.1 time: 0.542259 Oct 12 22:45:48.534552 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1550/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:47 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1469 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:48.545465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ae44d8ea-fbec-4d3d-8e00-815254c17d93 req-40211ad4-6282-445f-9c8d-fb876762b3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "name": "network-vif-plugged", "status": "completed", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:48.568959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ae44d8ea-fbec-4d3d-8e00-815254c17d93 req-40211ad4-6282-445f-9c8d-fb876762b3e1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:48.570872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ae44d8ea-fbec-4d3d-8e00-815254c17d93 req-40211ad4-6282-445f-9c8d-fb876762b3e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:48.572909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ae44d8ea-fbec-4d3d-8e00-815254c17d93 req-40211ad4-6282-445f-9c8d-fb876762b3e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:48.600436 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ae44d8ea-fbec-4d3d-8e00-815254c17d93 req-40211ad4-6282-445f-9c8d-fb876762b3e1 service nova] Creating event network-vif-plugged:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h1-860864-8 Oct 12 22:45:48.610501 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ae44d8ea-fbec-4d3d-8e00-815254c17d93 req-40211ad4-6282-445f-9c8d-fb876762b3e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074528 Oct 12 22:45:48.613543 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1551/3005] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:48.721368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:48.722293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:48.729355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:48.730102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:48.730602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:48.732097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:48.732764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:48.733408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:49.127097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:49.140259 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65c0f0ae-1392-44c7-bcc0-0e8127ec1b1a tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1474 microversion: 2.1 time: 0.423840 Oct 12 22:45:49.163226 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1552/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:48 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:49.564052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:49.572056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:49.588043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:49.588891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:49.589696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:49.591085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:49.592142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:49.593524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:49.633915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:49.649652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:49.651144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:49.660357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90246529-d935-4731-8cb5-46b817a49fb5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1848 microversion: 2.42 time: 1.610950 Oct 12 22:45:49.661247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1455/3007] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:48 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1848 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:45:49.866580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-90d0570f-2be8-48f2-88d8-58d6f5a865cd req-b4ffcc18-29d9-4066-be6a-a1d047ddee01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cd245f-3ada-4388-b3a8-a26da4e123bd", "name": "network-vif-deleted", "tag": "4154fce7-7027-4f18-a941-c4e185fbb63b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:49.883548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-90d0570f-2be8-48f2-88d8-58d6f5a865cd req-b4ffcc18-29d9-4066-be6a-a1d047ddee01 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:49.884374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-90d0570f-2be8-48f2-88d8-58d6f5a865cd req-b4ffcc18-29d9-4066-be6a-a1d047ddee01 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:49.894041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-90d0570f-2be8-48f2-88d8-58d6f5a865cd req-b4ffcc18-29d9-4066-be6a-a1d047ddee01 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:49.915084 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-90d0570f-2be8-48f2-88d8-58d6f5a865cd req-b4ffcc18-29d9-4066-be6a-a1d047ddee01 service nova] Creating event network-vif-deleted:4154fce7-7027-4f18-a941-c4e185fbb63b for instance e9cd245f-3ada-4388-b3a8-a26da4e123bd on n-h2-860864-8 Oct 12 22:45:49.924542 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-90d0570f-2be8-48f2-88d8-58d6f5a865cd req-b4ffcc18-29d9-4066-be6a-a1d047ddee01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061525 Oct 12 22:45:49.925883 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1456/3008] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:50.170460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:50.171249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:50.183208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:50.186060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:50.186732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:50.187762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:50.190044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:50.190951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:50.198633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:50.248598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:50.249094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:50.265231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:50.265888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lazy-loading 'fault' on Instance uuid e9cd245f-3ada-4388-b3a8-a26da4e123bd {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:45:50.357085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211d2c11280a4cbab2a1fb2596ffa688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe05abae9e944028fff1f2d5d9e0c3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:50.378060 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d6d4214-ca18-4542-a683-c020cb83e10e tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 200 len: 1308 microversion: 2.1 time: 0.212367 Oct 12 22:45:50.379523 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1457/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:50 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:45:50.691953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:50.692655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:50.705520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:50.706807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:50.707262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:50.708030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:50.708966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:50.709413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:50.859967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:50.873219 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7bf3ac07-ee30-4d11-b994-c45d5e691b1e tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1469 microversion: 2.1 time: 1.314873 Oct 12 22:45:50.874185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1553/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:49 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1469 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:51.207084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:51.217242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:51.218829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:51.220145 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ccbbe25-7ea1-4563-a642-d4216572a9e8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1857 microversion: 2.42 time: 0.532926 Oct 12 22:45:51.220850 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1458/3011] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:50 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1857 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:45:51.404050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:51.404868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] [instance: e9cd245f-3ada-4388-b3a8-a26da4e123bd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:51.412610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:51.414068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:51.414677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:51.415487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:51.416926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:51.417453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:51.439620 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] HTTP exception thrown: Instance e9cd245f-3ada-4388-b3a8-a26da4e123bd could not be found. Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Request method failure captured: Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd HTTP/1.1 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0L01IG9QpgL8RtkgVjnMw2cIRHrjI1nRj8fN1WO5Fjl5Vn5NyaTGNVl82vQYzRiQ8mQSfazKm-2-YaUZqTqlVrliDTjXbi2wZ1olJCF5V_JZ-PvWIi_fTXUPLMS8sonQua3XezBGpY4eEOVQBwhZ20nXs-7y5i712kMs-wgdKr3nqQ Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: cbe05abae9e944028fff1f2d5d9e0c3f Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListImageFiltersTestJSON-1763151006 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbe05abae9e944028fff1f2d5d9e0c3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbe05abae9e944028fff1f2d5d9e0c3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbe05abae9e944028fff1f2d5d9e0c3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbe05abae9e944028fff1f2d5d9e0c3f"}]}] Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListImageFiltersTestJSON-1763151006 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: cbe05abae9e944028fff1f2d5d9e0c3f Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1763151006 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListImageFiltersTestJSON-1763151006-project Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 211d2c11280a4cbab2a1fb2596ffa688 Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListImageFiltersTestJSON-1763151006-project Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance e9cd245f-3ada-4388-b3a8-a26da4e123bd could not be found. Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'e9cd245f-3ada-4388-b3a8-a26da4e123bd'} Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cd245f-3ada-4388-b3a8-a26da4e123bd could not be found. Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cd245f-3ada-4388-b3a8-a26da4e123bd could not be found. Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:51.442091 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:51.450944 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:51.450944 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:51.450944 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:51.450944 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:51.450944 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:51.450944 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cd245f-3ada-4388-b3a8-a26da4e123bd could not be found. Oct 12 22:45:51.450944 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:51.455729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Returning 404 to user: Instance e9cd245f-3ada-4388-b3a8-a26da4e123bd could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:51.457284 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-068a464a-6901-4fbf-869a-4fe11dd94974 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd" status: 404 len: 111 microversion: 2.1 time: 0.058241 Oct 12 22:45:51.461955 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1554/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:51 2022] GET /compute/v2.1/servers/e9cd245f-3ada-4388-b3a8-a26da4e123bd => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:51.467319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7c8e6704-68c5-4c55-b5cc-02b0af05dd78 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffe55670>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:51.853938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-22363a8a-d9b3-4530-9620-92483a61124b req-b09d15ae-4002-48cb-9759-219b54473658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd0a21a-8836-4048-a5f8-0b96a99fd293", "name": "network-vif-deleted", "tag": "d50b513e-8be6-47e7-9cb9-c861e5e43c18"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:51.886228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-22363a8a-d9b3-4530-9620-92483a61124b req-b09d15ae-4002-48cb-9759-219b54473658 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:51.895651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-22363a8a-d9b3-4530-9620-92483a61124b req-b09d15ae-4002-48cb-9759-219b54473658 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:51.895651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-22363a8a-d9b3-4530-9620-92483a61124b req-b09d15ae-4002-48cb-9759-219b54473658 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:51.915396 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-22363a8a-d9b3-4530-9620-92483a61124b req-b09d15ae-4002-48cb-9759-219b54473658 service nova] Creating event network-vif-deleted:d50b513e-8be6-47e7-9cb9-c861e5e43c18 for instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 on n-h1-860864-8 Oct 12 22:45:51.924788 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-22363a8a-d9b3-4530-9620-92483a61124b req-b09d15ae-4002-48cb-9759-219b54473658 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074597 Oct 12 22:45:51.925889 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1555/3013] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:45:51.933606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:51.935269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:51.942655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:51.943354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:51.943971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:51.944879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:51.945487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:51.946136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:52.222899 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7c8e6704-68c5-4c55-b5cc-02b0af05dd78 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/images/ced75165-1b63-4715-9c4e-cb65adb2a59d" status: 204 len: 0 microversion: 2.1 time: 0.759609 Oct 12 22:45:52.223959 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1459/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:51 2022] DELETE /compute/v2.1/images/ced75165-1b63-4715-9c4e-cb65adb2a59d => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:52.238267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fc43b893-70ef-4f45-bc13-3491d3f4e80a req-025850d7-29cf-40e6-bcdd-6729d6745a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "6940aca1-b7be-4fa9-b75f-3b146a851a4b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:52.264686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fc43b893-70ef-4f45-bc13-3491d3f4e80a req-025850d7-29cf-40e6-bcdd-6729d6745a53 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:52.265433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fc43b893-70ef-4f45-bc13-3491d3f4e80a req-025850d7-29cf-40e6-bcdd-6729d6745a53 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:52.266073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fc43b893-70ef-4f45-bc13-3491d3f4e80a req-025850d7-29cf-40e6-bcdd-6729d6745a53 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:52.296929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:52.308073 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fc43b893-70ef-4f45-bc13-3491d3f4e80a req-025850d7-29cf-40e6-bcdd-6729d6745a53 service nova] Creating event network-changed:6940aca1-b7be-4fa9-b75f-3b146a851a4b for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:45:52.314581 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fc43b893-70ef-4f45-bc13-3491d3f4e80a req-025850d7-29cf-40e6-bcdd-6729d6745a53 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088484 Oct 12 22:45:52.314825 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9fe87141-0a44-4a68-a224-bb66c9994d5a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 200 len: 1298 microversion: 2.1 time: 0.385888 Oct 12 22:45:52.316350 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1460/3015] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:52.318193 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1556/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:51 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 1298 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:52.323404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-256daa4e-907f-4239-a2e7-4a07253f3847 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ff8caee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:52.340634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:52.342044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:52.349819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:52.350618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:52.351247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:52.352150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:52.352757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:52.353968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.108192 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-256daa4e-907f-4239-a2e7-4a07253f3847 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/images/fa8ca348-1ee3-45a2-b647-7768b0df181b" status: 204 len: 0 microversion: 2.1 time: 0.790402 Oct 12 22:45:53.108796 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1461/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:52 2022] DELETE /compute/v2.1/images/fa8ca348-1ee3-45a2-b647-7768b0df181b => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:53.117054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3831e50-293f-41b9-8b71-165b8b40b665 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] Calling method '.version_select at 0x7f44ffefcb80>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:53.680933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:53.710049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:53.713498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:53.720505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c6b6476-3041-4c27-a17f-ad5a7f0a6240 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.397662 Oct 12 22:45:53.722580 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1557/3018] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:52 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:53.736028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:53.740105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 0fd0a21a-8836-4048-a5f8-0b96a99fd293] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:53.756537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:53.757304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:53.758871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.760703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:53.763915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:53.764586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.806299 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] HTTP exception thrown: Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 could not be found. Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Request method failure captured: Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 HTTP/1.1 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0JJnxwHsZUV7lesOEWUgRlGhnO4vLtPydY5Tzin3nABM8lwAve8kT7eOQlNwd4M7M2pP0p1Xg2zrKwi4ZH3tJuWl_os452pSMHuqJs2JnxiydtiiN_pKPTX2bpbbcfGLzZBYgm4JM2_Dx_D9NIVD9-lX9w0tvqn2hXKpjr5n8p-6k8 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}] Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-MigrationsAdminTest-987629196 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-MigrationsAdminTest-987629196-project Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 70dbe0c8a7784391a83066cb1cb74604 Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-MigrationsAdminTest-987629196-project Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 could not be found. Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '0fd0a21a-8836-4048-a5f8-0b96a99fd293'} Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 could not be found. Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 could not be found. Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:53.811389 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 could not be found. Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Returning 404 to user: Instance 0fd0a21a-8836-4048-a5f8-0b96a99fd293 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:53.816889 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21309479-d8b3-456b-b01b-41750c77c332 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293" status: 404 len: 111 microversion: 2.1 time: 0.086889 Oct 12 22:45:53.822696 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1558/3019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:53 2022] GET /compute/v2.1/servers/0fd0a21a-8836-4048-a5f8-0b96a99fd293 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:53.838029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:53.839214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:53.847080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:53.848258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:53.849090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.850216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:53.850956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:53.851563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:53.910066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:45:53.966056 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3831e50-293f-41b9-8b71-165b8b40b665 tempest-ListImageFiltersTestJSON-1763151006 tempest-ListImageFiltersTestJSON-1763151006-project] 10.222.0.20 "DELETE /compute/v2.1/images/8af52094-f055-41a8-a434-2a4c02f163f8" status: 204 len: 0 microversion: 2.1 time: 0.853064 Oct 12 22:45:53.966643 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1462/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:53 2022] DELETE /compute/v2.1/images/8af52094-f055-41a8-a434-2a4c02f163f8 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:45:54.024307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:45:54.133383 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-149e505c-b7ea-45f8-83cf-51e04008a0d9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "DELETE /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 204 len: 0 microversion: 2.1 time: 0.305518 Oct 12 22:45:54.136088 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1559/3021] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:45:53 2022] DELETE /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:45:54.144571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:54.145323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:54.167614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:54.169483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:54.169947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:54.170696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:54.171163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:54.171593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:54.399538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f01e3619-05df-4ac9-967f-2106be3e13de req-87dc3601-3c62-4f0d-920d-dad4f2a3ca55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "c6ee8a46-c164-4f82-8d33-fe913c0d99ca"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:54.422522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f01e3619-05df-4ac9-967f-2106be3e13de req-87dc3601-3c62-4f0d-920d-dad4f2a3ca55 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:54.423617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f01e3619-05df-4ac9-967f-2106be3e13de req-87dc3601-3c62-4f0d-920d-dad4f2a3ca55 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:54.424274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f01e3619-05df-4ac9-967f-2106be3e13de req-87dc3601-3c62-4f0d-920d-dad4f2a3ca55 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:54.452994 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f01e3619-05df-4ac9-967f-2106be3e13de req-87dc3601-3c62-4f0d-920d-dad4f2a3ca55 service nova] Creating event network-changed:c6ee8a46-c164-4f82-8d33-fe913c0d99ca for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:45:54.464285 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f01e3619-05df-4ac9-967f-2106be3e13de req-87dc3601-3c62-4f0d-920d-dad4f2a3ca55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069635 Oct 12 22:45:54.467077 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1560/3022] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:54.754658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:54.756072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:54.770432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:54.773209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:54.774067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:54.778667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:54.788128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:54.789064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:54.789691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:54.791160 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2170f6ff-8de3-40c1-8d19-04506abf7ac8 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1535 microversion: 2.1 time: 0.649916 Oct 12 22:45:54.804577 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1463/3023] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:54 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1535 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:55.781170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:55.797053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:55.803123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:55.804367 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56a9b066-0d41-4905-b439-5f24db0dd45d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.056195 Oct 12 22:45:55.805034 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1561/3024] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:54 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:45:55.821665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:55.822555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:55.837869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:55.840612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:55.843085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:55.844777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:55.845817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:55.848389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:56.835679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:56.836969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:56.853270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:56.856995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:56.857824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:56.858928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:56.859543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:56.861660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:57.501506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:57.536883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:57.542500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:57.543816 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8d3112b-1e01-4d6d-8359-fb79152043bd tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.713016 Oct 12 22:45:57.546822 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1562/3025] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:56 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:45:57.577883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9d2d5e68-7fba-491d-847d-bb96ec9ba56a req-47992c00-9a5c-45bd-ba49-d60179b08fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "c43ff5fc-65d2-467c-a135-f05491f4289a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:57.612480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9d2d5e68-7fba-491d-847d-bb96ec9ba56a req-47992c00-9a5c-45bd-ba49-d60179b08fbd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:57.613295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9d2d5e68-7fba-491d-847d-bb96ec9ba56a req-47992c00-9a5c-45bd-ba49-d60179b08fbd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:57.616673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9d2d5e68-7fba-491d-847d-bb96ec9ba56a req-47992c00-9a5c-45bd-ba49-d60179b08fbd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:57.646304 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9d2d5e68-7fba-491d-847d-bb96ec9ba56a req-47992c00-9a5c-45bd-ba49-d60179b08fbd service nova] Creating event network-changed:c43ff5fc-65d2-467c-a135-f05491f4289a for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:45:57.660978 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9d2d5e68-7fba-491d-847d-bb96ec9ba56a req-47992c00-9a5c-45bd-ba49-d60179b08fbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112412 Oct 12 22:45:57.662466 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1563/3026] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:45:57.853157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:57.864739 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4d50f4a-e8bb-431c-86c1-44bed059e525 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 200 len: 1535 microversion: 2.1 time: 2.047215 Oct 12 22:45:57.896863 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1464/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:55 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 1535 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:45:58.576568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:58.577326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:58.625157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:58.628546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:58.629196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:58.630159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:58.633678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:58.636197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:58.669388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcdd76b8-b42b-49ee-8c3b-08a101885af6"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:45:58.672717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:58.682871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:58.684464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:58.685188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:58.686247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:58.687013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:58.687718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:59.168872 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6aa71f84-15aa-4af5-ae4b-99a542401cea tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "POST /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501764 Oct 12 22:45:59.170812 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1465/3028] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 22:45:58 2022] POST /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:45:59.208247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:59.212511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:45:59.240155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:59.243102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:59.243573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:59.247797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:45:59.248353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:45:59.251013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:45:59.289860 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] HTTP exception thrown: Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc could not be found. Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Request method failure captured: Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc HTTP/1.1 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0JJnxwHsZUV7lesOEWUgRlGhnO4vLtPydY5Tzin3nABM8lwAve8kT7eOQlNwd4M7M2pP0p1Xg2zrKwi4ZH3tJuWl_os452pSMHuqJs2JnxiydtiiN_pKPTX2bpbbcfGLzZBYgm4JM2_Dx_D9NIVD9-lX9w0tvqn2hXKpjr5n8p-6k8 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}] Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MigrationsAdminTest-987629196 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MigrationsAdminTest-987629196-project Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 70dbe0c8a7784391a83066cb1cb74604 Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MigrationsAdminTest-987629196-project Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc could not be found. Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '530192e6-0cfe-4dc6-96ce-063b4e5fbbbc'} Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc could not be found. Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc could not be found. Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:45:59.291599 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc could not be found. Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Returning 404 to user: Instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:45:59.296077 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-252f79ce-9c61-4b35-aea0-2f4b42be0b5b tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc" status: 404 len: 111 microversion: 2.1 time: 0.102984 Oct 12 22:45:59.299679 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1466/3029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:45:59 2022] GET /compute/v2.1/servers/530192e6-0cfe-4dc6-96ce-063b4e5fbbbc => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:45:59.313763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f0de0355-00ed-4eb7-a937-f975d3b46598 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '.version_select at 0x7f4507c03700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:45:59.378972 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f0de0355-00ed-4eb7-a937-f975d3b46598 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986030539" status: 202 len: 0 microversion: 2.1 time: 0.078154 Oct 12 22:45:59.379586 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1467/3030] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 22:45:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986030539 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:45:59.737617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:59.748906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:59.762879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:45:59.764457 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ecbf2fc-b3b1-413a-bc46-878ed1b6c042 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.194693 Oct 12 22:45:59.788170 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1564/3031] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:45:58 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:00.045641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-65e93ace-93dd-48e7-9e88-08c240a482f0 req-0b2ddfc3-9db2-486d-9854-632aa2f1288c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530192e6-0cfe-4dc6-96ce-063b4e5fbbbc", "name": "network-vif-deleted", "tag": "799765a4-d098-4fb2-a9ac-f48d7065be51"}, {"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:00.062940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-65e93ace-93dd-48e7-9e88-08c240a482f0 req-0b2ddfc3-9db2-486d-9854-632aa2f1288c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:00.063539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-65e93ace-93dd-48e7-9e88-08c240a482f0 req-0b2ddfc3-9db2-486d-9854-632aa2f1288c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:00.064230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-65e93ace-93dd-48e7-9e88-08c240a482f0 req-0b2ddfc3-9db2-486d-9854-632aa2f1288c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:00.092308 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-65e93ace-93dd-48e7-9e88-08c240a482f0 req-0b2ddfc3-9db2-486d-9854-632aa2f1288c service nova] Creating event network-vif-deleted:799765a4-d098-4fb2-a9ac-f48d7065be51 for instance 530192e6-0cfe-4dc6-96ce-063b4e5fbbbc on n-h1-860864-8 Oct 12 22:46:00.092830 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-65e93ace-93dd-48e7-9e88-08c240a482f0 req-0b2ddfc3-9db2-486d-9854-632aa2f1288c service nova] Creating event network-changed:dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:46:00.107999 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-65e93ace-93dd-48e7-9e88-08c240a482f0 req-0b2ddfc3-9db2-486d-9854-632aa2f1288c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.372779 Oct 12 22:46:00.108633 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1468/3032] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:46:00.792789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:00.793983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:00.804895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:00.808301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:00.808760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:00.809517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:00.809980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:00.810417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:02.264397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3adf480d-6b59-42da-bb03-4018a9d22087 req-2489c8a7-18b2-4ab0-889a-c09b2ad5c02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "54928122-32c5-4bfb-bd09-eefd47b387a4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:02.285240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3adf480d-6b59-42da-bb03-4018a9d22087 req-2489c8a7-18b2-4ab0-889a-c09b2ad5c02c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:02.286157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3adf480d-6b59-42da-bb03-4018a9d22087 req-2489c8a7-18b2-4ab0-889a-c09b2ad5c02c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:02.287015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3adf480d-6b59-42da-bb03-4018a9d22087 req-2489c8a7-18b2-4ab0-889a-c09b2ad5c02c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:02.310289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3adf480d-6b59-42da-bb03-4018a9d22087 req-2489c8a7-18b2-4ab0-889a-c09b2ad5c02c service nova] Creating event network-changed:54928122-32c5-4bfb-bd09-eefd47b387a4 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:46:02.317521 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3adf480d-6b59-42da-bb03-4018a9d22087 req-2489c8a7-18b2-4ab0-889a-c09b2ad5c02c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065186 Oct 12 22:46:02.318898 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1469/3033] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:02.492708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:02.517776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:02.523703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:02.534811 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a4c753d-6606-4f84-a658-60d30eb1c81c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.738066 Oct 12 22:46:02.552489 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1565/3034] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:00 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:03.132793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:03.133981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:03.149465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:03.149964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:03.155130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:03.160138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:03.160872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:03.161483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:03.238476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:46:03.441641 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a678ccd9-6494-4ae2-8399-a69134b6a0e9 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 204 len: 0 microversion: 2.1 time: 0.313195 Oct 12 22:46:03.443175 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1470/3035] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:46:03 2022] DELETE /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:46:03.451870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:03.452811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:03.465025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:03.466326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:03.468958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:03.470013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:03.470880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:03.472224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:03.574586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:03.576248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:03.597589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:03.598103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:03.603348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:03.604551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:03.607519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:03.611111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:03.875031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:03.883982 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5495a753-ddda-4655-8d8f-27842bbfb8e2 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1469 microversion: 2.1 time: 0.436807 Oct 12 22:46:03.888865 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1566/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:03 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1469 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:04.911678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:04.912349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:04.926663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:04.929015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:04.930187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:04.933444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:04.935563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:04.936872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:05.315366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:05.332875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:05.334559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:05.338508 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1bec5599-0bf0-4659-b151-345879ad18b1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.771875 Oct 12 22:46:05.339126 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1471/3037] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:03 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:05.599855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:05.610484 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac4c5146-b50e-47b6-aa20-81906059fc73 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1469 microversion: 2.1 time: 0.703469 Oct 12 22:46:05.613655 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1567/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:04 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1469 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:05.946632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3df5929e-a8f2-4746-9980-896e359b2656 req-bb9541d1-3056-4520-9d4d-998dea6024d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5082b3ef-e43c-4503-938b-e856b9c5a272", "name": "network-vif-deleted", "tag": "11b8e391-b7ba-4cd7-b504-3bf4098f27bc"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:05.967786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3df5929e-a8f2-4746-9980-896e359b2656 req-bb9541d1-3056-4520-9d4d-998dea6024d7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:05.970352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3df5929e-a8f2-4746-9980-896e359b2656 req-bb9541d1-3056-4520-9d4d-998dea6024d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:05.971249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3df5929e-a8f2-4746-9980-896e359b2656 req-bb9541d1-3056-4520-9d4d-998dea6024d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:05.997340 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3df5929e-a8f2-4746-9980-896e359b2656 req-bb9541d1-3056-4520-9d4d-998dea6024d7 service nova] Creating event network-vif-deleted:11b8e391-b7ba-4cd7-b504-3bf4098f27bc for instance 5082b3ef-e43c-4503-938b-e856b9c5a272 on n-h1-860864-8 Oct 12 22:46:06.010126 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3df5929e-a8f2-4746-9980-896e359b2656 req-bb9541d1-3056-4520-9d4d-998dea6024d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067183 Oct 12 22:46:06.015978 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1472/3039] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:06.365019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:06.366439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:06.378797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:06.379410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:06.379715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:06.380643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:06.380989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:06.381373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:06.641245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:06.642581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:06.660646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:06.661351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:06.661999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:06.664530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:06.665476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:06.666848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:06.774733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:06.776084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:06.776084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:06.776350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lazy-loading 'fault' on Instance uuid 5082b3ef-e43c-4503-938b-e856b9c5a272 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:46:06.878455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:06.891216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:06.893843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:06.895734 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3f1d8d5e-6fa2-4704-b0c3-037726fb1a7a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.534699 Oct 12 22:46:06.897048 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1568/3040] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:06 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:07.052534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:07.063857 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f718f68a-0fd2-4491-a5ce-8e08e7d1a94a tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 200 len: 1303 microversion: 2.1 time: 0.428518 Oct 12 22:46:07.064741 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1473/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:06 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 1303 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:07.923085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:07.924123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:07.933575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:07.935643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:07.937703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:07.938754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:07.940018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:07.940553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.094122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:08.094905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 5082b3ef-e43c-4503-938b-e856b9c5a272] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:08.109308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:08.111605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.127180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.128012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.128867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.129789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.130331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.222787 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] HTTP exception thrown: Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 could not be found. Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Request method failure captured: Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 HTTP/1.1 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0JJnxwHsZUV7lesOEWUgRlGhnO4vLtPydY5Tzin3nABM8lwAve8kT7eOQlNwd4M7M2pP0p1Xg2zrKwi4ZH3tJuWl_os452pSMHuqJs2JnxiydtiiN_pKPTX2bpbbcfGLzZBYgm4JM2_Dx_D9NIVD9-lX9w0tvqn2hXKpjr5n8p-6k8 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}] Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MigrationsAdminTest-987629196 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MigrationsAdminTest-987629196-project Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 70dbe0c8a7784391a83066cb1cb74604 Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MigrationsAdminTest-987629196-project Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 could not be found. Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5082b3ef-e43c-4503-938b-e856b9c5a272'} Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 could not be found. Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 could not be found. Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:08.229609 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:08.237467 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:08.237467 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:08.237467 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:08.237467 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:08.237467 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:08.237467 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 could not be found. Oct 12 22:46:08.237467 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:08.240708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Returning 404 to user: Instance 5082b3ef-e43c-4503-938b-e856b9c5a272 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:08.243711 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d13c61a-d015-4419-b52c-52aeb2987463 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272" status: 404 len: 111 microversion: 2.1 time: 0.152077 Oct 12 22:46:08.248808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1474/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:08 2022] GET /compute/v2.1/servers/5082b3ef-e43c-4503-938b-e856b9c5a272 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:46:08.262602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:08.263351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:08.281624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.282414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.283814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.289409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.290143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.290944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.347484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:46:08.494320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:08.517923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:08.523258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:08.531121 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d953ab3-7118-4fe7-a963-35060231cfdf tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.609143 Oct 12 22:46:08.532978 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1569/3043] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:07 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:08.546791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-76ff66f0-e24b-4d5d-90f4-db661f3ab3b0 req-7adf64b5-f50d-4211-8d74-1368bf25d59b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "3fc4d68f-7b6b-4043-a00d-08e89eb886f3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:08.554885 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e5d3a7fe-7acf-4f4b-8ee2-747300e46752 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 204 len: 0 microversion: 2.1 time: 0.303284 Oct 12 22:46:08.559722 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1475/3044] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:46:08 2022] DELETE /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:46:08.580642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:08.583056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:08.588840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76ff66f0-e24b-4d5d-90f4-db661f3ab3b0 req-7adf64b5-f50d-4211-8d74-1368bf25d59b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.590872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76ff66f0-e24b-4d5d-90f4-db661f3ab3b0 req-7adf64b5-f50d-4211-8d74-1368bf25d59b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.591641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76ff66f0-e24b-4d5d-90f4-db661f3ab3b0 req-7adf64b5-f50d-4211-8d74-1368bf25d59b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.603501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.604818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.606643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.608037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:08.609090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:08.611365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:08.625365 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-76ff66f0-e24b-4d5d-90f4-db661f3ab3b0 req-7adf64b5-f50d-4211-8d74-1368bf25d59b service nova] Creating event network-changed:3fc4d68f-7b6b-4043-a00d-08e89eb886f3 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:46:08.634102 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-76ff66f0-e24b-4d5d-90f4-db661f3ab3b0 req-7adf64b5-f50d-4211-8d74-1368bf25d59b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098643 Oct 12 22:46:08.640397 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1570/3045] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:08.652954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:09.363238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:09.371712 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc846d78-059d-4617-8432-fa21f41b2676 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1468 microversion: 2.1 time: 0.809962 Oct 12 22:46:09.372330 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1476/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:08 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1468 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:09.565021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:09.566353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:09.577137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:09.578745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:09.580634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:09.584712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:09.585503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:09.586139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:09.588258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:09.928178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:09.944431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:09.949793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:09.963769 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-113aa00b-65a0-4347-a2eb-dca9d3605b74 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.394398 Oct 12 22:46:09.991180 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1571/3047] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:09 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:46:10.397911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:10.399066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:10.411440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:10.411969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:10.412415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:10.413121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:10.421400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:10.422606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:10.995366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:10.996070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:11.009226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:11.010624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:11.011073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:11.012377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:11.012858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:11.013254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:11.484080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:11.509713 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3dd41ef7-e06a-47a5-8f87-4e1d632d7842 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1468 microversion: 2.1 time: 1.115380 Oct 12 22:46:11.511224 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1477/3048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:10 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1468 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:11.524845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:11.536762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:11.539455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:11.541167 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b59ee30-b973-4c6d-83aa-d96d2d5d398f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.550427 Oct 12 22:46:11.542105 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1572/3049] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:10 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:46:12.538257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:12.538810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:12.552421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:12.552918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:12.553354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:12.554054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:12.554680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:12.555108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:12.569975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:12.571294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:12.587517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:12.588182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:12.588713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:12.589527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:12.590807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:12.591445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:12.754550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dbe0c8a7784391a83066cb1cb74604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf9e980a91540259cee1eb11016cfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:12.769406 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7c0ddbd8-31e9-48be-a2f0-8c5fbe0a82cd tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 200 len: 1426 microversion: 2.1 time: 0.239114 Oct 12 22:46:12.783919 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1478/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:12 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 1426 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:12.832671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-10a368bd-05bd-4d3f-a9a1-607edb9b21d3 req-b603c8e0-37ec-4d76-9e57-0180b148b436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bbf111-4479-4f63-b205-094fb84ab3c9", "name": "network-vif-deleted", "tag": "33396dab-3e25-41bf-a80c-4f7317e8f40d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:12.854054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-10a368bd-05bd-4d3f-a9a1-607edb9b21d3 req-b603c8e0-37ec-4d76-9e57-0180b148b436 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:12.854533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-10a368bd-05bd-4d3f-a9a1-607edb9b21d3 req-b603c8e0-37ec-4d76-9e57-0180b148b436 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:12.854961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-10a368bd-05bd-4d3f-a9a1-607edb9b21d3 req-b603c8e0-37ec-4d76-9e57-0180b148b436 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:12.883496 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-10a368bd-05bd-4d3f-a9a1-607edb9b21d3 req-b603c8e0-37ec-4d76-9e57-0180b148b436 service nova] Creating event network-vif-deleted:33396dab-3e25-41bf-a80c-4f7317e8f40d for instance 33bbf111-4479-4f63-b205-094fb84ab3c9 on n-h2-860864-8 Oct 12 22:46:12.890036 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-10a368bd-05bd-4d3f-a9a1-607edb9b21d3 req-b603c8e0-37ec-4d76-9e57-0180b148b436 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080148 Oct 12 22:46:12.892567 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1479/3051] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:13.295151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:13.311281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:13.313501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:13.316660 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-393cea6c-3969-468b-b34e-1e045df67197 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.751092 Oct 12 22:46:13.317892 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1573/3052] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:12 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:13.801139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:13.802439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] [instance: 33bbf111-4479-4f63-b205-094fb84ab3c9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:13.811086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:13.812000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:13.812647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:13.814583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:13.815554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:13.816776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:13.834883 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] HTTP exception thrown: Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 could not be found. Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Request method failure captured: Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 HTTP/1.1 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0JJnxwHsZUV7lesOEWUgRlGhnO4vLtPydY5Tzin3nABM8lwAve8kT7eOQlNwd4M7M2pP0p1Xg2zrKwi4ZH3tJuWl_os452pSMHuqJs2JnxiydtiiN_pKPTX2bpbbcfGLzZBYgm4JM2_Dx_D9NIVD9-lX9w0tvqn2hXKpjr5n8p-6k8 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cf9e980a91540259cee1eb11016cfe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cf9e980a91540259cee1eb11016cfe7"}]}] Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-MigrationsAdminTest-987629196 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8cf9e980a91540259cee1eb11016cfe7 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-MigrationsAdminTest-987629196 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-MigrationsAdminTest-987629196-project Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 70dbe0c8a7784391a83066cb1cb74604 Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-MigrationsAdminTest-987629196-project Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 could not be found. Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '33bbf111-4479-4f63-b205-094fb84ab3c9'} Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 could not be found. Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 could not be found. Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:13.836964 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:13.841932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:13.841932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:13.841932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:13.841932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:13.841932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:13.841932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 could not be found. Oct 12 22:46:13.841932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:13.844187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] Returning 404 to user: Instance 33bbf111-4479-4f63-b205-094fb84ab3c9 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:13.845084 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e3ab343-20fa-44e0-81c0-7c746c83a158 tempest-MigrationsAdminTest-987629196 tempest-MigrationsAdminTest-987629196-project] 10.222.0.20 "GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9" status: 404 len: 111 microversion: 2.1 time: 0.050814 Oct 12 22:46:13.848822 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1480/3053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:13 2022] GET /compute/v2.1/servers/33bbf111-4479-4f63-b205-094fb84ab3c9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:14.343488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:14.344323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:14.355019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:14.358357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:14.358953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:14.359793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:14.361738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:14.362669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:15.048745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:15.076740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:15.084927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:15.089182 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4bd933e5-41e2-4899-83a8-28b2cb2c934f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.747606 Oct 12 22:46:15.095039 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1574/3054] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:14 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:16.124069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:16.124852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:16.135412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:16.140261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:16.143508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:16.144724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:16.145487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:16.147521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:16.177173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:16.179871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:16.203200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:16.203633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:16.204552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:16.213131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:16.214010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:16.215465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:16.344804 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-31e301c8-67ce-4531-8d23-1e2ee977b60a tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173774 Oct 12 22:46:16.353552 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1575/3055] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:46:16 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:16.359595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:16.360431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:16.369185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:16.370024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:16.371165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:16.372210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:16.372859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:16.374143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:16.594190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lazy-loading 'services' on Instance uuid 62825a95-dac3-4250-b030-3f848dd6505a {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:46:16.786354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-06d42c68-e052-42fa-b89f-ec82e8bdcae5 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments/dcdd76b8-b42b-49ee-8c3b-08a101885af6" status: 202 len: 0 microversion: 2.1 time: 0.430533 Oct 12 22:46:16.808994 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1576/3056] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 22:46:16 2022] DELETE /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments/dcdd76b8-b42b-49ee-8c3b-08a101885af6 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:46:17.279332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:17.299569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:17.303056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:17.307805 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08f18b80-8f1d-41cf-92f9-4d2bd10c6114 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.186439 Oct 12 22:46:17.311066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1481/3057] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:16 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:18.341278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:18.341999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:18.361661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:18.362208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:18.362593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:18.363305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:18.363755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:18.368800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:18.441333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:18.950539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:18.974081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:18.979937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:18.981766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2569f166-28a4-428a-a754-3c4d233b687c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.646715 Oct 12 22:46:18.982337 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1577/3058] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:18 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:20.011108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:20.011620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:20.027573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:20.028499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:20.029103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:20.030021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:20.030913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:20.033122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:21.653612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:21.685848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:21.692167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:21.696185 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d7c9834-819d-4967-9f17-130cc87276f5 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.687360 Oct 12 22:46:21.713072 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1482/3059] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:20 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:22.727089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:22.728612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:22.744521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:22.745514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:22.747478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:22.750298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:22.751324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:22.752012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:23.448818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59ca8783-72c4-437e-a1a4-5e483e806dd9 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Calling method '.version_select at 0x7f44ff47eee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:23.512010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-59ca8783-72c4-437e-a1a4-5e483e806dd9 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:46:23.512632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-59ca8783-72c4-437e-a1a4-5e483e806dd9 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Neutron security group 722675e6-dac2-40d3-9012-613411c67919 not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:46:23.513159 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-59ca8783-72c4-437e-a1a4-5e483e806dd9 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] HTTP exception thrown: Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist Oct 12 22:46:23.513159 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-47061db9-ae9a-4c0f-8bac-afbd1d20644e'] Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59ca8783-72c4-437e-a1a4-5e483e806dd9 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Request method failure captured: Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/722675e6-dac2-40d3-9012-613411c67919 HTTP/1.1 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0O-gratOFRRm1hh_3hK6GiwYUhbsDyMAZM-Va9H-mB642LUXYtR87v4KRkCxFsKihaRdz1hxwk78_1JkMVSJIgw8CuZFA66fbImuOadiC34v7Fqbv3Ubjp4OGBX-jzUxXp8hUkKMj-uqpezfJIh3tejSXvWj0yYiBX4OO2uh0_RyqE Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}] Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 58e830fcb8a749d3996e6201ea545541 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-47061db9-ae9a-4c0f-8bac-afbd1d20644e'] Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '722675e6-dac2-40d3-9012-613411c67919'} Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:46:23.515437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47061db9-ae9a-4c0f-8bac-afbd1d20644e'] Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47061db9-ae9a-4c0f-8bac-afbd1d20644e'] Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47061db9-ae9a-4c0f-8bac-afbd1d20644e'] Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47061db9-ae9a-4c0f-8bac-afbd1d20644e'] Oct 12 22:46:23.520546 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:23.526023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59ca8783-72c4-437e-a1a4-5e483e806dd9 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Returning 404 to user: Security group 722675e6-dac2-40d3-9012-613411c67919 does not exist Oct 12 22:46:23.526023 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-47061db9-ae9a-4c0f-8bac-afbd1d20644e'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:23.526023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59ca8783-72c4-437e-a1a4-5e483e806dd9 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/722675e6-dac2-40d3-9012-613411c67919" status: 404 len: 194 microversion: 2.1 time: 0.997473 Oct 12 22:46:23.526023 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1578/3060] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:46:22 2022] DELETE /compute/v2.1/os-security-groups/722675e6-dac2-40d3-9012-613411c67919 => generated 194 bytes in 999 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:23.536492 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f6f674d-3c3b-455c-83fe-b21d28689ae6 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004235 Oct 12 22:46:23.539974 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1579/3061] 10.222.0.20 () {58 vars in 1164 bytes} [Wed Oct 12 22:46:23 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 12 22:46:23.548333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2ba9e9c5-3f0e-40a1-b637-c8ca570ec4a6 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Calling method '.version_select at 0x7f44ff47e1f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:23.700028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:23.716596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:23.723045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:23.729156 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b900f41a-8743-4cfe-942b-29670be0d67c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.006237 Oct 12 22:46:23.730704 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1483/3062] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:22 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:24.721896 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2ba9e9c5-3f0e-40a1-b637-c8ca570ec4a6 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.179541 Oct 12 22:46:24.722810 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1580/3063] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:46:23 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:46:24.738134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cc7f2ad-e73a-40ea-b2cd-f60a5134d469 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Calling method '.version_select at 0x7f44ffe55c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:24.763573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:24.764821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:24.785452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:24.789016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:24.792317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:24.796210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:24.796875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:24.800038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:25.200509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:25.247433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:25.257468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:25.264800 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3fdcb196-f362-4d62-82ab-3e79c1556f6f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.502667 Oct 12 22:46:25.265423 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1581/3064] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:24 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:25.347796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-1cc7f2ad-e73a-40ea-b2cd-f60a5134d469 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:46:25.348790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1cc7f2ad-e73a-40ea-b2cd-f60a5134d469 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 12 22:46:25.348790 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d20a58c9-9891-48a3-b276-3c276b40ff94'] Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cc7f2ad-e73a-40ea-b2cd-f60a5134d469 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Request method failure captured: Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-security-groups/bb7cbc7b-f1d4-4258-9d5f-62036b379965 HTTP/1.1 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0O-gratOFRRm1hh_3hK6GiwYUhbsDyMAZM-Va9H-mB642LUXYtR87v4KRkCxFsKihaRdz1hxwk78_1JkMVSJIgw8CuZFA66fbImuOadiC34v7Fqbv3Ubjp4OGBX-jzUxXp8hUkKMj-uqpezfJIh3tejSXvWj0yYiBX4OO2uh0_RyqE Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}] Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 58e830fcb8a749d3996e6201ea545541 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: exception: Insufficient rights for removing default security group. Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d20a58c9-9891-48a3-b276-3c276b40ff94'] Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'bb7cbc7b-f1d4-4258-9d5f-62036b379965'} Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:46:25.352274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20a58c9-9891-48a3-b276-3c276b40ff94'] Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20a58c9-9891-48a3-b276-3c276b40ff94'] Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20a58c9-9891-48a3-b276-3c276b40ff94'] Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d20a58c9-9891-48a3-b276-3c276b40ff94'] Oct 12 22:46:25.358112 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.367457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cc7f2ad-e73a-40ea-b2cd-f60a5134d469 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 12 22:46:25.367457 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d20a58c9-9891-48a3-b276-3c276b40ff94'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:25.379245 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1cc7f2ad-e73a-40ea-b2cd-f60a5134d469 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/bb7cbc7b-f1d4-4258-9d5f-62036b379965" status: 400 len: 182 microversion: 2.1 time: 0.643318 Oct 12 22:46:25.398672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2cafd749-2c2c-4b15-9909-a2f2082110f5 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Calling method '.version_select at 0x7f44ff4fd430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:25.404804 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1484/3065] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:46:24 2022] DELETE /compute/v2.1/os-security-groups/bb7cbc7b-f1d4-4258-9d5f-62036b379965 => generated 182 bytes in 672 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:46:25.456664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-2cafd749-2c2c-4b15-9909-a2f2082110f5 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:46:25.457672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-2cafd749-2c2c-4b15-9909-a2f2082110f5 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Neutron security group cbf67d90-d913-4e39-9a2c-129302e0d425 not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:46:25.458360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-2cafd749-2c2c-4b15-9909-a2f2082110f5 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] HTTP exception thrown: Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist Oct 12 22:46:25.458360 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-0af282e3-fdf9-4f2a-8402-78e1ed90a1b8'] Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2cafd749-2c2c-4b15-9909-a2f2082110f5 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Request method failure captured: Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-security-groups/cbf67d90-d913-4e39-9a2c-129302e0d425 HTTP/1.1 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0O-gratOFRRm1hh_3hK6GiwYUhbsDyMAZM-Va9H-mB642LUXYtR87v4KRkCxFsKihaRdz1hxwk78_1JkMVSJIgw8CuZFA66fbImuOadiC34v7Fqbv3Ubjp4OGBX-jzUxXp8hUkKMj-uqpezfJIh3tejSXvWj0yYiBX4OO2uh0_RyqE Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}] Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 58e830fcb8a749d3996e6201ea545541 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-0af282e3-fdf9-4f2a-8402-78e1ed90a1b8'] Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'cbf67d90-d913-4e39-9a2c-129302e0d425'} Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:46:25.461021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0af282e3-fdf9-4f2a-8402-78e1ed90a1b8'] Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0af282e3-fdf9-4f2a-8402-78e1ed90a1b8'] Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0af282e3-fdf9-4f2a-8402-78e1ed90a1b8'] Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0af282e3-fdf9-4f2a-8402-78e1ed90a1b8'] Oct 12 22:46:25.466385 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.470908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2cafd749-2c2c-4b15-9909-a2f2082110f5 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Returning 404 to user: Security group cbf67d90-d913-4e39-9a2c-129302e0d425 does not exist Oct 12 22:46:25.470908 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-0af282e3-fdf9-4f2a-8402-78e1ed90a1b8'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:25.472636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2cafd749-2c2c-4b15-9909-a2f2082110f5 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/cbf67d90-d913-4e39-9a2c-129302e0d425" status: 404 len: 194 microversion: 2.1 time: 0.079129 Oct 12 22:46:25.478577 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1582/3066] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:46:25 2022] GET /compute/v2.1/os-security-groups/cbf67d90-d913-4e39-9a2c-129302e0d425 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:25.485177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a528766-2f67-419d-a8fd-3a83771fd124 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Action: 'update', calling method: .version_select at 0x7f44ffe55670>, body: {"security_group": {"name": "tempest-sg-1938967735", "description": "tempest-description-743780366"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:25.646020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-3a528766-2f67-419d-a8fd-3a83771fd124 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:46:25.653316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-3a528766-2f67-419d-a8fd-3a83771fd124 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Neutron security group 003109ae-5b8b-4785-95c2-d961a425fb47 not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:46:25.654029 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-3a528766-2f67-419d-a8fd-3a83771fd124 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] HTTP exception thrown: Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist Oct 12 22:46:25.654029 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-86e33736-a136-43b9-acca-eabc26281b69'] Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a528766-2f67-419d-a8fd-3a83771fd124 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Request method failure captured: Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/os-security-groups/003109ae-5b8b-4785-95c2-d961a425fb47 HTTP/1.1 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 101 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0O-gratOFRRm1hh_3hK6GiwYUhbsDyMAZM-Va9H-mB642LUXYtR87v4KRkCxFsKihaRdz1hxwk78_1JkMVSJIgw8CuZFA66fbImuOadiC34v7Fqbv3Ubjp4OGBX-jzUxXp8hUkKMj-uqpezfJIh3tejSXvWj0yYiBX4OO2uh0_RyqE Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c5f0603434469e9dbe8a7546c0bc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c5f0603434469e9dbe8a7546c0bc79"}]}] Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: f3c5f0603434469e9dbe8a7546c0bc79 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 58e830fcb8a749d3996e6201ea545541 Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2125044061-project Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: {"security_group": {"name": "tempest-sg-1938967735", "description": "tempest-description-743780366"}} Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-86e33736-a136-43b9-acca-eabc26281b69'] Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '003109ae-5b8b-4785-95c2-d961a425fb47', 'body': {'security_group': {'name': 'tempest-sg-1938967735', 'description': 'tempest-description-743780366'}}} Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:46:25.657224 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e33736-a136-43b9-acca-eabc26281b69'] Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e33736-a136-43b9-acca-eabc26281b69'] Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e33736-a136-43b9-acca-eabc26281b69'] Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86e33736-a136-43b9-acca-eabc26281b69'] Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a528766-2f67-419d-a8fd-3a83771fd124 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] Returning 404 to user: Security group 003109ae-5b8b-4785-95c2-d961a425fb47 does not exist Oct 12 22:46:25.662454 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-86e33736-a136-43b9-acca-eabc26281b69'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:25.666905 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a528766-2f67-419d-a8fd-3a83771fd124 tempest-SecurityGroupsNegativeTestJSON-2125044061 tempest-SecurityGroupsNegativeTestJSON-2125044061-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/003109ae-5b8b-4785-95c2-d961a425fb47" status: 404 len: 194 microversion: 2.1 time: 0.187292 Oct 12 22:46:25.674330 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1485/3067] 10.222.0.20 () {60 vars in 1290 bytes} [Wed Oct 12 22:46:25 2022] PUT /compute/v2.1/os-security-groups/003109ae-5b8b-4785-95c2-d961a425fb47 => generated 194 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:26.296122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:26.298373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:26.327346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:26.328188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:26.328838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:26.330876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:26.331732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:26.332370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.005707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:27.027476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:27.032419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:27.034906 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-31134434-2204-4bb5-a870-a07b88d8b340 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.744214 Oct 12 22:46:27.057290 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1583/3068] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:26 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:27.078239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:27.080585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:27.088703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.089992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.090626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.091510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.092180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.092775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.131796 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99db01d5-3122-4c6c-83dc-bd6c1e79308d tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057555 Oct 12 22:46:27.139182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1486/3069] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:46:27 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:46:27.261098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:27.263823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:27.271205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.271980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.272776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.274795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.275998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.277644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.331629 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b2a358a-0e61-401d-aef8-448aac421856 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074775 Oct 12 22:46:27.338892 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1584/3070] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:46:27 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:46:27.444555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:27.445304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:27.456210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.459390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.460093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.465475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.465971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.466609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.514309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:46:27.650623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f9a5c72a-72d1-4346-9c6d-1147644902d8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 204 len: 0 microversion: 2.1 time: 0.210123 Oct 12 22:46:27.651511 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1487/3071] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:46:27 2022] DELETE /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:46:27.662964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:27.664724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:27.672109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.674845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.677164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:27.678129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:27.681568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:27.682183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:28.076796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:28.077574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:28.102953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:28.104258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:28.106712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:28.107709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:28.113333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:28.114906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:28.432049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:28.446965 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ab807af-f044-4156-8376-44686ff64cc2 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1680 microversion: 2.1 time: 0.787668 Oct 12 22:46:28.448309 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1585/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:27 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1680 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:28.702458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb129cd8-0b36-4914-ad0e-f5f32a76d613 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Action: 'create', calling method: .version_select at 0x7f44ff47e4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1959000037", "metadata": {"Type": "work"}}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:28.986328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:29.008610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:29.024440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:29.026340 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-189224b2-0040-49c1-9c32-d85c1bc98a75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.964860 Oct 12 22:46:29.031465 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1488/3073] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:28 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:29.470657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:29.471331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:29.486880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:29.487628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:29.501317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:29.503720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:29.504229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:29.504669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:29.627807 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb129cd8-0b36-4914-ad0e-f5f32a76d613 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.177611 Oct 12 22:46:29.638865 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1586/3074] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 12 22:46:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1189 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 22:46:29.650108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08f2ea24-cb7e-4f39-bc69-e9867fce47e8 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f4507c30b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:29.890667 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08f2ea24-cb7e-4f39-bc69-e9867fce47e8 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 353 microversion: 2.1 time: 0.245620 Oct 12 22:46:29.897960 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1587/3075] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:29 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:30.069861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:30.070499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:30.091730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:30.094698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:30.099274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:30.099833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:30.100343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:30.100781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:31.514641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:31.523473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1b3f9d9-d216-4e0b-8349-33785736c167 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1680 microversion: 2.1 time: 2.056643 Oct 12 22:46:31.543540 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1489/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:29 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1680 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:31.550386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80cc495d-93e9-4356-bdea-3365673efd08 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f44ff64bdc0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:31.647790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80cc495d-93e9-4356-bdea-3365673efd08 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 353 microversion: 2.1 time: 0.102897 Oct 12 22:46:31.648992 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1490/3077] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:31 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:32.104450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:32.124792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:32.127558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:32.136822 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-20116973-3acc-446c-aaf5-13f25bbf5385 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 2.072464 Oct 12 22:46:32.164721 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1588/3078] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:30 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:32.294831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1816232853", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:32.381595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:46:32.553463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:32.554653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:32.568195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:32.569441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:32.571010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:32.572197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:32.572861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:32.573513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:32.752086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db9db3a17de41708a9071e44c1624a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47fcb444af0489bbabd823baf7b0fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:32.784527 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b7f0ac83-d12f-4623-b533-53fabdcf0257 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 200 len: 1613 microversion: 2.1 time: 0.214701 Oct 12 22:46:32.785792 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1589/3079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:32 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 1613 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:32.790762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4824baa-7df6-48c0-ae0d-cf1106e14e96 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f4507a924c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:32.919527 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4824baa-7df6-48c0-ae0d-cf1106e14e96 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 354 microversion: 2.1 time: 0.132454 Oct 12 22:46:32.928089 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1590/3080] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:32 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:32.936226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-193ec408-4d87-4ac8-a51a-f86ea0284e4d tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f4507a928b0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:33.039819 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-193ec408-4d87-4ac8-a51a-f86ea0284e4d tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 354 microversion: 2.1 time: 0.108641 Oct 12 22:46:33.040701 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1591/3081] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:32 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:33.054137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6031f24-2b57-48cc-b5fa-d7f9db4b1e22 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f4507c37c10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:33.159927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6031f24-2b57-48cc-b5fa-d7f9db4b1e22 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 202 len: 0 microversion: 2.1 time: 0.108217 Oct 12 22:46:33.161823 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1592/3082] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:46:33 2022] DELETE /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:46:33.175127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03a28a82-7899-4a56-80e3-d4b339c1c941 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f4507a92550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:33.265456 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03a28a82-7899-4a56-80e3-d4b339c1c941 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 353 microversion: 2.1 time: 0.099159 Oct 12 22:46:33.266266 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1593/3083] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:33 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:33.272317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:33.272934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:33.294358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:33.295054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:33.295611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:33.296457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:33.297642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:33.298199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:33.387728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:46:33.388695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:46:33.389356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:46:33.389953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:46:33.391157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:46:33.413903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:33.414436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:33.415498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:33.416983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:33.418949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:33.420752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:33.478087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Getting quotas for project 466ee048fcc5436fbfc3e493cb88897c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:46:33.489950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Getting quotas for user 89304d08b821486e89303403b802a4ae and project 466ee048fcc5436fbfc3e493cb88897c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:46:33.517418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:46:33.520925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:46:33.598715 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ebc6559e-fff2-409b-b50a-58b4c857c7f3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.948450 Oct 12 22:46:33.600136 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1491/3084] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:46:33.613007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d2eb2157-eb72-4a3a-9c66-bc4a7f257d11 req-9d13f985-4a3c-485a-bbea-abb8f31ffda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62825a95-dac3-4250-b030-3f848dd6505a", "name": "network-vif-deleted", "tag": "7e51d1d9-0754-4b09-a8da-4ebe928c84b0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:33.640613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d2eb2157-eb72-4a3a-9c66-bc4a7f257d11 req-9d13f985-4a3c-485a-bbea-abb8f31ffda7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:33.642199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d2eb2157-eb72-4a3a-9c66-bc4a7f257d11 req-9d13f985-4a3c-485a-bbea-abb8f31ffda7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:33.643107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d2eb2157-eb72-4a3a-9c66-bc4a7f257d11 req-9d13f985-4a3c-485a-bbea-abb8f31ffda7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:33.675091 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d2eb2157-eb72-4a3a-9c66-bc4a7f257d11 req-9d13f985-4a3c-485a-bbea-abb8f31ffda7 service nova] Creating event network-vif-deleted:7e51d1d9-0754-4b09-a8da-4ebe928c84b0 for instance 62825a95-dac3-4250-b030-3f848dd6505a on n-h2-860864-8 Oct 12 22:46:33.686123 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d2eb2157-eb72-4a3a-9c66-bc4a7f257d11 req-9d13f985-4a3c-485a-bbea-abb8f31ffda7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084055 Oct 12 22:46:33.689951 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1492/3085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:33.701642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a2a59b9-4c04-490e-bbaf-c7562a3855c1 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:33.703137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a2a59b9-4c04-490e-bbaf-c7562a3855c1 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:33.950453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a2a59b9-4c04-490e-bbaf-c7562a3855c1 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:33.965600 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a2a59b9-4c04-490e-bbaf-c7562a3855c1 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1222 microversion: 2.1 time: 0.272123 Oct 12 22:46:33.969112 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1493/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:33 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:33.999822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:34.004393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:34.024070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:34.024676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:34.025887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:34.027247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:34.027775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:34.029635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:34.063793 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] HTTP exception thrown: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Request method failure captured: Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a HTTP/1.1 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0MB-r5nEcSqv595zCkfYxCI3O26gaX8QQrLvBy2ImiYkAu_4HAqKWla5InuHJ7dNDLbYraWpnWI1DluPyBmSLioQoio2U4vYMyOnBd_3ABxc3VvOji6PHbEq5W1bwOYmkF6V4l7hixUn58tzrL9kxmc7tR-IMbFWbp18VN8yrjBUbE Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: f47fcb444af0489bbabd823baf7b0fe8 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f47fcb444af0489bbabd823baf7b0fe8"}]}] Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: f47fcb444af0489bbabd823baf7b0fe8 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachSCSIVolumeTestJSON-1140503661-project Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7db9db3a17de41708a9071e44c1624a7 Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1140503661-project Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '62825a95-dac3-4250-b030-3f848dd6505a'} Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:34.073056 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Returning 404 to user: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f3886cf-dede-4621-9d2b-1e7e0c3d5dbd tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 404 len: 111 microversion: 2.1 time: 0.102572 Oct 12 22:46:34.078113 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1494/3087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:33 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:34.087435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a05392b-4db7-4f32-915d-409b90726fd8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '.version_select at 0x7f44ff7afee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:34.130275 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a05392b-4db7-4f32-915d-409b90726fd8 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-49801077" status: 202 len: 0 microversion: 2.1 time: 0.050205 Oct 12 22:46:34.131522 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1495/3088] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 12 22:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-49801077 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:46:34.280341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27f28e15-42f6-430d-afc0-e04e788736dc tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f44ff7c7430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:34.399850 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27f28e15-42f6-430d-afc0-e04e788736dc tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 353 microversion: 2.1 time: 0.124376 Oct 12 22:46:34.405385 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1496/3089] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:34 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:46:34.706239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:34.725924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:34.728790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:34.730909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f0e9d37-3c02-4b01-878b-bf085d41a145 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.463035 Oct 12 22:46:34.753825 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1594/3090] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:33 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:34.994680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:34.995810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:35.012307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:35.013210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:35.013880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:35.014799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:35.017371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:35.018870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:35.257040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:35.265100 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e27a6cf-f25c-4f32-a8cd-83a5694996ce tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1218 microversion: 2.1 time: 0.278254 Oct 12 22:46:35.268635 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1497/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:34 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1218 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:35.419947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c93399b7-9f50-4f76-9126-bbf31e60a5d9 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f4507a92b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:35.508219 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c93399b7-9f50-4f76-9126-bbf31e60a5d9 tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 353 microversion: 2.1 time: 0.093133 Oct 12 22:46:35.509406 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1595/3092] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:35 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:35.763455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:35.764244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:35.779829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:35.784333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:35.785192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:35.787449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:35.789523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:35.790302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:36.296702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:36.298013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:36.324496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:36.324977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:36.327142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:36.327875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:36.328364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:36.334387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:36.642188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:36.659980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:36.661896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:36.665864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9f3e6b8-e70c-4200-9bc0-3e0457cfa02d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.908318 Oct 12 22:46:36.680235 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1498/3093] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:35 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:36.688048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-756e3209-a2ea-4bbf-aaa7-7c8ed5bdeead tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f4507c03f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:36.741439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:36.753512 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12e936ed-9be8-4046-a7f5-578842d3b596 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1280 microversion: 2.1 time: 0.462135 Oct 12 22:46:36.754151 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1596/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:36 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1280 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:36.795038 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-756e3209-a2ea-4bbf-aaa7-7c8ed5bdeead tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 200 len: 353 microversion: 2.1 time: 0.127487 Oct 12 22:46:36.795875 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1499/3095] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:36 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:37.693983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:37.694611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:37.707658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.708693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.709485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.710590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.711213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.713650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.782980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:37.783805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:37.807088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.811240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.815846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:37.818495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:37.822972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:37.823921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:38.461588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:38.485377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:38.488237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:38.494815 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af4f405a-4051-41f1-8c39-4da011e28081 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.805795 Oct 12 22:46:38.500685 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1597/3096] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:37 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:38.505053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:38.517659 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4a31715-7482-4cca-bda2-3b1c51a89e23 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.740288 Oct 12 22:46:38.523010 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1500/3097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:37 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:38.525370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb49c589-1206-4dce-8d1e-40a12b21034a tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Calling method '.version_select at 0x7f44ffcabe50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:38.600954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-eb49c589-1206-4dce-8d1e-40a12b21034a tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] HTTP exception thrown: Volume 102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 could not be found. Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb49c589-1206-4dce-8d1e-40a12b21034a tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Request method failure captured: Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 HTTP/1.1 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PEIaC0v9a7vQcsJ6ZulSl4fxb69nlk6SuJMz1i97GcfcSZxfy3e8NZhadAe7I9l7234atc_Vg7Zl159HIL4-SJu-gx3-h3p-mFIOHIhmS0-VGTM9Xq9r5Hg12yL1HGCXXSiWWX2btjwcUX5SIi9Cmc-3Dr7_3wC5sSzwV8W4xqckk Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: e6d1efdaf56e4f159a6e8fac1633fe6e Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesGetTestJSON-602050782 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6d1efdaf56e4f159a6e8fac1633fe6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e6d1efdaf56e4f159a6e8fac1633fe6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e6d1efdaf56e4f159a6e8fac1633fe6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6d1efdaf56e4f159a6e8fac1633fe6e"}]}] Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesGetTestJSON-602050782 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: e6d1efdaf56e4f159a6e8fac1633fe6e Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesGetTestJSON-602050782 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesGetTestJSON-602050782-project Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: deb7cf906f364866ad2886ceaf91c278 Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesGetTestJSON-602050782-project Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: exception: Volume 102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 could not be found. Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '102c3617-f14b-44f6-b1ec-ef97ca3a6fb8'} Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 could not be found. (HTTP 404) (Request-ID: req-a773dc97-a903-4126-bf02-1bc7444817c4) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 22:46:38.629506 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 could not be found. Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 could not be found. Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 could not be found. Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb49c589-1206-4dce-8d1e-40a12b21034a tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] Returning 404 to user: Volume 102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:38.638094 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb49c589-1206-4dce-8d1e-40a12b21034a tempest-VolumesGetTestJSON-602050782 tempest-VolumesGetTestJSON-602050782-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8" status: 404 len: 109 microversion: 2.1 time: 0.122596 Oct 12 22:46:38.644809 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1598/3098] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 22:46:38 2022] GET /compute/v2.1/os-volumes/102c3617-f14b-44f6-b1ec-ef97ca3a6fb8 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:39.535030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:39.538035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:39.552166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:39.555492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:39.558527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:39.564825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.565203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.574081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.575032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.575513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.576217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.586350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.588479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.591219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:39.592732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.594028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:39.594919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:39.597231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:39.905066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:39.931662 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59c00357-538a-4fff-86f0-813391ffa3b6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.387292 Oct 12 22:46:39.935939 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1599/3099] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:39 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:40.436397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:40.447110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:40.468591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:40.473951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a5f2deb-842a-4a3a-9f6c-657235935f82 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.947974 Oct 12 22:46:40.476471 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1501/3100] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:39 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:40.956870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:40.958232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:40.974117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=34 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:40.985594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.987770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.988592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:40.989567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:40.992767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:40.997275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:41.514132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:41.515129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:41.532577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:41.534187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:41.534669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:41.537477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:41.539748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:41.540910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:41.767465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:41.788174 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c85d118c-9bd2-433a-8bc8-0b49a72898d3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.837142 Oct 12 22:46:41.805775 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1600/3101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:40 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:41.901845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:41.923782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:41.929368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:41.932961 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a1ba4dc-f1d5-427b-b817-96a811d01a55 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.426547 Oct 12 22:46:41.935792 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1502/3102] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:41 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:42.117667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6beefa71-5fcc-4685-bf9f-18b0737347c4 req-e2f63f42-4602-466f-9241-514278798f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddb2249-b5e2-4308-9d4b-6881107150f7", "tag": "31b5e870-26bb-47d6-b17b-7ede69c80df3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:42.142682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6beefa71-5fcc-4685-bf9f-18b0737347c4 req-e2f63f42-4602-466f-9241-514278798f02 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.155227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6beefa71-5fcc-4685-bf9f-18b0737347c4 req-e2f63f42-4602-466f-9241-514278798f02 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.156442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6beefa71-5fcc-4685-bf9f-18b0737347c4 req-e2f63f42-4602-466f-9241-514278798f02 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.199153 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6beefa71-5fcc-4685-bf9f-18b0737347c4 req-e2f63f42-4602-466f-9241-514278798f02 service nova] Creating event network-changed:31b5e870-26bb-47d6-b17b-7ede69c80df3 for instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 on n-h2-860864-8 Oct 12 22:46:42.214300 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6beefa71-5fcc-4685-bf9f-18b0737347c4 req-e2f63f42-4602-466f-9241-514278798f02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097204 Oct 12 22:46:42.230634 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1601/3103] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:42.830094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:42.830763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:42.846208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.857251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.857707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.862738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.863292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.866191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.966625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:42.967502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:42.981794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.983688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.990546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:42.991694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:42.995078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:42.996029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:43.452628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:43.958606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:43.961589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:43.974443 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-885e9af9-2596-4ca1-bc40-395ce46a8073 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 1.147639 Oct 12 22:46:43.991640 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1503/3104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:42 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:44.146541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:44.163359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:44.165526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:44.169977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6eebc763-b544-4fe6-9387-7c69645581cc tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.211047 Oct 12 22:46:44.173263 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1602/3105] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:42 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:45.007477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:45.008372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:45.022814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.031962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.032683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:45.035914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.037991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.040128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:45.210827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:45.212901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:45.225893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.226660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.228638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:45.229526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:45.229969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:45.232872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:45.849755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:45.883754 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5de27055-4183-458e-a7f0-abdec5a201ad tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.873691 Oct 12 22:46:45.884749 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1504/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:44 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:46.125765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:46.135857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:46.145748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:46.146956 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-729be3b6-93b0-4f54-8053-036218973944 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.944206 Oct 12 22:46:46.147528 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1603/3107] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:45 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:46.653056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:46.654141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:46.679579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.680285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.680804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:46.681694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.682388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.683163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:46.736168 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] HTTP exception thrown: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Request method failure captured: Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a HTTP/1.1 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0MB-r5nEcSqv595zCkfYxCI3O26gaX8QQrLvBy2ImiYkAu_4HAqKWla5InuHJ7dNDLbYraWpnWI1DluPyBmSLioQoio2U4vYMyOnBd_3ABxc3VvOji6PHbEq5W1bwOYmkF6V4l7hixUn58tzrL9kxmc7tR-IMbFWbp18VN8yrjBUbE Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: f47fcb444af0489bbabd823baf7b0fe8 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f47fcb444af0489bbabd823baf7b0fe8"}]}] Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: f47fcb444af0489bbabd823baf7b0fe8 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachSCSIVolumeTestJSON-1140503661-project Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7db9db3a17de41708a9071e44c1624a7 Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1140503661-project Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '62825a95-dac3-4250-b030-3f848dd6505a'} Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:46.737963 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Returning 404 to user: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-030e5cb7-4db8-4e88-b168-f0bab211f6f3 tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 404 len: 111 microversion: 2.1 time: 0.090897 Oct 12 22:46:46.746890 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1505/3108] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:46:46 2022] DELETE /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:46.748863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:46.749864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] [instance: 62825a95-dac3-4250-b030-3f848dd6505a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:46.769812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.770315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.770753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:46.771461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.771961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.772357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:46.836812 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] HTTP exception thrown: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Request method failure captured: Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a HTTP/1.1 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0MB-r5nEcSqv595zCkfYxCI3O26gaX8QQrLvBy2ImiYkAu_4HAqKWla5InuHJ7dNDLbYraWpnWI1DluPyBmSLioQoio2U4vYMyOnBd_3ABxc3VvOji6PHbEq5W1bwOYmkF6V4l7hixUn58tzrL9kxmc7tR-IMbFWbp18VN8yrjBUbE Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f47fcb444af0489bbabd823baf7b0fe8 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f47fcb444af0489bbabd823baf7b0fe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f47fcb444af0489bbabd823baf7b0fe8"}]}] Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f47fcb444af0489bbabd823baf7b0fe8 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1140503661 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachSCSIVolumeTestJSON-1140503661-project Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7db9db3a17de41708a9071e44c1624a7 Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1140503661-project Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '62825a95-dac3-4250-b030-3f848dd6505a'} Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:46.848613 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] Returning 404 to user: Instance 62825a95-dac3-4250-b030-3f848dd6505a could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:46.855938 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e61a0255-c704-4527-a5d1-f5c3dd1281ec tempest-AttachSCSIVolumeTestJSON-1140503661 tempest-AttachSCSIVolumeTestJSON-1140503661-project] 10.222.0.20 "GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a" status: 404 len: 111 microversion: 2.1 time: 0.105121 Oct 12 22:46:46.858053 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1604/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:46 2022] GET /compute/v2.1/servers/62825a95-dac3-4250-b030-3f848dd6505a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:46.911332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:46.912630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:46.927007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.927715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.928356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:46.929252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:46.929874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:46.930470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.177226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:47.178151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:47.186276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.186773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.187219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:47.200008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:47.201026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:47.201648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:48.031683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:48.049787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:48.057532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:48.059136 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ae6c77a-47d4-48d9-8df0-412e1e124a8d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.885842 Oct 12 22:46:48.062214 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1605/3110] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:47 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:48.168972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:48.181026 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc265858-2e2d-4482-b0f5-3ff0fdce375a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 1.273457 Oct 12 22:46:48.183634 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1506/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:46 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:49.094769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:49.095401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:49.119329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.119952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.123364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.128817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.129390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.129832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.160899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=92 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:46:49.208684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:49.209292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:49.216917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.217412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.232230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.233134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:49.233619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:49.234092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:49.603281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:49.620176 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-10e45cbc-4759-4d88-b107-61cb5579f5b9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.412556 Oct 12 22:46:49.621120 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1507/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:49 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:49.829052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:49.842526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:49.844023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:49.853055 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a56ea124-04fb-429d-9662-b9a90b94c687 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.767581 Oct 12 22:46:49.853707 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1606/3113] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:49 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:50.645968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:50.646582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:50.669500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.670312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.672352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.675173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.676635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.678194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.883042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:50.884296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:50.900063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.903106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.903749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:50.904682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:50.905421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:50.916690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:51.203656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:51.216327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5bc64aea-db8b-4db4-b530-6d9b2e51d1da tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.576823 Oct 12 22:46:51.254312 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1508/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:50 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:51.403385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:51.422546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:51.434751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:51.435998 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f018e49-f5f5-4636-ad07-144f4f46abe0 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.557128 Oct 12 22:46:51.441092 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1607/3115] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:50 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:46:52.244852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:52.247166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:52.273243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.282034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.282610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.283396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.286551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.289134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.347627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-172f5598-f3e7-4e4d-aa96-75e632e39527 req-c1e0572a-69d8-4307-888d-d1d731a1c3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddb2249-b5e2-4308-9d4b-6881107150f7", "name": "network-vif-plugged", "status": "completed", "tag": "31b5e870-26bb-47d6-b17b-7ede69c80df3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:52.370302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-172f5598-f3e7-4e4d-aa96-75e632e39527 req-c1e0572a-69d8-4307-888d-d1d731a1c3dc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.370781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-172f5598-f3e7-4e4d-aa96-75e632e39527 req-c1e0572a-69d8-4307-888d-d1d731a1c3dc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.371209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-172f5598-f3e7-4e4d-aa96-75e632e39527 req-c1e0572a-69d8-4307-888d-d1d731a1c3dc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.414478 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-172f5598-f3e7-4e4d-aa96-75e632e39527 req-c1e0572a-69d8-4307-888d-d1d731a1c3dc service nova] Creating event network-vif-plugged:31b5e870-26bb-47d6-b17b-7ede69c80df3 for instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 on n-h2-860864-8 Oct 12 22:46:52.441647 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-172f5598-f3e7-4e4d-aa96-75e632e39527 req-c1e0572a-69d8-4307-888d-d1d731a1c3dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.875139 Oct 12 22:46:52.442624 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1509/3116] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:52.465040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:52.466518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:52.477712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.484975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.485660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.486861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:52.487583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:52.490521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:52.610652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:52.623427 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4b87dec-59a7-40c0-a368-68be97f2f8ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.384554 Oct 12 22:46:52.624792 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1608/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:52 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:53.000510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-186494575", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6857b740-c8f6-435b-b880-87bc9b4758e7"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:53.174124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] validate_networks() for [('6857b740-c8f6-435b-b880-87bc9b4758e7', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:46:53.199572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:53.212659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:53.217431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:53.221624 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1268da7-c1fb-4d38-a998-fe5055ce1799 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.761376 Oct 12 22:46:53.224869 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1510/3118] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:52 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:53.648266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:53.650291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:53.661294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:53.669531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:53.670441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.673526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:53.680316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:53.681230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.966643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:46:53.967189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:46:53.968044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:46:53.968614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:46:53.969199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:46:53.991681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:53.995060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:53.995774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:53.998477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.000241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.003825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.026577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:46:54.034266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for user 1353d2e3246c44cf8d4501c0f4455790 and project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:46:54.053400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:46:54.057562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:46:54.081451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:54.109869 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f589e3ce-2933-4b33-b100-d5325f9c045e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1322 microversion: 2.1 time: 0.466431 Oct 12 22:46:54.145942 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1511/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:53 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:46:54.177883 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bebb6e5a-5bf8-4888-9b68-630dce30afea tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551746 Oct 12 22:46:54.183781 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1609/3120] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:46:54.195045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5d6a022-6c00-4d6a-b027-f82272d041fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:54.196161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5d6a022-6c00-4d6a-b027-f82272d041fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:54.266506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:54.267366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:54.333531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.334016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.334452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.335162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.335618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.362194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.383277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d5d6a022-6c00-4d6a-b027-f82272d041fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:54.396033 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5d6a022-6c00-4d6a-b027-f82272d041fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1214 microversion: 2.1 time: 0.204920 Oct 12 22:46:54.405408 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1512/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:54 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:54.578042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-be64e1fc-76b7-40f6-ac15-2e832a0b8511 req-75157762-d652-4712-8cd0-227893814517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-plugged", "status": "completed", "tag": "d69e65b4-1b49-4f2c-9d37-671a6c603a4b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:54.607169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-be64e1fc-76b7-40f6-ac15-2e832a0b8511 req-75157762-d652-4712-8cd0-227893814517 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:54.610411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-be64e1fc-76b7-40f6-ac15-2e832a0b8511 req-75157762-d652-4712-8cd0-227893814517 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:54.611613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-be64e1fc-76b7-40f6-ac15-2e832a0b8511 req-75157762-d652-4712-8cd0-227893814517 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:54.636292 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-be64e1fc-76b7-40f6-ac15-2e832a0b8511 req-75157762-d652-4712-8cd0-227893814517 service nova] Creating event network-vif-plugged:d69e65b4-1b49-4f2c-9d37-671a6c603a4b for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:46:54.659588 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-be64e1fc-76b7-40f6-ac15-2e832a0b8511 req-75157762-d652-4712-8cd0-227893814517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086955 Oct 12 22:46:54.661552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1513/3122] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:55.137603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:55.138341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:55.156463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.156888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.158317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.162146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.162662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.163945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.480437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:55.500235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a03e4cfa-1b02-410c-8444-c61c69d6bedd tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1472 microversion: 2.1 time: 0.369948 Oct 12 22:46:55.503654 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1514/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:55 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:55.522711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:55.524810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:55.545006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.546498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.547192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.550091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:55.552187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:55.552869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:55.580005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:55.597994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:55.600580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:55.611179 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d68404dd-ee74-454a-b713-cf22c24d3dd2 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.358846 Oct 12 22:46:55.621767 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1610/3124] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:54 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:55.781643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:55.793512 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aa8ed386-bb37-4f61-8080-e555a1b06c73 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1210 microversion: 2.1 time: 0.288393 Oct 12 22:46:55.794371 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1515/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:55 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1210 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:56.178891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a089791e-96c8-4d64-bbf4-9518dd92e87a tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:56.179699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a089791e-96c8-4d64-bbf4-9518dd92e87a tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] [instance: 1a849b6e-90ba-473a-97d9-b1fad611a8a2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:56.189136 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a089791e-96c8-4d64-bbf4-9518dd92e87a tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] HTTP exception thrown: Instance 1a849b6e-90ba-473a-97d9-b1fad611a8a2 could not be found. Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a089791e-96c8-4d64-bbf4-9518dd92e87a tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Request method failure captured: Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/1a849b6e-90ba-473a-97d9-b1fad611a8a2/action HTTP/1.1 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 15 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PG2MZUE2MPv5rYab5K_nhg-shPYbBWao6AzFQcB2RUHnibW8PhL79np-WWjoMZMUsYyFSIoURpPJPQMGKjX6GmKUziH-04cSWKJGUKuyykfpkCK4q1ywhaETXeP1r_G10Vnv4tYfTPL_mzyIm_YOwic8z8oTZ2m4OJvy8rwtVpz9o Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_735246f0e8604c9894438c0e9b56c819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}] Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 78dc76cea8544bd09cf0b50f99912487 Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: {"migrate": {}} Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 1a849b6e-90ba-473a-97d9-b1fad611a8a2 could not be found. Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1a849b6e-90ba-473a-97d9-b1fad611a8a2', 'body': {'migrate': {}}} Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a849b6e-90ba-473a-97d9-b1fad611a8a2 could not be found. Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a849b6e-90ba-473a-97d9-b1fad611a8a2 could not be found. Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:56.192397 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a849b6e-90ba-473a-97d9-b1fad611a8a2 could not be found. Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a089791e-96c8-4d64-bbf4-9518dd92e87a tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Returning 404 to user: Instance 1a849b6e-90ba-473a-97d9-b1fad611a8a2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:46:56.198380 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a089791e-96c8-4d64-bbf4-9518dd92e87a tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1a849b6e-90ba-473a-97d9-b1fad611a8a2/action" status: 404 len: 111 microversion: 2.1 time: 0.569833 Oct 12 22:46:56.209860 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1611/3126] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:46:55 2022] POST /compute/v2.1/servers/1a849b6e-90ba-473a-97d9-b1fad611a8a2/action => generated 111 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:46:56.490869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1047614544", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:56.596447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:46:56.640093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:56.640837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:56.665879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:56.668589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:56.671294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:56.675446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:56.676042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:56.678636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:57.445783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:46:57.446309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:46:57.446976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:46:57.448058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:46:57.448847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:46:57.484900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:57.485677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:57.486707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:57.489508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:57.490653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:57.492738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:57.540312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Getting quotas for project 466ee048fcc5436fbfc3e493cb88897c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:46:57.551660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Getting quotas for user 89304d08b821486e89303403b802a4ae and project 466ee048fcc5436fbfc3e493cb88897c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:46:57.576502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:46:57.579262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:46:57.680594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ecbe68f-9f92-4c40-9a5e-493c80d246c8 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200420 Oct 12 22:46:57.683257 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1516/3127] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:46:57.688974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-da4f827c-3c57-42a4-bc75-d76d79b3482c req-dac45f86-decf-4b91-b29b-b499f7ed098a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-plugged", "status": "completed", "tag": "3fc4d68f-7b6b-4043-a00d-08e89eb886f3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:57.702032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-da4f827c-3c57-42a4-bc75-d76d79b3482c req-dac45f86-decf-4b91-b29b-b499f7ed098a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:57.703055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-da4f827c-3c57-42a4-bc75-d76d79b3482c req-dac45f86-decf-4b91-b29b-b499f7ed098a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:57.703398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-da4f827c-3c57-42a4-bc75-d76d79b3482c req-dac45f86-decf-4b91-b29b-b499f7ed098a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:57.719480 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-da4f827c-3c57-42a4-bc75-d76d79b3482c req-dac45f86-decf-4b91-b29b-b499f7ed098a service nova] Creating event network-vif-plugged:3fc4d68f-7b6b-4043-a00d-08e89eb886f3 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:46:57.727809 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-da4f827c-3c57-42a4-bc75-d76d79b3482c req-dac45f86-decf-4b91-b29b-b499f7ed098a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042128 Oct 12 22:46:57.730491 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1517/3128] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:46:57.742708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:57.743712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:57.759665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:57.760901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:57.762330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:57.764497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:57.766640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:57.769289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:57.963595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:57.989942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:57.998459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:57.999246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:58.001605 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e25408c3-2938-401b-9a68-9ab0713e753a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.367520 Oct 12 22:46:58.004812 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1612/3129] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:56 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:46:58.019865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd3aae97-e7b9-4636-a24b-d251d6023348 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:58.020525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fd3aae97-e7b9-4636-a24b-d251d6023348 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:58.030108 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f65261d4-fb35-436a-aea7-4351e29f87ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1272 microversion: 2.1 time: 0.297869 Oct 12 22:46:58.031666 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1518/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:57 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:58.138294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fd3aae97-e7b9-4636-a24b-d251d6023348 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:58.147777 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd3aae97-e7b9-4636-a24b-d251d6023348 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1222 microversion: 2.1 time: 0.141520 Oct 12 22:46:58.160430 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1613/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:58 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:59.038048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:59.039867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:59.058998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:59.060498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:59.065731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.069378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.088963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.090858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.091971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.094131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.096632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.097377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.098225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.099197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.105937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.106711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.416039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:59.454428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9eb6845d-7f74-4f66-bac0-43721987e5a1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.400354 Oct 12 22:46:59.456775 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1614/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:59 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:59.473256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:46:59.476293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:46:59.492169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.495231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.495990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.506398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.510793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.512252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.727980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:46:59.746028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e1479b8-9a68-42e4-a4f8-751fbac3d06b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1274 microversion: 2.1 time: 0.285668 Oct 12 22:46:59.752794 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1615/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:46:59 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1274 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:46:59.893640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d38af3d5-677d-4ff2-86e3-1a4266e26a81 req-e997f2f0-8f73-4535-a73b-4012f96faaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-plugged", "status": "completed", "tag": "c43ff5fc-65d2-467c-a135-f05491f4289a"}, {"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-plugged", "status": "completed", "tag": "c6ee8a46-c164-4f82-8d33-fe913c0d99ca"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:46:59.912460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d38af3d5-677d-4ff2-86e3-1a4266e26a81 req-e997f2f0-8f73-4535-a73b-4012f96faaff service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:46:59.913005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d38af3d5-677d-4ff2-86e3-1a4266e26a81 req-e997f2f0-8f73-4535-a73b-4012f96faaff service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:46:59.913749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d38af3d5-677d-4ff2-86e3-1a4266e26a81 req-e997f2f0-8f73-4535-a73b-4012f96faaff service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:46:59.970313 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d38af3d5-677d-4ff2-86e3-1a4266e26a81 req-e997f2f0-8f73-4535-a73b-4012f96faaff service nova] Creating event network-vif-plugged:c43ff5fc-65d2-467c-a135-f05491f4289a for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:46:59.972866 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d38af3d5-677d-4ff2-86e3-1a4266e26a81 req-e997f2f0-8f73-4535-a73b-4012f96faaff service nova] Creating event network-vif-plugged:c6ee8a46-c164-4f82-8d33-fe913c0d99ca for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:46:59.995028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d38af3d5-677d-4ff2-86e3-1a4266e26a81 req-e997f2f0-8f73-4535-a73b-4012f96faaff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104171 Oct 12 22:46:59.995692 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1616/3134] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:00.107735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:00.119096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:00.120609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:00.121770 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3b14044-9a13-4a73-b78f-b2a7bf5bb4fe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.094868 Oct 12 22:47:00.122340 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1519/3135] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:46:59 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:47:00.482126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:00.482848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:00.502759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:00.503323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:00.503761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:00.508057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:00.508766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:00.513286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:00.774645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:00.775270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:00.787404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:00.787921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:00.788358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:00.789060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:00.789508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:00.792465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:00.801115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:00.812922 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5546b910-a5a1-4c3d-8f3d-5c6799fd2be2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.337347 Oct 12 22:47:00.822043 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1617/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:00 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:01.149563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:01.152404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:01.160458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:01.161253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:01.162164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:01.163057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:01.173512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:01.174898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:01.264839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:01.276068 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e9e6f75-2db7-41a0-9e8f-68c65a3a14fe tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1280 microversion: 2.1 time: 0.504747 Oct 12 22:47:01.276665 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1520/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:00 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1280 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:01.855421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:01.856536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:01.866714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:01.867620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:01.869810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:01.870854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:01.871756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:01.872887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:02.341684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:02.355550 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59e56005-74be-4ff9-9c29-13c13ec698f4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.507523 Oct 12 22:47:02.356756 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1521/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:01 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:02.372316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b237d91e-0144-4339-b71a-31223145c7f6 req-50d2e32c-94f5-4b2e-8d29-c0d8a8e21032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-plugged", "status": "completed", "tag": "54928122-32c5-4bfb-bd09-eefd47b387a4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:02.388391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b237d91e-0144-4339-b71a-31223145c7f6 req-50d2e32c-94f5-4b2e-8d29-c0d8a8e21032 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:02.390191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b237d91e-0144-4339-b71a-31223145c7f6 req-50d2e32c-94f5-4b2e-8d29-c0d8a8e21032 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:02.396532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b237d91e-0144-4339-b71a-31223145c7f6 req-50d2e32c-94f5-4b2e-8d29-c0d8a8e21032 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:02.401696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:02.428316 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b237d91e-0144-4339-b71a-31223145c7f6 req-50d2e32c-94f5-4b2e-8d29-c0d8a8e21032 service nova] Creating event network-vif-plugged:54928122-32c5-4bfb-bd09-eefd47b387a4 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:47:02.437629 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b237d91e-0144-4339-b71a-31223145c7f6 req-50d2e32c-94f5-4b2e-8d29-c0d8a8e21032 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079448 Oct 12 22:47:02.438256 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1522/3139] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:02.443390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:02.444136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:02.460405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:02.460903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:02.461344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:02.462082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:02.462506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:02.476142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:02.508985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:02.519734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:02.521212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:02.529713 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32990f1e-4968-4f29-8706-42ee4d425793 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.383991 Oct 12 22:47:02.545948 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1618/3140] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:47:01 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:47:02.561885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-dd22f026-e553-48d8-b5ed-9c3d2d7e8295 req-6f63f6b4-c800-4812-bdc3-5955340aad69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753b80e8-dd52-4d1a-9cb7-a4dc58cf2485", "tag": "953e48dc-64c1-4469-932a-f5ed8d4c5373"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:02.594825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dd22f026-e553-48d8-b5ed-9c3d2d7e8295 req-6f63f6b4-c800-4812-bdc3-5955340aad69 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:02.595862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dd22f026-e553-48d8-b5ed-9c3d2d7e8295 req-6f63f6b4-c800-4812-bdc3-5955340aad69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:02.599207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dd22f026-e553-48d8-b5ed-9c3d2d7e8295 req-6f63f6b4-c800-4812-bdc3-5955340aad69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:02.631092 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-dd22f026-e553-48d8-b5ed-9c3d2d7e8295 req-6f63f6b4-c800-4812-bdc3-5955340aad69 service nova] Creating event network-changed:953e48dc-64c1-4469-932a-f5ed8d4c5373 for instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 on n-h1-860864-8 Oct 12 22:47:02.649037 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-dd22f026-e553-48d8-b5ed-9c3d2d7e8295 req-6f63f6b4-c800-4812-bdc3-5955340aad69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100330 Oct 12 22:47:02.651140 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1619/3141] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:02.762734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:02.784720 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b47d9124-d149-4518-b735-a27b2362331a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1280 microversion: 2.1 time: 0.338254 Oct 12 22:47:02.792194 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1523/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:02 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1280 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:03.387734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:03.389801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:03.399621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:03.400488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:03.401152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:03.402040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:03.402651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:03.403319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:03.560245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:03.560868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:03.573725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:03.580258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:03.580686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:03.582629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:03.582629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:03.582629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:03.944533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:03.965923 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26e38c56-ab6e-440e-a82f-14a9a7bee152 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.581496 Oct 12 22:47:03.967768 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1620/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:03 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:04.002954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:04.003716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:04.016432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:04.019882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:04.025143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:04.027348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:04.040436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:04.042704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:04.044882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:04.557119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:04.576416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b29bdd46-17a8-4664-8c3f-14a77a4bede3 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.606454 Oct 12 22:47:04.578042 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1621/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:03 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:04.590169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fd825442-b6df-4526-9a73-f5e0b8b88891 req-a9a7609c-d6f2-4d12-bb5c-3a32c66369f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-plugged", "status": "completed", "tag": "dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb"}, {"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-plugged", "status": "completed", "tag": "6940aca1-b7be-4fa9-b75f-3b146a851a4b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:04.615998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fd825442-b6df-4526-9a73-f5e0b8b88891 req-a9a7609c-d6f2-4d12-bb5c-3a32c66369f9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:04.620016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fd825442-b6df-4526-9a73-f5e0b8b88891 req-a9a7609c-d6f2-4d12-bb5c-3a32c66369f9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:04.620016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fd825442-b6df-4526-9a73-f5e0b8b88891 req-a9a7609c-d6f2-4d12-bb5c-3a32c66369f9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:04.649401 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fd825442-b6df-4526-9a73-f5e0b8b88891 req-a9a7609c-d6f2-4d12-bb5c-3a32c66369f9 service nova] Creating event network-vif-plugged:dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:47:04.650014 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fd825442-b6df-4526-9a73-f5e0b8b88891 req-a9a7609c-d6f2-4d12-bb5c-3a32c66369f9 service nova] Creating event network-vif-plugged:6940aca1-b7be-4fa9-b75f-3b146a851a4b for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:47:04.663692 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fd825442-b6df-4526-9a73-f5e0b8b88891 req-a9a7609c-d6f2-4d12-bb5c-3a32c66369f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082134 Oct 12 22:47:04.665674 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1622/3145] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:04.997156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:04.999088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:05.014074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:05.016686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:05.017364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:05.019928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:05.022833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:05.023506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:05.045639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:05.062565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:05.071258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:05.085345 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59da0ea0-7595-4be2-98cc-5a3be807d245 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 1.527469 Oct 12 22:47:05.089886 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1524/3146] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:47:03 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:47:05.580506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:05.597643 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa8e783c-ef6c-488d-8461-972ddcddc2b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.606292 Oct 12 22:47:05.614649 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1623/3147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:04 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:05.616796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:05.624637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:05.640772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:05.641675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:05.644256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:05.645427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:05.648187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:05.649118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:06.124646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:06.125265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:06.136166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:06.137595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:06.140593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:06.141589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:06.142219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:06.145101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:06.279148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:06.288256 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca0fa6ae-75bc-43af-9379-9a83e4723984 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.690544 Oct 12 22:47:06.288866 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1525/3148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:05 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:06.631394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:06.632173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:06.642761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:06.643268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:06.643701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:06.646463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:06.649116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:06.649570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:06.808289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:06.823549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:06.825485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:06.827118 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc3b6d13-43ff-4e90-91b3-9a8aae11a6f1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1878 microversion: 2.42 time: 0.707173 Oct 12 22:47:06.828211 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1624/3149] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:47:06 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1878 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:47:07.265148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:07.291547 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3011def2-2b0d-4658-946c-55f1bdf7bd93 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.664125 Oct 12 22:47:07.292617 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1526/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:06 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:07.315426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:07.317137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:07.332748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:07.333358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:07.334999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:07.339569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:07.342922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:07.344761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:07.704148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:07.730562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e73f553b-a456-4c1f-a635-d984126823f5 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.416239 Oct 12 22:47:07.732981 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1625/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:07 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:07.857225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:07.858037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:07.862852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:07.865566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:07.882020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:07.882514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:07.882952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:07.887005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:07.888218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:07.888655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:08.314638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:08.315245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:08.332297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:08.334822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:08.340694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:08.344462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:08.346073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:08.347147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:08.349304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:08.850311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:08.861003 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-505b6aef-2293-48c7-97d1-d72b49d402fc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.550129 Oct 12 22:47:08.867796 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1626/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:08 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:08.894811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:08.895987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:08.923604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:08.924823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:08.926018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:08.928277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:08.928762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:08.929202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:08.997519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:09.626879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:09.660865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a28bef22-a773-4922-a17b-f97eb82af22a tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.788604 Oct 12 22:47:09.662354 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1627/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:08 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:09.675637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-02f47253-0d39-4edc-a8be-560266f1f981 req-4c78671f-5292-488d-8da0-fe77afd219ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de0393c-3979-4fe6-a684-e26d3fca7f60", "tag": "4eafab3c-3a7a-41f9-ab85-3ddfd538edc4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:09.716733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02f47253-0d39-4edc-a8be-560266f1f981 req-4c78671f-5292-488d-8da0-fe77afd219ad service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:09.717325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02f47253-0d39-4edc-a8be-560266f1f981 req-4c78671f-5292-488d-8da0-fe77afd219ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:09.717763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02f47253-0d39-4edc-a8be-560266f1f981 req-4c78671f-5292-488d-8da0-fe77afd219ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:09.759467 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-02f47253-0d39-4edc-a8be-560266f1f981 req-4c78671f-5292-488d-8da0-fe77afd219ad service nova] Creating event network-changed:4eafab3c-3a7a-41f9-ab85-3ddfd538edc4 for instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 on n-h2-860864-8 Oct 12 22:47:09.786476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-02f47253-0d39-4edc-a8be-560266f1f981 req-4c78671f-5292-488d-8da0-fe77afd219ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121979 Oct 12 22:47:09.795346 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1628/3154] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:09.869857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:09.889922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:09.890983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:09.902462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:09.903245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:09.903858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:09.904774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:09.904912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:09.909410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:09.910116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:09.912403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:09.914064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef87b3c6-f6c7-437b-9547-f82a87575e79 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2835 microversion: 2.42 time: 2.063247 Oct 12 22:47:09.914650 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1527/3155] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:47:07 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2835 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:47:09.948919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:09.949498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:09.969926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:09.980468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:09.981689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:09.990035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:09.990812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:09.996300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:09.997017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:10.561423 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:47:10.561885 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 22:47:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 (ip 10.222.0.20) !!! Oct 12 22:47:10.597050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:10.607272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-55117533-d115-4f46-9169-5d7a1e41b962 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 0.721450 Oct 12 22:47:10.611519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-215a6a03-6aaf-4818-b12a-d5ab6de63467 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.667498 Oct 12 22:47:10.613355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1528/3156] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 22:47:09 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524/os-interface => generated 1830 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:47:10.622816 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1629/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:09 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:10.689301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:10.689920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:10.703375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:10.704500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:10.704500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:10.705010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:10.705463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:10.705888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:11.055059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:11.065790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e125435-2d65-4c09-8510-105fdd700f4d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.380237 Oct 12 22:47:11.075421 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1529/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:10 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:11.654674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:11.656338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:11.659572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:11.669591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:11.672538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:11.673397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:11.676441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:11.677440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:11.678083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:12.093717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:12.094339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:12.113197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:12.115341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:12.116083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:12.116839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:12.117375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:12.123386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:12.910002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:12.924349 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a89bcfe-4907-4d10-a632-953b308111d6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.836172 Oct 12 22:47:12.927432 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1530/3159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:12 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:12.944544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f6929c7b-7b6e-4fdf-a171-8ea7f0d03cd4 req-c74ef180-85b1-48fe-921a-eb9857736aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753b80e8-dd52-4d1a-9cb7-a4dc58cf2485", "name": "network-vif-plugged", "status": "completed", "tag": "953e48dc-64c1-4469-932a-f5ed8d4c5373"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:13.011248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f6929c7b-7b6e-4fdf-a171-8ea7f0d03cd4 req-c74ef180-85b1-48fe-921a-eb9857736aad service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:13.012152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f6929c7b-7b6e-4fdf-a171-8ea7f0d03cd4 req-c74ef180-85b1-48fe-921a-eb9857736aad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:13.025183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f6929c7b-7b6e-4fdf-a171-8ea7f0d03cd4 req-c74ef180-85b1-48fe-921a-eb9857736aad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:13.081421 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f6929c7b-7b6e-4fdf-a171-8ea7f0d03cd4 req-c74ef180-85b1-48fe-921a-eb9857736aad service nova] Creating event network-vif-plugged:953e48dc-64c1-4469-932a-f5ed8d4c5373 for instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 on n-h1-860864-8 Oct 12 22:47:13.096835 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f6929c7b-7b6e-4fdf-a171-8ea7f0d03cd4 req-c74ef180-85b1-48fe-921a-eb9857736aad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167844 Oct 12 22:47:13.109729 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1531/3160] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:13.959313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:13.960439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:13.980929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:13.981424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:13.981854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:13.982570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:13.983019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:13.983439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:14.098088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:14.115257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3f9db49-aa02-4af9-ab9c-86239da70a33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1314 microversion: 2.1 time: 2.471760 Oct 12 22:47:14.132073 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1630/3161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:11 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1314 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:14.265043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:14.274015 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b7bd8b0-e9f3-499d-929b-9b6e9b72b2a2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.324257 Oct 12 22:47:14.294684 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1532/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:13 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:15.140920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:15.142703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:15.158551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:15.164914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:15.166311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:15.167316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:15.168883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:15.171842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:15.302109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:15.303447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:15.321089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:15.323460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:15.324148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:15.327844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:15.330745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:15.331643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:15.748305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:15.763079 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79496426-d3f9-4100-a138-bcee44b92190 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1500 microversion: 2.1 time: 0.628363 Oct 12 22:47:15.774196 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1631/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:15 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1500 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:15.806097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:15.826911 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6c9b566-396e-4d04-844a-c2d03f80764d tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.523733 Oct 12 22:47:15.829944 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1533/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:15 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:15.849113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:15.851567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:15.880852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:15.885317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:15.887301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:15.897348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:15.897906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:15.898351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:15.989693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:47:16.122590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3f1567de-b86e-40f8-8db5-a78dedf263e7 req-bb5671a6-325d-4cc2-a362-b5b7b6d42e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "tag": "d69e65b4-1b49-4f2c-9d37-671a6c603a4b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:16.148092 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-075f44ce-da40-4e24-b7e8-d68735fe1d5d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 204 len: 0 microversion: 2.1 time: 0.315980 Oct 12 22:47:16.149007 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1534/3165] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:47:15 2022] DELETE /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:47:16.152307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3f1567de-b86e-40f8-8db5-a78dedf263e7 req-bb5671a6-325d-4cc2-a362-b5b7b6d42e17 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:16.153221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3f1567de-b86e-40f8-8db5-a78dedf263e7 req-bb5671a6-325d-4cc2-a362-b5b7b6d42e17 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:16.153735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3f1567de-b86e-40f8-8db5-a78dedf263e7 req-bb5671a6-325d-4cc2-a362-b5b7b6d42e17 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:16.163371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:16.164249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:16.176353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:16.176843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:16.177287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:16.186185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:16.186486 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3f1567de-b86e-40f8-8db5-a78dedf263e7 req-bb5671a6-325d-4cc2-a362-b5b7b6d42e17 service nova] Creating event network-changed:d69e65b4-1b49-4f2c-9d37-671a6c603a4b for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:47:16.186682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:16.187119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:16.201474 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3f1567de-b86e-40f8-8db5-a78dedf263e7 req-bb5671a6-325d-4cc2-a362-b5b7b6d42e17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.420208 Oct 12 22:47:16.202104 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1632/3166] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:16.241914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-bbc7b5d8-93d8-4a7d-ace1-cd665aa6bf9b req-9aa0275f-f380-4197-bde7-a98ea7bdcbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de0393c-3979-4fe6-a684-e26d3fca7f60", "name": "network-vif-plugged", "status": "completed", "tag": "4eafab3c-3a7a-41f9-ab85-3ddfd538edc4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:16.266335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bbc7b5d8-93d8-4a7d-ace1-cd665aa6bf9b req-9aa0275f-f380-4197-bde7-a98ea7bdcbe1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:16.266810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bbc7b5d8-93d8-4a7d-ace1-cd665aa6bf9b req-9aa0275f-f380-4197-bde7-a98ea7bdcbe1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:16.267367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bbc7b5d8-93d8-4a7d-ace1-cd665aa6bf9b req-9aa0275f-f380-4197-bde7-a98ea7bdcbe1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:16.292029 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-bbc7b5d8-93d8-4a7d-ace1-cd665aa6bf9b req-9aa0275f-f380-4197-bde7-a98ea7bdcbe1 service nova] Creating event network-vif-plugged:4eafab3c-3a7a-41f9-ab85-3ddfd538edc4 for instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 on n-h2-860864-8 Oct 12 22:47:16.300570 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-bbc7b5d8-93d8-4a7d-ace1-cd665aa6bf9b req-9aa0275f-f380-4197-bde7-a98ea7bdcbe1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064044 Oct 12 22:47:16.301854 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1633/3167] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:16.522076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:16.536844 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d5ef0f9-5b64-4949-96a7-9128d91160b7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1506 microversion: 2.1 time: 0.382807 Oct 12 22:47:16.552303 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1535/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:16 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:16.858641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:16.860167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:16.889484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:16.890460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:16.891314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:16.892546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:16.893812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:16.894418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:17.575405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:17.576111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:17.598448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:17.601503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:17.605694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:17.607142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:17.607791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:17.608404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:17.738072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:17.760945 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c85ca5c9-5ea8-4d12-b22a-95c9f3c1d4ba tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1322 microversion: 2.1 time: 0.911072 Oct 12 22:47:17.772250 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1634/3169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:16 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1322 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:18.724819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-955e3243-c4a4-428e-a3f4-01eb3d25dc8e req-b11dffad-5284-4a79-966c-44ebb9372e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753b80e8-dd52-4d1a-9cb7-a4dc58cf2485", "name": "network-vif-deleted", "tag": "953e48dc-64c1-4469-932a-f5ed8d4c5373"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:18.750409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-955e3243-c4a4-428e-a3f4-01eb3d25dc8e req-b11dffad-5284-4a79-966c-44ebb9372e5a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:18.751831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-955e3243-c4a4-428e-a3f4-01eb3d25dc8e req-b11dffad-5284-4a79-966c-44ebb9372e5a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:18.752461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-955e3243-c4a4-428e-a3f4-01eb3d25dc8e req-b11dffad-5284-4a79-966c-44ebb9372e5a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:18.774597 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-955e3243-c4a4-428e-a3f4-01eb3d25dc8e req-b11dffad-5284-4a79-966c-44ebb9372e5a service nova] Creating event network-vif-deleted:953e48dc-64c1-4469-932a-f5ed8d4c5373 for instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 on n-h1-860864-8 Oct 12 22:47:18.788749 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-955e3243-c4a4-428e-a3f4-01eb3d25dc8e req-b11dffad-5284-4a79-966c-44ebb9372e5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067796 Oct 12 22:47:18.789865 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1635/3170] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:18.798608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:18.803593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:18.817191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:18.821168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:18.821842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:18.822744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:18.823393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:18.823532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:18.824481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:18.837008 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fcf24a0b-52a1-40ab-b98a-d2c07e663005 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 200 len: 1506 microversion: 2.1 time: 1.278168 Oct 12 22:47:18.843163 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1536/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:17 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 1506 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:19.365945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:19.374460 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8d3f35a-86df-46e2-a4e2-5c4147dc59b2 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1471 microversion: 2.1 time: 0.580167 Oct 12 22:47:19.377082 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1636/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:18 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1471 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:19.400580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:19.401126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:19.423692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:19.424297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:19.424759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:19.430447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:19.430954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:19.431992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:19.535657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lazy-loading 'flavor' on Instance uuid 2de0393c-3979-4fe6-a684-e26d3fca7f60 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:47:19.638643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:19.713594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d9eebd6-fccd-4aaf-8af9-04e5390c3aa9 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60/action" status: 202 len: 0 microversion: 2.1 time: 0.316346 Oct 12 22:47:19.719367 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1537/3173] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:47:19 2022] POST /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:47:19.723972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:19.725038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:19.735179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:19.736577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:19.737308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:19.739577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:19.740573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:19.741331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:19.863815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:19.866076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:19.875798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:19.876254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:19.876695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:19.877613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:19.878256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:19.878847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:19.897014 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 HTTP/1.1 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '753b80e8-dd52-4d1a-9cb7-a4dc58cf2485'} Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:19.902514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:19.910557 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:19.910557 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:19.910557 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:19.910557 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:19.910557 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:19.910557 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:47:19.910557 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:19.923980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:19.923980 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb8791fd-aa1d-4983-a5d6-668281a16b96 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 404 len: 111 microversion: 2.1 time: 0.055071 Oct 12 22:47:19.923980 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1538/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:19 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:47:20.207456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1680704832", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6857b740-c8f6-435b-b880-87bc9b4758e7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:20.340472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] validate_networks() for [('6857b740-c8f6-435b-b880-87bc9b4758e7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:47:20.578053 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6efce57-42e9-452d-a413-11e71bf510be tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1630 microversion: 2.1 time: 0.857373 Oct 12 22:47:20.578924 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1637/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:19 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1630 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:21.614526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:21.616386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:21.626235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:21.626989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:21.627648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:21.628605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:21.629423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:21.630286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:22.062527 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4679ce6e-b5cd-4450-ad51-3218109d9e85 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1613 microversion: 2.1 time: 0.457224 Oct 12 22:47:22.064968 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1638/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:21 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1613 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:22.093343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:22.094202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:22.101396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:22.104482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:22.105206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:22.108127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:22.108814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:22.110444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:22.160381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:47:22.160944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:47:22.161270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:47:22.161680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:47:22.162089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:47:22.180059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:22.180847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:22.182029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:22.182951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:22.185083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:22.185728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:22.237733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:22.253598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for user 1353d2e3246c44cf8d4501c0f4455790 and project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:22.288262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:47:22.291256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:47:22.410156 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c075d72-232c-4ef4-b4d2-51045f690110 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.208248 Oct 12 22:47:22.416750 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1539/3177] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:47:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:47:22.439611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8e1fbbd-231d-401b-8d2a-09eb87da8ea1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:22.451748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a8e1fbbd-231d-401b-8d2a-09eb87da8ea1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:22.626020 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] HTTP exception thrown: Cannot 'migrate' instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 while it is in vm_state suspended Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Request method failure captured: Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60/action HTTP/1.1 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 15 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PG2MZUE2MPv5rYab5K_nhg-shPYbBWao6AzFQcB2RUHnibW8PhL79np-WWjoMZMUsYyFSIoURpPJPQMGKjX6GmKUziH-04cSWKJGUKuyykfpkCK4q1ywhaETXeP1r_G10Vnv4tYfTPL_mzyIm_YOwic8z8oTZ2m4OJvy8rwtVpz9o Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_735246f0e8604c9894438c0e9b56c819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}] Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 78dc76cea8544bd09cf0b50f99912487 Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: {"migrate": {}} Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'migrate' instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 while it is in vm_state suspended Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2de0393c-3979-4fe6-a684-e26d3fca7f60', 'body': {'migrate': {}}} Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 in vm_state suspended. Cannot resize while the instance is in this state. Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:22.628097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 while it is in vm_state suspended Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 while it is in vm_state suspended Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Returning 409 to user: Cannot 'migrate' instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 while it is in vm_state suspended {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:22.632765 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e37d0d1-0dd3-4842-b2da-f2cfa5d67b46 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60/action" status: 409 len: 148 microversion: 2.1 time: 0.540053 Oct 12 22:47:22.642065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1639/3178] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:47:22 2022] POST /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60/action => generated 148 bytes in 553 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:47:22.660532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba2b25fb-1b02-44e3-bf1b-ff7daecd51e5 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba2b25fb-1b02-44e3-bf1b-ff7daecd51e5 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Request method failure captured: Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7/action HTTP/1.1 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 39 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PG2MZUE2MPv5rYab5K_nhg-shPYbBWao6AzFQcB2RUHnibW8PhL79np-WWjoMZMUsYyFSIoURpPJPQMGKjX6GmKUziH-04cSWKJGUKuyykfpkCK4q1ywhaETXeP1r_G10Vnv4tYfTPL_mzyIm_YOwic8z8oTZ2m4OJvy8rwtVpz9o Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_735246f0e8604c9894438c0e9b56c819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}] Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 78dc76cea8544bd09cf0b50f99912487 Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: {"os-resetState": {"state": "invalid"}} Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '8ddb2249-b5e2-4308-9d4b-6881107150f7', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:47:22.676887 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.682571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba2b25fb-1b02-44e3-bf1b-ff7daecd51e5 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:22.684522 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ba2b25fb-1b02-44e3-bf1b-ff7daecd51e5 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7/action" status: 400 len: 144 microversion: 2.1 time: 0.039476 Oct 12 22:47:22.694265 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1640/3179] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:47:22 2022] POST /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7/action => generated 144 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 22:47:22.703276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-905863c3-3e72-4344-8fa7-c25f2d8dd7e8 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-905863c3-3e72-4344-8fa7-c25f2d8dd7e8 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Request method failure captured: Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7/action HTTP/1.1 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 31 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PG2MZUE2MPv5rYab5K_nhg-shPYbBWao6AzFQcB2RUHnibW8PhL79np-WWjoMZMUsYyFSIoURpPJPQMGKjX6GmKUziH-04cSWKJGUKuyykfpkCK4q1ywhaETXeP1r_G10Vnv4tYfTPL_mzyIm_YOwic8z8oTZ2m4OJvy8rwtVpz9o Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_735246f0e8604c9894438c0e9b56c819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}] Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 78dc76cea8544bd09cf0b50f99912487 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: {"os-resetState": {"state": 1}} Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '8ddb2249-b5e2-4308-9d4b-6881107150f7', 'body': {'os-resetState': {'state': 1}}} Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 1 Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 22:47:22.710095 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 22:47:22.718447 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.731516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-905863c3-3e72-4344-8fa7-c25f2d8dd7e8 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:22.731516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-905863c3-3e72-4344-8fa7-c25f2d8dd7e8 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7/action" status: 400 len: 120 microversion: 2.1 time: 0.025140 Oct 12 22:47:22.732992 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1641/3180] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:47:22 2022] POST /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7/action => generated 120 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:47:22.738447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99fd9016-8478-4975-acf5-406167f94185 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:22.741276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99fd9016-8478-4975-acf5-406167f94185 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Failed to fetch instance by id 999 {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 22:47:22.742021 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-99fd9016-8478-4975-acf5-406167f94185 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99fd9016-8478-4975-acf5-406167f94185 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Request method failure captured: Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 37 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PG2MZUE2MPv5rYab5K_nhg-shPYbBWao6AzFQcB2RUHnibW8PhL79np-WWjoMZMUsYyFSIoURpPJPQMGKjX6GmKUziH-04cSWKJGUKuyykfpkCK4q1ywhaETXeP1r_G10Vnv4tYfTPL_mzyIm_YOwic8z8oTZ2m4OJvy8rwtVpz9o Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/735246f0e8604c9894438c0e9b56c819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_735246f0e8604c9894438c0e9b56c819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/735246f0e8604c9894438c0e9b56c819"}]}] Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 735246f0e8604c9894438c0e9b56c819 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-948003243 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 78dc76cea8544bd09cf0b50f99912487 Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-948003243-project-admin Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: {"os-resetState": {"state": "error"}} Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 999 could not be found. Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:22.754461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:22.759443 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:22.759443 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 12 22:47:22.759443 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:22.764719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99fd9016-8478-4975-acf5-406167f94185 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:22.776269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99fd9016-8478-4975-acf5-406167f94185 tempest-ServersAdminNegativeTestJSON-948003243 tempest-ServersAdminNegativeTestJSON-948003243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.041849 Oct 12 22:47:22.784114 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1642/3181] 10.222.0.20 () {60 vars in 1179 bytes} [Wed Oct 12 22:47:22 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:47:22.792495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:22.793332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:22.804478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:22.806119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:22.807010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:22.808961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:22.809965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:22.810708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:22.860444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:47:22.941513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a8e1fbbd-231d-401b-8d2a-09eb87da8ea1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:22.955410 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8e1fbbd-231d-401b-8d2a-09eb87da8ea1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1215 microversion: 2.1 time: 0.530614 Oct 12 22:47:22.956789 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1540/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:22 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1215 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:23.068261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-18f19fad-07fc-4c2d-853f-f64eb12272ca tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 204 len: 0 microversion: 2.1 time: 0.281049 Oct 12 22:47:23.070427 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1643/3183] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:47:22 2022] DELETE /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:47:23.084503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:23.085400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:23.094753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:23.095251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:23.095694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:23.096525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:23.096878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:23.103169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:23.992656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:23.996270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:24.021835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:24.026787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:24.027278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:24.030279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:24.044829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:24.047740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:24.291878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:24.304367 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-daa9bf39-4470-43d4-94ea-ae504ecd3944 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1267 microversion: 2.1 time: 0.326803 Oct 12 22:47:24.307229 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1644/3184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:23 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:24.453386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:24.463691 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19c845ad-2fe9-4bed-b985-9d0d638c6522 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1468 microversion: 2.1 time: 1.383571 Oct 12 22:47:24.469340 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1541/3185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:23 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1468 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:25.333231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:25.335163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:25.350428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:25.351657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:25.352348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:25.353866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:25.354649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:25.355243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:25.496558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:25.501155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:25.505024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:25.530138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0fabc70-0fe4-45dd-966d-29f8cdef6b83 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1273 microversion: 2.1 time: 0.200457 Oct 12 22:47:25.532309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:25.533673 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1645/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:25 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:25.533943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:25.534738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:25.538000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:25.538760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:25.539530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:26.139789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:26.153350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e070dc71-0ec1-4fd6-8474-c18f88ba0215 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1468 microversion: 2.1 time: 0.663567 Oct 12 22:47:26.160777 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1542/3187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:25 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1468 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:26.554210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:26.554835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:26.568594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:26.570817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:26.571512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:26.573514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:26.574949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:26.575565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:26.737133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:26.755021 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-18c5a4da-ccae-41bd-a9df-0d0dec6b4b18 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1273 microversion: 2.1 time: 0.205233 Oct 12 22:47:26.772645 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1646/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:26 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:27.189481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:27.191346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:27.205137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:27.206081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:27.206738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:27.207776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:27.208671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:27.209536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:27.374980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-110a2b0f-003b-4d68-b401-a7b54dd5c917 req-252fbbfd-81e7-4f5f-9617-4457776e3730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de0393c-3979-4fe6-a684-e26d3fca7f60", "name": "network-vif-deleted", "tag": "4eafab3c-3a7a-41f9-ab85-3ddfd538edc4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:27.402699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:27.416496 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b59c5ed1-0aac-479f-83a4-58fc2473fe6e tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 200 len: 1426 microversion: 2.1 time: 0.231445 Oct 12 22:47:27.417864 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1543/3189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:27 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 1426 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:27.419674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-110a2b0f-003b-4d68-b401-a7b54dd5c917 req-252fbbfd-81e7-4f5f-9617-4457776e3730 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:27.421464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-110a2b0f-003b-4d68-b401-a7b54dd5c917 req-252fbbfd-81e7-4f5f-9617-4457776e3730 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:27.421908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-110a2b0f-003b-4d68-b401-a7b54dd5c917 req-252fbbfd-81e7-4f5f-9617-4457776e3730 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:27.454656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-110a2b0f-003b-4d68-b401-a7b54dd5c917 req-252fbbfd-81e7-4f5f-9617-4457776e3730 service nova] Creating event network-vif-deleted:4eafab3c-3a7a-41f9-ab85-3ddfd538edc4 for instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 on n-h2-860864-8 Oct 12 22:47:27.465537 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-110a2b0f-003b-4d68-b401-a7b54dd5c917 req-252fbbfd-81e7-4f5f-9617-4457776e3730 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098516 Oct 12 22:47:27.470152 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1647/3190] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:27.782371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:27.783354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:27.796523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:27.797327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:27.798174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:27.799088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:27.800315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:27.800958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.448672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:28.450104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 2de0393c-3979-4fe6-a684-e26d3fca7f60] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:28.461621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.468586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.470907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.477083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.478949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.481982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.506613 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] HTTP exception thrown: Instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 could not be found. Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Request method failure captured: Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 HTTP/1.1 Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PF4hUxD-1PDK-gM5tLHkKAwJ8qbNEKBA8zd9N1Cp-tusEGAH9pz1WozhWGkc4MKrXo55und3HFWZ7D1i1BUcUIbP-nXxkVD8kNKts6w7nfueQEkOf0t6-ZAOLH6wp34bgj2LgpGyElTo4p1RoEMXpQ_njhRLWdh2TLvdJgXmkqm3s Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 466ee048fcc5436fbfc3e493cb88897c Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-619950624 Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/466ee048fcc5436fbfc3e493cb88897c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/466ee048fcc5436fbfc3e493cb88897c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_466ee048fcc5436fbfc3e493cb88897c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/466ee048fcc5436fbfc3e493cb88897c"}]}] Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-619950624 Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 466ee048fcc5436fbfc3e493cb88897c Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-619950624 Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-619950624-project Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 89304d08b821486e89303403b802a4ae Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-619950624-project Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 could not be found. Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2de0393c-3979-4fe6-a684-e26d3fca7f60'} Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 could not be found. Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 could not be found. Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:28.510542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 could not be found. Oct 12 22:47:28.516657 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:28.518781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Returning 404 to user: Instance 2de0393c-3979-4fe6-a684-e26d3fca7f60 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:28.520023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f9dc228-2099-4e82-93a5-f24c2f8ef19b tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60" status: 404 len: 111 microversion: 2.1 time: 0.078026 Oct 12 22:47:28.521258 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1648/3191] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:28 2022] GET /compute/v2.1/servers/2de0393c-3979-4fe6-a684-e26d3fca7f60 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:47:28.530834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:28.531514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:28.539922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.541149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.541863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.542758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.543378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.544518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.604017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:28.619693 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d13cf068-f095-40a7-918d-59f23a9ab7d6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1315 microversion: 2.1 time: 0.841625 Oct 12 22:47:28.627012 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1544/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:27 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:28.628389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:47:28.633018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:28.903193 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c73b886-181f-4f03-9f04-f14110871b56 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 204 len: 0 microversion: 2.1 time: 0.376822 Oct 12 22:47:28.906657 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1649/3193] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:47:28 2022] DELETE /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:47:28.916225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:28.917235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:28.931565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.933508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.938574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:28.942108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:28.943084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:28.945416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:29.241050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:29.252534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-326fd51a-e32c-4484-8885-a08a823a3c32 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1478 microversion: 2.1 time: 0.341808 Oct 12 22:47:29.265763 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1545/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:28 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1478 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:29.662945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:29.664471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:29.674384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:29.677058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:29.678314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:29.683206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:29.685323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:29.686771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:30.279104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:30.280244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:30.295912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:30.296840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:30.298178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:30.303955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:30.304874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:30.306233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:30.331668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:30.349770 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c6441c2-f8c7-4cc1-bff7-d31e75c29a1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1315 microversion: 2.1 time: 0.700325 Oct 12 22:47:30.353849 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1650/3195] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:29 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:31.335704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:31.354926 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1adf639-9508-4b91-9afc-878a74f0c0c6 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1478 microversion: 2.1 time: 1.078535 Oct 12 22:47:31.355594 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1546/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:30 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1478 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:31.378139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:31.378962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:31.396648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:31.401000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:31.401320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:31.408302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:31.410779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:31.411424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:31.734352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:31.742402 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-87226479-56be-45df-976a-c4380752130f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1315 microversion: 2.1 time: 0.372124 Oct 12 22:47:31.742990 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1651/3197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:31 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:31.891208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-605c117a-8dd4-460f-90d9-a48547b727ec req-3fb65366-a43c-49a5-a1ed-a0e0352b23a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361c1555-4595-4f25-8e04-a81993718e1c", "tag": "089a9668-5b8f-4471-86c8-56e46919b889"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:31.910735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-605c117a-8dd4-460f-90d9-a48547b727ec req-3fb65366-a43c-49a5-a1ed-a0e0352b23a5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:31.916497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-605c117a-8dd4-460f-90d9-a48547b727ec req-3fb65366-a43c-49a5-a1ed-a0e0352b23a5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:31.920178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-605c117a-8dd4-460f-90d9-a48547b727ec req-3fb65366-a43c-49a5-a1ed-a0e0352b23a5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:31.945500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-605c117a-8dd4-460f-90d9-a48547b727ec req-3fb65366-a43c-49a5-a1ed-a0e0352b23a5 service nova] Creating event network-changed:089a9668-5b8f-4471-86c8-56e46919b889 for instance 361c1555-4595-4f25-8e04-a81993718e1c on n-h1-860864-8 Oct 12 22:47:31.958566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-605c117a-8dd4-460f-90d9-a48547b727ec req-3fb65366-a43c-49a5-a1ed-a0e0352b23a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072492 Oct 12 22:47:31.959589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1652/3198] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:32.226460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:32.301313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89c05b64-9929-484c-a933-fdaacf61f294 tempest-FloatingIPDetailsNegativeTestJSON-597122488 tempest-FloatingIPDetailsNegativeTestJSON-597122488-project] Calling method '.version_select at 0x7f44ff523ee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:32.381601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:32.382309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:32.408460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:32.408957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:32.409403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:32.417628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:32.417991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:32.418441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:32.442237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-89c05b64-9929-484c-a933-fdaacf61f294 tempest-FloatingIPDetailsNegativeTestJSON-597122488 tempest-FloatingIPDetailsNegativeTestJSON-597122488-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ed0389aa-c29a-4c5a-83af-3609dc1dc94c could not be found", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:47:32.443400 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-89c05b64-9929-484c-a933-fdaacf61f294 tempest-FloatingIPDetailsNegativeTestJSON-597122488 tempest-FloatingIPDetailsNegativeTestJSON-597122488-project] HTTP exception thrown: Floating IP not found for ID ed0389aa-c29a-4c5a-83af-3609dc1dc94c Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89c05b64-9929-484c-a933-fdaacf61f294 tempest-FloatingIPDetailsNegativeTestJSON-597122488 tempest-FloatingIPDetailsNegativeTestJSON-597122488-project] Request method failure captured: Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-floating-ips/ed0389aa-c29a-4c5a-83af-3609dc1dc94c HTTP/1.1 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0QDJHyW-4870II7ZqNjMZzTLW1HgL3EQ6AByOJZARMdZfMvbKpoicNANreGGrfmssOMkxM5W_nNiyRxYQif9hXu9vG-NTL8IN7o2Tu-ZKn4Sk6ZF1pGAyz7VQC775X_LRLEVvcHdwZKr26hqRS-IZCYDzF9zvvXo8KCJ4VnIwxF3vM Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: bb30095910244db5945a1b00481d3289 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-597122488 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb30095910244db5945a1b00481d3289"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb30095910244db5945a1b00481d3289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb30095910244db5945a1b00481d3289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb30095910244db5945a1b00481d3289"}]}] Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-597122488 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: bb30095910244db5945a1b00481d3289 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-597122488 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-597122488-project Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 23ddc7217444444d981216e5de84718d Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-597122488-project Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: exception: Floating IP not found for ID ed0389aa-c29a-4c5a-83af-3609dc1dc94c Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ed0389aa-c29a-4c5a-83af-3609dc1dc94c'} Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ed0389aa-c29a-4c5a-83af-3609dc1dc94c could not be found Oct 12 22:47:32.445757 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b952ef1e-7720-4f6b-a2fb-2de04c8ae9a1'] Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ed0389aa-c29a-4c5a-83af-3609dc1dc94c. Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ed0389aa-c29a-4c5a-83af-3609dc1dc94c Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ed0389aa-c29a-4c5a-83af-3609dc1dc94c Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89c05b64-9929-484c-a933-fdaacf61f294 tempest-FloatingIPDetailsNegativeTestJSON-597122488 tempest-FloatingIPDetailsNegativeTestJSON-597122488-project] Returning 404 to user: Floating IP not found for ID ed0389aa-c29a-4c5a-83af-3609dc1dc94c {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:32.454120 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89c05b64-9929-484c-a933-fdaacf61f294 tempest-FloatingIPDetailsNegativeTestJSON-597122488 tempest-FloatingIPDetailsNegativeTestJSON-597122488-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/ed0389aa-c29a-4c5a-83af-3609dc1dc94c" status: 404 len: 111 microversion: 2.1 time: 0.676760 Oct 12 22:47:32.461250 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1547/3199] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:47:31 2022] GET /compute/v2.1/os-floating-ips/ed0389aa-c29a-4c5a-83af-3609dc1dc94c => generated 111 bytes in 685 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:47:32.772460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:32.784880 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5f994d53-0107-472a-a78f-37594520c923 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1478 microversion: 2.1 time: 0.408398 Oct 12 22:47:32.790979 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1653/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:32 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1478 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:32.799289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:32.800354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:32.817119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:32.822030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:32.822929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:32.823961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:32.824760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:32.826558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:32.950735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:32.989431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-69a224b5-dd00-4f2e-9603-232cd4c654d6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Action: 'create', calling method: .version_select at 0x7f44ff5ad280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1108858470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiEKN/VyhFROL8RdLmbO5xAUUtuEWmDvYgfsOcIUWG6SUjgwLh5nM3PjPPlV00Wj5ncY/mqKZxb564YkooDqYwIZzPwEbMmMlfJfucPlAtDoYliidpxbeUoheQ2ikMrhg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:33.035930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-69a224b5-dd00-4f2e-9603-232cd4c654d6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Getting quotas for project 61d6b17cc51e417f8a8c428b62f47679. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:33.043234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-69a224b5-dd00-4f2e-9603-232cd4c654d6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Getting quotas for user 913ca79af8f44a7dba95a763c3afa305 and project 61d6b17cc51e417f8a8c428b62f47679. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:33.119679 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-69a224b5-dd00-4f2e-9603-232cd4c654d6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.571811 Oct 12 22:47:33.124629 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1548/3201] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:47:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:33.431222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:33.446938 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8934f24-d1ba-4d18-881e-c8adb0439465 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1315 microversion: 2.1 time: 0.652598 Oct 12 22:47:33.449182 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1654/3202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:32 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:33.820955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:33.822281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:33.834469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:33.836518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:33.837773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:33.841919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:33.842842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:33.843553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:34.321803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-90b07a03-c3b3-40d5-9841-1da8673750a7 req-45f8ec7f-e502-48d2-8cb8-be06ac593dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddb2249-b5e2-4308-9d4b-6881107150f7", "name": "network-vif-deleted", "tag": "31b5e870-26bb-47d6-b17b-7ede69c80df3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:34.329286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89304d08b821486e89303403b802a4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ee048fcc5436fbfc3e493cb88897c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:34.349214 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-501f3b5d-ad12-43af-ba3d-f8b4b1ef05c9 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 200 len: 1436 microversion: 2.1 time: 0.529044 Oct 12 22:47:34.350127 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1549/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:33 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 1436 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:34.361251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-90b07a03-c3b3-40d5-9841-1da8673750a7 req-45f8ec7f-e502-48d2-8cb8-be06ac593dd7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:34.362634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-90b07a03-c3b3-40d5-9841-1da8673750a7 req-45f8ec7f-e502-48d2-8cb8-be06ac593dd7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:34.364136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-90b07a03-c3b3-40d5-9841-1da8673750a7 req-45f8ec7f-e502-48d2-8cb8-be06ac593dd7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:34.400535 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-90b07a03-c3b3-40d5-9841-1da8673750a7 req-45f8ec7f-e502-48d2-8cb8-be06ac593dd7 service nova] Creating event network-vif-deleted:31b5e870-26bb-47d6-b17b-7ede69c80df3 for instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 on n-h2-860864-8 Oct 12 22:47:34.410927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-90b07a03-c3b3-40d5-9841-1da8673750a7 req-45f8ec7f-e502-48d2-8cb8-be06ac593dd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094515 Oct 12 22:47:34.418216 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1655/3204] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:34.477365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:34.477983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:34.506664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:34.508240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:34.509404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:34.510138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:34.514449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:34.516862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:35.284884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:35.297220 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd4a9dbf-44a5-447a-a5be-df47ee4f8879 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1315 microversion: 2.1 time: 0.825134 Oct 12 22:47:35.298084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1550/3205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:34 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:35.376323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:35.378073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] [instance: 8ddb2249-b5e2-4308-9d4b-6881107150f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:35.391131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:35.397255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:35.398895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:35.400810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:35.401581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:35.404003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:35.427009 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] HTTP exception thrown: Instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 could not be found. Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Request method failure captured: Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 HTTP/1.1 Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PF4hUxD-1PDK-gM5tLHkKAwJ8qbNEKBA8zd9N1Cp-tusEGAH9pz1WozhWGkc4MKrXo55und3HFWZ7D1i1BUcUIbP-nXxkVD8kNKts6w7nfueQEkOf0t6-ZAOLH6wp34bgj2LgpGyElTo4p1RoEMXpQ_njhRLWdh2TLvdJgXmkqm3s Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 466ee048fcc5436fbfc3e493cb88897c Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-619950624 Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/466ee048fcc5436fbfc3e493cb88897c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/466ee048fcc5436fbfc3e493cb88897c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_466ee048fcc5436fbfc3e493cb88897c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/466ee048fcc5436fbfc3e493cb88897c"}]}] Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-619950624 Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 466ee048fcc5436fbfc3e493cb88897c Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-619950624 Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-619950624-project Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 89304d08b821486e89303403b802a4ae Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-619950624-project Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 could not be found. Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '8ddb2249-b5e2-4308-9d4b-6881107150f7'} Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 could not be found. Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 could not be found. Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:35.437445 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 could not be found. Oct 12 22:47:35.443150 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:35.449776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] Returning 404 to user: Instance 8ddb2249-b5e2-4308-9d4b-6881107150f7 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:35.452216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38e19cfa-46f8-4d00-b533-a32edf94d841 tempest-ServersAdminNegativeTestJSON-619950624 tempest-ServersAdminNegativeTestJSON-619950624-project] 10.222.0.20 "GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7" status: 404 len: 111 microversion: 2.1 time: 0.079493 Oct 12 22:47:35.453783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1656/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:35 2022] GET /compute/v2.1/servers/8ddb2249-b5e2-4308-9d4b-6881107150f7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:47:36.323018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:36.323647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:36.339690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:36.347762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:36.349963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:36.353099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:36.353744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:36.354578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:37.440722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:37.457926 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4454940-976d-4bb5-8e88-ef2fc76d81f2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1315 microversion: 2.1 time: 1.138051 Oct 12 22:47:37.462658 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1551/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:36 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:38.487717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:38.488380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:38.506764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:38.507333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:38.507784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:38.509212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:38.509561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:38.510741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:38.932173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-57ccc330-b6a3-488b-ab8f-66071359e062 req-84056927-c120-46e1-88a6-b08afe10c30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361c1555-4595-4f25-8e04-a81993718e1c", "name": "network-vif-plugged", "status": "completed", "tag": "089a9668-5b8f-4471-86c8-56e46919b889"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:38.957763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57ccc330-b6a3-488b-ab8f-66071359e062 req-84056927-c120-46e1-88a6-b08afe10c30c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:38.958251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57ccc330-b6a3-488b-ab8f-66071359e062 req-84056927-c120-46e1-88a6-b08afe10c30c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:38.958680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57ccc330-b6a3-488b-ab8f-66071359e062 req-84056927-c120-46e1-88a6-b08afe10c30c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:38.994846 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-57ccc330-b6a3-488b-ab8f-66071359e062 req-84056927-c120-46e1-88a6-b08afe10c30c service nova] Creating event network-vif-plugged:089a9668-5b8f-4471-86c8-56e46919b889 for instance 361c1555-4595-4f25-8e04-a81993718e1c on n-h1-860864-8 Oct 12 22:47:39.013854 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-57ccc330-b6a3-488b-ab8f-66071359e062 req-84056927-c120-46e1-88a6-b08afe10c30c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083531 Oct 12 22:47:39.017265 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1552/3208] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:47:39.861549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:39.886638 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-02548896-afca-4955-865c-23f204c6f32b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1315 microversion: 2.1 time: 1.402776 Oct 12 22:47:39.902740 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1657/3209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:38 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1315 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:40.913307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:40.914942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:40.918357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:40.926686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:40.927628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:40.929080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:40.930586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:40.931611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:40.932086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:41.602909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:41.612728 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91f464aa-0f4a-45c7-ad7c-d75581fa320e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1501 microversion: 2.1 time: 0.705185 Oct 12 22:47:41.613327 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1553/3210] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:40 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1501 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:42.552704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-665204101", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:42.580571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:42.630936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:47:43.678213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:47:43.679348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:47:43.679828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:47:43.680934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:47:43.681231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:47:43.703845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:43.704781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:43.705428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:43.706443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:43.706925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:43.707540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:43.758473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:43.765305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:43.796973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:47:43.799381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:47:43.871885 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8776beba-1a36-4d3e-815f-d57237cf1f78 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.525647 Oct 12 22:47:43.880426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1658/3211] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:47:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:47:43.891112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aa7fcf5c-941b-4ca0-9ae8-2192d43d1d45 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:43.892893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aa7fcf5c-941b-4ca0-9ae8-2192d43d1d45 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:43.898538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:44.204056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa7fcf5c-941b-4ca0-9ae8-2192d43d1d45 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:44.222408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aa7fcf5c-941b-4ca0-9ae8-2192d43d1d45 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1216 microversion: 2.1 time: 0.340011 Oct 12 22:47:44.226872 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1554/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:43 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1216 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:44.408854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "091186de-894a-42b7-9ed4-2ad8860a96d7"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:44.411271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:44.435448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:44.435965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:44.442445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:44.443446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:44.444081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:44.444640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:45.000658 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa7b1d90-8e27-40b1-bc46-c8da302a2bc2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.596076 Oct 12 22:47:45.002313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1659/3213] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 22:47:44 2022] POST /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c/os-volume_attachments => generated 194 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:45.257993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:45.261018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:45.284000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:45.286605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:45.290678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:45.293667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:45.297465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:45.298218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:45.567071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:45.579544 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d6931c2d-cc20-4c6b-9107-3cfa84792689 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1212 microversion: 2.1 time: 0.327504 Oct 12 22:47:45.581733 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1555/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:45 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1212 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:46.622888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:46.624507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:46.639280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:46.643022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:46.643775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:46.645772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:46.646744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:46.647486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:46.917450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:46.934456 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42a1900f-2c1d-4692-881c-5047bf26a836 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1274 microversion: 2.1 time: 0.324992 Oct 12 22:47:46.948480 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1660/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:46 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1274 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:47.963597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:47.964728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:47.984985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:47.987677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:47.988362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:47.990156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:47.994257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:47.996202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:48.536773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:48.549910 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e070c81-14c0-4a2d-8803-295a6e9ba8db tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1274 microversion: 2.1 time: 0.592038 Oct 12 22:47:48.560866 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1556/3216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:47 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1274 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:49.585707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:49.587395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:49.600475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:49.626654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:49.627505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:49.629053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:49.630543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:49.631527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:49.843136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:49.895681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-77f0ceac-6c58-429c-a9ab-5139ff7a1bc8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1274 microversion: 2.1 time: 0.315545 Oct 12 22:47:49.899930 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1661/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:49 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:50.929272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:50.930576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:50.942144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:50.942647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:50.943082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:50.943793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:50.944296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:50.944720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:50.947592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:51.145858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:51.168242 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a52df6b5-9429-460b-bf91-52e856390a82 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1274 microversion: 2.1 time: 0.243604 Oct 12 22:47:51.172569 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1557/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:50 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:52.199708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:52.200933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:52.219341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:52.220112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:52.220729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:52.222352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:52.222943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:52.223519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:52.388766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db031ccb-abb6-4949-91df-ca9110eb244e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f44fee78280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNDOKAK/G00a+tC4Lyj1RnCRhRRkyZVlQAw8tNSroaVtZ7y2OloY5GlHUSoMvmANLurIwj3COprQzmIN588zubVi19r320lGuSIZsC7mKXtMIMTas0RxkCllWbFpUbfVg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db031ccb-abb6-4949-91df-ca9110eb244e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 257 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNDOKAK/G00a+tC4Lyj1RnCRhRRkyZVlQAw8tNSroaVtZ7y2OloY5GlHUSoMvmANLurIwj3COprQzmIN588zubVi19r320lGuSIZsC7mKXtMIMTas0RxkCllWbFpUbfVg=="}} Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNDOKAK/G00a+tC4Lyj1RnCRhRRkyZVlQAw8tNSroaVtZ7y2OloY5GlHUSoMvmANLurIwj3COprQzmIN588zubVi19r320lGuSIZsC7mKXtMIMTas0RxkCllWbFpUbfVg=='}}} Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 12 22:47:52.393529 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 22:47:52.396792 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.412168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db031ccb-abb6-4949-91df-ca9110eb244e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:52.413542 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db031ccb-abb6-4949-91df-ca9110eb244e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.240070 Oct 12 22:47:52.414345 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1662/3219] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:47:52.426115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2250c4b-bf65-40d7-99cd-a2734165fa9b tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f4507a38430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1915626340", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.447391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b2250c4b-bf65-40d7-99cd-a2734165fa9b tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:52.461148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b2250c4b-bf65-40d7-99cd-a2734165fa9b tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for user e511000bb17f426c9ec235651360ce28 and project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:52.491131 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b2250c4b-bf65-40d7-99cd-a2734165fa9b tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2250c4b-bf65-40d7-99cd-a2734165fa9b tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 2167 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1915626340", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:52.516326 n-d-860864-8 devstack@n-api.service[120542]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1915626340', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:52.518161 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.521670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.526212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2250c4b-bf65-40d7-99cd-a2734165fa9b tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:52.527323 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2250c4b-bf65-40d7-99cd-a2734165fa9b tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.106701 Oct 12 22:47:52.528589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1663/3220] 10.222.0.20 () {60 vars in 1160 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 22:47:52.542391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a56419f-334c-49ce-b8ba-8f82abd8c404 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f44ff470700>, body: {"keypair": {"name": "tempest-keypair-1373067286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF85eBKK0CSyj2VKWcNoLZdCoN9iebmYQkfIB7I03HQaWlFyGchz5pmu3OKaWYrfRl7hoYEdHqNyMrU8xSnVfklP9RyIAf5NtkwiNuVkVwpLszSwm7vt0u/jViyzGnO6Q=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.575308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2a56419f-334c-49ce-b8ba-8f82abd8c404 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:52.581298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2a56419f-334c-49ce-b8ba-8f82abd8c404 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for user e511000bb17f426c9ec235651360ce28 and project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:52.618939 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a56419f-334c-49ce-b8ba-8f82abd8c404 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081472 Oct 12 22:47:52.619795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1664/3221] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:52.634261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e06d04e-1586-48f9-bd40-1fc652be804e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f44ff4341f0>, body: {"keypair": {"name": "tempest-keypair-1373067286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwJTUFwvOwYPiJ7c7Txdf8Elaja6ucWFxF+CiWXgu/2xwqxO7DF7VUbiF1UFOxdeo1xKzbOT/lyaMxqIKFjQYTLP36tTzb5KLz+G+M4vB/bPCbmg1j0gzUK0mQwTmjf3A=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.655400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0e06d04e-1586-48f9-bd40-1fc652be804e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:52.661915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0e06d04e-1586-48f9-bd40-1fc652be804e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for user e511000bb17f426c9ec235651360ce28 and project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:52.689805 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0e06d04e-1586-48f9-bd40-1fc652be804e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] HTTP exception thrown: Key pair 'tempest-keypair-1373067286' already exists. Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e06d04e-1586-48f9-bd40-1fc652be804e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 273 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: {"keypair": {"name": "tempest-keypair-1373067286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwJTUFwvOwYPiJ7c7Txdf8Elaja6ucWFxF+CiWXgu/2xwqxO7DF7VUbiF1UFOxdeo1xKzbOT/lyaMxqIKFjQYTLP36tTzb5KLz+G+M4vB/bPCbmg1j0gzUK0mQwTmjf3A=="}} Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: exception: Key pair 'tempest-keypair-1373067286' already exists. Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1373067286', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwJTUFwvOwYPiJ7c7Txdf8Elaja6ucWFxF+CiWXgu/2xwqxO7DF7VUbiF1UFOxdeo1xKzbOT/lyaMxqIKFjQYTLP36tTzb5KLz+G+M4vB/bPCbmg1j0gzUK0mQwTmjf3A=='}}} Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'e511000bb17f426c9ec235651360ce28-tempest-keypair-1373067286' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 22:47:52.697913 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result.read() Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 22:47:52.701040 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'e511000bb17f426c9ec235651360ce28-tempest-keypair-1373067286' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 22, 47, 52, 682047), 'updated_at': None, 'name': 'tempest-keypair-1373067286', 'user_id': 'e511000bb17f426c9ec235651360ce28', 'fingerprint': 'be:f1:5b:f0:ad:58:f3:70:be:77:1e:94:26:b2:eb:7c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwJTUFwvOwYPiJ7c7Txdf8Elaja6ucWFxF+CiWXgu/2xwqxO7DF7VUbiF1UFOxdeo1xKzbOT/lyaMxqIKFjQYTLP36tTzb5KLz+G+M4vB/bPCbmg1j0gzUK0mQwTmjf3A==', 'type': 'ssh'}] Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi keypair.create() Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._create() Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1373067286' already exists. Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 12 22:47:52.703726 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1373067286' already exists. Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1373067286' already exists. Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.710594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e06d04e-1586-48f9-bd40-1fc652be804e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 409 to user: Key pair 'tempest-keypair-1373067286' already exists. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:52.714086 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e06d04e-1586-48f9-bd40-1fc652be804e tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.078386 Oct 12 22:47:52.715009 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1665/3222] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:47:52.724249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4354be07-84a7-45c5-ae8f-3f9b47eb5ac6 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Calling method '.version_select at 0x7f44fee3a040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:52.748925 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4354be07-84a7-45c5-ae8f-3f9b47eb5ac6 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373067286" status: 202 len: 0 microversion: 2.1 time: 0.028835 Oct 12 22:47:52.749972 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1666/3223] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:47:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373067286 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:47:52.785700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c19800a3-edcd-4517-a0a2-ed17f6818aa1 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f4507a38940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEJhvQAHhQZQcHHnA6dIwx2Y7+Nmv6au+EksKbsj4a/tIEEzFED+0aa48h8g8NpuKu70bq4dRbmo545RaP5G8jwKd7D2119xiDv1LjiLzb9mfzhvzd8p5AIpWP56f5bcw=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c19800a3-edcd-4517-a0a2-ed17f6818aa1 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 247 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEJhvQAHhQZQcHHnA6dIwx2Y7+Nmv6au+EksKbsj4a/tIEEzFED+0aa48h8g8NpuKu70bq4dRbmo545RaP5G8jwKd7D2119xiDv1LjiLzb9mfzhvzd8p5AIpWP56f5bcw=="}} Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEJhvQAHhQZQcHHnA6dIwx2Y7+Nmv6au+EksKbsj4a/tIEEzFED+0aa48h8g8NpuKu70bq4dRbmo545RaP5G8jwKd7D2119xiDv1LjiLzb9mfzhvzd8p5AIpWP56f5bcw=='}}} Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi '' Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:47:52.799684 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c19800a3-edcd-4517-a0a2-ed17f6818aa1 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:52.802937 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c19800a3-edcd-4517-a0a2-ed17f6818aa1 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.038711 Oct 12 22:47:52.807300 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1667/3224] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:47:52.817827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d09220d1-1cf4-420e-9d30-456c95835f68 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f4507b2d430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-203580953", "public_key": " "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.860705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d09220d1-1cf4-420e-9d30-456c95835f68 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:52.876939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d09220d1-1cf4-420e-9d30-456c95835f68 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for user e511000bb17f426c9ec235651360ce28 and project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:52.908641 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d09220d1-1cf4-420e-9d30-456c95835f68 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d09220d1-1cf4-420e-9d30-456c95835f68 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 94 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-203580953", "public_key": " "}} Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-203580953', 'public_key': ' '}}} Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.911764 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:52.915252 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.919367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d09220d1-1cf4-420e-9d30-456c95835f68 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:52.920835 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d09220d1-1cf4-420e-9d30-456c95835f68 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.109439 Oct 12 22:47:52.928856 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1668/3225] 10.222.0.20 () {60 vars in 1158 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:47:52.943772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-449a5b95-d97d-4642-8c22-210ffb36307d tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f44fee78820>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3f99BbmZpavNWq/WqJsVkn343XXhtQmUCPPo2tP4iGEMs5ICvHfO7T0ryVVnMtC4twHtkIFrwedn70WQGMcQkUD/l3dPOv9HqKgjnkJFpX9eBKyX9FVc7u5loHbQAerg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-449a5b95-d97d-4642-8c22-210ffb36307d tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 507 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3f99BbmZpavNWq/WqJsVkn343XXhtQmUCPPo2tP4iGEMs5ICvHfO7T0ryVVnMtC4twHtkIFrwedn70WQGMcQkUD/l3dPOv9HqKgjnkJFpX9eBKyX9FVc7u5loHbQAerg=="}} Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3f99BbmZpavNWq/WqJsVkn343XXhtQmUCPPo2tP4iGEMs5ICvHfO7T0ryVVnMtC4twHtkIFrwedn70WQGMcQkUD/l3dPOv9HqKgjnkJFpX9eBKyX9FVc7u5loHbQAerg=='}}} Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 22:47:52.954610 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-449a5b95-d97d-4642-8c22-210ffb36307d tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-449a5b95-d97d-4642-8c22-210ffb36307d tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.025268 Oct 12 22:47:52.957148 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1669/3226] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:47:52.968813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3760cdb-3ce0-442e-97e4-bc5e4cf61775 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Action: 'create', calling method: .version_select at 0x7f4507a38670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1873977974", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:52.992286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e3760cdb-3ce0-442e-97e4-bc5e4cf61775 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:52.998461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e3760cdb-3ce0-442e-97e4-bc5e4cf61775 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Getting quotas for user e511000bb17f426c9ec235651360ce28 and project c32742f819c04727a8d1fc419169de72. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:53.018960 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e3760cdb-3ce0-442e-97e4-bc5e4cf61775 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3760cdb-3ce0-442e-97e4-bc5e4cf61775 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 118 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1873977974", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1873977974', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 22:47:53.020906 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3760cdb-3ce0-442e-97e4-bc5e4cf61775 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e3760cdb-3ce0-442e-97e4-bc5e4cf61775 tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058390 Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1670/3227] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:47:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 22:47:53.034287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b943d43-4f0e-407e-9b05-0fa0586de23f tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Calling method '.version_select at 0x7f44feca9af0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:53.080030 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6b943d43-4f0e-407e-9b05-0fa0586de23f tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2021263089 not found for user e511000bb17f426c9ec235651360ce28 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b943d43-4f0e-407e-9b05-0fa0586de23f tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Request method failure captured: Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2021263089 HTTP/1.1 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QYCWFLvhI-kIdR2rA45YkgzG75S4sSQox8rJ1foRpPhljj_PWDFQn3EGwEA8v2CH9iesFuszqFmJJI4L3XUbxBYiwuwZdhTOYoaTbb1hO86VIM0CvEvScYpcLkYdNWDvuGXxPpyfFDitlSOBDhh5xCA_5ofux87P9ICCmj7ajAGb0 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c32742f819c04727a8d1fc419169de72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c32742f819c04727a8d1fc419169de72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c32742f819c04727a8d1fc419169de72"}]}] Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c32742f819c04727a8d1fc419169de72 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-221024176 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e511000bb17f426c9ec235651360ce28 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-221024176-project Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: exception: Keypair tempest-keypair-non-existent-2021263089 not found for user e511000bb17f426c9ec235651360ce28 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'tempest-keypair-non-existent-2021263089'} Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2021263089 not found for user e511000bb17f426c9ec235651360ce28 Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.082314 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2021263089 not found for user e511000bb17f426c9ec235651360ce28 Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2021263089 not found for user e511000bb17f426c9ec235651360ce28 Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b943d43-4f0e-407e-9b05-0fa0586de23f tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2021263089 not found for user e511000bb17f426c9ec235651360ce28 {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:47:53.085299 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b943d43-4f0e-407e-9b05-0fa0586de23f tempest-KeyPairsNegativeTestJSON-221024176 tempest-KeyPairsNegativeTestJSON-221024176-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2021263089" status: 404 len: 145 microversion: 2.1 time: 0.054462 Oct 12 22:47:53.087268 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1671/3228] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2021263089 => generated 145 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:47:53.445332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:53.457090 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04cf5748-d2c4-465c-9390-1968d72dc774 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1316 microversion: 2.1 time: 1.262586 Oct 12 22:47:53.469604 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1558/3229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:52 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1316 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:54.511428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:54.513456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:54.521885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:54.534300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:54.534300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:54.534300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:54.534991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:54.535456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:54.535879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:54.844721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:54.853203 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ba363ff-8c76-4119-bd99-d43f20da27b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1316 microversion: 2.1 time: 0.368961 Oct 12 22:47:54.854322 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1672/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:54 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:55.515687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-32be14ea-1678-4ea2-9aed-5258bb111034 req-5881db7a-6dcd-4a24-8764-15126976ef9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b422b505-f575-4ff4-af58-1d9eeec9c2c2", "tag": "abc46808-34fa-4625-9480-25b69b824c88"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:55.540044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:55.561441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-32be14ea-1678-4ea2-9aed-5258bb111034 req-5881db7a-6dcd-4a24-8764-15126976ef9b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:55.561934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-32be14ea-1678-4ea2-9aed-5258bb111034 req-5881db7a-6dcd-4a24-8764-15126976ef9b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:55.562370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-32be14ea-1678-4ea2-9aed-5258bb111034 req-5881db7a-6dcd-4a24-8764-15126976ef9b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:55.608333 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-32be14ea-1678-4ea2-9aed-5258bb111034 req-5881db7a-6dcd-4a24-8764-15126976ef9b service nova] Creating event network-changed:abc46808-34fa-4625-9480-25b69b824c88 for instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 on n-h2-860864-8 Oct 12 22:47:55.620683 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-32be14ea-1678-4ea2-9aed-5258bb111034 req-5881db7a-6dcd-4a24-8764-15126976ef9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108369 Oct 12 22:47:55.626339 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1559/3231] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:55.877353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:55.878441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:55.891420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:55.893276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:55.894805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:55.896945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:55.898419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:55.899676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:56.851654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:56.860234 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a61d2a3a-2a92-4ae5-adb2-38adf937bd91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1316 microversion: 2.1 time: 0.987514 Oct 12 22:47:56.860833 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1673/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:55 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1316 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:47:57.343696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ace29e9b-4912-437f-8ba5-646e9bb5980b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44ffcf30d0>, body: {"keypair": {"name": "tempest-keypair-1196925053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx2dyODZtnKV7elo/nwsLxPwn4JKkaJRCJllHrD0aKd7yYBmi8Fd6OE2dMaTAdDlu8H0uJYdTpTHasw02qoho4c9eZ6GsfeLDdLiByeg0BwgAqqNQ/PsPpFYHlgAFg3kA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:57.384441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ace29e9b-4912-437f-8ba5-646e9bb5980b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:57.410476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ace29e9b-4912-437f-8ba5-646e9bb5980b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:57.452044 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ace29e9b-4912-437f-8ba5-646e9bb5980b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.424879 Oct 12 22:47:57.453107 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1560/3233] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Oct 12 22:47:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 430 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:47:57.464652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56fea5a9-63b1-4e0e-82a3-e117bda54ffc tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44fee3a670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:57.475599 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56fea5a9-63b1-4e0e-82a3-e117bda54ffc tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1196925053" status: 200 len: 513 microversion: 2.2 time: 0.015739 Oct 12 22:47:57.497708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a06e0dc-c570-45ac-b9c5-0c2389fd899b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44ffd64040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:57.501150 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1674/3234] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Oct 12 22:47:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1196925053 => generated 513 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:47:57.527307 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a06e0dc-c570-45ac-b9c5-0c2389fd899b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196925053" status: 204 len: 0 microversion: 2.2 time: 0.034423 Oct 12 22:47:57.543212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e38aec7-1a3b-49b3-8b2f-062e277c71ed tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44ff4341f0>, body: {"keypair": {"name": "tempest-keypair-921841112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODQV4zPRYTEdGbHcgWzdf6yoOUo3yTuEr7cjacjNQeTdj54V9oz1tbFiFuH487I+Xh0GWHPgdQnU64613L+/VScLoCus3MDDFQgjqiIoKFqzEQ3xNUUgoLn4zv5GQEL7Q=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:57.548430 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1561/3235] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Oct 12 22:47:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196925053 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:47:57.563486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2e38aec7-1a3b-49b3-8b2f-062e277c71ed tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:57.572941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2e38aec7-1a3b-49b3-8b2f-062e277c71ed tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:57.617842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e38aec7-1a3b-49b3-8b2f-062e277c71ed tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.077337 Oct 12 22:47:57.628506 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1675/3236] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Oct 12 22:47:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:47:57.634368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-748f721d-e6a7-450e-a69b-cea4ad08e056 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44ff523e50>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:57.692316 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-748f721d-e6a7-450e-a69b-cea4ad08e056 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921841112" status: 204 len: 0 microversion: 2.2 time: 0.063543 Oct 12 22:47:57.693358 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1562/3237] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Oct 12 22:47:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921841112 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:47:57.704384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ad91a78-12bc-4ab2-bf55-76fe11968dd6 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44fec8f670>, body: {"keypair": {"name": "tempest-keypair-539415768", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:57.711574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:57.726649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9ad91a78-12bc-4ab2-bf55-76fe11968dd6 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:57.734289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9ad91a78-12bc-4ab2-bf55-76fe11968dd6 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:57.787210 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ad91a78-12bc-4ab2-bf55-76fe11968dd6 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.085982 Oct 12 22:47:57.794240 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1676/3238] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Oct 12 22:47:57 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:47:57.800315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b5e7d6c-e0d9-498d-9ff7-b3fbf4acf136 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44ff4e8310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:57.852305 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b5e7d6c-e0d9-498d-9ff7-b3fbf4acf136 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539415768" status: 204 len: 0 microversion: 2.2 time: 0.056341 Oct 12 22:47:57.860174 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1563/3239] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Oct 12 22:47:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539415768 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:47:57.868358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a421988b-81b1-4f00-ad53-900d31c3a267 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44ff6c0160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-855651002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX+2xSHP0XvWx68xLjCu6+nnnZwjMYbdwxUmODZi410mZZiQORJ/bsHFhm8aHaSpKV7pyTpOWudend450m3ACA3myjPb4HhRMpAVsu3uDUxY94ubzAPmTc/66S+aoN2Tg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:57.886285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:57.887190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:57.897675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:57.903340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a421988b-81b1-4f00-ad53-900d31c3a267 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:57.903641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:57.904249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:57.905101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:57.908595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:57.909168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:57.919361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a421988b-81b1-4f00-ad53-900d31c3a267 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:57.979851 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a421988b-81b1-4f00-ad53-900d31c3a267 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.116669 Oct 12 22:47:57.980730 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1677/3240] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Oct 12 22:47:57 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:47:57.996242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1752758986-access_point-2017951901", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "9e228ef8-cb7f-44ec-a322-53fa564d65d3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1108858470", "security_groups": [{"name": "tempest-secgroup_access--375837245"}, {"name": "tempest-secgroup_general--2077939895"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:58.362693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] validate_networks() for [('9e228ef8-cb7f-44ec-a322-53fa564d65d3', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:47:58.952256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:58.968295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3dabfc0-c27e-4c72-9447-9f8d92e803d4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1316 microversion: 2.1 time: 1.086702 Oct 12 22:47:58.969369 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1564/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:47:57 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1316 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:47:58.980162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7de49a5f-897f-44bd-8096-fb1c6d317a75 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44ff54b550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1088485816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/8DX0UJog69PICFR2JEAqhSaUwvHogmu6iw3aQfhNP4g1yJAo5QKFzQbkrmC5CE4iLJ+rVPV4Vsg5vCnBsLc6qJZmH62Ep7+Ze5L+OqU1ms9MuMmxjRBZ4pxPwUizQAQ=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:59.019255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-7de49a5f-897f-44bd-8096-fb1c6d317a75 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:59.033902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-7de49a5f-897f-44bd-8096-fb1c6d317a75 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:59.116649 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7de49a5f-897f-44bd-8096-fb1c6d317a75 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.146067 Oct 12 22:47:59.125414 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1565/3242] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Oct 12 22:47:58 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:47:59.128873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:59.129706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:59.147802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:59.153602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:59.154049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:59.154938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:59.155662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:59.156153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:59.578707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:47:59.579246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:47:59.579986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:47:59.580414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:47:59.580831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:47:59.597256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:59.597747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:59.598177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:59.598899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:47:59.599348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:47:59.603581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:47:59.647462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:47:59.687407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Getting quotas for project 61d6b17cc51e417f8a8c428b62f47679. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:59.710621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Getting quotas for user 913ca79af8f44a7dba95a763c3afa305 and project 61d6b17cc51e417f8a8c428b62f47679. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:59.734880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:59.752492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:59.756672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:47:59.756672 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b51a5e8a-f07c-4584-b008-3f69d27c9d18 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2953 microversion: 2.42 time: 0.636900 Oct 12 22:47:59.770339 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1566/3243] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:47:59 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2953 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:47:59.780983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b51796b-6b2f-40ee-a212-d3abc2034a90 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44ff4b43a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-250062016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLMg+zyjNPMVCE74fGO0Pa1NMCiUjQ8vQyrFuoOSQNDz38D7kGBaKZq+6oXncImVSxA0gLOV8IhMuNCdwc1KI2ddirhjzsqBfo4NI4EHqJcn/4nL5wJ1/vSpodH8Gbn0g=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:47:59.807521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:47:59.839019 n-d-860864-8 devstack@n-api.service[120542]: WARNING nova.utils [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1752758986-access_point-2017951901 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1752758986-ac Oct 12 22:47:59.840716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:47:59.848602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4b51796b-6b2f-40ee-a212-d3abc2034a90 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:47:59.874196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4b51796b-6b2f-40ee-a212-d3abc2034a90 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:47:59.974032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b51796b-6b2f-40ee-a212-d3abc2034a90 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.201936 Oct 12 22:47:59.975589 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1567/3244] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Oct 12 22:47:59 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 204 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:47:59.982730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:47:59.985776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:47:59.999795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.021647 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-852b4863-8b5c-45e7-a4b6-eb79e362388b tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.029145 Oct 12 22:48:00.026940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.028330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.029193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.031321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.031859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.041420 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1678/3245] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:47:57 2022] POST /compute/v2.1/servers => generated 457 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:48:00.063875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d1b1814-1133-4162-a00a-e9ea59e13b24 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f4507b2dca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:00.076128 n-d-860864-8 devstack@n-api.service[120542]: WARNING oslo_db.sqlalchemy.utils [None req-6d1b1814-1133-4162-a00a-e9ea59e13b24 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:48:00.088640 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d1b1814-1133-4162-a00a-e9ea59e13b24 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.044914 Oct 12 22:48:00.103597 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1679/3246] 10.222.0.20 () {60 vars in 1177 bytes} [Wed Oct 12 22:48:00 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:00.111596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:00.112286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:00.128242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.136867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.143750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.144862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:00.145485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:00.146063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:00.650485 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30b421e7-81e1-45dc-bc69-5f1dd100fcc6 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.673596 Oct 12 22:48:00.651416 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1568/3247] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 22:47:59 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524/os-interface => generated 1830 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:48:00.657525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e46f9964-ddd3-427c-9273-1781a43b2827 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:00.658229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e46f9964-ddd3-427c-9273-1781a43b2827 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:00.837053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e46f9964-ddd3-427c-9273-1781a43b2827 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:00.845859 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e46f9964-ddd3-427c-9273-1781a43b2827 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1295 microversion: 2.1 time: 0.193026 Oct 12 22:48:00.847214 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1569/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:00 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1295 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:00.853727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05a9b939-4dd8-4d72-a9a9-b3bef014b3df tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44ff4e84c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:00.916761 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05a9b939-4dd8-4d72-a9a9-b3bef014b3df tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-250062016" status: 204 len: 0 microversion: 2.2 time: 0.067572 Oct 12 22:48:00.921199 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1570/3249] 10.222.0.20 () {60 vars in 1318 bytes} [Wed Oct 12 22:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-250062016 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:00.928432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3057e80d-7bdb-4315-87a4-e1ae91fd3983 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44ff54bc10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:00.983775 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3057e80d-7bdb-4315-87a4-e1ae91fd3983 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1088485816" status: 204 len: 0 microversion: 2.2 time: 0.060180 Oct 12 22:48:00.995926 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1571/3250] 10.222.0.20 () {60 vars in 1321 bytes} [Wed Oct 12 22:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1088485816 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:01.031035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-51d0f5ef-1684-44d7-b430-6b563fe3cb7b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44ff54e310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:01.093175 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-51d0f5ef-1684-44d7-b430-6b563fe3cb7b tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-855651002" status: 204 len: 0 microversion: 2.2 time: 0.087940 Oct 12 22:48:01.102644 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1572/3251] 10.222.0.20 () {60 vars in 1318 bytes} [Wed Oct 12 22:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-855651002 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:01.109239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-990012fc-b285-4012-afd0-b5d1e3005a16 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44ff455ee0>, body: {"keypair": {"name": "tempest-keypair-1626371222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk1MW35BfTCRmSf73JgNDoik6Gyd0Fel0/4FOvjomm3mOxBCgVCaDF21OlF/NvUYW+yBMthfZzuENrtsjlsnFyV+uwBv9MVbR0J+oL75IYxWWEb0LCrlw1WCMzeIJ6MWg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:01.148920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-990012fc-b285-4012-afd0-b5d1e3005a16 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:01.155473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-990012fc-b285-4012-afd0-b5d1e3005a16 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:01.192975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-990012fc-b285-4012-afd0-b5d1e3005a16 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.088392 Oct 12 22:48:01.194936 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1573/3252] 10.222.0.20 () {62 vars in 1199 bytes} [Wed Oct 12 22:48:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:48:01.202955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:01.203951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:01.215786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:01.217223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:01.219551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:01.220655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:01.222158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:01.222874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:01.260840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:48:01.417104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:01.478782 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4dcadda1-0165-46b6-98f5-2b2e3f751e62 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 204 len: 0 microversion: 2.1 time: 0.279950 Oct 12 22:48:01.480278 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1574/3253] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:48:01 2022] DELETE /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:01.487695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd65fe06-7e59-469f-8acc-9e5ddb2546aa tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44ff54b310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:01.503510 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd65fe06-7e59-469f-8acc-9e5ddb2546aa tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1626371222" status: 200 len: 513 microversion: 2.2 time: 0.021311 Oct 12 22:48:01.504508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1575/3254] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Oct 12 22:48:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1626371222 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:01.511754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:01.513012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:01.521960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:01.522811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:01.524012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:01.526436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:01.526916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:01.527381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:01.567089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:01.589977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c11b06ed-a95f-4020-93a1-dcf6357e02c0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1316 microversion: 2.1 time: 1.484256 Oct 12 22:48:01.609687 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1680/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:00 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1316 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:01.615006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-45f1ad3e-4b21-4772-a8c8-3de0c2797100 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f4507b2d280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:01.626914 n-d-860864-8 devstack@n-api.service[120542]: WARNING oslo_db.sqlalchemy.utils [None req-45f1ad3e-4b21-4772-a8c8-3de0c2797100 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:48:01.639440 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-45f1ad3e-4b21-4772-a8c8-3de0c2797100 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.027253 Oct 12 22:48:01.640776 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1681/3256] 10.222.0.20 () {60 vars in 1177 bytes} [Wed Oct 12 22:48:01 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:01.654242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59b21bc0-5a4c-4daf-86b0-37a60d54001d tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44fec4a310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:01.688708 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59b21bc0-5a4c-4daf-86b0-37a60d54001d tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626371222" status: 204 len: 0 microversion: 2.2 time: 0.039694 Oct 12 22:48:01.689930 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1682/3257] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Oct 12 22:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626371222 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:01.706854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Action: 'create', calling method: .version_select at 0x7f44fec4adc0>, body: {"keypair": {"name": "tempest-keypair-1839549070", "type": "x509"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:01.730130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:01.738138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:01.782852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.processutils [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmppr05bepj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppr05bepj/temp.key -subj /CN=8129e2e269f04751bc7a7e86909ef0d7 -extensions v3_req_client {{(pid=120542) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 22:48:02.397865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:02.413006 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03e118c5-a749-4670-8731-f5ed9b3de5b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1553 microversion: 2.1 time: 0.904664 Oct 12 22:48:02.417150 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1576/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:01 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1553 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:02.428144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:02.430252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:02.446374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.446862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.447299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.448089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.448655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.448984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.496641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.processutils [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmppr05bepj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppr05bepj/temp.key -subj /CN=8129e2e269f04751bc7a7e86909ef0d7 -extensions v3_req_client" returned: 0 in 0.716s {{(pid=120542) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 22:48:02.507218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.processutils [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmppr05bepj/temp.key -password pass: {{(pid=120542) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 22:48:02.563777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.processutils [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] CMD "openssl pkcs12 -export -inkey /tmp/tmppr05bepj/temp.key -password pass:" returned: 0 in 0.060s {{(pid=120542) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 22:48:02.587354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:02.597957 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-437e6f4b-89a8-4e24-8991-18f78b6bcc63 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1347 microversion: 2.1 time: 0.179502 Oct 12 22:48:02.598966 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1577/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:02 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1347 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:02.621375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:02.623750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:02.657805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.659715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.660268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.661959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:02.663283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:02.665229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:02.665854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:02.675141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Getting quotas for user 8129e2e269f04751bc7a7e86909ef0d7 and project d7db1d988ddc4de98b935dea64b593f0. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:02.725999 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-987a4f84-433e-437c-9b18-1565cb23335c tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.020390 Oct 12 22:48:02.729931 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1683/3260] 10.222.0.20 () {62 vars in 1198 bytes} [Wed Oct 12 22:48:01 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1028 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:02.756608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e49b711-6e3f-4269-82f4-e34fd26d12a5 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44fee3a160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:02.778675 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e49b711-6e3f-4269-82f4-e34fd26d12a5 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1839549070" status: 200 len: 1534 microversion: 2.2 time: 0.032629 Oct 12 22:48:02.780737 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1684/3261] 10.222.0.20 () {60 vars in 1258 bytes} [Wed Oct 12 22:48:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1839549070 => generated 1534 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:02.796550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-816c7b0c-0a74-41f7-bdca-575aacd45970 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44fec4ab80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:02.813287 n-d-860864-8 devstack@n-api.service[120542]: WARNING oslo_db.sqlalchemy.utils [None req-816c7b0c-0a74-41f7-bdca-575aacd45970 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:48:02.830431 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-816c7b0c-0a74-41f7-bdca-575aacd45970 tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.041554 Oct 12 22:48:02.832517 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1685/3262] 10.222.0.20 () {60 vars in 1177 bytes} [Wed Oct 12 22:48:02 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:02.848273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2ca54917-bd16-46b8-8a0b-4bf7a20e59fd tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] Calling method '.version_select at 0x7f44fec53820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:02.888943 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2ca54917-bd16-46b8-8a0b-4bf7a20e59fd tempest-KeyPairsV22TestJSON-72190507 tempest-KeyPairsV22TestJSON-72190507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839549070" status: 204 len: 0 microversion: 2.2 time: 0.044692 Oct 12 22:48:02.890573 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1686/3263] 10.222.0.20 () {60 vars in 1261 bytes} [Wed Oct 12 22:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839549070 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:03.002320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:03.011250 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-892907b6-ae13-48ca-a204-2a9315ecb864 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1316 microversion: 2.1 time: 0.398103 Oct 12 22:48:03.027294 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1578/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:02 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:03.453878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:03.456711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:03.549347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:03.550005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:03.552178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:03.553174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:03.554612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:03.564745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:03.634158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:03.636383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:03.669882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:03.673068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:03.675708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:03.678798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:03.680678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:03.681156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:03.936532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:03.950831 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd16ec0c-3cf3-40ab-9d8d-75ead3bc4bb5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1355 microversion: 2.1 time: 0.324623 Oct 12 22:48:03.964305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1579/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:03 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1355 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:04.029545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-68e746ac-4697-400e-bf88-40fe851de037 req-0a607b63-177c-4d14-8240-b0ed0f7b6a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b422b505-f575-4ff4-af58-1d9eeec9c2c2", "name": "network-vif-plugged", "status": "completed", "tag": "abc46808-34fa-4625-9480-25b69b824c88"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:04.054148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68e746ac-4697-400e-bf88-40fe851de037 req-0a607b63-177c-4d14-8240-b0ed0f7b6a45 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:04.055734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68e746ac-4697-400e-bf88-40fe851de037 req-0a607b63-177c-4d14-8240-b0ed0f7b6a45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:04.057225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-68e746ac-4697-400e-bf88-40fe851de037 req-0a607b63-177c-4d14-8240-b0ed0f7b6a45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:04.084296 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-68e746ac-4697-400e-bf88-40fe851de037 req-0a607b63-177c-4d14-8240-b0ed0f7b6a45 service nova] Creating event network-vif-plugged:abc46808-34fa-4625-9480-25b69b824c88 for instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 on n-h2-860864-8 Oct 12 22:48:04.095919 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-68e746ac-4697-400e-bf88-40fe851de037 req-0a607b63-177c-4d14-8240-b0ed0f7b6a45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069862 Oct 12 22:48:04.098269 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1580/3266] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:04.111371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:04.112998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:04.143057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:04.144669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:04.145742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:04.146667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:04.147352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:04.147786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:04.337237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:04.350119 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-43bf0062-7333-4922-8997-9f59508d3933 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1553 microversion: 2.1 time: 0.910344 Oct 12 22:48:04.350772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1687/3267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:03 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1553 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:04.948686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:04.960297 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3eaf82db-e6e8-4d7b-8eec-382128a9ad90 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1316 microversion: 2.1 time: 0.860088 Oct 12 22:48:04.963333 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1581/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:04 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1316 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:04.979381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:04.980016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:04.989503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:04.989995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:04.990438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:04.991141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:04.996942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:04.997674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:05.173081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:05.189855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14a34f02-8a24-4836-ac22-6cdf35df6dc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1353 microversion: 2.1 time: 0.212458 Oct 12 22:48:05.209773 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1688/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:04 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1353 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:05.379825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:05.381170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:05.390425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:05.391388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:05.392180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:05.393765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:05.394440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:05.395070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:05.521346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9eb9beb8-cacc-4099-a096-4234db65d2e8 req-20638092-92e8-48c9-9a90-6c7f78b55a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361c1555-4595-4f25-8e04-a81993718e1c", "name": "network-vif-deleted", "tag": "089a9668-5b8f-4471-86c8-56e46919b889"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:05.554420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9eb9beb8-cacc-4099-a096-4234db65d2e8 req-20638092-92e8-48c9-9a90-6c7f78b55a39 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:05.555475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9eb9beb8-cacc-4099-a096-4234db65d2e8 req-20638092-92e8-48c9-9a90-6c7f78b55a39 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:05.558562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9eb9beb8-cacc-4099-a096-4234db65d2e8 req-20638092-92e8-48c9-9a90-6c7f78b55a39 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:05.609277 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9eb9beb8-cacc-4099-a096-4234db65d2e8 req-20638092-92e8-48c9-9a90-6c7f78b55a39 service nova] Creating event network-vif-deleted:089a9668-5b8f-4471-86c8-56e46919b889 for instance 361c1555-4595-4f25-8e04-a81993718e1c on n-h1-860864-8 Oct 12 22:48:05.624162 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9eb9beb8-cacc-4099-a096-4234db65d2e8 req-20638092-92e8-48c9-9a90-6c7f78b55a39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110118 Oct 12 22:48:05.625253 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1689/3270] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:05.816833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:05.828140 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5fefde90-6b80-428f-be0f-e471116d1c33 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1511 microversion: 2.1 time: 0.453390 Oct 12 22:48:05.831506 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1582/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:05 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:05.989870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:05.990847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:06.034624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:06.036909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:06.038485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:06.040741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:06.043003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:06.043674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:06.218792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:06.219412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:06.262005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:06.264074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:06.268386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:06.275443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:06.276834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:06.277455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:06.634168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:06.647855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b188fa44-9333-4176-b119-bc30d0acbb91 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1465 microversion: 2.1 time: 0.663785 Oct 12 22:48:06.651635 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1690/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:05 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1465 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:06.734619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:06.746548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ce2fd5f-33e8-4e68-8f8c-56ce228c1ec5 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1472 microversion: 2.1 time: 0.532905 Oct 12 22:48:06.749448 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1583/3273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:06 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:06.874314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:06.875116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:06.882464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:06.883610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:06.884549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:06.885697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:06.886366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:06.887026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:07.072600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:07.089450 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-db420b71-69c6-485a-89eb-bb3f02efc014 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1346 microversion: 2.1 time: 0.227915 Oct 12 22:48:07.092923 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1584/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:06 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1346 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:07.203910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] Calling method '.version_select at 0x7f4507c07160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:07.229592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:07.230876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:07.231451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:07.231554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:07.232418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:07.232565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:07.233164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:07.233769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:07.255602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:07.256138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:07.256579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:07.257289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:07.258273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:07.258713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:07.284058 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0324b9a8-a7d9-497b-b80f-bcd71918ceb0 tempest-AbsoluteLimitsTestJSON-819455093 tempest-AbsoluteLimitsTestJSON-819455093-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.158502 Oct 12 22:48:07.285062 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1585/3275] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Oct 12 22:48:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:07.779296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:07.779930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:07.793010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:07.793757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:07.794348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:07.795215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:07.799276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:07.800614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:07.840349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:08.624670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:08.640645 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7dddb9a8-b41c-4b93-ab92-88fa2ddd4abf tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1472 microversion: 2.1 time: 0.864985 Oct 12 22:48:08.651395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1586/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:07 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1472 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:08.662408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-aa3f591c-bdee-43d4-a1e0-eb1a9a9686a0 req-013db94a-441c-4017-adf0-c98d8d06cbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65cd61be-6259-4f23-aada-1055af774205", "tag": "7d03e8f6-ec6b-4fa0-bb4c-d49b120be648"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:08.677127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aa3f591c-bdee-43d4-a1e0-eb1a9a9686a0 req-013db94a-441c-4017-adf0-c98d8d06cbba service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:08.677665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aa3f591c-bdee-43d4-a1e0-eb1a9a9686a0 req-013db94a-441c-4017-adf0-c98d8d06cbba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:08.678104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aa3f591c-bdee-43d4-a1e0-eb1a9a9686a0 req-013db94a-441c-4017-adf0-c98d8d06cbba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:08.691437 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-aa3f591c-bdee-43d4-a1e0-eb1a9a9686a0 req-013db94a-441c-4017-adf0-c98d8d06cbba service nova] Creating event network-changed:7d03e8f6-ec6b-4fa0-bb4c-d49b120be648 for instance 65cd61be-6259-4f23-aada-1055af774205 on n-h1-860864-8 Oct 12 22:48:08.705137 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-aa3f591c-bdee-43d4-a1e0-eb1a9a9686a0 req-013db94a-441c-4017-adf0-c98d8d06cbba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051883 Oct 12 22:48:08.707684 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1587/3277] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:08.714520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:08.715236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:08.722020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:08.722997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:08.723428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:08.724467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:08.725070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:08.725640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:08.852961 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b099304-af5c-4702-991e-cb2e97b51464 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1616 microversion: 2.1 time: 2.173796 Oct 12 22:48:08.854374 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1691/3278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:06 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1616 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:08.881825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99f2c696-2528-48f7-bce0-904cea15b497 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: .version_select at 0x7f44ffbaeaf0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1427035141", "policies": ["affinity"]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:08.902913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=53 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:08.914264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-99f2c696-2528-48f7-bce0-904cea15b497 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:08.926943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-99f2c696-2528-48f7-bce0-904cea15b497 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:08.929782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:08.987097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:09.000775 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2dc6dbf6-e4c6-40b5-aac8-cf70dbbff0f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1346 microversion: 2.1 time: 0.289114 Oct 12 22:48:09.005714 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1588/3279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:08 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1346 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:09.077256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-99f2c696-2528-48f7-bce0-904cea15b497 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:09.094209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-99f2c696-2528-48f7-bce0-904cea15b497 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:09.154596 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99f2c696-2528-48f7-bce0-904cea15b497 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.277080 Oct 12 22:48:09.158650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1692/3280] 10.222.0.20 () {60 vars in 1174 bytes} [Wed Oct 12 22:48:08 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:09.389751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-247645870", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "112a4117-b377-4c0c-a5b1-88551154bd46"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:09.489335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:48:09.666460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:09.667348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:09.689055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:09.691100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:09.695458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:09.701632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:09.702718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:09.703585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:09.706520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:10.099170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:10.111186 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50564bf8-f010-4629-bf20-4dd9975c8e7a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1472 microversion: 2.1 time: 0.448988 Oct 12 22:48:10.115325 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1693/3281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:09 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:10.137849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:10.139540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:10.175040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:10.177219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:10.181747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:10.185206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:10.189641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:10.190300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:10.427351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:10.439807 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f5e200c5-4e99-4bad-ab44-ecb32fe12415 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1346 microversion: 2.1 time: 0.318619 Oct 12 22:48:10.444184 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1694/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:10 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1346 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:11.140356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:11.141086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:11.171247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:11.172843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:11.173591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:11.176525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:11.180481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:11.182108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:11.467608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:48:11.468135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:48:11.468711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:48:11.469298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:48:11.469886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:48:11.509348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:11.510164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:11.510859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:11.511838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:11.514271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:11.514916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:11.560258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:11.574584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:11.608943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Going to run 2 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:48:11.619782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:11.684025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120543) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 22:48:11.707769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:11.720675 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89d48d2c-e41d-4a30-8ebe-8740936acbc1 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1472 microversion: 2.1 time: 0.585350 Oct 12 22:48:11.724066 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1695/3283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:11 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1472 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:11.731562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:11.733864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:11.736308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:11.744394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:11.752440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:11.754590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:11.756028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:11.759108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:11.759761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:11.760427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:11.890125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:11.902642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:11.946308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=4dff7c05-b126-48d1-ada6-35441f8fb917,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:11.996379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:12.016209 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6b32aae-9f36-4caf-8173-e003f2be9e38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1346 microversion: 2.1 time: 0.289465 Oct 12 22:48:12.018788 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1696/3284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:11 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1346 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:12.111394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:12.118605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:12.202925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:12.233386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:12.247153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:12.286340 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb4d616b-9688-4f6d-b8a3-3cf6d38509da tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.903139 Oct 12 22:48:12.287578 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1589/3285] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:48:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 2906 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:48:12.303736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:12.309004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:12.315913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Searching by: {'deleted': False, 'project_id': '115ba104dfa745dd9fa95a23fbd90474'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:48:12.373532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:12.374019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:12.376974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:12.380195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:12.382700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:12.384497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:12.452610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:48:12.491627 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef71cc4c-8990-4f76-a658-bfbf173696c7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.199227 Oct 12 22:48:12.492544 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1697/3286] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:48:12 2022] GET /compute/v2.1/servers => generated 1001 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:12.505127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58b88347-aa6d-4ca4-a888-5397c3591f48 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:12.505937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58b88347-aa6d-4ca4-a888-5397c3591f48 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:12.588155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-58b88347-aa6d-4ca4-a888-5397c3591f48 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:12.598113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58b88347-aa6d-4ca4-a888-5397c3591f48 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1218 microversion: 2.1 time: 0.097176 Oct 12 22:48:12.612123 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1590/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:12 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:12.747961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:12.748780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:12.755645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:12.756332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:12.757865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:12.758742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:12.762640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:12.763392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:13.044384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:13.045539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:13.061596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:13.063804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:13.064455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:13.065551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:13.067379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:13.072922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:13.314284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:13.317108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:13.327300 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3287bbaf-bac3-41f0-abc2-569167756427 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1346 microversion: 2.1 time: 0.287812 Oct 12 22:48:13.329934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ecb2c35-b1d9-4268-9b71-80848b3b6e80 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1472 microversion: 2.1 time: 0.584097 Oct 12 22:48:13.331360 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1591/3288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:13 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1346 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:13.332273 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1698/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:12 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1472 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:13.624015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:13.626676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:13.643186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:13.650570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:13.651257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:13.652350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:13.653268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:13.654031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:13.826478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:13.838926 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ff2192c-437b-4d1e-b9c5-a64154fb2755 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1222 microversion: 2.1 time: 0.219066 Oct 12 22:48:13.843947 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1592/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:13 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:14.354404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:14.359478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:14.360125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:14.364228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:14.379479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:14.380237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:14.380858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:14.381738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:14.383423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:14.384055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:14.393276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:14.393779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:14.397655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:14.398469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:14.398946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:14.399381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:14.612641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:14.630232 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d1662e55-052d-4c43-bbd7-3bb1d689474d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 200 len: 1346 microversion: 2.1 time: 0.283768 Oct 12 22:48:14.637390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:14.647147 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30b1fb5c-f1ef-4be0-9a05-e9ea272990c7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1472 microversion: 2.1 time: 0.291428 Oct 12 22:48:14.650634 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1699/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:14 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 1346 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:14.666766 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1593/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:14 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:14.674116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9f4bfe52-caa7-43b1-a082-129d77ea853c req-d2e2b2c4-b095-4d64-8cf4-6f357fa1931e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cd61be-6259-4f23-aada-1055af774205", "name": "network-vif-plugged", "status": "completed", "tag": "7d03e8f6-ec6b-4fa0-bb4c-d49b120be648"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:14.700390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9f4bfe52-caa7-43b1-a082-129d77ea853c req-d2e2b2c4-b095-4d64-8cf4-6f357fa1931e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:14.701041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9f4bfe52-caa7-43b1-a082-129d77ea853c req-d2e2b2c4-b095-4d64-8cf4-6f357fa1931e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:14.701472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9f4bfe52-caa7-43b1-a082-129d77ea853c req-d2e2b2c4-b095-4d64-8cf4-6f357fa1931e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:14.735113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9f4bfe52-caa7-43b1-a082-129d77ea853c req-d2e2b2c4-b095-4d64-8cf4-6f357fa1931e service nova] Creating event network-vif-plugged:7d03e8f6-ec6b-4fa0-bb4c-d49b120be648 for instance 65cd61be-6259-4f23-aada-1055af774205 on n-h1-860864-8 Oct 12 22:48:14.744916 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9f4bfe52-caa7-43b1-a082-129d77ea853c req-d2e2b2c4-b095-4d64-8cf4-6f357fa1931e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091975 Oct 12 22:48:14.745392 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1700/3293] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:14.863684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:14.864640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:14.874668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:14.879921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:14.883650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:14.884605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:14.887171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:14.891572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:15.035875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:15.049480 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-539dba6e-1fc2-4959-9457-a786a16d6a46 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1270 microversion: 2.1 time: 0.190396 Oct 12 22:48:15.050079 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1594/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:14 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:15.656629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:15.657676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:15.672193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:15.672873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:15.684212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:15.684701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:15.685138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:15.688188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:15.688670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:15.689097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:15.693236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:15.694428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:15.695414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:15.698302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:15.698867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:15.699544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:15.739447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c HTTP/1.1 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '361c1555-4595-4f25-8e04-a81993718e1c'} Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:15.745989 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:15.749882 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:15.749882 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:15.749882 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:15.749882 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:48:15.749882 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:48:15.749882 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:15.749882 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:15.753069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:48:15.756499 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d2e214c-f4ea-4ff1-a940-0b0a4ec1945e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 404 len: 111 microversion: 2.1 time: 0.105205 Oct 12 22:48:15.757152 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1701/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:15 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:48:15.957278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:15.968072 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16803e71-f830-45a2-a230-3bc66eb14370 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1472 microversion: 2.1 time: 0.301326 Oct 12 22:48:15.985938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:15.988302 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1595/3296] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:15 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:15.993299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:16.003471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:16.004312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:16.004973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:16.006078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:16.008851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:16.009664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:16.073437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:16.074064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:16.086945 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:16.090082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:16.090723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:16.091021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:16.091740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c/os-volume_attachments HTTP/1.1 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': '361c1555-4595-4f25-8e04-a81993718e1c'} Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:48:16.092602 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:48:16.097031 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:16.097731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:16.097731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:16.098356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:48:16.101460 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8c0fb1e-7554-4d83-a02a-0909b95c94b8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.121587 Oct 12 22:48:16.110448 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1702/3297] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 22:48:15 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c/os-volume_attachments => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:48:16.245145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:16.265067 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1665c63-5b5b-4f3c-9c4f-d4b97642b7c3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1276 microversion: 2.1 time: 0.196077 Oct 12 22:48:16.269686 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1596/3298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:16 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:16.484183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2030165464", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6857b740-c8f6-435b-b880-87bc9b4758e7"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:16.591451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] validate_networks() for [('6857b740-c8f6-435b-b880-87bc9b4758e7', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:48:16.996200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:16.997716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:17.029739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:17.030498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:17.030936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:17.038982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:17.042228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:17.042844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:17.520242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:17.531659 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54b75434-1e5f-4b0d-8801-077ba8205bcc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1644 microversion: 2.1 time: 0.541267 Oct 12 22:48:17.533966 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1597/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:16 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1644 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:17.539046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:17.539796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:17.550895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:17.551551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:17.552134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:17.563942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:17.565510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:17.566844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:17.727166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:17.747473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fbb293ae-4146-4965-88fe-29b07d87e1d5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1276 microversion: 2.1 time: 0.211904 Oct 12 22:48:17.750900 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1598/3300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:17 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:17.769902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:17.770733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:17.793603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:17.794482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:17.795207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:17.796922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:17.797600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:17.798192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:18.097497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:48:18.098399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:48:18.098972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:48:18.099458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:48:18.100009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:48:18.136647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:18.137148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:18.137692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:18.138320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:18.138775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:18.139204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:18.159441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:18.167060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for user 1353d2e3246c44cf8d4501c0f4455790 and project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:18.183236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:48:18.187221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:18.219775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:18.244212 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4880b8a6-2877-4cc7-b324-3b617d8af513 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1644 microversion: 2.1 time: 0.482854 Oct 12 22:48:18.251068 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1599/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:17 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1644 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:18.276535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:18.277215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:18.296440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:18.296940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:18.297380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:18.298088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:18.302778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:18.305796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:18.331217 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0787aaaf-a0b6-463b-b012-b3899aeb91e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.850847 Oct 12 22:48:18.332778 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1703/3302] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:48:18.344573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b08dfe1-1dc9-4952-8f90-75f27fa01cd2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:18.345935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b08dfe1-1dc9-4952-8f90-75f27fa01cd2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:18.534337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b08dfe1-1dc9-4952-8f90-75f27fa01cd2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:18.541361 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b08dfe1-1dc9-4952-8f90-75f27fa01cd2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26" status: 200 len: 1215 microversion: 2.1 time: 0.201004 Oct 12 22:48:18.541952 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1704/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:18 2022] GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:18.567712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-767ce100-f12c-4756-8a04-8ab240b79d28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:18.568275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-767ce100-f12c-4756-8a04-8ab240b79d28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:18.602141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-767ce100-f12c-4756-8a04-8ab240b79d28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:48:19.122936 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.scheduler.client.report [None req-767ce100-f12c-4756-8a04-8ab240b79d28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Deleted allocations for instance 37d40994-fa10-48ce-abfb-e9e390d57c26 Oct 12 22:48:19.138814 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.compute.api [None req-767ce100-f12c-4756-8a04-8ab240b79d28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] Instance Mapping does not exist while attempting local delete cleanup. Oct 12 22:48:19.139646 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-767ce100-f12c-4756-8a04-8ab240b79d28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26" status: 204 len: 0 microversion: 2.1 time: 0.576454 Oct 12 22:48:19.140336 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1705/3304] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:48:18 2022] DELETE /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:19.161910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:19.162539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:19.171942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:19.172780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:19.173395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:19.174267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:19.175069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:19.176075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:19.376867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:19.386122 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5de0d49f-743a-4bf3-8683-feffa6f2d57e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1276 microversion: 2.1 time: 0.233731 Oct 12 22:48:19.386717 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1706/3305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:19 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:19.419765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92cabaa4-62e4-42d4-bca9-344aea11a6ab tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:19.420451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92cabaa4-62e4-42d4-bca9-344aea11a6ab tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:19.437681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-92cabaa4-62e4-42d4-bca9-344aea11a6ab tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92cabaa4-62e4-42d4-bca9-344aea11a6ab tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 HTTP/1.1 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '37d40994-fa10-48ce-abfb-e9e390d57c26'} Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:19.439758 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:19.443225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:19.443225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:48:19.443225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:48:19.443225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:48:19.443225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:19.445071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92cabaa4-62e4-42d4-bca9-344aea11a6ab tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:48:19.445939 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92cabaa4-62e4-42d4-bca9-344aea11a6ab tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26" status: 404 len: 111 microversion: 2.1 time: 0.036846 Oct 12 22:48:19.446524 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1707/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:19 2022] GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:48:19.471374 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-500ec704-d39a-41b8-ae16-a3fc665af3dc tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1795 microversion: 2.1 time: 1.201083 Oct 12 22:48:19.472015 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1600/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:18 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1795 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:19.651947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-171868602", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6857b740-c8f6-435b-b880-87bc9b4758e7"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:19.740340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] validate_networks() for [('6857b740-c8f6-435b-b880-87bc9b4758e7', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:48:20.414668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:20.415293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:20.423696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:20.424576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:20.425623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:20.426573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:20.427244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:20.428127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:20.875878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:20.893076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-10246967-c803-461f-9228-2b9e9a1825e5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 0.483449 Oct 12 22:48:20.908701 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1601/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:20 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:21.263419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e3279112-d5ba-48b5-9e72-9c1eba7ca7de req-359c66c0-486b-440c-90a7-2217cf2b8902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dff7c05-b126-48d1-ada6-35441f8fb917", "tag": "038f3805-a57c-4c92-a9a3-1749c35b07e5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:21.289235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e3279112-d5ba-48b5-9e72-9c1eba7ca7de req-359c66c0-486b-440c-90a7-2217cf2b8902 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:21.290055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e3279112-d5ba-48b5-9e72-9c1eba7ca7de req-359c66c0-486b-440c-90a7-2217cf2b8902 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:21.290686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e3279112-d5ba-48b5-9e72-9c1eba7ca7de req-359c66c0-486b-440c-90a7-2217cf2b8902 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:21.309681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e3279112-d5ba-48b5-9e72-9c1eba7ca7de req-359c66c0-486b-440c-90a7-2217cf2b8902 service nova] Creating event network-changed:038f3805-a57c-4c92-a9a3-1749c35b07e5 for instance 4dff7c05-b126-48d1-ada6-35441f8fb917 on n-h2-860864-8 Oct 12 22:48:21.317241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e3279112-d5ba-48b5-9e72-9c1eba7ca7de req-359c66c0-486b-440c-90a7-2217cf2b8902 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062301 Oct 12 22:48:21.318451 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1602/3309] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:21.916986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:21.922066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:21.922800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:21.942110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:21.943265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:21.944474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:21.945374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:21.947106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:21.948416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:22.462098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:22.472881 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c602abed-09d7-4330-9957-cee2befed7b4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 0.558015 Oct 12 22:48:22.473910 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1603/3310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:21 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:22.525125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:48:22.526072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:48:22.526688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:48:22.527252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:48:22.527839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:48:22.538386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:22.541085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:22.541725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:22.542630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:22.544484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:22.545098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:22.575824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:22.585640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for user 1353d2e3246c44cf8d4501c0f4455790 and project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:22.611098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:48:22.613793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:22.709038 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84c9a684-1341-4617-9096-467858edae20 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.061519 Oct 12 22:48:22.710371 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1708/3311] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:48:22.722576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d10b532b-6eb2-41b7-95d0-6d068314ac8f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:22.723376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d10b532b-6eb2-41b7-95d0-6d068314ac8f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:22.727949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=44 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:23.011274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d10b532b-6eb2-41b7-95d0-6d068314ac8f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:23.019326 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d10b532b-6eb2-41b7-95d0-6d068314ac8f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1214 microversion: 2.1 time: 0.301603 Oct 12 22:48:23.020187 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1604/3312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:22 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:23.497887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:23.498754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:23.518770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:23.526982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:23.528172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:23.529090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:23.529695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:23.530569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:24.042747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:24.043389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:24.057538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:24.059087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:24.060319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:24.063214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:24.063865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:24.067963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:24.139721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:24.147838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a14752d9-02a5-4044-be6c-d4c6e1819960 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 0.654968 Oct 12 22:48:24.148479 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1709/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:23 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:24.527236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:24.545245 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62a0be6b-2747-4ed5-bf9c-accd6a09e87d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1266 microversion: 2.1 time: 0.504852 Oct 12 22:48:24.547671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1605/3314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:24 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1266 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:24.791001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f625810b-d9a1-4d69-8275-111d50d2463a req-95a14aa3-fa8b-420f-93e6-92c9e63c9b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03760a13-75c4-44cb-b498-ff14a833463c", "tag": "10c74ac6-c97c-432c-b9af-48879266484f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:24.822522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f625810b-d9a1-4d69-8275-111d50d2463a req-95a14aa3-fa8b-420f-93e6-92c9e63c9b9c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:24.823231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f625810b-d9a1-4d69-8275-111d50d2463a req-95a14aa3-fa8b-420f-93e6-92c9e63c9b9c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:24.823765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f625810b-d9a1-4d69-8275-111d50d2463a req-95a14aa3-fa8b-420f-93e6-92c9e63c9b9c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:24.833038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:24.857668 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f625810b-d9a1-4d69-8275-111d50d2463a req-95a14aa3-fa8b-420f-93e6-92c9e63c9b9c service nova] Creating event network-changed:10c74ac6-c97c-432c-b9af-48879266484f for instance 03760a13-75c4-44cb-b498-ff14a833463c on n-h2-860864-8 Oct 12 22:48:24.867050 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f625810b-d9a1-4d69-8275-111d50d2463a req-95a14aa3-fa8b-420f-93e6-92c9e63c9b9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079152 Oct 12 22:48:24.868499 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1710/3315] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:25.174121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:25.177366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:25.188462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:25.189025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:25.190463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:25.191366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:25.192020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:25.192463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:25.575491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:25.576572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:25.583592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:25.584145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:25.584576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:25.586083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:25.586731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:25.587159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:25.750172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:25.770569 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-770c0b58-6481-49ac-aac6-ea03d82c5647 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1272 microversion: 2.1 time: 0.200303 Oct 12 22:48:25.788632 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1711/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:25 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:25.857021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:25.876255 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6babc233-232c-4b6a-8c0e-6d29c7436538 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 0.705581 Oct 12 22:48:25.878343 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1606/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:25 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:26.068314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3f1fd4dc-64da-4891-9df7-8dd998859b0b req-7e64ebb8-84f8-4d07-883c-5206b73b791c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dff7c05-b126-48d1-ada6-35441f8fb917", "name": "network-vif-plugged", "status": "completed", "tag": "038f3805-a57c-4c92-a9a3-1749c35b07e5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:26.087420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3f1fd4dc-64da-4891-9df7-8dd998859b0b req-7e64ebb8-84f8-4d07-883c-5206b73b791c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.089587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3f1fd4dc-64da-4891-9df7-8dd998859b0b req-7e64ebb8-84f8-4d07-883c-5206b73b791c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.090408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3f1fd4dc-64da-4891-9df7-8dd998859b0b req-7e64ebb8-84f8-4d07-883c-5206b73b791c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.097012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:26.107697 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3f1fd4dc-64da-4891-9df7-8dd998859b0b req-7e64ebb8-84f8-4d07-883c-5206b73b791c service nova] Creating event network-vif-plugged:038f3805-a57c-4c92-a9a3-1749c35b07e5 for instance 4dff7c05-b126-48d1-ada6-35441f8fb917 on n-h2-860864-8 Oct 12 22:48:26.114048 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3f1fd4dc-64da-4891-9df7-8dd998859b0b req-7e64ebb8-84f8-4d07-883c-5206b73b791c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052740 Oct 12 22:48:26.115538 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1607/3318] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:26.267451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Calling method '.version_select at 0x7f44fee781f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:26.269570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.270111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.270549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.311491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.311943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.312402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.348151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:26.349898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.353778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.354505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.365653 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-745247df-fb68-4b94-8b68-5ae51c30e1fc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1509351383-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.330352 Oct 12 22:48:26.368178 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1712/3319] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:48:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:26.796981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:26.798936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:26.805991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.806827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.807426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.808338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.808943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.809517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.902657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:26.903406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:26.911424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.912423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.913690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.914686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:26.915694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:26.916683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:26.965010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:26.987876 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3d6e301-dd5c-4e6d-8d42-f72db734d841 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1272 microversion: 2.1 time: 0.196068 Oct 12 22:48:27.000399 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1608/3320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:26 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:27.035877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1b45155d-8aef-4f0e-8efa-e3be498cc0d6 req-9157ed0a-9dd5-497c-b6bd-59f0a9b7b6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65cd61be-6259-4f23-aada-1055af774205", "tag": "7d03e8f6-ec6b-4fa0-bb4c-d49b120be648"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:27.055786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1b45155d-8aef-4f0e-8efa-e3be498cc0d6 req-9157ed0a-9dd5-497c-b6bd-59f0a9b7b6e1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:27.057679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1b45155d-8aef-4f0e-8efa-e3be498cc0d6 req-9157ed0a-9dd5-497c-b6bd-59f0a9b7b6e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:27.058800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1b45155d-8aef-4f0e-8efa-e3be498cc0d6 req-9157ed0a-9dd5-497c-b6bd-59f0a9b7b6e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:27.073644 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1b45155d-8aef-4f0e-8efa-e3be498cc0d6 req-9157ed0a-9dd5-497c-b6bd-59f0a9b7b6e1 service nova] Creating event network-changed:7d03e8f6-ec6b-4fa0-bb4c-d49b120be648 for instance 65cd61be-6259-4f23-aada-1055af774205 on n-h1-860864-8 Oct 12 22:48:27.081344 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1b45155d-8aef-4f0e-8efa-e3be498cc0d6 req-9157ed0a-9dd5-497c-b6bd-59f0a9b7b6e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049544 Oct 12 22:48:27.082432 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1609/3321] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:28.014973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:28.016446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:28.026358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:28.032183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:28.032808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:28.033741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:28.034404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:28.035061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:28.063475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:28.083566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61b4451d-4e69-467d-a627-72be3eb55997 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 1.184664 Oct 12 22:48:28.086745 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1713/3322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:26 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:29.030530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-751374b7-6a33-4cf1-925a-ab912b3ca887 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44fec59430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1197550717", "description": "tempest-description-1264874604"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:29.069855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:29.079811 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d0a674d-2652-419e-9fe0-8915f84fa449 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1314 microversion: 2.1 time: 1.069902 Oct 12 22:48:29.080973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1610/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:28 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:29.112548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:29.113404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:29.120911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:29.121732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:29.122403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:29.123323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:29.124088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:29.124738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:29.508021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:29.523312 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-011905b7-cb09-4bd0-99a4-5df4ba6cadc0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 0.414522 Oct 12 22:48:29.533217 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1611/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:29 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:29.593931 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-751374b7-6a33-4cf1-925a-ab912b3ca887 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.696115 Oct 12 22:48:29.596621 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1714/3325] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:48:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:29.611523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6baf858-62bf-46a8-a48c-65c9294778f0 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff547940>, body: {"security_group_rule": {"parent_group_id": "98de8ebe-4cb2-446e-a09e-cefa41010b8c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:30.112480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:30.113809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:30.153358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:30.156574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:30.157234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:30.159007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:30.162059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:30.163174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:30.400689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:30.415519 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c016b6f0-75f9-4b49-be2e-08c1a0d97eb5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1314 microversion: 2.1 time: 0.314294 Oct 12 22:48:30.416855 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1715/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:30 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:30.535911 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6baf858-62bf-46a8-a48c-65c9294778f0 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.928136 Oct 12 22:48:30.536520 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1612/3327] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:48:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:30.550691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:30.551309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:30.551431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bc99979-e437-4c80-a36b-91e3dfe12d12 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ffe4f310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-612080626", "description": "tempest-description-622292451"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:30.562376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:30.563158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:30.563764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:30.564700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:30.565381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:30.565996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:31.117625 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5bc99979-e437-4c80-a36b-91e3dfe12d12 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.567117 Oct 12 22:48:31.127516 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1613/3328] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:48:30 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:31.143069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-73a316ea-e3f2-4676-b579-c286abac0f27 req-cfcd34a1-2df9-41a7-a0fb-8da87fcadc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03760a13-75c4-44cb-b498-ff14a833463c", "name": "network-vif-plugged", "status": "completed", "tag": "10c74ac6-c97c-432c-b9af-48879266484f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:31.228205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-73a316ea-e3f2-4676-b579-c286abac0f27 req-cfcd34a1-2df9-41a7-a0fb-8da87fcadc68 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:31.230716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-73a316ea-e3f2-4676-b579-c286abac0f27 req-cfcd34a1-2df9-41a7-a0fb-8da87fcadc68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.057s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:31.231362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-73a316ea-e3f2-4676-b579-c286abac0f27 req-cfcd34a1-2df9-41a7-a0fb-8da87fcadc68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:31.265128 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-73a316ea-e3f2-4676-b579-c286abac0f27 req-cfcd34a1-2df9-41a7-a0fb-8da87fcadc68 service nova] Creating event network-vif-plugged:10c74ac6-c97c-432c-b9af-48879266484f for instance 03760a13-75c4-44cb-b498-ff14a833463c on n-h2-860864-8 Oct 12 22:48:31.271568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-73a316ea-e3f2-4676-b579-c286abac0f27 req-cfcd34a1-2df9-41a7-a0fb-8da87fcadc68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140739 Oct 12 22:48:31.273376 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1614/3329] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:31.279370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-214287ca-ddd5-4cc4-8fa3-162563e9befb req-16e9b942-06a2-4c13-9420-ac396a45bb86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd", "tag": "09fff62e-7709-4d6d-b256-3a19e110eb7d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:31.340531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-214287ca-ddd5-4cc4-8fa3-162563e9befb req-16e9b942-06a2-4c13-9420-ac396a45bb86 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:31.342337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-214287ca-ddd5-4cc4-8fa3-162563e9befb req-16e9b942-06a2-4c13-9420-ac396a45bb86 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:31.342988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-214287ca-ddd5-4cc4-8fa3-162563e9befb req-16e9b942-06a2-4c13-9420-ac396a45bb86 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:31.361676 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-214287ca-ddd5-4cc4-8fa3-162563e9befb req-16e9b942-06a2-4c13-9420-ac396a45bb86 service nova] Creating event network-changed:09fff62e-7709-4d6d-b256-3a19e110eb7d for instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd on n-h1-860864-8 Oct 12 22:48:31.370004 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-214287ca-ddd5-4cc4-8fa3-162563e9befb req-16e9b942-06a2-4c13-9420-ac396a45bb86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094590 Oct 12 22:48:31.371731 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1615/3330] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:31.380064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f9de1e6c-8027-4221-ad3e-7e26040be6c8 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff519430>, body: {"security_group_rule": {"parent_group_id": "55184cf8-945f-4b19-8d5f-74d29f001930", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:31.423980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:31.440787 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bae8a096-ffca-42d7-a24b-c6618906aaa8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 0.894800 Oct 12 22:48:31.441330 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1716/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:30 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:31.446307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:31.447109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:31.454193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:31.456521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:31.456969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:31.457693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:31.462359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:31.462808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:31.955233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:31.964708 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e7f2605e-2523-4499-bbd6-7e7389725cff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1314 microversion: 2.1 time: 0.521808 Oct 12 22:48:31.973083 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1717/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:31 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:32.110568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f9de1e6c-8027-4221-ad3e-7e26040be6c8 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.736247 Oct 12 22:48:32.111781 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1616/3333] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:48:31 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:32.125565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb88d771-e96e-46ee-aa61-7c9506762b8c tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44fec59b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1151600605", "description": "tempest-description-1105264515"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:32.463541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:32.464314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:32.471864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:32.472537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:32.473132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:32.473995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:32.474688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:32.475148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:32.565748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:32.598905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=23 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:32.675561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:32.688547 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0756723c-2f25-448f-8c47-8e04ed907c65 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1318 microversion: 2.1 time: 0.228704 Oct 12 22:48:32.703621 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1617/3334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:32 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:32.802446 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb88d771-e96e-46ee-aa61-7c9506762b8c tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.680891 Oct 12 22:48:32.804164 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1718/3335] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:48:32 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:32.821915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43f3f58c-b754-4835-a334-8935000f2888 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff519a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-138813057", "description": "tempest-description-221506333"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:32.995967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:32.996600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:33.006641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:33.009987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:33.010491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:33.011222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:33.011695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:33.012155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:33.016014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:33.196159 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-43f3f58c-b754-4835-a334-8935000f2888 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.382224 Oct 12 22:48:33.196778 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1618/3336] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:48:32 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:33.211717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eb11425a-1f41-46e5-af1c-f0d92cf48a44 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff34a5e0>, body: {"security_group_rule": {"parent_group_id": "c27a6cf7-4f13-400a-a904-618fee34b1bb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "43bcd9a2-16f5-4600-bf33-98baa35600e2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:33.382713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:33.391070 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-faec24f9-81e0-4b65-8d91-fc94f11634f0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1314 microversion: 2.1 time: 0.400353 Oct 12 22:48:33.391978 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1719/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:32 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:33.710698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:33.712006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:33.718837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:33.719481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:33.719945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:33.720916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:33.722317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:33.722780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:33.914950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:33.922844 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e624fa70-87f8-43b8-b163-f25747356bc6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1468 microversion: 2.1 time: 0.216089 Oct 12 22:48:33.923522 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1720/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:33 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1468 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:33.946515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:33.947133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:33.954574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:33.955413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:33.956052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:33.956914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:33.957495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:33.958103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:34.356792 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eb11425a-1f41-46e5-af1c-f0d92cf48a44 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.150877 Oct 12 22:48:34.358385 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1619/3339] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:48:33 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:34.392177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c04752b-4ceb-4cec-939e-05e0b30dcfd9 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff547940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1241935149", "description": "tempest-description-1636279977"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:34.686658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:34.705128 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c04752b-4ceb-4cec-939e-05e0b30dcfd9 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.317854 Oct 12 22:48:34.705729 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1620/3340] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:48:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:34.708663 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5c2239c-9347-4b70-b667-78dae7fe682e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 200 len: 1467 microversion: 2.1 time: 0.764943 Oct 12 22:48:34.710059 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1721/3341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:33 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 1467 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:34.711754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:34.712578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:34.725164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:34.725670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:34.726204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3443d6d6-c004-4a26-895c-84e6d4ea71d3 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44fec53160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-562194640", "description": "tempest-description-591570397"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:34.727717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:34.728647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:34.729329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:34.729986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:35.151753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:35.163304 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-425c110d-13eb-4e8c-9459-084bae0a0166 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1314 microversion: 2.1 time: 0.456042 Oct 12 22:48:35.184361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1621/3342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:34 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:35.184361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:35.184361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:35.184361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Searching by: {'reservation_id': 'r-d0pj6k20', 'deleted': False, 'project_id': '115ba104dfa745dd9fa95a23fbd90474'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:48:35.193585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:35.195048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:35.195496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:35.196549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:35.196994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:35.197531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:35.216771 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3443d6d6-c004-4a26-895c-84e6d4ea71d3 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.495000 Oct 12 22:48:35.217614 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1722/3343] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:48:34 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:35.233729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6b0c341-f5b9-42ab-b360-87f983a28c2e tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44fec7d790>, body: {"security_group_rule": {"parent_group_id": "4a956f9d-2bb8-4350-9ab8-6e2662d63089", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f8b7cc58-26ae-40c0-accc-1ed67267e0ce"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:35.363148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:48:35.446868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:35.454290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:35.454854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:35.455382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:35.707923 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d97f696-fb22-412a-be1c-91caa2a04764 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-d0pj6k20" status: 200 len: 2928 microversion: 2.1 time: 0.539385 Oct 12 22:48:35.708753 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1622/3344] 10.222.0.20 () {58 vars in 1197 bytes} [Wed Oct 12 22:48:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-d0pj6k20 => generated 2928 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:35.735459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a0f3c38f-40d7-44e5-918c-ab01b609d502 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:35.751151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.server_groups [None req-a0f3c38f-40d7-44e5-918c-ab01b609d502 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Querying cell 868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) for 2 instances {{(pid=120543) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:48:35.752616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0f3c38f-40d7-44e5-918c-ab01b609d502 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:35.753268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0f3c38f-40d7-44e5-918c-ab01b609d502 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:35.754132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0f3c38f-40d7-44e5-918c-ab01b609d502 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:35.789333 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a0f3c38f-40d7-44e5-918c-ab01b609d502 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/112a4117-b377-4c0c-a5b1-88551154bd46" status: 200 len: 266 microversion: 2.1 time: 0.057386 Oct 12 22:48:35.790144 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1623/3345] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:48:35 2022] GET /compute/v2.1/os-server-groups/112a4117-b377-4c0c-a5b1-88551154bd46 => generated 266 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:35.803032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:35.804661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:35.812066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:35.812774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:35.813631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:35.814560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:35.815224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:35.815841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:35.960101 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6b0c341-f5b9-42ab-b360-87f983a28c2e tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.730342 Oct 12 22:48:35.961590 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1723/3346] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:48:35 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:35.973289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e302f568-c59f-43c3-bd89-654c49f38907 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44feca93a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:36.342954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e302f568-c59f-43c3-bd89-654c49f38907 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f8b7cc58-26ae-40c0-accc-1ed67267e0ce" status: 202 len: 0 microversion: 2.1 time: 0.373358 Oct 12 22:48:36.343689 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1724/3347] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:35 2022] DELETE /compute/v2.1/os-security-groups/f8b7cc58-26ae-40c0-accc-1ed67267e0ce => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:36.348604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:36.349347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:36.360592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:36.362691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:36.363977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:36.365296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:36.365916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:36.366432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:36.468000 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46babfdf-8d00-4eb7-aa4c-7fc8862c5b55 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 200 len: 1619 microversion: 2.1 time: 0.669163 Oct 12 22:48:36.480877 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1624/3348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:35 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 1619 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:36.492630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13d65eb2-5f4b-4d56-b06a-9ca64664b3bb tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff561280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:36.550732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:36.560112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9dc33f25-a5ad-4d07-91ce-7e3e8af3aa3a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1314 microversion: 2.1 time: 0.215060 Oct 12 22:48:36.564715 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1725/3349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:36 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:36.572193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:36.577387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:36.591616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:36.592341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:36.593419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:36.594791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:36.595393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:36.595987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:36.687663 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13d65eb2-5f4b-4d56-b06a-9ca64664b3bb tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/4a956f9d-2bb8-4350-9ab8-6e2662d63089" status: 200 len: 248 microversion: 2.1 time: 0.205353 Oct 12 22:48:36.689302 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1625/3350] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:48:36 2022] GET /compute/v2.1/os-security-groups/4a956f9d-2bb8-4350-9ab8-6e2662d63089 => generated 248 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:36.706939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-dc2155dd-0677-4f7b-b46e-1b6b364a1913 req-cda99f61-e0df-4cf3-be42-eb29157c5465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd", "name": "network-vif-plugged", "status": "completed", "tag": "09fff62e-7709-4d6d-b256-3a19e110eb7d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:36.736445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-dc2155dd-0677-4f7b-b46e-1b6b364a1913 req-cda99f61-e0df-4cf3-be42-eb29157c5465 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:36.737344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-dc2155dd-0677-4f7b-b46e-1b6b364a1913 req-cda99f61-e0df-4cf3-be42-eb29157c5465 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:36.737850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-dc2155dd-0677-4f7b-b46e-1b6b364a1913 req-cda99f61-e0df-4cf3-be42-eb29157c5465 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:36.754043 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-dc2155dd-0677-4f7b-b46e-1b6b364a1913 req-cda99f61-e0df-4cf3-be42-eb29157c5465 service nova] Creating event network-vif-plugged:09fff62e-7709-4d6d-b256-3a19e110eb7d for instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd on n-h1-860864-8 Oct 12 22:48:36.775616 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-dc2155dd-0677-4f7b-b46e-1b6b364a1913 req-cda99f61-e0df-4cf3-be42-eb29157c5465 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072139 Oct 12 22:48:36.776662 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1626/3351] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:36.783907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-467fd0cd-2ad5-4e24-8689-69616c62f046 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff3d25e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-424262608", "description": "tempest-description-1208730208"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:36.822564 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a6745a7-5532-4251-a64c-b964da1135eb tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 200 len: 1618 microversion: 2.1 time: 0.256586 Oct 12 22:48:36.823166 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1726/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:36 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 1618 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:36.849749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79b4c923-9b23-49dc-a0f7-c99f0b1cdcda tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: .version_select at 0x7f44fec7a4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-41049549", "policies": ["anti-affinity"]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:36.872977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79b4c923-9b23-49dc-a0f7-c99f0b1cdcda tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:36.878229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79b4c923-9b23-49dc-a0f7-c99f0b1cdcda tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:36.926748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79b4c923-9b23-49dc-a0f7-c99f0b1cdcda tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:36.933301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79b4c923-9b23-49dc-a0f7-c99f0b1cdcda tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:36.947334 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79b4c923-9b23-49dc-a0f7-c99f0b1cdcda tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.103587 Oct 12 22:48:36.948652 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1727/3353] 10.222.0.20 () {60 vars in 1174 bytes} [Wed Oct 12 22:48:36 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:48:37.081381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-494253743", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9980a58a-9df8-4633-acee-db5158b1c9c8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:37.139112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:48:37.410241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:48:37.412141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:48:37.413694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:48:37.414114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:48:37.414994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:48:37.461403 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-467fd0cd-2ad5-4e24-8689-69616c62f046 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.683510 Oct 12 22:48:37.462400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1627/3354] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:48:36 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:37.463263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:37.463770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:37.464244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:37.464987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:37.465435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:37.465862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:37.478640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cae99d8b-c62b-4703-a7ae-5ad28ee80bce tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff455550>, body: {"security_group_rule": {"parent_group_id": "3b2c3742-d38e-46cf-b8d1-e980940697c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:37.494529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:37.501807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:37.516343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Going to run 2 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:48:37.519181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:37.564517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120542) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 22:48:37.589788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:37.595760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:37.651774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:37.661291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:37.691958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=1fd009ac-e125-453d-9b46-6efd41f2e324,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:37.786073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:37.789496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:37.794957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:37.858985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:37.868205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:37.930920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e81614c-2f86-4b4b-a954-3b3f3365fa6d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.853202 Oct 12 22:48:37.931837 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1728/3355] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:48:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 855 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 22:48:37.941462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:37.942537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:37.951987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:37.952733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:37.953263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:37.954488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:37.955124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:37.957351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:37.983595 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cae99d8b-c62b-4703-a7ae-5ad28ee80bce tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.511627 Oct 12 22:48:37.985337 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1628/3356] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:48:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:37.997264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:38.018579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:38.019371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Searching by: {'deleted': False, 'project_id': '115ba104dfa745dd9fa95a23fbd90474'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:48:38.050486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:38.051333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:38.052178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:38.053506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:38.054588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:38.055186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:38.103332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:48:38.245622 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ba0f1be-56bc-4051-8d79-ff057043999b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.255878 Oct 12 22:48:38.246848 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1629/3357] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:48:37 2022] GET /compute/v2.1/servers => generated 1661 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:38.263540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e9e4c1a-1c51-400f-bc1a-542d0877db65 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Action: 'create', calling method: .version_select at 0x7f44ff455280>, body: {"security_group_rule": {"parent_group_id": "3b2c3742-d38e-46cf-b8d1-e980940697c0", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:38.328771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:38.343548 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bf05d57a-9d82-46ce-bc06-b97ebe3e3a2e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1314 microversion: 2.1 time: 0.407020 Oct 12 22:48:38.358080 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1729/3358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:37 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:38.384847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d8bfe043-c836-44ca-a28a-e30e90f3bed7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:38.385482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d8bfe043-c836-44ca-a28a-e30e90f3bed7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:38.517635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d8bfe043-c836-44ca-a28a-e30e90f3bed7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:38.525289 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d8bfe043-c836-44ca-a28a-e30e90f3bed7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1218 microversion: 2.1 time: 0.159657 Oct 12 22:48:38.525879 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1730/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:38 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:39.312810 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e9e4c1a-1c51-400f-bc1a-542d0877db65 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.063976 Oct 12 22:48:39.314289 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1630/3360] 10.222.0.20 () {60 vars in 1195 bytes} [Wed Oct 12 22:48:38 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:39.327411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35b1d8ba-db99-4a23-9377-9715b7969314 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44fec59b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:39.371790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:39.373249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:39.387350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:39.388177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:39.388844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:39.390270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:39.391141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:39.392010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:39.549802 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35b1d8ba-db99-4a23-9377-9715b7969314 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/3b2c3742-d38e-46cf-b8d1-e980940697c0" status: 200 len: 664 microversion: 2.1 time: 0.227166 Oct 12 22:48:39.550855 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1731/3361] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:48:39 2022] GET /compute/v2.1/os-security-groups/3b2c3742-d38e-46cf-b8d1-e980940697c0 => generated 664 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:39.555981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:39.557267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:39.578451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:39.579363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:39.579486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:39.580148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:39.580911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:39.582605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:39.799463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:39.814567 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-defebd7f-1a1e-47da-b06c-36836e28a814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1222 microversion: 2.1 time: 0.262489 Oct 12 22:48:39.815154 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1732/3362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:39 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:39.825845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b69aace-ca71-48df-930c-a24d18193e88 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44fec9ad30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:39.880002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:39.892990 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54604778-2f32-497e-ad63-ad5f1063d47b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1500 microversion: 2.1 time: 0.526321 Oct 12 22:48:39.893586 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1631/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:39 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1500 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:39.923006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:39.923544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:39.933122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:39.933614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:39.938642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:39.940226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:39.943073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:39.943757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:40.095143 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f97efbf-1cf9-4a7e-9468-72a03e6f1ed4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd/action" status: 202 len: 0 microversion: 2.1 time: 0.176520 Oct 12 22:48:40.097609 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1632/3364] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:48:39 2022] POST /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:48:40.141685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:40.152425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:40.163596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:40.165496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:40.168211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:40.169434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:40.170225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:40.170837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:40.722650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:40.734773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-559563e2-3606-45a4-9c7a-efe3f0cb8572 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1505 microversion: 2.1 time: 0.620446 Oct 12 22:48:40.736325 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1633/3365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:40 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:40.856899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:40.857529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:40.884608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:40.885991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:40.886597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:40.888323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:40.890186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:40.890790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:41.201142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:41.219727 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2325aa69-cb9d-4e31-8a5e-bbf07204753c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1270 microversion: 2.1 time: 0.375293 Oct 12 22:48:41.223783 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1634/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:40 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:41.249476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b69aace-ca71-48df-930c-a24d18193e88 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/f7cc9035-36e7-49f1-9918-2aabec61cd1d" status: 202 len: 0 microversion: 2.1 time: 1.432753 Oct 12 22:48:41.250642 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1733/3367] 10.222.0.20 () {58 vars in 1287 bytes} [Wed Oct 12 22:48:39 2022] DELETE /compute/v2.1/os-security-group-rules/f7cc9035-36e7-49f1-9918-2aabec61cd1d => generated 0 bytes in 1435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:41.261014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc78df41-f50c-42ca-96ab-f6772f793e90 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff447c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:41.760795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:41.761780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:41.778251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:41.778736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:41.779230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:41.780365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:41.780819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:41.781243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:42.301969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:42.319544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea867d0c-6f7c-4836-b4f4-62d572e5ab87 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1485 microversion: 2.1 time: 0.562812 Oct 12 22:48:42.321233 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1734/3368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:41 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1485 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:42.327457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:42.328402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:42.338540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:42.339505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:42.340204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:42.351383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:42.352964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:42.353559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:42.491705 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc78df41-f50c-42ca-96ab-f6772f793e90 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3b2c3742-d38e-46cf-b8d1-e980940697c0" status: 202 len: 0 microversion: 2.1 time: 1.235680 Oct 12 22:48:42.493033 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1635/3369] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:41 2022] DELETE /compute/v2.1/os-security-groups/3b2c3742-d38e-46cf-b8d1-e980940697c0 => generated 0 bytes in 1237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:42.499222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:42.499920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:42.510291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=88 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:42.512337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:42.513420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:42.514052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:42.515352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:42.516018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:42.516815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:42.536810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:42.552696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:48:42.653684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d096e0c1-78af-443f-9bcd-14be6395cffa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 204 len: 0 microversion: 2.1 time: 0.158391 Oct 12 22:48:42.658512 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1636/3370] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:48:42 2022] DELETE /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:48:42.665242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8b8218b-9b85-496a-bd03-eb3461894cbf tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff41d820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:42.720974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:42.733745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-e8b8218b-9b85-496a-bd03-eb3461894cbf tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:48:42.734728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-98be72b5-0622-43fc-8151-6df2349b3814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1276 microversion: 2.1 time: 0.412030 Oct 12 22:48:42.735124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-e8b8218b-9b85-496a-bd03-eb3461894cbf tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Neutron security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:48:42.736903 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1735/3371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:42 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:42.737040 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-e8b8218b-9b85-496a-bd03-eb3461894cbf tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] HTTP exception thrown: Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist Oct 12 22:48:42.737040 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d04ac445-1f6a-4adf-96b8-9ad4d7a879d9'] Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8b8218b-9b85-496a-bd03-eb3461894cbf tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Request method failure captured: Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-security-groups/f8b7cc58-26ae-40c0-accc-1ed67267e0ce HTTP/1.1 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Q8YQbinB5mD9CudAhkz9MabF85Kyn4nLiLUB1B3bltXfPO0pVEXIW0qD_MBI7OVmMLDnMtX6CEFnPvHGu-yGUiF8T-v2iMYvJmTI8blFkdsFy0AiWaY6B4SttSx8mINuedx6zh4xWQ16PK6CtSpEcdypkPf-PD9UgVcZ_G7Mi6pnc Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 58ef42bfd6784651b7dd39661a52da33 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-841744146 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58ef42bfd6784651b7dd39661a52da33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/58ef42bfd6784651b7dd39661a52da33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_58ef42bfd6784651b7dd39661a52da33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58ef42bfd6784651b7dd39661a52da33"}]}] Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupRulesTestJSON-841744146 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 58ef42bfd6784651b7dd39661a52da33 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-841744146 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupRulesTestJSON-841744146-project Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 46e9d4d399094efca02f7eba0ae6cded Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupRulesTestJSON-841744146-project Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d04ac445-1f6a-4adf-96b8-9ad4d7a879d9'] Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'f8b7cc58-26ae-40c0-accc-1ed67267e0ce'} Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:48:42.739840 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d04ac445-1f6a-4adf-96b8-9ad4d7a879d9'] Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d04ac445-1f6a-4adf-96b8-9ad4d7a879d9'] Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d04ac445-1f6a-4adf-96b8-9ad4d7a879d9'] Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d04ac445-1f6a-4adf-96b8-9ad4d7a879d9'] Oct 12 22:48:42.743994 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:48:42.746043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:42.746043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:42.748702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8b8218b-9b85-496a-bd03-eb3461894cbf tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Returning 404 to user: Security group f8b7cc58-26ae-40c0-accc-1ed67267e0ce does not exist Oct 12 22:48:42.748702 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d04ac445-1f6a-4adf-96b8-9ad4d7a879d9'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:48:42.750597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:42.751090 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e8b8218b-9b85-496a-bd03-eb3461894cbf tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f8b7cc58-26ae-40c0-accc-1ed67267e0ce" status: 404 len: 194 microversion: 2.1 time: 0.090856 Oct 12 22:48:42.751261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:42.752307 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1637/3372] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:42 2022] DELETE /compute/v2.1/os-security-groups/f8b7cc58-26ae-40c0-accc-1ed67267e0ce => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:48:42.752472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:42.753386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:42.760634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:42.763540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9be80675-5fab-418b-8ff9-6d759c9ad615 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff5470d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:42.764739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:43.048589 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9be80675-5fab-418b-8ff9-6d759c9ad615 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4a956f9d-2bb8-4350-9ab8-6e2662d63089" status: 202 len: 0 microversion: 2.1 time: 0.292207 Oct 12 22:48:43.052411 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1638/3373] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:42 2022] DELETE /compute/v2.1/os-security-groups/4a956f9d-2bb8-4350-9ab8-6e2662d63089 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:43.061969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e01c673e-1de1-4c06-8be3-994be10ed3c3 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff8caaf0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:43.356556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:43.374301 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e01c673e-1de1-4c06-8be3-994be10ed3c3 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/43bcd9a2-16f5-4600-bf33-98baa35600e2" status: 202 len: 0 microversion: 2.1 time: 0.317323 Oct 12 22:48:43.378233 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1639/3374] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:43 2022] DELETE /compute/v2.1/os-security-groups/43bcd9a2-16f5-4600-bf33-98baa35600e2 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:43.384028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0214e9bc-6c9e-4d51-9830-f724671af527 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff41d820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:43.421910 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b71309bb-9f5b-45c1-aed0-5103ab1ce366 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1491 microversion: 2.1 time: 0.678220 Oct 12 22:48:43.427470 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1736/3375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:42 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1491 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:43.761161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:43.762504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:43.772672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:43.773636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:43.774350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:43.775330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:43.776092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:43.776688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:43.790020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:44.303846 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0214e9bc-6c9e-4d51-9830-f724671af527 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c27a6cf7-4f13-400a-a904-618fee34b1bb" status: 202 len: 0 microversion: 2.1 time: 0.923800 Oct 12 22:48:44.305234 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1640/3376] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:43 2022] DELETE /compute/v2.1/os-security-groups/c27a6cf7-4f13-400a-a904-618fee34b1bb => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:44.313402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d5221b6-e586-40fe-a651-773d076b6b79 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff41d4c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:44.516873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:44.533720 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7161034f-33ec-4eae-822a-e63aae875e3a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1276 microversion: 2.1 time: 0.778823 Oct 12 22:48:44.538383 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1737/3377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:43 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1276 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:44.550742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:44.551523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:44.565827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:44.569047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:44.571294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:44.573116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:44.575358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:44.577946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:45.405465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:45.414296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-126839de-4a8e-43c1-81c0-e77df4798666 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1491 microversion: 2.1 time: 0.874475 Oct 12 22:48:45.418266 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1738/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:44 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1491 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:45.446789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:45.551964 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d5221b6-e586-40fe-a651-773d076b6b79 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/55184cf8-945f-4b19-8d5f-74d29f001930" status: 202 len: 0 microversion: 2.1 time: 1.242296 Oct 12 22:48:45.552560 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1641/3379] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:44 2022] DELETE /compute/v2.1/os-security-groups/55184cf8-945f-4b19-8d5f-74d29f001930 => generated 0 bytes in 1244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:48:45.561063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b036bb0-5dd5-4147-a105-3cdfcbb28b09 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] Calling method '.version_select at 0x7f44ff4ffb80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:45.571303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:45.572471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:45.580264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:45.581002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:45.581616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:45.582771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:45.583469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:45.584543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:46.023077 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b036bb0-5dd5-4147-a105-3cdfcbb28b09 tempest-SecurityGroupRulesTestJSON-841744146 tempest-SecurityGroupRulesTestJSON-841744146-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/98de8ebe-4cb2-446e-a09e-cefa41010b8c" status: 202 len: 0 microversion: 2.1 time: 0.465730 Oct 12 22:48:46.023671 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1739/3380] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:48:45 2022] DELETE /compute/v2.1/os-security-groups/98de8ebe-4cb2-446e-a09e-cefa41010b8c => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:48:46.446677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:46.447297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:46.454081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:46.454081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:46.454409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:46.455514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:46.456140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:46.456689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:46.728025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:46.738006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:46.742010 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-333c4df6-2e05-4812-a389-84be6dc731ee tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 200 len: 1449 microversion: 2.1 time: 0.300125 Oct 12 22:48:46.744397 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1740/3381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:46 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 1449 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:46.749212 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4419aa95-51d4-4a3b-bf33-4d45678c3200 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 1.186369 Oct 12 22:48:46.749787 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1642/3382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:45 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:46.751759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f534a0f2-873c-4e38-9b77-621329172a07 req-488cd896-8e38-45cf-9284-6c11a9d1c0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fd009ac-e125-453d-9b46-6efd41f2e324", "tag": "78b5e6f5-e053-46d0-92f6-2c366f98c8d5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:46.777619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-55b31906-2eef-4c2d-bfbe-074f4ed7b50c req-61185112-13bb-4d93-a7fd-786391b591fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd", "name": "network-vif-deleted", "tag": "09fff62e-7709-4d6d-b256-3a19e110eb7d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:46.788103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f534a0f2-873c-4e38-9b77-621329172a07 req-488cd896-8e38-45cf-9284-6c11a9d1c0b2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:46.788943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f534a0f2-873c-4e38-9b77-621329172a07 req-488cd896-8e38-45cf-9284-6c11a9d1c0b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:46.789083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55b31906-2eef-4c2d-bfbe-074f4ed7b50c req-61185112-13bb-4d93-a7fd-786391b591fa service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:46.789537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55b31906-2eef-4c2d-bfbe-074f4ed7b50c req-61185112-13bb-4d93-a7fd-786391b591fa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:46.789687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f534a0f2-873c-4e38-9b77-621329172a07 req-488cd896-8e38-45cf-9284-6c11a9d1c0b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:46.790253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55b31906-2eef-4c2d-bfbe-074f4ed7b50c req-61185112-13bb-4d93-a7fd-786391b591fa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:46.804890 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-55b31906-2eef-4c2d-bfbe-074f4ed7b50c req-61185112-13bb-4d93-a7fd-786391b591fa service nova] Creating event network-vif-deleted:09fff62e-7709-4d6d-b256-3a19e110eb7d for instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd on n-h1-860864-8 Oct 12 22:48:46.807530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f534a0f2-873c-4e38-9b77-621329172a07 req-488cd896-8e38-45cf-9284-6c11a9d1c0b2 service nova] Creating event network-changed:78b5e6f5-e053-46d0-92f6-2c366f98c8d5 for instance 1fd009ac-e125-453d-9b46-6efd41f2e324 on n-h1-860864-8 Oct 12 22:48:46.813574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f534a0f2-873c-4e38-9b77-621329172a07 req-488cd896-8e38-45cf-9284-6c11a9d1c0b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067024 Oct 12 22:48:46.815483 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1741/3383] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:46.819820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-55b31906-2eef-4c2d-bfbe-074f4ed7b50c req-61185112-13bb-4d93-a7fd-786391b591fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051244 Oct 12 22:48:46.820363 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1643/3384] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:47.765822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:47.771169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:47.772762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:47.777260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:47.778230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:47.788712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:47.789310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:47.792990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:47.792990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:47.792990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:47.793689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:47.793928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:47.794711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:47.796774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:47.797688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:47.800113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:47.800741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:47.835793 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd HTTP/1.1 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd'} Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:48:47.840673 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:47.844516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:48:47.844516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:48:47.844516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:48:47.844516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:48:47.844516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:48:47.844516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:48:47.844516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:48:47.846221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:48:47.847273 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2eaa68a-7cd9-4afe-a7b9-3bfcec868f9e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 404 len: 111 microversion: 2.1 time: 0.082970 Oct 12 22:48:47.848410 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1742/3385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:47 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:48:47.985052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1230569557", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6857b740-c8f6-435b-b880-87bc9b4758e7"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:48.056754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] validate_networks() for [('6857b740-c8f6-435b-b880-87bc9b4758e7', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:48:48.073388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:48.437467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:48.448719 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6689f0f9-da90-4a68-9d78-2f9cef9a3e8c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.678434 Oct 12 22:48:48.458074 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1644/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:47 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:48.524832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:48.863503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:48:48.864084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:48:48.865548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:48:48.865969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:48:48.866975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:48:48.889687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:48.892089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:48.892554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:48.898181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:48.900748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:48.901626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:48.966163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:48:48.983788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for user 1353d2e3246c44cf8d4501c0f4455790 and project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:48:49.029373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:48:49.034082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:48:49.154310 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b536dfda-d005-4c24-9c87-1f1ab3592759 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173124 Oct 12 22:48:49.157273 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1743/3387] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:48:49.170103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a9520af-65c5-473d-a770-a57f072da111 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:49.171335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a9520af-65c5-473d-a770-a57f072da111 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:49.379305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-cdecc04e-83ea-43ef-81e5-613d8258efe9 req-7d5983ac-722d-4dd4-ad9d-7df2d217abc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733fab40-dabb-4977-a8b7-0ff7ee75fea3", "tag": "cfb7ba63-28a6-46cf-a11e-869d5c685f36"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:49.414807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cdecc04e-83ea-43ef-81e5-613d8258efe9 req-7d5983ac-722d-4dd4-ad9d-7df2d217abc0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:49.415991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cdecc04e-83ea-43ef-81e5-613d8258efe9 req-7d5983ac-722d-4dd4-ad9d-7df2d217abc0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:49.416635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cdecc04e-83ea-43ef-81e5-613d8258efe9 req-7d5983ac-722d-4dd4-ad9d-7df2d217abc0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:49.450432 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-cdecc04e-83ea-43ef-81e5-613d8258efe9 req-7d5983ac-722d-4dd4-ad9d-7df2d217abc0 service nova] Creating event network-changed:cfb7ba63-28a6-46cf-a11e-869d5c685f36 for instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 on n-h2-860864-8 Oct 12 22:48:49.466664 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-cdecc04e-83ea-43ef-81e5-613d8258efe9 req-7d5983ac-722d-4dd4-ad9d-7df2d217abc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090419 Oct 12 22:48:49.468108 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1744/3388] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:49.479051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:49.481092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:49.498221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:49.502914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:49.504137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:49.505896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:49.506825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:49.509975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:49.791824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a9520af-65c5-473d-a770-a57f072da111 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:49.806646 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a9520af-65c5-473d-a770-a57f072da111 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1215 microversion: 2.1 time: 0.641803 Oct 12 22:48:49.820720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1645/3389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:49 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1215 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:50.079771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:50.108900 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cefdfa3-2d6b-4830-b3a8-5fa6b3c605f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.637775 Oct 12 22:48:50.116358 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1745/3390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:49 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:50.833026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:50.835731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:50.882443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:50.884816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:50.885562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:50.890067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:50.892747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:50.895513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:51.104539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:51.113816 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f454c6fd-4b24-4a55-9869-975156d456a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1267 microversion: 2.1 time: 0.287136 Oct 12 22:48:51.114450 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1646/3391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:50 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:51.139448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:51.140189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:51.148780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:51.149777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:51.150449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:51.151543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:51.152283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:51.153130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:51.361638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:51.378870 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3592954d-84cf-416a-ac49-39ba1630008d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.240758 Oct 12 22:48:51.380433 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1746/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:51 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:52.146059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:52.148185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:52.158709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:52.159475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:52.160145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:52.161715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:52.164709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:52.166081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:52.406800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:52.408204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:52.418192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:52.418983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:52.430392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:52.433944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:52.438233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:52.438839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:52.954543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:52.977104 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7b18ce6b-0332-4b86-bb38-fac678ef5afc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1285 microversion: 2.1 time: 0.836395 Oct 12 22:48:52.977692 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1647/3393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:52 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1285 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:53.042616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:53.055578 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d65b8b2-8069-4cf9-aa75-3a9267f426b9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.654495 Oct 12 22:48:53.071726 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1747/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:52 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:53.248748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c75d2251-a2bb-4bc8-8ccd-106ce5686764 req-85efca09-0250-41ce-9059-1d452769fb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd009ac-e125-453d-9b46-6efd41f2e324", "name": "network-vif-plugged", "status": "completed", "tag": "78b5e6f5-e053-46d0-92f6-2c366f98c8d5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:53.271049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c75d2251-a2bb-4bc8-8ccd-106ce5686764 req-85efca09-0250-41ce-9059-1d452769fb86 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:53.272628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c75d2251-a2bb-4bc8-8ccd-106ce5686764 req-85efca09-0250-41ce-9059-1d452769fb86 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:53.280216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c75d2251-a2bb-4bc8-8ccd-106ce5686764 req-85efca09-0250-41ce-9059-1d452769fb86 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:53.305222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c75d2251-a2bb-4bc8-8ccd-106ce5686764 req-85efca09-0250-41ce-9059-1d452769fb86 service nova] Creating event network-vif-plugged:78b5e6f5-e053-46d0-92f6-2c366f98c8d5 for instance 1fd009ac-e125-453d-9b46-6efd41f2e324 on n-h1-860864-8 Oct 12 22:48:53.313155 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c75d2251-a2bb-4bc8-8ccd-106ce5686764 req-85efca09-0250-41ce-9059-1d452769fb86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068847 Oct 12 22:48:53.314605 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1648/3395] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:54.004524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:54.006438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:54.015882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:54.016664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:54.017317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:54.018316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:54.019675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:54.020366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:54.079288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:54.080104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:54.102987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:54.103567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:54.103665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:54.112164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:54.112740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:54.113200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:54.236625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:54.248770 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50ef3591-f584-4fc6-8ed4-43a3980472b0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1273 microversion: 2.1 time: 0.248295 Oct 12 22:48:54.274995 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1748/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:53 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:54.539745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:54.563830 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c94555a8-e741-4c39-a60f-54b379fb6c87 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.484926 Oct 12 22:48:54.566238 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1649/3397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:54 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:55.283166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:55.283740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:55.307654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:55.309362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:55.310145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:55.312581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:55.313249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:55.314730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:55.595659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:55.597178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:55.614425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:55.615829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:55.618350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:55.620627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:55.621716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:55.622551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:56.059827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:56.072243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db3445d0-50fb-4c74-9198-4bd024c7ddd4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.793575 Oct 12 22:48:56.093194 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1749/3398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:55 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:56.195630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:56.203074 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c10d247b-d91a-4a3f-9a67-9231897bab5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.615153 Oct 12 22:48:56.213281 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1650/3399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:55 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:57.098843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:57.100286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:57.123444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.131734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.133585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.134458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.135875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.136343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.230650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:57.231927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:57.246913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.250643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.252292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.253487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.256902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.257648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.476543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:57.487483 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21434c9d-9649-4672-a976-8d48ee45e0c9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.392480 Oct 12 22:48:57.488686 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1750/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:57 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:57.495000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-cfe8aa10-1f26-4914-bdf4-a6c53fc3a98a req-b857cdb9-aba7-429d-a809-0325601cebfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f4bb0ee-be3d-44c3-874e-ba0a423adfd1", "tag": "dc3445b9-1916-4abc-97f1-eac727f87c9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:57.509135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cfe8aa10-1f26-4914-bdf4-a6c53fc3a98a req-b857cdb9-aba7-429d-a809-0325601cebfd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:57.509853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cfe8aa10-1f26-4914-bdf4-a6c53fc3a98a req-b857cdb9-aba7-429d-a809-0325601cebfd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:57.510582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cfe8aa10-1f26-4914-bdf4-a6c53fc3a98a req-b857cdb9-aba7-429d-a809-0325601cebfd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:57.527462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-cfe8aa10-1f26-4914-bdf4-a6c53fc3a98a req-b857cdb9-aba7-429d-a809-0325601cebfd service nova] Creating event network-changed:dc3445b9-1916-4abc-97f1-eac727f87c9f for instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 on n-h2-860864-8 Oct 12 22:48:57.534803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-cfe8aa10-1f26-4914-bdf4-a6c53fc3a98a req-b857cdb9-aba7-429d-a809-0325601cebfd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044296 Oct 12 22:48:57.536310 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1751/3401] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:57.815623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:57.828855 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-daae95db-c8ba-4243-9a2d-5214e41e51dc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.603077 Oct 12 22:48:57.830827 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1651/3402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:57 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:58.137382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6041d20b-ef4f-4b89-aa38-963866fb19e8 req-4a56550e-a7d0-440e-a63b-67059591de88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733fab40-dabb-4977-a8b7-0ff7ee75fea3", "name": "network-vif-plugged", "status": "completed", "tag": "cfb7ba63-28a6-46cf-a11e-869d5c685f36"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:48:58.158234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6041d20b-ef4f-4b89-aa38-963866fb19e8 req-4a56550e-a7d0-440e-a63b-67059591de88 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:58.158714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6041d20b-ef4f-4b89-aa38-963866fb19e8 req-4a56550e-a7d0-440e-a63b-67059591de88 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:58.159142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6041d20b-ef4f-4b89-aa38-963866fb19e8 req-4a56550e-a7d0-440e-a63b-67059591de88 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:58.180773 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6041d20b-ef4f-4b89-aa38-963866fb19e8 req-4a56550e-a7d0-440e-a63b-67059591de88 service nova] Creating event network-vif-plugged:cfb7ba63-28a6-46cf-a11e-869d5c685f36 for instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 on n-h2-860864-8 Oct 12 22:48:58.186400 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6041d20b-ef4f-4b89-aa38-963866fb19e8 req-4a56550e-a7d0-440e-a63b-67059591de88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053648 Oct 12 22:48:58.187180 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1752/3403] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:48:58.510911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:58.511525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:58.519655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:58.520327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:58.520825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:58.522437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:58.523109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:58.523599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:58.856863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:58.858209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:48:58.868183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:58.869390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:58.870237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:58.871200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:48:58.871829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:48:58.872444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:48:58.940883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:58.943235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:58.965761 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-72104903-9ee8-4997-b2dd-d807ae5db054 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.458900 Oct 12 22:48:58.986102 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1652/3404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:58 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:48:59.017869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:48:59.310362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:48:59.338804 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10e5a139-752e-4deb-9454-21c744f5b5a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1318 microversion: 2.1 time: 0.485827 Oct 12 22:48:59.339695 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1753/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:58 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:48:59.991723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:48:59.992524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:00.001514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:00.006965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:00.007532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:00.009877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:00.011546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:00.012893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:00.014988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:00.376779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:00.377366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:00.404411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:00.405243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:00.406986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:00.408053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:00.412283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:00.413692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:00.944165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:00.953504 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7e3a304-012d-405b-b62c-93bbc0ca9294 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.966394 Oct 12 22:49:00.960102 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1653/3406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:48:59 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:00.978127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:00.993057 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea7824f2-6d33-4f91-a596-7471b24c6aab tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1468 microversion: 2.1 time: 0.632362 Oct 12 22:49:00.996139 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1754/3407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:00 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1468 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:01.021799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:01.022979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:01.033925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:01.040728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:01.041526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:01.042779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:01.043464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:01.044193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:01.983721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:01.984418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:02.000342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:02.005809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:02.007012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:02.008035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:02.020714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:02.021692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:02.337530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:02.352434 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c262a2eb-6c3c-4c8d-9e17-a1ebded98b67 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324" status: 200 len: 1468 microversion: 2.1 time: 1.334151 Oct 12 22:49:02.353110 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1654/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:01 2022] GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 => generated 1468 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:02.379344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:02.391825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:02.392930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Searching by: {'reservation_id': 'r-8g0qr4kl', 'deleted': False, 'project_id': '115ba104dfa745dd9fa95a23fbd90474'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:49:02.420088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:02.421737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:02.422188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:02.425170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:02.425656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:02.426096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:02.671985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:49:02.780534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:02.789702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:02.790450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:02.791042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:02.875860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:02.891617 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b57a4bf-c18f-4f21-8eed-22425525e526 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.911700 Oct 12 22:49:02.893131 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1755/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:01 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:03.086311 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-905cef20-b1dc-440c-8381-c7ec6d3304aa tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-8g0qr4kl" status: 200 len: 2929 microversion: 2.1 time: 0.710937 Oct 12 22:49:03.095988 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1655/3410] 10.222.0.20 () {58 vars in 1197 bytes} [Wed Oct 12 22:49:02 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8g0qr4kl => generated 2929 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:03.117973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea16667f-1a99-4d5e-8afb-ce2285e333f9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:03.145007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.compute.server_groups [None req-ea16667f-1a99-4d5e-8afb-ce2285e333f9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Querying cell 868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) for 2 instances {{(pid=120542) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:49:03.146606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea16667f-1a99-4d5e-8afb-ce2285e333f9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.147275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea16667f-1a99-4d5e-8afb-ce2285e333f9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.148051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea16667f-1a99-4d5e-8afb-ce2285e333f9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.222138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea16667f-1a99-4d5e-8afb-ce2285e333f9 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/9980a58a-9df8-4633-acee-db5158b1c9c8" status: 200 len: 269 microversion: 2.1 time: 0.111703 Oct 12 22:49:03.239243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:03.240535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:03.252368 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1756/3411] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:49:03 2022] GET /compute/v2.1/os-server-groups/9980a58a-9df8-4633-acee-db5158b1c9c8 => generated 269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:03.258624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.259975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.262754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.266157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.266811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.272902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.607515 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32d55955-be53-4853-b88f-2501f3156751 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324" status: 200 len: 1619 microversion: 2.1 time: 0.367235 Oct 12 22:49:03.616665 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1656/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:03 2022] GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 => generated 1619 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:03.655699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:03.657143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:03.684742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.686413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.687396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.690952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.695786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.696458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.917574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:03.918321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:03.934419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.936147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.936612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:03.938312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:03.939560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:03.940152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:04.224688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:04.241695 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5896f9b5-5b6c-40f8-a60a-bcef55c55a19 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.329231 Oct 12 22:49:04.243912 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1657/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:03 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:04.617701 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a2f743d-1c80-4277-9025-62dc31460735 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1619 microversion: 2.1 time: 0.987468 Oct 12 22:49:04.622012 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1757/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:03 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1619 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:04.791470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6e346796-9679-4fa5-82da-378f1d28cc04 req-86fd7884-afd3-44c9-bcbd-179769fd5817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4bb0ee-be3d-44c3-874e-ba0a423adfd1", "name": "network-vif-plugged", "status": "completed", "tag": "dc3445b9-1916-4abc-97f1-eac727f87c9f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:04.830395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6e346796-9679-4fa5-82da-378f1d28cc04 req-86fd7884-afd3-44c9-bcbd-179769fd5817 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:04.832198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6e346796-9679-4fa5-82da-378f1d28cc04 req-86fd7884-afd3-44c9-bcbd-179769fd5817 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:04.832833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6e346796-9679-4fa5-82da-378f1d28cc04 req-86fd7884-afd3-44c9-bcbd-179769fd5817 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:04.881167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:04.887115 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6e346796-9679-4fa5-82da-378f1d28cc04 req-86fd7884-afd3-44c9-bcbd-179769fd5817 service nova] Creating event network-vif-plugged:dc3445b9-1916-4abc-97f1-eac727f87c9f for instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 on n-h2-860864-8 Oct 12 22:49:04.905916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1623103628", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b422b505-f575-4ff4-af58-1d9eeec9c2c2"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:04.907459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6e346796-9679-4fa5-82da-378f1d28cc04 req-86fd7884-afd3-44c9-bcbd-179769fd5817 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120617 Oct 12 22:49:04.908484 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1658/3415] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:05.070333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:49:05.278345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:05.279072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:05.308858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:05.309398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:05.309844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:05.317140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:05.326305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:05.326793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:05.734384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:05.756216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af0376d7-6ac0-4fbe-8ba8-36fe6365b5ff tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.487151 Oct 12 22:49:05.773302 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1659/3416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:05 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:06.788718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:06.789425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:06.796970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:06.797545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:06.801342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:06.803022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:06.804400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:06.804902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:06.922793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:49:06.923358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:49:06.923842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:49:06.924438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:49:06.925043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:49:06.950607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:06.952029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:06.952579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:06.953208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:06.953667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:06.954087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:07.007007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:49:07.017715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:49:07.060787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:49:07.068798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:49:07.096815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:07.187963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58dbf3ec-da00-4d8e-be3c-55a0f465c5d8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.287017 Oct 12 22:49:07.189416 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1758/3417] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:49:07.218818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9de75e9-3e74-47b3-a4cb-2eb826b60168 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:07.219766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b9de75e9-3e74-47b3-a4cb-2eb826b60168 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:07.406060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b9de75e9-3e74-47b3-a4cb-2eb826b60168 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:07.417954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b9de75e9-3e74-47b3-a4cb-2eb826b60168 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1217 microversion: 2.1 time: 0.212265 Oct 12 22:49:07.428038 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1759/3418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:07 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:07.536852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:07.554134 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7bd5a8d8-4fad-42f7-ac33-2d8e934f2bb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1315 microversion: 2.1 time: 0.770633 Oct 12 22:49:07.556855 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1660/3419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:06 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:08.444296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:08.444926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:08.465275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:08.465700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:08.466136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:08.466850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:08.467304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:08.467723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:08.594175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:08.597393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:08.629203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:08.633392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:08.633851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:08.634582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:08.640226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:08.640857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:08.940103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:08.947004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:08.952733 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b10a24f-716d-478e-a340-5b52ec98612e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1213 microversion: 2.1 time: 0.513010 Oct 12 22:49:08.969091 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1760/3420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:08 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1213 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:09.312490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:09.330301 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0f268310-3215-45eb-afb3-f4e4490e8efa tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1501 microversion: 2.1 time: 0.743502 Oct 12 22:49:09.342172 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1661/3421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:08 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1501 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:09.368459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:09.369267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:09.378222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:09.380943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:09.381618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:09.382510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:09.384564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:09.385357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:09.451217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lazy-loading 'flavor' on Instance uuid 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:49:09.982907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:09.984083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:10.007125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:10.008346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:10.010667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:10.012046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:10.014148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:10.016494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:10.089170 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9928061d-ce8f-4939-8054-4f97ba1ba47c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1/action" status: 202 len: 0 microversion: 2.1 time: 0.724394 Oct 12 22:49:10.089807 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1761/3422] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:49:09 2022] POST /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:49:10.104375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:10.107287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:10.128659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:10.129515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:10.130735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:10.132349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:10.133195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:10.133830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:10.883033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:10.896960 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b98169cf-1fa8-4a87-957a-218b03e22ba1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1275 microversion: 2.1 time: 0.918188 Oct 12 22:49:10.910285 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1662/3423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:09 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1275 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:11.618260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:11.631602 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44bc1985-56a3-48d9-9f2d-fb5709052b38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 1.535999 Oct 12 22:49:11.632672 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1762/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:10 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:11.932696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:11.933882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:11.946144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:11.947221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:11.951485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:11.952991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:11.954880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:11.958063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:12.102573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:12.113870 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-95e72f60-c27a-43d3-a682-cfd80bb12ca1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1275 microversion: 2.1 time: 0.185038 Oct 12 22:49:12.114501 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1663/3425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:11 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:12.655988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:12.656717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:12.687484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:12.688404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:12.689010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:12.691023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:12.694513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:12.696200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:13.145281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:13.156527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:13.162252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:13.183758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:13.190777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:13.222925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:13.224508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:13.226517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:13.228137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:13.229916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:13.231843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:13.724524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:13.756703 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-892d9905-2174-4404-b391-30669fd67dfb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 1.105799 Oct 12 22:49:13.757986 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1763/3426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:12 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:14.584244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:14.595233 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cac1c961-1b96-470f-8f32-57d9c57d85d6 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 1.454597 Oct 12 22:49:14.598672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1664/3427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:13 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:14.782408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:14.783540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:14.793941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:14.796565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:14.800664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:14.802302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:14.802982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:14.803644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:15.023606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f00df830-3d94-41b7-aa85-c7571357fcd8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Action: 'create', calling method: .version_select at 0x7f44fec30e50>, body: {"keypair": {"name": "tempest-keypair-1657903649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVQVxBD8tEuxUNDIQJ0pXL3LlBLcWTXTedb6l/d3MsFDcoInx2z3DvA6ulOjl9XFNv9C4Uo5V5/g2Tul9uPQJNSuNtG2UoNeXcp7LV+t7adBR2biLnffbHHpFSsCbDKbQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:15.072759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f00df830-3d94-41b7-aa85-c7571357fcd8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Getting quotas for project 5ac89fe7811f41848744c84e333c8761. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:49:15.099488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f00df830-3d94-41b7-aa85-c7571357fcd8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Getting quotas for user e13632157d304b97b43a1bf8a58aaa18 and project 5ac89fe7811f41848744c84e333c8761. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:49:15.169095 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f00df830-3d94-41b7-aa85-c7571357fcd8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.466540 Oct 12 22:49:15.170504 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1764/3428] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:49:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:15.176299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1491641536", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "33d7358e-28cb-432f-9e6b-3d52f607da22"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1108858470", "security_groups": []}, "os:scheduler_hints": {"different_host": ["65cd61be-6259-4f23-aada-1055af774205"]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:15.274540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] validate_networks() for [('33d7358e-28cb-432f-9e6b-3d52f607da22', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:49:16.008596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:16.017428 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6bd73c65-a2f9-48b9-967c-15f0ac6468e3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 1.237888 Oct 12 22:49:16.018508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1665/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:14 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:16.025861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:16.040855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:16.048790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:16.049495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:16.050153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:16.051207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:16.051848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:16.052482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:16.624422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:16.634574 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24b306c0-0a8a-402e-99a2-0c1c3f09b896 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 0.612325 Oct 12 22:49:16.635593 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1666/3430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:16 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:16.801943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:49:16.802481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:49:16.802937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:49:16.803362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:49:16.804740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:49:16.835213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:16.835712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:16.836177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:16.836908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:16.839652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:16.840117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:16.897611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Getting quotas for project 61d6b17cc51e417f8a8c428b62f47679. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:49:16.922897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Getting quotas for user 913ca79af8f44a7dba95a763c3afa305 and project 61d6b17cc51e417f8a8c428b62f47679. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:49:16.959368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:49:16.962821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:49:17.046588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:17.047210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:17.059523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:17.060363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:17.061132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:17.061620 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-220d95de-e69f-4118-ae68-5bb7f53c3bbd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.889574 Oct 12 22:49:17.062217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:17.062747 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1765/3431] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:49:15 2022] POST /compute/v2.1/servers => generated 361 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:49:17.064758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:17.065353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:17.074691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-28294dcc-15b1-42ce-ab13-27f7436c8559 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:17.075407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-28294dcc-15b1-42ce-ab13-27f7436c8559 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:17.186516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-28294dcc-15b1-42ce-ab13-27f7436c8559 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:17.201307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-28294dcc-15b1-42ce-ab13-27f7436c8559 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1242 microversion: 2.1 time: 0.130890 Oct 12 22:49:17.221052 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1766/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:17 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1242 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:17.662997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:17.665347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:17.681392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:17.688182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:17.689169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:17.691105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:17.691874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:17.694507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:18.070601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:18.084489 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbdc56e2-5038-470a-87d0-b0ec63faf80d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 1.038298 Oct 12 22:49:18.086786 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1667/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:17 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:18.231440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:18.232250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:18.247809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:18.248433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:18.248971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:18.253580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:18.254299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:18.254850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:18.272346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:18.288848 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-83dddebb-56fb-459a-9016-ea70b4b31a5b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 0.630699 Oct 12 22:49:18.291161 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1767/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:17 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:18.439703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:18.455252 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2834b939-f207-4cca-a7ec-f28fe240c56d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1246 microversion: 2.1 time: 0.228349 Oct 12 22:49:18.458358 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1668/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:18 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1246 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:18.817979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-99a0afdf-ae64-48e0-848a-568c6a9d16d4 req-01761a83-a611-4d4b-bd1f-b528ec4943f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3041339c-5dcd-4265-9ea5-790c6b5bda15", "tag": "f9f4a7db-d8af-4b64-a87b-88ed7cceda9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:18.862227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-99a0afdf-ae64-48e0-848a-568c6a9d16d4 req-01761a83-a611-4d4b-bd1f-b528ec4943f7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:18.862700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-99a0afdf-ae64-48e0-848a-568c6a9d16d4 req-01761a83-a611-4d4b-bd1f-b528ec4943f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:18.863124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-99a0afdf-ae64-48e0-848a-568c6a9d16d4 req-01761a83-a611-4d4b-bd1f-b528ec4943f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:18.908807 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-99a0afdf-ae64-48e0-848a-568c6a9d16d4 req-01761a83-a611-4d4b-bd1f-b528ec4943f7 service nova] Creating event network-changed:f9f4a7db-d8af-4b64-a87b-88ed7cceda9f for instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 on n-h1-860864-8 Oct 12 22:49:18.922636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-99a0afdf-ae64-48e0-848a-568c6a9d16d4 req-01761a83-a611-4d4b-bd1f-b528ec4943f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109961 Oct 12 22:49:18.924363 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1768/3436] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:19.112082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:19.113517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:19.123735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:19.124602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:19.130213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:19.134066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:19.143294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:19.144090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:19.315729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:19.317013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:19.342032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:19.342562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:19.343028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:19.343747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:19.344252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:19.344677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:19.977977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:19.986003 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16744de0-7e60-4be4-ad02-c9d12aa37e58 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.879226 Oct 12 22:49:20.001796 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1669/3437] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:19 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:20.008401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:20.010160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:20.027994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:20.036279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:20.037028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:20.037788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:20.038252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:20.038686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:20.539038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:20.559568 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e23ec34-f405-4078-8b76-404ec07b7c5c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 1.249376 Oct 12 22:49:20.561273 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1769/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:19 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:20.818318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:20.834084 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d4f705b7-f370-4264-a640-17c8b993d581 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.830578 Oct 12 22:49:20.835166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1670/3439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:20 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:21.011818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:21.012724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:21.021984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:21.030699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:21.031374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:21.032365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:21.032970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:21.033545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:21.583272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:21.584233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:21.600280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:21.603223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:21.603751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:21.604725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:21.608774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:21.609429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:21.691181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:21.707001 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d2096d08-399f-4c41-b933-238d7f36a503 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.698414 Oct 12 22:49:21.709654 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1770/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:21 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:21.863064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:21.864919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:21.876920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:21.878125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:21.879106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:21.884484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:21.885395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:21.886038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:22.074341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:22.086791 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3b21998-3ec4-42bc-b198-201b4ebbbbcd tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.232487 Oct 12 22:49:22.088375 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1771/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:21 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:22.502720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-173233737", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1ecbae79-ca27-46c0-8449-05ca473f1ad8"}], "security_groups": [{"name": "tempest-securitygroup--347039877"}], "key_name": "tempest-keypair-1657903649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:22.656202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:22.671883 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2809b183-74ce-47f8-887f-261920e89d2b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 1.092537 Oct 12 22:49:22.674841 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1671/3442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:21 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:22.732240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:22.733488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:22.749899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:22.756636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:22.758222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:22.759015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:22.761202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:22.761655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:23.049894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] validate_networks() for [('1ecbae79-ca27-46c0-8449-05ca473f1ad8', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:49:23.864910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:23.881062 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-023c87be-e89d-4181-80ab-e2f638b99e42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 1.153133 Oct 12 22:49:23.896516 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1672/3443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:22 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:23.932092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:23.934823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:23.958559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:23.960179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:23.968770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:23.970527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:23.977867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:23.979692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:24.374049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:24.386630 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0511aafd-2d58-4ade-9054-305db4f2b115 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.487270 Oct 12 22:49:24.397018 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1673/3444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:23 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:24.412736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:24.413691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:24.437067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:24.437553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:24.442907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:24.448499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:24.449319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:24.449920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:25.295206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Getting quotas for project 5ac89fe7811f41848744c84e333c8761. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:49:25.314904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Getting quotas for user e13632157d304b97b43a1bf8a58aaa18 and project 5ac89fe7811f41848744c84e333c8761. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:49:25.341033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:49:25.342007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:49:25.344533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:49:25.346229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:49:25.346892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:49:25.379401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:25.379574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:25.380191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:25.390181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:25.391466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:25.393631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:25.454087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:25.467339 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c2a6139-735e-41c6-bb64-14f4e46f13f3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 1.062700 Oct 12 22:49:25.468705 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1674/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:24 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:25.476841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Getting quotas for project 5ac89fe7811f41848744c84e333c8761. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:49:25.481502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:25.483299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:25.495802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Getting quotas for user e13632157d304b97b43a1bf8a58aaa18 and project 5ac89fe7811f41848744c84e333c8761. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:49:25.517856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:25.518509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:25.519028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:25.522314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:25.522910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:25.523467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:25.527549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:49:25.537086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:49:25.580683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:25.661685 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d434f5a-b025-4d9f-b8c5-9876edb2140c tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.164754 Oct 12 22:49:25.668838 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1772/3446] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:49:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 3172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:49:25.674398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:25.675058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:25.687914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:25.688429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:25.688755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:25.689525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:25.689934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:25.690302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:25.997525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:26.012992 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-881935d7-f375-4c17-b6cb-35687fb3687a tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.342940 Oct 12 22:49:26.014183 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1773/3447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:25 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:26.024660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e388dd94-0817-4a7d-a5e0-13e30d4a22c8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:26.025285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e388dd94-0817-4a7d-a5e0-13e30d4a22c8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:26.217778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e388dd94-0817-4a7d-a5e0-13e30d4a22c8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:26.229094 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e388dd94-0817-4a7d-a5e0-13e30d4a22c8 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1277 microversion: 2.1 time: 0.213690 Oct 12 22:49:26.240641 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1774/3448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:26 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:26.294673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:26.303939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-234ead86-b568-480a-ad4f-3f81c2cdb5ed tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.832799 Oct 12 22:49:26.304532 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1675/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:25 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:26.491110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:26.492448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:26.511199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:26.512819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:26.513713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:26.517946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:26.518729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:26.524499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:26.859294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:26.872444 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3affe5a-3825-4318-bd76-2b1d5ab82b97 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 0.385443 Oct 12 22:49:26.873742 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1775/3450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:26 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:26.991555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-991d46e6-bdd1-4546-bc3c-41379b61f1b3 req-ef7a9206-cfd4-4712-af42-4a8f03f9224e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b648c0f-a4ec-421d-a410-78f04bf557dd", "tag": "9f0ff48f-5827-4203-b4c2-b165661b6308"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:27.015530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-991d46e6-bdd1-4546-bc3c-41379b61f1b3 req-ef7a9206-cfd4-4712-af42-4a8f03f9224e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.016037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-991d46e6-bdd1-4546-bc3c-41379b61f1b3 req-ef7a9206-cfd4-4712-af42-4a8f03f9224e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.016474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-991d46e6-bdd1-4546-bc3c-41379b61f1b3 req-ef7a9206-cfd4-4712-af42-4a8f03f9224e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.035774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:27.036828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:27.050655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.052188 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-991d46e6-bdd1-4546-bc3c-41379b61f1b3 req-ef7a9206-cfd4-4712-af42-4a8f03f9224e service nova] Creating event network-changed:9f0ff48f-5827-4203-b4c2-b165661b6308 for instance 0b648c0f-a4ec-421d-a410-78f04bf557dd on n-h2-860864-8 Oct 12 22:49:27.052727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.055437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.057230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.058662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.064210 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-991d46e6-bdd1-4546-bc3c-41379b61f1b3 req-ef7a9206-cfd4-4712-af42-4a8f03f9224e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076782 Oct 12 22:49:27.064848 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1676/3451] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:27.065765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.258614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:27.259057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:27.270783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.271278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.271715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.275437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.276385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.279993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.360226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:27.376394 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86a95c48-269a-47d2-8d8d-3deb7474f41c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.339588 Oct 12 22:49:27.378009 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1776/3452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:27 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:27.383449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:27.389175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:27.405088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.405586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.406017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.406719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.420232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.424543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.514768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:27.544037 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b487dac-e79b-4368-b025-a48a784bb411 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1273 microversion: 2.1 time: 0.289728 Oct 12 22:49:27.544664 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1677/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:27 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:27.860895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:27.873582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-125adc6c-d8dd-4c69-b409-3ebe496e9a53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.494294 Oct 12 22:49:27.875127 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1777/3454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:27 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:27.898141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:27.899318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:27.906481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.906990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.907399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:27.908135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:27.909023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:27.909853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.407024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:28.407748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:28.419045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:28.424041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:28.424612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.425441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:28.426025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:28.426513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.542210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:28.553443 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86019c6c-6a6a-4252-9946-19b042d90de0 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.156066 Oct 12 22:49:28.554650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1778/3455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:28 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:28.573586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:28.574604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:28.578821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:28.585136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:28.588706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:28.589207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:28.592273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.593101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:28.593579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:28.594016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.603618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a3411ab9-b905-4e10-825e-150a790bb669 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 0.710564 Oct 12 22:49:28.604686 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1678/3456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:27 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:28.694275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:28.703678 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c1c11cc4-eac9-4c46-82b5-1ab40fd46801 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1335 microversion: 2.1 time: 0.139564 Oct 12 22:49:28.716656 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1779/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:28 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1335 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:28.898405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:28.899325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:28.906972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:28.907661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:28.908531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.909378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:28.909996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:28.911149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.940692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d3e08319-1ec8-45f9-bf44-79324b7bddd6 req-180f6a93-3eea-41fb-943a-646a825a424b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3041339c-5dcd-4265-9ea5-790c6b5bda15", "name": "network-vif-plugged", "status": "completed", "tag": "f9f4a7db-d8af-4b64-a87b-88ed7cceda9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:28.962900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d3e08319-1ec8-45f9-bf44-79324b7bddd6 req-180f6a93-3eea-41fb-943a-646a825a424b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:28.963630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d3e08319-1ec8-45f9-bf44-79324b7bddd6 req-180f6a93-3eea-41fb-943a-646a825a424b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:28.965150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d3e08319-1ec8-45f9-bf44-79324b7bddd6 req-180f6a93-3eea-41fb-943a-646a825a424b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:28.991028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d3e08319-1ec8-45f9-bf44-79324b7bddd6 req-180f6a93-3eea-41fb-943a-646a825a424b service nova] Creating event network-vif-plugged:f9f4a7db-d8af-4b64-a87b-88ed7cceda9f for instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 on n-h1-860864-8 Oct 12 22:49:28.997076 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d3e08319-1ec8-45f9-bf44-79324b7bddd6 req-180f6a93-3eea-41fb-943a-646a825a424b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060931 Oct 12 22:49:28.998385 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1780/3458] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:49:29.383671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:29.409169 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47a1bc0d-7ea2-4891-bfb0-d88d2992ab42 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.514750 Oct 12 22:49:29.411063 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1679/3459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:28 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:29.578465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:29.579427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:29.609207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:29.612215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:29.612895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:29.615826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:29.617653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:29.619199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:29.630939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:29.630939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:29.631456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:29.645652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:29.646301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:29.646765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:29.649013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:29.649488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:29.651031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:30.106558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:30.114598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40e38881-9481-4d87-a19f-0b3e9963eb8f tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.540938 Oct 12 22:49:30.132842 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1781/3460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:29 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:30.137886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:30.138510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:30.157728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:30.158230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:30.158666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:30.159373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:30.159821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:30.160911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:30.291469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:30.307100 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7149a315-a1b2-4c4f-874c-6748e068b4b5 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1335 microversion: 2.1 time: 0.168258 Oct 12 22:49:30.307770 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1782/3461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:30 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1335 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:30.435868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:30.436726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:30.444847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:30.445339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:30.445955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:30.447218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:30.448018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:30.448944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:30.533002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:30.544070 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ca98029-092d-4b0f-ac08-599733631c81 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1317 microversion: 2.1 time: 0.919138 Oct 12 22:49:30.561526 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1680/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:29 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:30.624225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:30.635296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5aca4748-b8af-46db-b572-9a5d9338d18a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.204863 Oct 12 22:49:30.636577 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1783/3463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:30 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:31.142257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:31.142912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:31.155883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.156471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.156921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.157633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.158091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.158526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.330834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:31.331538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:31.342194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.354507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.355027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.355848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.356488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.357176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.415407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:31.438023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-df79a0c9-fa8a-4d43-9413-5206c1f68dd7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.297636 Oct 12 22:49:31.443832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1681/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:31 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:31.573628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:31.574782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:31.585987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.588361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.590214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.592848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.593829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.595591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.718796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:31.727566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a62d1c0-86e1-49d3-8658-705f6cf16f46 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.400777 Oct 12 22:49:31.729254 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1784/3465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:31 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:31.734689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:31.735540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:31.742448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.743345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.743993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.744908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:31.745511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:31.746080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:31.921267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:31.932104 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f3dd5dfa-abba-414b-83be-4ac62a031de5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.201172 Oct 12 22:49:31.934103 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1785/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:31 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:32.316388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:32.329780 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-752d1f96-aea2-4b57-a867-491c0b5042f7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1467 microversion: 2.1 time: 0.762919 Oct 12 22:49:32.333973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1682/3467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:31 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1467 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:32.360164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:32.360755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:32.367557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.368136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.368573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.369271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.369878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.370303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.467441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:32.468688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:32.481223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.482091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.483643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.485248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.488436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.489483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.690227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:32.707812 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d6dc3428-12a4-432d-af5f-74bef2c913e2 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.243870 Oct 12 22:49:32.712724 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1683/3468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:32 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:32.724116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-91273d8a-e9c3-4257-94b3-51eaf4343ea1 req-4086d416-01c1-4db1-8c42-aad339611b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b648c0f-a4ec-421d-a410-78f04bf557dd", "name": "network-vif-plugged", "status": "completed", "tag": "9f0ff48f-5827-4203-b4c2-b165661b6308"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:32.764096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-91273d8a-e9c3-4257-94b3-51eaf4343ea1 req-4086d416-01c1-4db1-8c42-aad339611b70 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.766185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-91273d8a-e9c3-4257-94b3-51eaf4343ea1 req-4086d416-01c1-4db1-8c42-aad339611b70 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.767696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-91273d8a-e9c3-4257-94b3-51eaf4343ea1 req-4086d416-01c1-4db1-8c42-aad339611b70 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.802771 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-91273d8a-e9c3-4257-94b3-51eaf4343ea1 req-4086d416-01c1-4db1-8c42-aad339611b70 service nova] Creating event network-vif-plugged:9f0ff48f-5827-4203-b4c2-b165661b6308 for instance 0b648c0f-a4ec-421d-a410-78f04bf557dd on n-h2-860864-8 Oct 12 22:49:32.814874 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f5e57a15-292d-43f7-a5b8-4168e515a583 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1618 microversion: 2.1 time: 0.460369 Oct 12 22:49:32.816279 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1786/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:32 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1618 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:32.821462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-91273d8a-e9c3-4257-94b3-51eaf4343ea1 req-4086d416-01c1-4db1-8c42-aad339611b70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106868 Oct 12 22:49:32.822959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:32.823748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:32.825392 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1684/3470] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:32.834520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.835225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.835864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.837910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.839231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.839791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.959953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:32.960869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:32.972645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.973961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.975161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:32.977560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:32.979058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:32.980448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:33.231498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:33.240520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3515faf5-fb3a-4d7e-82dd-875e8aa3426d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.422432 Oct 12 22:49:33.241870 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1787/3471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:32 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:33.246973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1036542433", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b422b505-f575-4ff4-af58-1d9eeec9c2c2"]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:33.322174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:49:33.443312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:33.459338 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2f84a8f-94ad-45d1-a203-b5d8e302887f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.505733 Oct 12 22:49:33.479337 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1685/3472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:32 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:33.740702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:33.741935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:33.761205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:33.761205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:33.761205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:33.762197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:33.762743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:33.771127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:33.797902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:49:33.798509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:49:33.798779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:49:33.799369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:49:33.800634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:49:33.817362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=33 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:33.819477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:33.820179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:33.820776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:33.827747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:33.828860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:33.830141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:33.850853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:33.881012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:49:33.897934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:49:33.932466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:49:33.941931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:49:34.000370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d762e5de-d4a8-41de-b8aa-ed880ac874a7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756737 Oct 12 22:49:34.001625 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1788/3473] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:49:34.021712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-73b62605-f7fe-4e47-8f05-0700f5aaa2fe tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:34.024082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73b62605-f7fe-4e47-8f05-0700f5aaa2fe tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:34.086833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:34.094786 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f45ff103-b5b4-4708-8f98-2096954cacc6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1300 microversion: 2.1 time: 0.362276 Oct 12 22:49:34.095415 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1686/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:33 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1300 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:34.168631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-73b62605-f7fe-4e47-8f05-0700f5aaa2fe tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:34.178690 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-73b62605-f7fe-4e47-8f05-0700f5aaa2fe tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1217 microversion: 2.1 time: 0.167277 Oct 12 22:49:34.181956 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1789/3475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:34 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:34.267179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:34.268065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:34.286380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:34.287313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:34.287941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:34.290286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:34.290648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:34.292573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:34.500136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:34.500136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:34.544010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:34.545089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:34.548814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:34.549475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:34.550302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:34.551069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:35.300985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:35.310374 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f2ee49a3-ccc2-45a0-901c-5069e7e79a4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.826521 Oct 12 22:49:35.334037 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1790/3476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:34 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:35.343685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-09dbf99a-2d40-4410-851f-571f19c10677 req-4461af84-9d77-4b3e-9dde-c99bbaacfa1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ecb804-3f67-48cf-b503-4431d0c7b461", "tag": "a7cf5741-016d-4fbd-8879-a9bc6f2ed55c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:35.387097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-09dbf99a-2d40-4410-851f-571f19c10677 req-4461af84-9d77-4b3e-9dde-c99bbaacfa1c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:35.387569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-09dbf99a-2d40-4410-851f-571f19c10677 req-4461af84-9d77-4b3e-9dde-c99bbaacfa1c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:35.388016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-09dbf99a-2d40-4410-851f-571f19c10677 req-4461af84-9d77-4b3e-9dde-c99bbaacfa1c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:35.452011 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-09dbf99a-2d40-4410-851f-571f19c10677 req-4461af84-9d77-4b3e-9dde-c99bbaacfa1c service nova] Creating event network-changed:a7cf5741-016d-4fbd-8879-a9bc6f2ed55c for instance 61ecb804-3f67-48cf-b503-4431d0c7b461 on n-h1-860864-8 Oct 12 22:49:35.468357 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-09dbf99a-2d40-4410-851f-571f19c10677 req-4461af84-9d77-4b3e-9dde-c99bbaacfa1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131396 Oct 12 22:49:35.471594 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1791/3477] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:35.492823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:35.495963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:35.525099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:35.538044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:35.539965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:35.542388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:35.543034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:35.545610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:35.637127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:35.670503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f82a60c-7067-4891-bb8f-dec286666a7a tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 1.402134 Oct 12 22:49:35.672772 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1687/3478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:34 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:35.705098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:35.706840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:35.717681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:35.718467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:35.719091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:35.720025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:35.721067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:35.721979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:35.851378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:35.875339 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23d0924e-7e46-4570-b303-e76416147c95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1269 microversion: 2.1 time: 0.199951 Oct 12 22:49:35.888414 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1688/3479] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:35 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:35.995915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:36.011656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-64b02d5f-68ba-486c-9cca-485859b55b6e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1472 microversion: 2.1 time: 0.536952 Oct 12 22:49:36.012650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1792/3480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:35 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1472 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:36.045526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:36.047834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:36.060861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.061353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.061793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.062500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.062946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.066682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.338128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:36.339189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:36.349585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.350827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.351663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.353137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.354001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.355332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.434359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:36.448378 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3c58916d-ec8c-4fb2-af0f-027401558fdc tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1472 microversion: 2.1 time: 0.408435 Oct 12 22:49:36.449386 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1689/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:36 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:36.471453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:36.472380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:36.485265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.487464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.488966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.490717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.497334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.497968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.706516 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ef57796-5d62-41d9-88a7-484fba2d6d95 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1623 microversion: 2.1 time: 0.239773 Oct 12 22:49:36.709979 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1690/3482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:36 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1623 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:36.715420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:36.716053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:36.729886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.734435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.735211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.736771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.742173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.742769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.880723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:36.899977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70af117a-725f-4703-8a0d-57cd93725707 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.566051 Oct 12 22:49:36.900848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1793/3483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:36 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:36.911195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:36.912181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:36.923810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.935358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.936174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:36.937157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:36.937847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:36.939312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.277592 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90e9f55e-cc49-406f-927f-96c3753307c0 tempest-TestSecurityGroupsBasicOps-174487704 tempest-TestSecurityGroupsBasicOps-174487704-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1913 microversion: 2.1 time: 0.373507 Oct 12 22:49:37.277891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:37.280030 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1794/3484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:36 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1913 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:37.290155 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8da5e0e-43bd-4642-88a3-c57cb2edd2a9 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.579008 Oct 12 22:49:37.297864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:37.301961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:37.315564 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1691/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:36 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:37.323307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.323806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.324274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.324991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.326675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.327539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.490889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:37.501276 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-094172bd-bd29-4e7c-9709-31a633f078ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1275 microversion: 2.1 time: 0.218921 Oct 12 22:49:37.505612 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1795/3486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:37 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:37.546627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:37.547136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:37.556722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.559866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.566190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.567502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.568023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.568462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.631441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:49:37.680894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:37.809183 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b171410-510d-48a5-b8aa-874b563f2d88 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 204 len: 0 microversion: 2.1 time: 0.266826 Oct 12 22:49:37.809776 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1692/3487] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:49:37 2022] DELETE /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:49:37.819151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:37.819776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:37.830646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.831135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.831570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.844005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.844972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.846320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.928821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:37.929681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:37.937073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.937600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.938366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:37.939363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:37.939812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:37.940475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:38.093649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:38.108307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92c567c5-71ce-4db0-8b33-12a5d1da34a6 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1478 microversion: 2.1 time: 0.288305 Oct 12 22:49:38.109197 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1796/3488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:37 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:38.340164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:38.341492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:38.342284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:38.364035 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c8cb9af-768d-4255-9d0b-5b41988cdbc6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.440835 Oct 12 22:49:38.364412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:38.365026 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1693/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:37 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:38.379471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:38.380045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:38.380974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:38.381593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:38.382174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:38.526798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:38.527496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:38.536276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:38.537186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:38.539532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:38.541326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:38.543340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:38.544173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:38.705124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:38.714814 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12ab4fac-def8-4526-b359-85288d679df0 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.377234 Oct 12 22:49:38.718200 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1797/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:38 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:39.141758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:39.152115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:39.180383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:39.185767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:39.195921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:39.202800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:39.203622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:39.204653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:39.373645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:39.386693 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-02cca9ac-21a0-4376-861d-00d80ed9ca36 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1275 microversion: 2.1 time: 0.863431 Oct 12 22:49:39.388221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1694/3491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:38 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1275 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:39.400012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:39.400902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:39.413550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:39.416628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:39.417554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:39.418461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:39.420844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:39.424964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:39.914629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:39.926028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d947e027-070d-4a66-8aad-8b3f6f27b182 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1507 microversion: 2.1 time: 0.534658 Oct 12 22:49:39.944833 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1695/3492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:39 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:39.962379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:39.965435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:39.977645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:39.978775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:39.979457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:39.980405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:39.981768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:39.982558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:39.990979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:40.003375 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ee4e5a4-ee32-40c7-bae6-e47c96e09e36 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1478 microversion: 2.1 time: 0.871882 Oct 12 22:49:40.006243 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1798/3493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:39 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1478 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:40.344112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:40.355512 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5af05ba6-1104-4652-8a04-317e2da76063 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.409262 Oct 12 22:49:40.356469 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1696/3494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:39 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:40.411373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:40.412011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:40.420747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:40.421441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:40.422094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:40.422940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:40.423567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:40.424274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:40.958724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:40.959445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:40.970282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:40.970761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:40.976322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:40.978905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:40.979599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:40.983279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:41.136512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:41.150668 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99975475-28ff-46e3-af3b-ae881f0bbdf4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 0.743630 Oct 12 22:49:41.173041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1799/3495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:40 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:41.187167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:41.187796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:41.205990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:41.206619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:41.214609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:41.216014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:41.219606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:41.220331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:41.233742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:41.341333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:41.350473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7f473f5-be81-4623-8efe-7bad722c4a28 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1528 microversion: 2.1 time: 0.396862 Oct 12 22:49:41.351471 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1697/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:40 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:41.379092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:41.381515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:41.390570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:41.391493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:41.392144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:41.428552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:41.429351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:41.429953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:41.510766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:41.531233 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cfbf3242-5b5e-4e4d-862a-05960948577e tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1478 microversion: 2.1 time: 0.356956 Oct 12 22:49:41.542178 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1800/3497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:41 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1478 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:41.645114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:41.656420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a1815c5-c457-4ab5-8490-ecb3fd6b8660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.281739 Oct 12 22:49:41.657710 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1698/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:41 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:41.809426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-103ec7fe-3eba-4394-bb6f-f1b669e2b376 req-2d68b742-960f-461f-a1bd-cee143b57f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b648c0f-a4ec-421d-a410-78f04bf557dd", "name": "network-vif-deleted", "tag": "9f0ff48f-5827-4203-b4c2-b165661b6308"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:41.826107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-103ec7fe-3eba-4394-bb6f-f1b669e2b376 req-2d68b742-960f-461f-a1bd-cee143b57f37 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:41.826580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-103ec7fe-3eba-4394-bb6f-f1b669e2b376 req-2d68b742-960f-461f-a1bd-cee143b57f37 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:41.827001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-103ec7fe-3eba-4394-bb6f-f1b669e2b376 req-2d68b742-960f-461f-a1bd-cee143b57f37 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:41.858133 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-103ec7fe-3eba-4394-bb6f-f1b669e2b376 req-2d68b742-960f-461f-a1bd-cee143b57f37 service nova] Creating event network-vif-deleted:9f0ff48f-5827-4203-b4c2-b165661b6308 for instance 0b648c0f-a4ec-421d-a410-78f04bf557dd on n-h2-860864-8 Oct 12 22:49:41.867123 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-103ec7fe-3eba-4394-bb6f-f1b669e2b376 req-2d68b742-960f-461f-a1bd-cee143b57f37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060580 Oct 12 22:49:41.868339 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1801/3499] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:42.178691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:42.179308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:42.188655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.189396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.190163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.191725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.192373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.193090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.376697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:42.377400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:42.392536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.393015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.393464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.394255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.394743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.399929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.495990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:42.505455 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-55b7b392-b4ca-490b-aa7b-103c932eedb7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 0.330976 Oct 12 22:49:42.506040 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1699/3500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:42 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:42.576196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:42.577031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:42.633509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.634375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.634868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.635618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.636706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.638341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.701096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.703309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.703810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.705960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lazy-loading 'fault' on Instance uuid 0b648c0f-a4ec-421d-a410-78f04bf557dd {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:49:42.801550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:42.821264 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e5ec0289-0e73-41ba-b9fc-c55b684c2b74 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 200 len: 1332 microversion: 2.1 time: 0.255205 Oct 12 22:49:42.822249 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1700/3501] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:42 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 1332 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:42.828846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:42.832253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:42.839259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.840060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.840746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:42.841678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:42.842398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:42.843139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:43.082574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:43.100305 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f19b10d3-8e57-4b63-b383-301a54fc293d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.268651 Oct 12 22:49:43.102273 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1701/3502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:42 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:43.380956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:43.395130 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4071aad6-b10e-4fa4-adaa-02321fcb2b9f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1528 microversion: 2.1 time: 1.023713 Oct 12 22:49:43.395736 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1802/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:42 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1528 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:43.487541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-388c2f36-6cfe-4742-8253-d52595afa6d5 req-c7294883-1f05-40d0-95fa-69a353a1b724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ecb804-3f67-48cf-b503-4431d0c7b461", "name": "network-vif-plugged", "status": "completed", "tag": "a7cf5741-016d-4fbd-8879-a9bc6f2ed55c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:43.515161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:43.517944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-388c2f36-6cfe-4742-8253-d52595afa6d5 req-c7294883-1f05-40d0-95fa-69a353a1b724 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:43.518626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-388c2f36-6cfe-4742-8253-d52595afa6d5 req-c7294883-1f05-40d0-95fa-69a353a1b724 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:43.519970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-388c2f36-6cfe-4742-8253-d52595afa6d5 req-c7294883-1f05-40d0-95fa-69a353a1b724 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:43.532476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:43.533926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:43.547019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:43.553250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:43.554733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:43.560463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:43.562483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:43.564218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:43.593721 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-388c2f36-6cfe-4742-8253-d52595afa6d5 req-c7294883-1f05-40d0-95fa-69a353a1b724 service nova] Creating event network-vif-plugged:a7cf5741-016d-4fbd-8879-a9bc6f2ed55c for instance 61ecb804-3f67-48cf-b503-4431d0c7b461 on n-h1-860864-8 Oct 12 22:49:43.624083 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-388c2f36-6cfe-4742-8253-d52595afa6d5 req-c7294883-1f05-40d0-95fa-69a353a1b724 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138437 Oct 12 22:49:43.638562 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1702/3504] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:49:43.850456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:43.851238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 0b648c0f-a4ec-421d-a410-78f04bf557dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:43.872551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:43.873560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:43.874530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:43.875231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:43.877781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:43.888337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:43.889465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:43.922604 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] HTTP exception thrown: Instance 0b648c0f-a4ec-421d-a410-78f04bf557dd could not be found. Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Request method failure captured: Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd HTTP/1.1 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0QAGyO9vRors27yeqNKrXMs5OqVb-_Malk4KpJKKOyavAQ2LtDGashxx3TA2BQ0rOQmlSUPVaqliS_NwTdgwiBRNYYh3OH1RNqFxCxdpSTRuUtwO_HYqu2-W-2m98aBXDdRRI91GKCynU6lSsT7dbzx8A4leP4JaYDRifrATNSXrVg Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 61d6b17cc51e417f8a8c428b62f47679 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1752758986 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61d6b17cc51e417f8a8c428b62f47679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/61d6b17cc51e417f8a8c428b62f47679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_61d6b17cc51e417f8a8c428b62f47679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61d6b17cc51e417f8a8c428b62f47679"}]}] Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1752758986 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 61d6b17cc51e417f8a8c428b62f47679 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1752758986 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestSecurityGroupsBasicOps-1752758986-project Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 913ca79af8f44a7dba95a763c3afa305 Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1752758986-project Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 0b648c0f-a4ec-421d-a410-78f04bf557dd could not be found. Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '0b648c0f-a4ec-421d-a410-78f04bf557dd'} Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b648c0f-a4ec-421d-a410-78f04bf557dd could not be found. Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b648c0f-a4ec-421d-a410-78f04bf557dd could not be found. Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:49:43.939116 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b648c0f-a4ec-421d-a410-78f04bf557dd could not be found. Oct 12 22:49:43.943822 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:49:43.945288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Returning 404 to user: Instance 0b648c0f-a4ec-421d-a410-78f04bf557dd could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:49:43.951007 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5bfa8dfd-e048-4c09-8b86-a15faa3738b8 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd" status: 404 len: 111 microversion: 2.1 time: 0.105323 Oct 12 22:49:43.951782 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1703/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:43 2022] GET /compute/v2.1/servers/0b648c0f-a4ec-421d-a410-78f04bf557dd => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:49:44.026785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8bd21fda-748d-41ea-9848-86fed13f430f req-321dbbc5-79cc-4ae1-8c11-ee9685600757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "456c524e-8422-4f02-bc07-1dbd4a98e42b", "tag": "67082951-67f3-477c-86d1-4e45774eb63b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:44.043620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8bd21fda-748d-41ea-9848-86fed13f430f req-321dbbc5-79cc-4ae1-8c11-ee9685600757 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:44.048161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8bd21fda-748d-41ea-9848-86fed13f430f req-321dbbc5-79cc-4ae1-8c11-ee9685600757 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:44.048720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8bd21fda-748d-41ea-9848-86fed13f430f req-321dbbc5-79cc-4ae1-8c11-ee9685600757 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:44.075838 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8bd21fda-748d-41ea-9848-86fed13f430f req-321dbbc5-79cc-4ae1-8c11-ee9685600757 service nova] Creating event network-changed:67082951-67f3-477c-86d1-4e45774eb63b for instance 456c524e-8422-4f02-bc07-1dbd4a98e42b on n-h1-860864-8 Oct 12 22:49:44.091014 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8bd21fda-748d-41ea-9848-86fed13f430f req-321dbbc5-79cc-4ae1-8c11-ee9685600757 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068122 Oct 12 22:49:44.092192 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1704/3506] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:44.126776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:44.127638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:44.137865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:44.140520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:44.143944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:44.145700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:44.146524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:44.147311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:44.174739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:44.690103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:44.702824 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57b5f898-ce15-4ae4-b198-e1b1ffd5958d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1402 microversion: 2.1 time: 0.580848 Oct 12 22:49:44.709077 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1705/3507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:44 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1402 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:44.714306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:44.718085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:44.730929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:44.732460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:44.733129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:44.736261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:44.741153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:44.741949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:44.940131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:44.944192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:44.952938 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c9efbfcb-57cd-401b-99d0-510ca4f02246 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.242270 Oct 12 22:49:44.953913 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1706/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:44 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:44.968054 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb7d6eac-2d5d-43e9-b27b-acded91919ba tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 1.431391 Oct 12 22:49:44.968054 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1803/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:43 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:45.735430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:45.736244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:45.767836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:45.773208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:45.777099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:45.778443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:45.783435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:45.788317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:45.922842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ec098d25-de37-4aad-9397-9041c504e5af req-c3441064-e2f8-4b0b-8ff6-04ed12e54123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4bb0ee-be3d-44c3-874e-ba0a423adfd1", "name": "network-vif-plugged", "status": "completed", "tag": "dc3445b9-1916-4abc-97f1-eac727f87c9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:45.945833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ec098d25-de37-4aad-9397-9041c504e5af req-c3441064-e2f8-4b0b-8ff6-04ed12e54123 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:45.946498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ec098d25-de37-4aad-9397-9041c504e5af req-c3441064-e2f8-4b0b-8ff6-04ed12e54123 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:45.959310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ec098d25-de37-4aad-9397-9041c504e5af req-c3441064-e2f8-4b0b-8ff6-04ed12e54123 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:46.006737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ec098d25-de37-4aad-9397-9041c504e5af req-c3441064-e2f8-4b0b-8ff6-04ed12e54123 service nova] Creating event network-vif-plugged:dc3445b9-1916-4abc-97f1-eac727f87c9f for instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 on n-h2-860864-8 Oct 12 22:49:46.026716 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ec098d25-de37-4aad-9397-9041c504e5af req-c3441064-e2f8-4b0b-8ff6-04ed12e54123 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107554 Oct 12 22:49:46.029688 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1804/3510] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:49:46.038971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:46.043412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:46.089158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:46.089657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:46.096512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:46.102401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:46.102896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:46.103364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:46.300060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:46.310018 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bf2b06cc-63b5-4824-9692-cd6bd2e87660 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1590 microversion: 2.1 time: 0.579243 Oct 12 22:49:46.331917 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1707/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:45 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1590 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:46.331917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:46.331917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:46.366784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:46.367456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:46.370723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:46.371870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:46.374969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:46.377978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:46.764366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:46.803993 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e68d15b3-693f-4bc4-8f26-672a1997abc5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 0.772950 Oct 12 22:49:46.804881 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1805/3512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:46 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:46.841272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:46.845388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:46.859565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:46.861120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:46.861941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:46.862853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:46.863454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:46.864224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:47.022972 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c32bbba-6b57-4204-8a83-24c5b66db1f3 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.216801 Oct 12 22:49:47.024924 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1806/3513] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:49:46 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461/os-interface => generated 285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:47.252480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:47.266751 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c71c6103-660a-4483-a6c9-c37ad60ba36a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.944288 Oct 12 22:49:47.271757 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1708/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:46 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:47.830325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:47.831327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:47.842030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:47.844902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:47.845614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:47.851820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:47.852428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:47.852951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:48.299699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:48.300684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:48.326964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:48.328584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:48.329323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:48.341156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:48.341156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:48.341156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:48.801246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:48.807455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:48.809983 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7ef9be2-5f0d-4256-9229-37b5f3186df2 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.515718 Oct 12 22:49:48.814841 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1709/3515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:48 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:48.818757 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e82092c0-3021-4e9e-93a8-5728412c9c4e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 0.993371 Oct 12 22:49:48.849394 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1807/3516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:47 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:49.843975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:49.845226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:49.855704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:49.857050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:49.876444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:49.879935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:49.882192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:49.882912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:49.884410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:49.885044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:49.887607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:49.888193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:49.890771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:49.891132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:49.891762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:49.892399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:49.957411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:50.327159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:50.353220 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0eef1e05-e206-48b4-9060-b8c4c4351004 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.513918 Oct 12 22:49:50.357607 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1710/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:49 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:51.383696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:51.384694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:51.406775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:51.407693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:51.408472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:51.410500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:51.415786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:51.417514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:51.574725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:51.585727 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e26a2f0-f7be-47f0-8355-78d88751b687 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 1.738693 Oct 12 22:49:51.600606 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1808/3518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:49 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:51.894092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:51.905569 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cee90210-3882-4b59-aa7e-b3f4b4b0e568 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.526686 Oct 12 22:49:51.906421 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1711/3519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:51 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:52.612913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:52.614105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:52.625014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:52.625014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:52.625775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:52.626665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:52.627270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:52.627847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:52.936872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:52.938174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:52.961809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:52.965503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:52.966663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:52.970888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:52.972483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:52.974751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:53.064904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:53.085292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d034252-f42f-4cbf-b71c-e82c6c83d6ae tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 0.479748 Oct 12 22:49:53.106416 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1809/3520] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:52 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:53.617133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fe31958e-26b6-4654-9bff-bad39f11e88a req-52bd72b7-5f2a-4cb4-8ddd-9fa9892b7cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456c524e-8422-4f02-bc07-1dbd4a98e42b", "name": "network-vif-plugged", "status": "completed", "tag": "67082951-67f3-477c-86d1-4e45774eb63b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:53.656664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe31958e-26b6-4654-9bff-bad39f11e88a req-52bd72b7-5f2a-4cb4-8ddd-9fa9892b7cb0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:53.657155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe31958e-26b6-4654-9bff-bad39f11e88a req-52bd72b7-5f2a-4cb4-8ddd-9fa9892b7cb0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:53.667783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fe31958e-26b6-4654-9bff-bad39f11e88a req-52bd72b7-5f2a-4cb4-8ddd-9fa9892b7cb0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:53.701140 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fe31958e-26b6-4654-9bff-bad39f11e88a req-52bd72b7-5f2a-4cb4-8ddd-9fa9892b7cb0 service nova] Creating event network-vif-plugged:67082951-67f3-477c-86d1-4e45774eb63b for instance 456c524e-8422-4f02-bc07-1dbd4a98e42b on n-h1-860864-8 Oct 12 22:49:53.709937 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fe31958e-26b6-4654-9bff-bad39f11e88a req-52bd72b7-5f2a-4cb4-8ddd-9fa9892b7cb0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097399 Oct 12 22:49:53.714213 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1810/3521] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:49:53.810367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:53.822032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d59bd8b-53b6-4924-9c06-50fc59125438 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.891176 Oct 12 22:49:53.824261 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1712/3522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:52 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:54.114180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:54.114917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:54.130281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:54.130762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:54.136559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:54.137340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:54.139871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:54.140530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:54.849145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:54.849847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:54.858460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:54.865111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:54.866093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:54.867008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:54.867625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:54.868245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:55.246792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:55.260214 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6f5f7a8-04fa-48bf-b651-1c3d4e69447b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.413953 Oct 12 22:49:55.273490 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1713/3523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:54 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:55.448477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:55.449108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:55.458511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:55.465724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:55.468520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:55.470786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:55.478004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:55.478905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:55.539634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:55.548550 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-48876bf6-7108-4136-8aef-fa891dbb5b03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1317 microversion: 2.1 time: 1.443550 Oct 12 22:49:55.553898 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1811/3524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:54 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1317 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:55.563568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-922e0092-7708-47e8-8712-36abe9fd80bb req-76eeab1b-b90c-4ba5-b0b9-4e2205bec81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ecb804-3f67-48cf-b503-4431d0c7b461", "tag": "a7cf5741-016d-4fbd-8879-a9bc6f2ed55c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:55.614562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-922e0092-7708-47e8-8712-36abe9fd80bb req-76eeab1b-b90c-4ba5-b0b9-4e2205bec81f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:55.615754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-922e0092-7708-47e8-8712-36abe9fd80bb req-76eeab1b-b90c-4ba5-b0b9-4e2205bec81f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:55.616415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-922e0092-7708-47e8-8712-36abe9fd80bb req-76eeab1b-b90c-4ba5-b0b9-4e2205bec81f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:55.648898 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-922e0092-7708-47e8-8712-36abe9fd80bb req-76eeab1b-b90c-4ba5-b0b9-4e2205bec81f service nova] Creating event network-changed:a7cf5741-016d-4fbd-8879-a9bc6f2ed55c for instance 61ecb804-3f67-48cf-b503-4431d0c7b461 on n-h1-860864-8 Oct 12 22:49:55.665385 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-922e0092-7708-47e8-8712-36abe9fd80bb req-76eeab1b-b90c-4ba5-b0b9-4e2205bec81f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109895 Oct 12 22:49:55.670409 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1812/3525] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:55.914800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:55.925599 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fbbf2530-daa1-405c-bd10-7110b1b8e00b tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1590 microversion: 2.1 time: 0.481600 Oct 12 22:49:55.931494 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1714/3526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:55 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1590 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:56.287773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:56.291059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:56.303907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:56.308141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:56.310253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:56.311046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:56.311495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:56.318862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:56.577078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:56.578378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:56.591697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:56.592816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:56.593584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:56.594741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:56.595711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:56.597060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:56.959928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:56.970849 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b69edaf6-1ea1-4be0-bbc2-d629860766cb tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1465 microversion: 2.1 time: 0.399493 Oct 12 22:49:56.973591 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1715/3527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:56 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1465 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:56.999569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:57.000609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:57.011150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:57.016613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:57.017076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:57.017821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:57.018282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:57.030158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:57.032745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:57.053064 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d4eb57a-dbf8-46d7-a568-98d67d68e94b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.769598 Oct 12 22:49:57.053654 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1813/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:56 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:57.394510 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-906a8b0c-6616-4f61-9cee-60c3e8792732 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1616 microversion: 2.1 time: 0.399838 Oct 12 22:49:57.400241 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1716/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:56 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1616 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:49:57.623166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-494280183", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b422b505-f575-4ff4-af58-1d9eeec9c2c2"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:57.750177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:49:58.080684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:58.082414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:58.096950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.098964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.102152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.105708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.108824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.109468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.506262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:58.524939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a3a9b83-5a24-4809-a8ad-d70bb250e600 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.447978 Oct 12 22:49:58.528104 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1717/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:58 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:58.539252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:58.544880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:58.554274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.555063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.555667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.556634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.557245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.558161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.589358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:49:58.590535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:49:58.591340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:49:58.592018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:49:58.593015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:49:58.613470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.614435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.617098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.619335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.620794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.628715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.652772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:49:58.665228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:49:58.696844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:49:58.717582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Getting quotas for user 695c23f6a65d47168088cc346c99b8b7 and project 115ba104dfa745dd9fa95a23fbd90474. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:49:58.785293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:49:58.791422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:49:58.923232 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8cd39e0f-7cb6-46f0-ab0e-ef13ae8dcc7c tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 204 len: 0 microversion: 2.1 time: 0.393529 Oct 12 22:49:58.925298 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1718/3531] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:49:58 2022] DELETE /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:49:58.932614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f58fc3c0-fa24-49b7-a210-41a18c73f044 req-7088548b-caf4-440f-b0f0-67dbe37f1310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65cd61be-6259-4f23-aada-1055af774205", "tag": "7d03e8f6-ec6b-4fa0-bb4c-d49b120be648"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:49:58.935612 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32c1293e-92fa-4a92-ac20-35c24e6cb12a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319688 Oct 12 22:49:58.938214 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1814/3532] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:49:58.948344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:58.951294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:58.956868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f58fc3c0-fa24-49b7-a210-41a18c73f044 req-7088548b-caf4-440f-b0f0-67dbe37f1310 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.960070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f58fc3c0-fa24-49b7-a210-41a18c73f044 req-7088548b-caf4-440f-b0f0-67dbe37f1310 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.961000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f58fc3c0-fa24-49b7-a210-41a18c73f044 req-7088548b-caf4-440f-b0f0-67dbe37f1310 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.971160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.976642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.977405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:58.978494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:58.990472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:58.992543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:59.010003 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f58fc3c0-fa24-49b7-a210-41a18c73f044 req-7088548b-caf4-440f-b0f0-67dbe37f1310 service nova] Creating event network-changed:7d03e8f6-ec6b-4fa0-bb4c-d49b120be648 for instance 65cd61be-6259-4f23-aada-1055af774205 on n-h1-860864-8 Oct 12 22:49:59.025583 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f58fc3c0-fa24-49b7-a210-41a18c73f044 req-7088548b-caf4-440f-b0f0-67dbe37f1310 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098555 Oct 12 22:49:59.030556 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1719/3533] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:49:59.048858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4607b757-34f4-4b05-9c4a-e83140b7cdbc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:59.051136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4607b757-34f4-4b05-9c4a-e83140b7cdbc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:59.557204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:49:59.572726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b747426-5b90-4a9c-987a-2a893108f339 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1768 microversion: 2.1 time: 0.633089 Oct 12 22:49:59.576470 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1815/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:58 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1768 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:49:59.603605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:49:59.605138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:49:59.632399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:59.634577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:59.635186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:49:59.637108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:49:59.645817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:49:59.647372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:00.263027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4607b757-34f4-4b05-9c4a-e83140b7cdbc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:00.276157 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4607b757-34f4-4b05-9c4a-e83140b7cdbc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1216 microversion: 2.1 time: 1.243905 Oct 12 22:50:00.282871 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1720/3535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:59 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1216 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:00.362017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:00.375313 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1113f1d-baca-4dc2-bcf3-754d3d1bb2ae tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.796201 Oct 12 22:50:00.378754 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1816/3536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:49:59 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:00.599593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:00.600834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:00.626354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:00.628253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:00.633307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:00.634287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:00.638523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:00.643278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:01.298562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:01.299230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:01.312259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:01.312769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:01.313192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:01.313910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:01.314365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:01.314791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:01.635101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:01.653454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d2c21759-da9d-4324-bf5f-42893f70d814 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1286 microversion: 2.1 time: 0.358530 Oct 12 22:50:01.666097 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1817/3537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:01 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1286 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:01.694143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:01.695109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:01.722617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:01.723184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:01.723638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:01.730762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:01.732146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:01.732767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:01.802849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:01.824453 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-738f6a95-dbcb-4856-a040-e2d1456488e7 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1768 microversion: 2.1 time: 1.217174 Oct 12 22:50:01.825160 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1721/3538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:00 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1768 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:02.677775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:02.678403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:02.692866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:02.693603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:02.694223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:02.695089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:02.695697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:02.696338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:02.893463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:02.902899 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c62699f-0737-4699-900d-65b4586ab509 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 1.231886 Oct 12 22:50:02.927977 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1818/3539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:01 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:02.941453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:02.942093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:02.961551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:02.962316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:02.962942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:02.966291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:02.967965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:02.968575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:02.983235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:02.994282 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e97fa0d4-ff1b-40ab-a40c-2deec0470732 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1274 microversion: 2.1 time: 0.320885 Oct 12 22:50:02.998679 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1722/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:02 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:03.148013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:03.165211 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-368342d2-e8bd-42f7-a283-4e534c5f50ed tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1531 microversion: 2.1 time: 0.233367 Oct 12 22:50:03.168688 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1819/3541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:02 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1531 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:03.389816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9d410720-9aac-4878-b318-54f86bc30fc9 req-1011a74d-2624-42de-99f4-702fd7a541ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cd61be-6259-4f23-aada-1055af774205", "name": "network-vif-deleted", "tag": "7d03e8f6-ec6b-4fa0-bb4c-d49b120be648"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:03.429084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9d410720-9aac-4878-b318-54f86bc30fc9 req-1011a74d-2624-42de-99f4-702fd7a541ad service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:03.429616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9d410720-9aac-4878-b318-54f86bc30fc9 req-1011a74d-2624-42de-99f4-702fd7a541ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:03.430065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9d410720-9aac-4878-b318-54f86bc30fc9 req-1011a74d-2624-42de-99f4-702fd7a541ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:03.468202 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9d410720-9aac-4878-b318-54f86bc30fc9 req-1011a74d-2624-42de-99f4-702fd7a541ad service nova] Creating event network-vif-deleted:7d03e8f6-ec6b-4fa0-bb4c-d49b120be648 for instance 65cd61be-6259-4f23-aada-1055af774205 on n-h1-860864-8 Oct 12 22:50:03.480649 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9d410720-9aac-4878-b318-54f86bc30fc9 req-1011a74d-2624-42de-99f4-702fd7a541ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094276 Oct 12 22:50:03.481924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1723/3542] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:03.937778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:03.938539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:03.962181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:03.965391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:03.965858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:03.977816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:03.978412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:03.978844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:04.026591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:04.027296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:04.045264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:04.057866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:04.058370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:04.058811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:04.066892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:04.067384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:04.067910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:04.391659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:04.415359 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e5e3e264-b253-493b-ac93-fe43e083df4c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.477420 Oct 12 22:50:04.426626 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1820/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:03 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:04.468256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:04.474529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:04.498706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:04.499199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:04.499631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:04.500368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:04.500817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:04.515803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:04.612503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:04.639719 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c98aaf53-1a68-4989-8c8f-46bd07f7d514 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1316 microversion: 2.1 time: 0.617701 Oct 12 22:50:04.650666 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1724/3544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:04 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:04.722783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:04.723530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:04.724137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:04.724783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lazy-loading 'fault' on Instance uuid 65cd61be-6259-4f23-aada-1055af774205 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:04.795147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913ca79af8f44a7dba95a763c3afa305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d6b17cc51e417f8a8c428b62f47679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:04.807026 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e23395de-d53d-4459-aa44-ff24a9b72247 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 200 len: 1385 microversion: 2.1 time: 0.376804 Oct 12 22:50:04.810428 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1821/3545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:04 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 1385 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:05.327306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-47069a48-9c4e-4e12-ad19-da4bc9192bc6 req-d62fe179-b20f-42ca-8cbd-eb9bbb98b2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d038b236-1d62-497d-8c21-1ebcdc1f4eff", "tag": "7aebf407-a2fa-4bb8-b28c-df75967e47ce"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:05.357599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-47069a48-9c4e-4e12-ad19-da4bc9192bc6 req-d62fe179-b20f-42ca-8cbd-eb9bbb98b2bc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:05.358491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-47069a48-9c4e-4e12-ad19-da4bc9192bc6 req-d62fe179-b20f-42ca-8cbd-eb9bbb98b2bc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:05.359475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-47069a48-9c4e-4e12-ad19-da4bc9192bc6 req-d62fe179-b20f-42ca-8cbd-eb9bbb98b2bc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:05.374825 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-47069a48-9c4e-4e12-ad19-da4bc9192bc6 req-d62fe179-b20f-42ca-8cbd-eb9bbb98b2bc service nova] Creating event network-changed:7aebf407-a2fa-4bb8-b28c-df75967e47ce for instance d038b236-1d62-497d-8c21-1ebcdc1f4eff on n-h2-860864-8 Oct 12 22:50:05.385050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-47069a48-9c4e-4e12-ad19-da4bc9192bc6 req-d62fe179-b20f-42ca-8cbd-eb9bbb98b2bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071515 Oct 12 22:50:05.388516 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1725/3546] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:05.446841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:05.447566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:05.458349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:05.458934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:05.461383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:05.465200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:05.465749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:05.466330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:05.671093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:05.671882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:05.681419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:05.689119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:05.694683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:05.695546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:05.696169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:05.696692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:05.839788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:05.848096 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2eca4a0f-3088-48fe-a1dc-92cce5be6cda tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.405051 Oct 12 22:50:05.866597 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1822/3547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:05 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:05.876099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:05.879875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] [instance: 65cd61be-6259-4f23-aada-1055af774205] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:05.892881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:05.893936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:05.894383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:05.895091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:05.895543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:05.896031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:06.140774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:06.149979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d878e9c1-4976-41f7-846c-e2c82dd0f0ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1316 microversion: 2.1 time: 0.483280 Oct 12 22:50:06.157531 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1726/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:05 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:06.284407 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] HTTP exception thrown: Instance 65cd61be-6259-4f23-aada-1055af774205 could not be found. Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Request method failure captured: Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 HTTP/1.1 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QAGyO9vRors27yeqNKrXMs5OqVb-_Malk4KpJKKOyavAQ2LtDGashxx3TA2BQ0rOQmlSUPVaqliS_NwTdgwiBRNYYh3OH1RNqFxCxdpSTRuUtwO_HYqu2-W-2m98aBXDdRRI91GKCynU6lSsT7dbzx8A4leP4JaYDRifrATNSXrVg Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 61d6b17cc51e417f8a8c428b62f47679 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1752758986 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61d6b17cc51e417f8a8c428b62f47679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/61d6b17cc51e417f8a8c428b62f47679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_61d6b17cc51e417f8a8c428b62f47679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61d6b17cc51e417f8a8c428b62f47679"}]}] Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1752758986 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 61d6b17cc51e417f8a8c428b62f47679 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1752758986 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestSecurityGroupsBasicOps-1752758986-project Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 913ca79af8f44a7dba95a763c3afa305 Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1752758986-project Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 65cd61be-6259-4f23-aada-1055af774205 could not be found. Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '65cd61be-6259-4f23-aada-1055af774205'} Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cd61be-6259-4f23-aada-1055af774205 could not be found. Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cd61be-6259-4f23-aada-1055af774205 could not be found. Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:06.286113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cd61be-6259-4f23-aada-1055af774205 could not be found. Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Returning 404 to user: Instance 65cd61be-6259-4f23-aada-1055af774205 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3bbc028-c594-47a2-9a05-3f78a6e1ef91 tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205" status: 404 len: 111 microversion: 2.1 time: 0.415501 Oct 12 22:50:06.290740 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1823/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:05 2022] GET /compute/v2.1/servers/65cd61be-6259-4f23-aada-1055af774205 => generated 111 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:06.875386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:06.877077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:06.889348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:06.893423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:06.894210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:06.895401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:06.898217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:06.900452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:07.233471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:07.246157 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5db84635-923c-405d-8888-a7bbdbfe3bf7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.373170 Oct 12 22:50:07.249656 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1727/3550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:06 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:07.268920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:07.270807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:07.310923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:07.316154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:07.316911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:07.321305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:07.323179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:07.324407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:07.334879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:07.479668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:07.480517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:07.496474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:07.497298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:07.497927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:07.498827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:07.501651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:07.502359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:07.561265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:07.774678 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc31f52f-10fa-4294-bc44-04d3bd91e2ee tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "DELETE /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 204 len: 0 microversion: 2.42 time: 0.773237 Oct 12 22:50:07.777152 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1824/3551] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:50:06 2022] DELETE /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:50:07.795082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:07.795786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:07.815101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:07.815589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:07.816246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:07.817130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:07.817744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:07.818318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:07.857415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:07.883583 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91437a9e-03ca-4b4d-af5d-64b7e0e69ef8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1316 microversion: 2.1 time: 0.632655 Oct 12 22:50:07.886629 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1728/3552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:07 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:08.274810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:08.276743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:08.287986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:08.288907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:08.292349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:08.293119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:08.293595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:08.294328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:08.656546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:08.758850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:08.787768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:08.806664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:08.808167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:08.809471 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21406800-7acd-460d-b6ea-7ee2b70e275c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2959 microversion: 2.42 time: 1.027446 Oct 12 22:50:08.810039 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1825/3553] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:07 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2959 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:08.907729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:08.908105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:08.923977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:08.925130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:08.925589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:08.926333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:08.926790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:08.934328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:09.134081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:09.142498 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b988f8e5-a164-4ee4-acbe-5849bd3e11ac tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.873784 Oct 12 22:50:09.147849 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1729/3554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:08 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:09.842337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:09.843424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:09.871052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:09.875969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:09.878848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:09.882464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:09.884531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:09.890101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:09.899532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:09.916289 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40e1def1-79c4-4087-938e-229a11d6fa7d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1316 microversion: 2.1 time: 1.013022 Oct 12 22:50:09.918602 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1826/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:08 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1316 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:10.174947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:10.175813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:10.193105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:10.198223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:10.199024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:10.202616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:10.203369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:10.205418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:10.268711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:10.701390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:10.731247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:10.740516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:10.749739 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c77895f9-75e9-4820-bd0d-5d51ab1da902 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2959 microversion: 2.42 time: 0.908069 Oct 12 22:50:10.754406 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1730/3556] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:09 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2959 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:10.805500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4e5ddb46-cf84-43e5-b9b0-781757c03728 req-823f2405-f92b-4428-b696-e1d7b173f759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d038b236-1d62-497d-8c21-1ebcdc1f4eff", "name": "network-vif-plugged", "status": "completed", "tag": "7aebf407-a2fa-4bb8-b28c-df75967e47ce"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:10.836378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4e5ddb46-cf84-43e5-b9b0-781757c03728 req-823f2405-f92b-4428-b696-e1d7b173f759 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:10.837669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4e5ddb46-cf84-43e5-b9b0-781757c03728 req-823f2405-f92b-4428-b696-e1d7b173f759 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:10.838135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4e5ddb46-cf84-43e5-b9b0-781757c03728 req-823f2405-f92b-4428-b696-e1d7b173f759 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:10.871268 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4e5ddb46-cf84-43e5-b9b0-781757c03728 req-823f2405-f92b-4428-b696-e1d7b173f759 service nova] Creating event network-vif-plugged:7aebf407-a2fa-4bb8-b28c-df75967e47ce for instance d038b236-1d62-497d-8c21-1ebcdc1f4eff on n-h2-860864-8 Oct 12 22:50:10.879840 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4e5ddb46-cf84-43e5-b9b0-781757c03728 req-823f2405-f92b-4428-b696-e1d7b173f759 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078464 Oct 12 22:50:10.881014 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1731/3557] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:10.956947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:10.959259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:10.978055 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b1ea8b84-cddc-46ef-99d4-eb95e28ed723 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1523 microversion: 2.1 time: 0.803194 Oct 12 22:50:10.981753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:10.982576 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1827/3558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:10 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1523 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:11.008040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:11.008539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:11.008981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:11.009861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:11.010487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:11.010960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:11.623578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:11.637637 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-436b36ed-6e55-4db1-8842-8f323deca962 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1316 microversion: 2.1 time: 0.687719 Oct 12 22:50:11.659094 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1732/3559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:10 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:11.783094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:11.784496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:11.801302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:11.810974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:11.811685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:11.812526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:11.815411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:11.817934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:12.009227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:12.009863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:12.019801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:12.020662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:12.021331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:12.022289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:12.022961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:12.023584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:12.440573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:12.455505 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-788867dd-5efc-43c7-be3a-16ced367df39 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1505 microversion: 2.1 time: 0.453177 Oct 12 22:50:12.473192 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1733/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:12 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:12.665698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:12.667047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:12.679270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:12.681090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:12.683317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:12.684561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:12.685990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:12.689526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:12.771210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:12.793667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:12.798988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:12.814453 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12975d63-b594-475d-aaf0-8cb08e8b5300 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2959 microversion: 2.42 time: 1.034034 Oct 12 22:50:12.818983 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1828/3561] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:11 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2959 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:13.468859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3c067b33-6e91-4daa-a74d-a9da17c3f661 req-521ce8f3-e901-4419-9cd1-15de5246322f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-unplugged", "status": "completed", "tag": "3fc4d68f-7b6b-4043-a00d-08e89eb886f3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:13.489605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3c067b33-6e91-4daa-a74d-a9da17c3f661 req-521ce8f3-e901-4419-9cd1-15de5246322f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:13.490706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3c067b33-6e91-4daa-a74d-a9da17c3f661 req-521ce8f3-e901-4419-9cd1-15de5246322f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:13.491383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3c067b33-6e91-4daa-a74d-a9da17c3f661 req-521ce8f3-e901-4419-9cd1-15de5246322f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:13.530712 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3c067b33-6e91-4daa-a74d-a9da17c3f661 req-521ce8f3-e901-4419-9cd1-15de5246322f service nova] Creating event network-vif-unplugged:3fc4d68f-7b6b-4043-a00d-08e89eb886f3 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:13.545741 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3c067b33-6e91-4daa-a74d-a9da17c3f661 req-521ce8f3-e901-4419-9cd1-15de5246322f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081126 Oct 12 22:50:13.551678 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1829/3562] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:13.563687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:13.567791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:13.586765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:13.588809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:13.589520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:13.595563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:13.598982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:13.599692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:13.641788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:13.660460 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-020c2346-d6c3-4fa2-8f9f-2685d4f9d7a2 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1316 microversion: 2.1 time: 0.998463 Oct 12 22:50:13.662448 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1734/3563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:12 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1316 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:13.851680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:13.854278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:13.856879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:13.863313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:13.864250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:13.864907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:13.865864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:13.866552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:13.867187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:14.435884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:14.445971 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef167305-4624-475a-9430-7ae0ad721af6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1505 microversion: 2.1 time: 0.892586 Oct 12 22:50:14.446463 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1830/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:13 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:14.687409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:14.688436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:14.700541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:14.704162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:14.704850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:14.707392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:14.708637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:14.716542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.001943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:15.018766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:15.020281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:15.021544 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f53d0191-29b9-4539-8859-0caefa2fe931 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2938 microversion: 2.42 time: 1.174746 Oct 12 22:50:15.022113 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1735/3565] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:13 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2938 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:50:15.380190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:15.382536 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-494708d5-fab6-4e97-9464-4fdeeee29f0b tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1465 microversion: 2.1 time: 0.699682 Oct 12 22:50:15.400208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1831/3566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:14 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1465 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:15.405023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:15.405644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:15.413520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:15.414013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:15.414449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.415151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:15.415604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:15.416067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.475375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:15.476961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:15.490124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:15.490616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:15.491051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.494965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:15.495449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:15.495917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.808596 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2808851e-3d9d-44a1-8fc9-9fcb07d7dcc0 tempest-ServersOnMultiNodesTest-1369860 tempest-ServersOnMultiNodesTest-1369860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1616 microversion: 2.1 time: 0.407516 Oct 12 22:50:15.809984 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1736/3567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:15 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1616 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:15.814974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-unplugged", "status": "completed", "tag": "c43ff5fc-65d2-467c-a135-f05491f4289a"}, {"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-unplugged", "status": "completed", "tag": "d69e65b4-1b49-4f2c-9d37-671a6c603a4b"}, {"server_uuid": "3f4bb0ee-be3d-44c3-874e-ba0a423adfd1", "name": "network-vif-unplugged", "status": "completed", "tag": "dc3445b9-1916-4abc-97f1-eac727f87c9f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:15.825752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:15.826115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:15.826710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.842446 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] Creating event network-vif-unplugged:c43ff5fc-65d2-467c-a135-f05491f4289a for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:15.843081 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] Creating event network-vif-unplugged:d69e65b4-1b49-4f2c-9d37-671a6c603a4b for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:15.843585 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] Creating event network-vif-unplugged:dc3445b9-1916-4abc-97f1-eac727f87c9f for instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 on n-h2-860864-8 Oct 12 22:50:15.853173 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1255fbf0-f062-4135-bc7e-bda2c8591c3b req-a7ea405f-78b2-466e-a342-8c30a85837dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.041722 Oct 12 22:50:15.854333 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1737/3568] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:15.862641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:15.863440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:15.870262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:15.870908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:15.871505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.872543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:15.873152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:15.873753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:15.905482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:15.970406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:15.984764 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3ca247e-26f8-4587-9c1b-d1bcb2dbb86e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1505 microversion: 2.1 time: 0.517470 Oct 12 22:50:16.001867 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1832/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:15 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:16.019594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c9fdf5e-df24-4a9e-8b42-dd7e4192ee61 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 204 len: 0 microversion: 2.1 time: 0.161562 Oct 12 22:50:16.020642 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1738/3570] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:15 2022] DELETE /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:16.043703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:16.045896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:16.057064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:16.058365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:16.058531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:16.059250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:16.059839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:16.060765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:16.061403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:16.062023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:16.071720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:16.073070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:16.074765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:16.076655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:16.077356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:16.078758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:16.571819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:16.587249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:16.588726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:16.597379 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ccfb4336-96ba-40e1-aaf7-60f8dbeeddc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2917 microversion: 2.42 time: 0.546952 Oct 12 22:50:16.597973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1739/3571] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:16 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2917 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:16.928290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:16.948075 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef951024-621e-46ac-a429-fcd082ae23a5 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1471 microversion: 2.1 time: 0.910844 Oct 12 22:50:16.949405 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1833/3572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:16 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1471 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:17.010509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-bf17fa09-9cdc-40be-9389-17e6d89b8bbc req-03d4e8c9-28c0-4664-b408-29a365bb0284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-deleted", "tag": "54928122-32c5-4bfb-bd09-eefd47b387a4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:17.010686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:17.014075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:17.025672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:17.029076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:17.029549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:17.030460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:17.032171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:17.032765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:17.034863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bf17fa09-9cdc-40be-9389-17e6d89b8bbc req-03d4e8c9-28c0-4664-b408-29a365bb0284 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:17.035903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bf17fa09-9cdc-40be-9389-17e6d89b8bbc req-03d4e8c9-28c0-4664-b408-29a365bb0284 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:17.037935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bf17fa09-9cdc-40be-9389-17e6d89b8bbc req-03d4e8c9-28c0-4664-b408-29a365bb0284 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:17.071824 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-bf17fa09-9cdc-40be-9389-17e6d89b8bbc req-03d4e8c9-28c0-4664-b408-29a365bb0284 service nova] Creating event network-vif-deleted:54928122-32c5-4bfb-bd09-eefd47b387a4 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:17.096383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-bf17fa09-9cdc-40be-9389-17e6d89b8bbc req-03d4e8c9-28c0-4664-b408-29a365bb0284 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090513 Oct 12 22:50:17.097603 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1740/3573] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:17.630121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:17.631247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:17.646050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:17.646800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:17.647410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:17.648562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:17.649177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:17.649784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:17.912793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:17.927266 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a72ef5ce-e001-4dee-8c52-16f4a16ec8cc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1505 microversion: 2.1 time: 0.920259 Oct 12 22:50:17.943201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1834/3574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:17 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1505 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:17.950167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c50a326e-cd9a-42f6-ae1c-798a1cd8385f req-8280f242-cb31-4bec-bfeb-7c16d3a3fded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-unplugged", "status": "completed", "tag": "54928122-32c5-4bfb-bd09-eefd47b387a4"}, {"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-unplugged", "status": "completed", "tag": "dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:17.960848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c50a326e-cd9a-42f6-ae1c-798a1cd8385f req-8280f242-cb31-4bec-bfeb-7c16d3a3fded service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:17.961314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c50a326e-cd9a-42f6-ae1c-798a1cd8385f req-8280f242-cb31-4bec-bfeb-7c16d3a3fded service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:17.961740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c50a326e-cd9a-42f6-ae1c-798a1cd8385f req-8280f242-cb31-4bec-bfeb-7c16d3a3fded service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:17.982893 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c50a326e-cd9a-42f6-ae1c-798a1cd8385f req-8280f242-cb31-4bec-bfeb-7c16d3a3fded service nova] Creating event network-vif-unplugged:54928122-32c5-4bfb-bd09-eefd47b387a4 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:17.983486 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c50a326e-cd9a-42f6-ae1c-798a1cd8385f req-8280f242-cb31-4bec-bfeb-7c16d3a3fded service nova] Creating event network-vif-unplugged:dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:17.990161 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c50a326e-cd9a-42f6-ae1c-798a1cd8385f req-8280f242-cb31-4bec-bfeb-7c16d3a3fded service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.044676 Oct 12 22:50:17.995385 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1835/3575] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:18.007492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:18.008633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:18.017468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:18.018277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:18.019163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:18.021687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:18.023033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:18.023808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:18.043455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:18.055637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:18.062486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:18.069568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dbf97aee-5383-4c63-a42b-cff3c8ab5f73 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2756 microversion: 2.42 time: 0.443488 Oct 12 22:50:18.083945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1741/3576] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:17 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2756 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:18.140361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98bb7fd8-2280-4df8-8e50-ac0ca355f46d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] Calling method '.version_select at 0x7f44fed0a160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:18.165053 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98bb7fd8-2280-4df8-8e50-ac0ca355f46d tempest-TestSecurityGroupsBasicOps-1752758986 tempest-TestSecurityGroupsBasicOps-1752758986-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1108858470" status: 202 len: 0 microversion: 2.1 time: 0.028450 Oct 12 22:50:18.166696 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1742/3577] 10.222.0.20 () {58 vars in 1278 bytes} [Wed Oct 12 22:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1108858470 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:50:18.530864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:18.559790 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0994255b-effa-499d-91b7-02993ded1e03 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1471 microversion: 2.1 time: 0.561153 Oct 12 22:50:18.563329 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1836/3578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:17 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1471 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:18.952532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:18.953600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:18.976197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:18.977523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:18.980007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:18.981061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:18.982744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:18.986261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:19.099532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:19.100193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:19.117818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:19.118744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:19.120209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:19.122402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:19.123629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:19.124745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:19.137505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:19.702794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:19.720420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:19.725722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:19.727207 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34c31e4c-326c-4201-b9bd-9dfd446ebdc8 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2709 microversion: 2.42 time: 0.632475 Oct 12 22:50:19.730689 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1837/3579] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:19 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2709 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:50:19.774242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-894ab15d-7cef-448c-aebd-31aebf82af2c req-f09898ed-8baf-4e43-8c72-47178d696d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-deleted", "tag": "dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:19.804519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-894ab15d-7cef-448c-aebd-31aebf82af2c req-f09898ed-8baf-4e43-8c72-47178d696d69 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:19.805086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-894ab15d-7cef-448c-aebd-31aebf82af2c req-f09898ed-8baf-4e43-8c72-47178d696d69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:19.805533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-894ab15d-7cef-448c-aebd-31aebf82af2c req-f09898ed-8baf-4e43-8c72-47178d696d69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:19.832811 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-894ab15d-7cef-448c-aebd-31aebf82af2c req-f09898ed-8baf-4e43-8c72-47178d696d69 service nova] Creating event network-vif-deleted:dc19b07c-b9fe-4728-ab9f-6ac0fc9b0ceb for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:19.848731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-894ab15d-7cef-448c-aebd-31aebf82af2c req-f09898ed-8baf-4e43-8c72-47178d696d69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114780 Oct 12 22:50:19.849386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1838/3580] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:19.860392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-989c200a-7991-4d7b-a357-48ed19d6a8ce req-6be19e5e-895f-4932-af0b-a08f70fcf518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d038b236-1d62-497d-8c21-1ebcdc1f4eff", "name": "network-vif-deleted", "tag": "7aebf407-a2fa-4bb8-b28c-df75967e47ce"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:19.894223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-989c200a-7991-4d7b-a357-48ed19d6a8ce req-6be19e5e-895f-4932-af0b-a08f70fcf518 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:19.894819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-989c200a-7991-4d7b-a357-48ed19d6a8ce req-6be19e5e-895f-4932-af0b-a08f70fcf518 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:19.896835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-989c200a-7991-4d7b-a357-48ed19d6a8ce req-6be19e5e-895f-4932-af0b-a08f70fcf518 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:19.929737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-989c200a-7991-4d7b-a357-48ed19d6a8ce req-6be19e5e-895f-4932-af0b-a08f70fcf518 service nova] Creating event network-vif-deleted:7aebf407-a2fa-4bb8-b28c-df75967e47ce for instance d038b236-1d62-497d-8c21-1ebcdc1f4eff on n-h2-860864-8 Oct 12 22:50:19.936988 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-989c200a-7991-4d7b-a357-48ed19d6a8ce req-6be19e5e-895f-4932-af0b-a08f70fcf518 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086200 Oct 12 22:50:19.937990 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1839/3581] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:19.944848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:19.947232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:19.955325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:19.956085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:19.956696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:19.957676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:19.958279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:19.958974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:20.011649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:20.012471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:20.013091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:20.014214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lazy-loading 'fault' on Instance uuid d038b236-1d62-497d-8c21-1ebcdc1f4eff {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:20.025780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:20.045248 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40edb26e-4390-4d96-835b-8949a195e77e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 200 len: 1448 microversion: 2.1 time: 1.097414 Oct 12 22:50:20.045983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1743/3582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:18 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 1448 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:20.073861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:20.076125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:20.086408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:20.087008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:20.087540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:20.088398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:20.089557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:20.090113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:20.166172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:20.179448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-de1d948b-4a6f-4144-a930-4927104ebff0 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 200 len: 1306 microversion: 2.1 time: 0.240001 Oct 12 22:50:20.180065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1840/3583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:19 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 1306 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:20.186673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:20.210956 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Working on deleting snapshot fd0cbd36-fae7-4643-afd3-f70713607700 from shelved instance... Oct 12 22:50:20.389496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ce173093-6ead-4870-a423-4d03a5791713 req-93cfcd3c-4fc8-4d81-9d76-3e4d4df17de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d038b236-1d62-497d-8c21-1ebcdc1f4eff", "name": "network-vif-unplugged", "status": "completed", "tag": "7aebf407-a2fa-4bb8-b28c-df75967e47ce"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:20.424578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ce173093-6ead-4870-a423-4d03a5791713 req-93cfcd3c-4fc8-4d81-9d76-3e4d4df17de4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:20.426690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ce173093-6ead-4870-a423-4d03a5791713 req-93cfcd3c-4fc8-4d81-9d76-3e4d4df17de4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:20.427415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ce173093-6ead-4870-a423-4d03a5791713 req-93cfcd3c-4fc8-4d81-9d76-3e4d4df17de4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:20.441259 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ce173093-6ead-4870-a423-4d03a5791713 req-93cfcd3c-4fc8-4d81-9d76-3e4d4df17de4 service nova] Creating event network-vif-unplugged:7aebf407-a2fa-4bb8-b28c-df75967e47ce for instance d038b236-1d62-497d-8c21-1ebcdc1f4eff on n-h2-860864-8 Oct 12 22:50:20.447762 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ce173093-6ead-4870-a423-4d03a5791713 req-93cfcd3c-4fc8-4d81-9d76-3e4d4df17de4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062921 Oct 12 22:50:20.449915 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1841/3584] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:20.766491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:20.769301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:20.784946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:20.788974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:20.788974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:20.797985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:20.802380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:20.805513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:21.644224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Doing local delete in cell 868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=120543) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 12 22:50:21.645744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:21.646435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:21.647773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:21.648420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 12 22:50:21.667462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:21.680644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] deallocate_for_instance() {{(pid=120543) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 12 22:50:21.687316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:21.693812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:21.695121 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ff344d2-4662-494f-b093-7678108288d1 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2548 microversion: 2.42 time: 0.937016 Oct 12 22:50:21.699070 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1842/3585] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:20 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2548 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:21.712439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:21.713097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: d038b236-1d62-497d-8c21-1ebcdc1f4eff] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:21.730533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:21.731290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:21.732114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:21.732998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:21.735174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:21.735620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:21.774522 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance d038b236-1d62-497d-8c21-1ebcdc1f4eff could not be found. Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff HTTP/1.1 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d038b236-1d62-497d-8c21-1ebcdc1f4eff could not be found. Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd038b236-1d62-497d-8c21-1ebcdc1f4eff'} Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d038b236-1d62-497d-8c21-1ebcdc1f4eff could not be found. Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d038b236-1d62-497d-8c21-1ebcdc1f4eff could not be found. Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:21.776196 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:21.781235 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:21.781235 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:21.781235 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:21.781235 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:21.781235 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:21.781235 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d038b236-1d62-497d-8c21-1ebcdc1f4eff could not be found. Oct 12 22:50:21.781235 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:21.788052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance d038b236-1d62-497d-8c21-1ebcdc1f4eff could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:21.790475 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d7935e3b-cf31-48dc-a743-87fdef7a7979 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff" status: 404 len: 111 microversion: 2.1 time: 0.090065 Oct 12 22:50:21.792793 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1843/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:21 2022] GET /compute/v2.1/servers/d038b236-1d62-497d-8c21-1ebcdc1f4eff => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:21.803828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:21.816618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:21.825131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:21.825923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:21.826531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:21.827489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:21.828161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:21.828744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:21.897798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:22.071373 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d6c885d-193a-4daf-9567-aab51957782f tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 204 len: 0 microversion: 2.1 time: 0.273302 Oct 12 22:50:22.072948 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1844/3587] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:21 2022] DELETE /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:22.080704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e526bd94-d0a1-4880-90d8-0bba1193eaf7 req-14923012-27f6-4d3c-9829-90d9e00ccff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-deleted", "tag": "c43ff5fc-65d2-467c-a135-f05491f4289a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:22.093104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e526bd94-d0a1-4880-90d8-0bba1193eaf7 req-14923012-27f6-4d3c-9829-90d9e00ccff7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:22.093608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e526bd94-d0a1-4880-90d8-0bba1193eaf7 req-14923012-27f6-4d3c-9829-90d9e00ccff7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:22.094031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e526bd94-d0a1-4880-90d8-0bba1193eaf7 req-14923012-27f6-4d3c-9829-90d9e00ccff7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:22.109717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e526bd94-d0a1-4880-90d8-0bba1193eaf7 req-14923012-27f6-4d3c-9829-90d9e00ccff7 service nova] Creating event network-vif-deleted:c43ff5fc-65d2-467c-a135-f05491f4289a for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:22.116849 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e526bd94-d0a1-4880-90d8-0bba1193eaf7 req-14923012-27f6-4d3c-9829-90d9e00ccff7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042125 Oct 12 22:50:22.117758 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1845/3588] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:22.123022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:22.123724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:22.130768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:22.131251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:22.132472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:22.133179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:22.133629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:22.135314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:22.878073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:22.887380 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b57d6fc0-a33c-4a12-a3fb-68f1f50987b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1471 microversion: 2.1 time: 0.768397 Oct 12 22:50:22.898373 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1846/3589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:22 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1471 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:22.911819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:22.912910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:22.921136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:22.922009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:22.922498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:22.923470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:22.925072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:22.925811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:23.248424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:23.258955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Updating instance_info_cache with network_info: [] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:50:23.376543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:23.396138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:23.400522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:23.405160 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff3eba65-e78e-4fa9-b3ae-87e25f31cf02 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 2501 microversion: 2.42 time: 0.505244 Oct 12 22:50:23.405743 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1847/3590] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:22 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 2501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:23.413029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-564975264", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "42a96352-7d4f-4102-8c5e-541ea547a93d"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:23.498935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] validate_networks() for [('42a96352-7d4f-4102-8c5e-541ea547a93d', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:50:23.806577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88653ebc-b45e-4833-ae78-42afd6314ca0 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 204 len: 0 microversion: 2.1 time: 3.737272 Oct 12 22:50:23.811671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1744/3591] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:20 2022] DELETE /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 0 bytes in 3740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:23.822450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:23.825946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:23.839736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:23.842483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:23.844351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:23.845451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:23.846744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:23.848147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:23.879576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 HTTP/1.1 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '3f4bb0ee-be3d-44c3-874e-ba0a423adfd1'} Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:23.881309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:23.885261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:23.889526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0bfe5a9-7d07-4afc-9f15-3b8b167d5d44 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 404 len: 111 microversion: 2.1 time: 0.068371 Oct 12 22:50:23.889526 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1745/3592] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:23 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:23.924518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:23.925137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:23.945037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:23.948022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:23.948804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:23.949754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:23.951060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:23.953605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:24.265368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:24.282535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe57d243-8892-4f18-9bdb-7fff6107f067 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1471 microversion: 2.1 time: 0.364075 Oct 12 22:50:24.297230 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1746/3593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:23 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:24.311088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-207643029", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6857b740-c8f6-435b-b880-87bc9b4758e7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:24.419248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] validate_networks() for [('6857b740-c8f6-435b-b880-87bc9b4758e7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:50:25.376874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:50:25.377530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:50:25.377927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:50:25.378337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:50:25.378936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:50:25.395570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:25.396083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:25.396519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:25.397242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:25.397712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:25.398116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:25.440823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:50:25.447992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for user 1353d2e3246c44cf8d4501c0f4455790 and project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:50:25.474962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:50:25.477630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:50:25.586931 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4a946fc-1290-4143-9e48-da2fbfb55add tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283545 Oct 12 22:50:25.592656 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1747/3594] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:50:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:50:25.620221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d3e64d19-e3b7-4987-877c-860d43155f7b req-81d282f3-5b8e-4a20-be7e-4853c68625fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4bb0ee-be3d-44c3-874e-ba0a423adfd1", "name": "network-vif-deleted", "tag": "dc3445b9-1916-4abc-97f1-eac727f87c9f"}, {"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-deleted", "tag": "d69e65b4-1b49-4f2c-9d37-671a6c603a4b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:25.664950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d3e64d19-e3b7-4987-877c-860d43155f7b req-81d282f3-5b8e-4a20-be7e-4853c68625fd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:25.666066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d3e64d19-e3b7-4987-877c-860d43155f7b req-81d282f3-5b8e-4a20-be7e-4853c68625fd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:25.667733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d3e64d19-e3b7-4987-877c-860d43155f7b req-81d282f3-5b8e-4a20-be7e-4853c68625fd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:25.702816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.server_external_events [req-d3e64d19-e3b7-4987-877c-860d43155f7b req-81d282f3-5b8e-4a20-be7e-4853c68625fd service nova] Unable to find a host for instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1. Dropping event network-vif-deleted {{(pid=120543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 22:50:25.705820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d3e64d19-e3b7-4987-877c-860d43155f7b req-81d282f3-5b8e-4a20-be7e-4853c68625fd service nova] Creating event network-vif-deleted:d69e65b4-1b49-4f2c-9d37-671a6c603a4b for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:25.716818 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d3e64d19-e3b7-4987-877c-860d43155f7b req-81d282f3-5b8e-4a20-be7e-4853c68625fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 351 microversion: 2.1 time: 0.122641 Oct 12 22:50:25.719419 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1748/3595] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 351 bytes in 125 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 22:50:25.733969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:25.736599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:25.745606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:25.746548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:25.747255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:25.748206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:25.748866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:25.750135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:25.965180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:25.977903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:25.979582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:25.982181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0cbbeda4-525f-4815-b8a2-8eef47b0775f tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.256540 Oct 12 22:50:25.983270 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1749/3596] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:25 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:25.989009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:25.997074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:25.999745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Searching by: {'deleted': False, 'project_id': '5ac89fe7811f41848744c84e333c8761'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:50:26.006431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.007259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.007942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.008916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.009609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.010248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.054419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:50:26.092351 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-187642c0-7869-4737-98c7-8c5df6f99006 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.107540 Oct 12 22:50:26.100574 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1750/3597] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:50:25 2022] GET /compute/v2.1/servers => generated 339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:26.108186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:26.109387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:26.120605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.121520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.122171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.123172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.123980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.124788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.222991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.223563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.224624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.226894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lazy-loading 'fault' on Instance uuid 456c524e-8422-4f02-bc07-1dbd4a98e42b {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:26.288764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:50:26.289516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:50:26.290491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:50:26.290952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:50:26.292023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:50:26.310484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.311706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.312801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.317832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:26.323237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.331957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.332516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.333576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f0b8cfd5-5ef3-406c-a5c8-c064912587ef tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 200 len: 1307 microversion: 2.1 time: 0.230057 Oct 12 22:50:26.337532 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1751/3598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:26 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:26.354871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-91e2b989-664c-47c4-bdd8-e6a26f9cd4e5 req-34869855-85da-4aaf-8f54-0d8891f79dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456c524e-8422-4f02-bc07-1dbd4a98e42b", "name": "network-vif-deleted", "tag": "67082951-67f3-477c-86d1-4e45774eb63b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:26.392001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-91e2b989-664c-47c4-bdd8-e6a26f9cd4e5 req-34869855-85da-4aaf-8f54-0d8891f79dfa service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.395000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-91e2b989-664c-47c4-bdd8-e6a26f9cd4e5 req-34869855-85da-4aaf-8f54-0d8891f79dfa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.397038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-91e2b989-664c-47c4-bdd8-e6a26f9cd4e5 req-34869855-85da-4aaf-8f54-0d8891f79dfa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.409007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Getting quotas for project 32e848bceee740759ad1aef081c0a248. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:50:26.420214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:26.437880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Getting quotas for user 4e1a67c76bbd4817b865da0f8da65165 and project 32e848bceee740759ad1aef081c0a248. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:50:26.443849 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-91e2b989-664c-47c4-bdd8-e6a26f9cd4e5 req-34869855-85da-4aaf-8f54-0d8891f79dfa service nova] Creating event network-vif-deleted:67082951-67f3-477c-86d1-4e45774eb63b for instance 456c524e-8422-4f02-bc07-1dbd4a98e42b on n-h1-860864-8 Oct 12 22:50:26.462620 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-91e2b989-664c-47c4-bdd8-e6a26f9cd4e5 req-34869855-85da-4aaf-8f54-0d8891f79dfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122480 Oct 12 22:50:26.463513 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1752/3599] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:26.481984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:50:26.485436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:50:26.489410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:26.490380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:26.520819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.521407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.521866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.522614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.523113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.539053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.575354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79dc0ce8-46fa-4b64-a336-47f8ec647503 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.166924 Oct 12 22:50:26.578322 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1848/3600] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:50:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:50:26.589187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:26.598699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:26.599957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Searching by: {'deleted': False, 'project_id': '5ac89fe7811f41848744c84e333c8761'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:50:26.635147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.636447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.638710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.643054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.643561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.644083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.676101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:26.709695 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-965a9bac-5b8c-4527-a6a2-09c761b37b41 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1218 microversion: 2.1 time: 0.232355 Oct 12 22:50:26.710532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:50:26.711262 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1753/3601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:26 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:26.721550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a5f956c4-a224-4b73-ae0c-1fc9b36cf552 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:26.724064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a5f956c4-a224-4b73-ae0c-1fc9b36cf552 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:26.835551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:26.854910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:26.855163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:26.856487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:26.987373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a5f956c4-a224-4b73-ae0c-1fc9b36cf552 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:26.998371 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a5f956c4-a224-4b73-ae0c-1fc9b36cf552 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1213 microversion: 2.1 time: 0.285213 Oct 12 22:50:27.000504 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1754/3602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:26 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:27.012517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:27.016199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:27.036696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.038325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.039126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.040055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.040734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.041543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.362069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:27.381866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:27.391744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:27.396708 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91122d70-3567-44b6-8735-c7f688f0d154 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.387310 Oct 12 22:50:27.399639 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1755/3603] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:27 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:27.413900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:27.415961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 456c524e-8422-4f02-bc07-1dbd4a98e42b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:27.430457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.431281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.432206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.433489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.434488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.435415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.481193 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance 456c524e-8422-4f02-bc07-1dbd4a98e42b could not be found. Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b HTTP/1.1 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 456c524e-8422-4f02-bc07-1dbd4a98e42b could not be found. Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '456c524e-8422-4f02-bc07-1dbd4a98e42b'} Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 456c524e-8422-4f02-bc07-1dbd4a98e42b could not be found. Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 456c524e-8422-4f02-bc07-1dbd4a98e42b could not be found. Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:27.485477 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 456c524e-8422-4f02-bc07-1dbd4a98e42b could not be found. Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance 456c524e-8422-4f02-bc07-1dbd4a98e42b could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8e60a4c1-00c7-45a3-8f1a-755bbcafc1ea tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b" status: 404 len: 111 microversion: 2.1 time: 0.085217 Oct 12 22:50:27.490366 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1756/3604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:27 2022] GET /compute/v2.1/servers/456c524e-8422-4f02-bc07-1dbd4a98e42b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:27.503397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:27.505263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:27.521852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.523444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.524392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.527111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.529168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.530727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.631144 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f93cf168-5d75-4742-a687-b79fda9e2b05 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.051651 Oct 12 22:50:27.632361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:27.633197 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1849/3605] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:50:26 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:27.666876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d35869b-7be4-414f-a8a5-c5e9de56ec33 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:27.694397 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d35869b-7be4-414f-a8a5-c5e9de56ec33 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032519 Oct 12 22:50:27.695549 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1850/3606] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:50:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:27.734091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:27.734915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:27.768642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.769453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.770104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.771022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.771804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.776926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.914864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-45e53fa8-7c92-451e-b0db-381042ac80e7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 204 len: 0 microversion: 2.1 time: 0.420283 Oct 12 22:50:27.915705 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1757/3607] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:27 2022] DELETE /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:27.923823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ce8cccb0-92f0-42d8-8a7d-9e10836b0544 req-57e5d24a-00d9-472e-9c2b-f6a1917285cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337ba34e-9f41-4a02-b6cf-1be43c118524", "name": "network-vif-deleted", "tag": "3fc4d68f-7b6b-4043-a00d-08e89eb886f3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:27.956355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ce8cccb0-92f0-42d8-8a7d-9e10836b0544 req-57e5d24a-00d9-472e-9c2b-f6a1917285cb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:27.956763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ce8cccb0-92f0-42d8-8a7d-9e10836b0544 req-57e5d24a-00d9-472e-9c2b-f6a1917285cb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:27.957217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ce8cccb0-92f0-42d8-8a7d-9e10836b0544 req-57e5d24a-00d9-472e-9c2b-f6a1917285cb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:27.980199 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ce8cccb0-92f0-42d8-8a7d-9e10836b0544 req-57e5d24a-00d9-472e-9c2b-f6a1917285cb service nova] Creating event network-vif-deleted:3fc4d68f-7b6b-4043-a00d-08e89eb886f3 for instance 337ba34e-9f41-4a02-b6cf-1be43c118524 on n-h1-860864-8 Oct 12 22:50:27.989234 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ce8cccb0-92f0-42d8-8a7d-9e10836b0544 req-57e5d24a-00d9-472e-9c2b-f6a1917285cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069884 Oct 12 22:50:27.990267 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1758/3608] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:28.004870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:28.005612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:28.023491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.023645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:28.024071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.025466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.032491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.033061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.033514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.039784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:UPDATE=16,nova_cell1:SELECT=79,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:28.043192 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c17642d-0a22-41af-9bc1-9dc770b5d3d1 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1274 microversion: 2.1 time: 0.312240 Oct 12 22:50:28.055624 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1851/3609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:27 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1274 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:28.055624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:28.055624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:28.073880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.074766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.075436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.076413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.079145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.080895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.246248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:28.255646 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ed834363-5567-4f26-a30c-136a3903a2ec tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1217 microversion: 2.1 time: 0.208306 Oct 12 22:50:28.256438 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1852/3610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:28 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:28.285362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:28.285878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:28.304056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.304780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.305616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.306510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.307131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.307718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.359433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:28.551736 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f9a4b064-2e02-4b76-8a4d-a2466aae0059 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 204 len: 0 microversion: 2.1 time: 0.274112 Oct 12 22:50:28.555332 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1853/3611] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:28 2022] DELETE /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:28.562994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:28.563702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:28.579325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.580349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.580785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.586092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:28.586388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:28.586822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:28.622705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:29.003871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:29.018487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33524af9-59fe-495e-9baf-89bb63f95f0a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1473 microversion: 2.1 time: 1.027110 Oct 12 22:50:29.022722 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1759/3612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:27 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1473 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:29.032685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:29.035676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:29.052011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:29.056188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:29.059781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:29.060264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:29.061124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:29.063079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:29.066853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:29.074202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:29.087421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:29.089638 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b5d21c60-dbbf-4b19-b0e5-fe0daaec93a9 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.535691 Oct 12 22:50:29.093751 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1854/3613] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:28 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:29.118060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:29.118967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:29.127253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:29.128078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:29.128696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:29.129628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:29.130307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:29.130935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:29.351423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:29.385333 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46f73791-9bdc-4e43-a828-b88b0b27dd38 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1272 microversion: 2.1 time: 0.270311 Oct 12 22:50:29.392783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1855/3614] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:29 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:29.399808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:29.400452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:29.418656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:29.419232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:29.419676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:29.426747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:29.427251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:29.427682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:29.649383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:29.679328 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-01d5d4fa-3b7e-4a4c-9f60-a5ed680c65f1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1271 microversion: 2.1 time: 0.285388 Oct 12 22:50:29.680653 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1856/3615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:29 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:29.788615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:29.807380 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-611df48f-1dad-4e44-ba34-cb29b034a4fa tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1715 microversion: 2.1 time: 0.782690 Oct 12 22:50:29.808025 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1760/3616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:29 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1715 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:30.047176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:30.047800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:30.058564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:30.059207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:30.059487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:30.060221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:30.060672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:30.061100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:30.119618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:30.120854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:30.137931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:30.138985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:30.146943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:30.147919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:30.148536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:30.149143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:30.397123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:30.407352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:30.409536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:30.419538 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b300fb82-d70a-4689-af47-51313daffa75 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.304825 Oct 12 22:50:30.432630 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1761/3617] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:30 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:50:30.447692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:30.448349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:30.466349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:30.467119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:30.467754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:30.468660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:30.469288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:30.469941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:31.044698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:31.054652 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f9fe17b-3911-409c-9c7e-49e0d8433730 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1473 microversion: 2.1 time: 1.011910 Oct 12 22:50:31.056080 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1857/3618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:30 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1473 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:31.061830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:31.063233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:31.075632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:31.076386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:31.076971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:31.077823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:31.078450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:31.079020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:31.256677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:31.266674 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c07146e-10f0-4974-8f8b-ec6d8bae6797 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1271 microversion: 2.1 time: 0.209097 Oct 12 22:50:31.267652 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1858/3619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:31 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:31.273615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:31.275303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:31.279306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:31.283755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:31.284542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:31.285194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:31.286149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:31.286913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:31.287554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:31.289467 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-911fc87c-2fc0-4980-a13e-aa8b0cdeb9a6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 0.854666 Oct 12 22:50:31.291253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1762/3620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:30 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:31.450373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:31.451424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:31.458177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:31.458960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:31.459606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:31.460560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:31.461218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:31.461848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:31.605525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:31.625923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:31.627761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:31.629795 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9933af74-09e1-400a-be4d-9d0b037f4d1d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.182747 Oct 12 22:50:31.637818 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1763/3621] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:31 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:50:31.834900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:31.850208 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4de3bfe-e9f7-40ca-8638-b01a8630dcae tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1715 microversion: 2.1 time: 0.580165 Oct 12 22:50:31.852264 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1859/3622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:31 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1715 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:32.078290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:32.079099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:32.092893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.093401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.093918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:32.097899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.098379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.098820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:32.290470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:32.291739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:32.311835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.315245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.316812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:32.319929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.320688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.321281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:32.337480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:32.345820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4c14bac-f3db-47f0-b83a-ddbeb7fa297d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1431 microversion: 2.1 time: 0.271281 Oct 12 22:50:32.360324 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1764/3623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:32 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1431 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:32.366117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:32.366940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:32.370322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:32.384315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.385035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.385626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:32.386481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.387084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.387787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:32.524031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:32.539692 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-280b2bdd-0072-4d7e-81e2-5da46fbf4ab0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1271 microversion: 2.1 time: 0.254062 Oct 12 22:50:32.540657 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1860/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:32 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:32.664545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:32.665949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:32.674503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.675793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.676415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:32.677530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:32.678293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:32.678996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.013261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:33.036831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:33.040052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:33.042292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e883ac19-ae96-4888-9fc8-b517485e3f7c tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.387052 Oct 12 22:50:33.065296 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1861/3625] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:32 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:50:33.090981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:33.091612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:33.111653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.112920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.113438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.116619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.117114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.118727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.326221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:33.349631 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-402c8926-3ba2-4bf2-bca3-0f366d6a2e20 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1648 microversion: 2.1 time: 0.276494 Oct 12 22:50:33.364961 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1862/3626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:33 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1648 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:33.366386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-31557cdb-e204-434c-a238-748f89e50e25 req-b0626c84-eb9a-49c6-8586-a1bb6af7b600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3041339c-5dcd-4265-9ea5-790c6b5bda15", "name": "network-vif-deleted", "tag": "f9f4a7db-d8af-4b64-a87b-88ed7cceda9f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:33.386108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-31557cdb-e204-434c-a238-748f89e50e25 req-b0626c84-eb9a-49c6-8586-a1bb6af7b600 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.388239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-31557cdb-e204-434c-a238-748f89e50e25 req-b0626c84-eb9a-49c6-8586-a1bb6af7b600 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.388938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-31557cdb-e204-434c-a238-748f89e50e25 req-b0626c84-eb9a-49c6-8586-a1bb6af7b600 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.396518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:33.416692 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f961fa04-4bb7-418c-9add-9b2c3aeafe53 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 1.054257 Oct 12 22:50:33.417293 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-31557cdb-e204-434c-a238-748f89e50e25 req-b0626c84-eb9a-49c6-8586-a1bb6af7b600 service nova] Creating event network-vif-deleted:f9f4a7db-d8af-4b64-a87b-88ed7cceda9f for instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 on n-h1-860864-8 Oct 12 22:50:33.424005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1765/3627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:32 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:33.429368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:33.430050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:33.434500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-31557cdb-e204-434c-a238-748f89e50e25 req-b0626c84-eb9a-49c6-8586-a1bb6af7b600 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082875 Oct 12 22:50:33.435123 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1863/3628] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:33.441577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.442284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.442908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.443812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.444507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.445253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.486767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.487640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.489000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.489615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lazy-loading 'fault' on Instance uuid 3041339c-5dcd-4265-9ea5-790c6b5bda15 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:33.565454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:33.566480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:33.581830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.582563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.583203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:33.584197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:33.584840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:33.587593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.047193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:34.055404 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a5db9f52-021c-471a-89f6-f0f7fb42d099 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 200 len: 1307 microversion: 2.1 time: 0.629854 Oct 12 22:50:34.056519 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1766/3629] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:33 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 1307 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:34.075106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:34.076303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:34.082888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:34.083717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:34.084380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.085321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:34.086028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:34.086654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.159213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:34.167426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea0980a3-62a0-425c-9115-c8fb047d255e tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.608372 Oct 12 22:50:34.180453 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1864/3630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:33 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:34.257424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:34.270547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:34.272763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:34.275785 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2be474d-6c6e-41ed-a8da-6ec352c0ec30 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.204678 Oct 12 22:50:34.290441 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1767/3631] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:34 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:50:34.379057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:34.379938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:34.390936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:34.391665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:34.392638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.393545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:34.394166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:34.394756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.447249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:34.448579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:34.455330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:34.456059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:34.456641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.457511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:34.458547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:34.459124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.534026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:34.547585 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6cf56f1c-3193-4e65-84a4-38aef22d619d tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1648 microversion: 2.1 time: 0.172629 Oct 12 22:50:34.549138 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1865/3632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:34 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1648 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:34.813362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-75371c17-55e0-4651-b1f6-22b50b172a5c req-bf103dbf-d6ae-4ac4-ac91-347264b0225e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ecb804-3f67-48cf-b503-4431d0c7b461", "name": "network-vif-deleted", "tag": "a7cf5741-016d-4fbd-8879-a9bc6f2ed55c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:34.839367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-75371c17-55e0-4651-b1f6-22b50b172a5c req-bf103dbf-d6ae-4ac4-ac91-347264b0225e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:34.839865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-75371c17-55e0-4651-b1f6-22b50b172a5c req-bf103dbf-d6ae-4ac4-ac91-347264b0225e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:34.840973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-75371c17-55e0-4651-b1f6-22b50b172a5c req-bf103dbf-d6ae-4ac4-ac91-347264b0225e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:34.869080 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-75371c17-55e0-4651-b1f6-22b50b172a5c req-bf103dbf-d6ae-4ac4-ac91-347264b0225e service nova] Creating event network-vif-deleted:a7cf5741-016d-4fbd-8879-a9bc6f2ed55c for instance 61ecb804-3f67-48cf-b503-4431d0c7b461 on n-h1-860864-8 Oct 12 22:50:34.882254 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-75371c17-55e0-4651-b1f6-22b50b172a5c req-bf103dbf-d6ae-4ac4-ac91-347264b0225e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074277 Oct 12 22:50:34.883203 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1866/3633] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:50:35.082222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:35.082950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 3041339c-5dcd-4265-9ea5-790c6b5bda15] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:35.093171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.093674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.094117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.094864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.104682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.105399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.133728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 could not be found. Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 HTTP/1.1 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 could not be found. Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3041339c-5dcd-4265-9ea5-790c6b5bda15'} Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 could not be found. Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 could not be found. Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:35.135437 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:35.141211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:35.141211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:35.141211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:35.141211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:35.141211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:35.141211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 could not be found. Oct 12 22:50:35.141211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:35.164223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance 3041339c-5dcd-4265-9ea5-790c6b5bda15 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:35.165342 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09f00361-861f-4daa-82ff-d608881b32e4 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15" status: 404 len: 111 microversion: 2.1 time: 0.087992 Oct 12 22:50:35.166291 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1867/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:35 2022] GET /compute/v2.1/servers/3041339c-5dcd-4265-9ea5-790c6b5bda15 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:35.174291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:35.174798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:35.196422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.200873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.201411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.202193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.202660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.203097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.266925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:35.289220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:35.305725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9eb932ae-65b5-4ce9-89c0-13ab917cfc11 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 0.863519 Oct 12 22:50:35.316537 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1768/3635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:34 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:35.329720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:35.335915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:35.353817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.355188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.355809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.357540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.358363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.358932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.473272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d02f8e8c-ddec-4213-b439-5fdc5e0ce3a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324" status: 204 len: 0 microversion: 2.1 time: 0.302572 Oct 12 22:50:35.476757 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1868/3636] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:35 2022] DELETE /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:50:35.484373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:35.485141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:35.497933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.498429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.498873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.499581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.500070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.500497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.684706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:35.700882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:35.703371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:35.710393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb1e574b-6ee7-40d1-8c8b-f64500fd07ad tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.234933 Oct 12 22:50:35.711860 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1869/3637] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:35 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:35.731819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:35.734638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:35.744126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.745605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.745605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.746928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:35.747655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:35.748358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:35.828379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:35.890119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:36.006384 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3baf7ef0-da23-4b6b-9426-0e378313f29d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 204 len: 0 microversion: 2.1 time: 0.276691 Oct 12 22:50:36.011079 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1870/3638] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:35 2022] DELETE /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:36.022753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d156bb74-0209-47f2-9a38-d4fa463ef6b4 req-35986f7b-d33c-4a94-9dd8-13ea159f1373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ff794d-fb40-4973-9e43-016499c8b0db", "tag": "4265e58f-4c90-41c1-a759-e0822c795377"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:36.026739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:36.052179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d156bb74-0209-47f2-9a38-d4fa463ef6b4 req-35986f7b-d33c-4a94-9dd8-13ea159f1373 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.053058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d156bb74-0209-47f2-9a38-d4fa463ef6b4 req-35986f7b-d33c-4a94-9dd8-13ea159f1373 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.053997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d156bb74-0209-47f2-9a38-d4fa463ef6b4 req-35986f7b-d33c-4a94-9dd8-13ea159f1373 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.075292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d156bb74-0209-47f2-9a38-d4fa463ef6b4 req-35986f7b-d33c-4a94-9dd8-13ea159f1373 service nova] Creating event network-changed:4265e58f-4c90-41c1-a759-e0822c795377 for instance 80ff794d-fb40-4973-9e43-016499c8b0db on n-h2-860864-8 Oct 12 22:50:36.103624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:36.104994 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d156bb74-0209-47f2-9a38-d4fa463ef6b4 req-35986f7b-d33c-4a94-9dd8-13ea159f1373 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091424 Oct 12 22:50:36.109324 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1871/3639] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:36.120385 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d275bc1c-3a43-489c-bc2a-04fa5aedef73 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.802346 Oct 12 22:50:36.121216 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1769/3640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:35 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:36.122103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:36.123715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:36.127356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:36.132518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.133285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.133576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:36.133719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.134652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.135113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.135543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.145503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.147083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.148151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.152294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.152952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.154268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.242708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.245150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.246491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.250285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lazy-loading 'fault' on Instance uuid 61ecb804-3f67-48cf-b503-4431d0c7b461 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:36.313579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13632157d304b97b43a1bf8a58aaa18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac89fe7811f41848744c84e333c8761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:36.330492 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d85b84c5-f15c-4b44-befe-4569e5a5ab3f tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 200 len: 1367 microversion: 2.1 time: 0.218578 Oct 12 22:50:36.332484 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1872/3641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:36 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:36.352744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:36.353476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:36.373484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.374655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.393403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.397058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.397557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.404190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.674534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:36.826761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:36.861790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:36.872612 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6f9e12c-3575-46e1-98e7-2498534e648e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 0.538517 Oct 12 22:50:36.883917 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1873/3642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:36 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:36.883917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:36.883917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:36.889408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.889408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.889408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.890089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:36.890642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:36.891546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:36.992076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:37.148741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:37.184012 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ced54b59-ac4f-4e61-9b75-843855b3bfe3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324" status: 200 len: 1474 microversion: 2.1 time: 1.053870 Oct 12 22:50:37.200813 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1770/3643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:36 2022] GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 => generated 1474 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:37.458128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-812153936", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "bad1aa77-b8f9-45f6-a395-134b41198997"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:37.576938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:37.579815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] validate_networks() for [('bad1aa77-b8f9-45f6-a395-134b41198997', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:50:37.594235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:37.597199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:37.599570 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6e29a64-86e4-4c45-a359-80d24bac1349 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.724823 Oct 12 22:50:37.617500 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1874/3644] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:36 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:37.628277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:37.634908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:37.646658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:37.647150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:37.647581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:37.648882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:37.649488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:37.650074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.098693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:38.108766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4f7ee10e-9fa6-46c3-a699-17ed544ab0ef tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.491548 Oct 12 22:50:38.110255 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1875/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:37 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:38.116456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:38.119393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] [instance: 61ecb804-3f67-48cf-b503-4431d0c7b461] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:38.131274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.131913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.132506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.134494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.135072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.136271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.158304 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] HTTP exception thrown: Instance 61ecb804-3f67-48cf-b503-4431d0c7b461 could not be found. Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Request method failure captured: Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 HTTP/1.1 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0RqqtawiUv7z211SgXZFL9CbeRQwF02e5KKFmSayrkok2n_sAvkkadv4JoCgOPBBnWCwT2mTqAQuo0fIGbNrvViTyLF0AY31Rag1-GepoLEFYy7EHV5Q_ySjLoWqNoIzaQs-yVTQnqFZS8zKBDGGtMs79R8f7RN0T6C7EHvKTe30Xg Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5ac89fe7811f41848744c84e333c8761 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestManualDisk-1439966259 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ac89fe7811f41848744c84e333c8761"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ac89fe7811f41848744c84e333c8761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ac89fe7811f41848744c84e333c8761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ac89fe7811f41848744c84e333c8761"}]}] Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestManualDisk-1439966259 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5ac89fe7811f41848744c84e333c8761 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestManualDisk-1439966259 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestManualDisk-1439966259-project Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e13632157d304b97b43a1bf8a58aaa18 Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestManualDisk-1439966259-project Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 61ecb804-3f67-48cf-b503-4431d0c7b461 could not be found. Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '61ecb804-3f67-48cf-b503-4431d0c7b461'} Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ecb804-3f67-48cf-b503-4431d0c7b461 could not be found. Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ecb804-3f67-48cf-b503-4431d0c7b461 could not be found. Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:38.160185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ecb804-3f67-48cf-b503-4431d0c7b461 could not be found. Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Returning 404 to user: Instance 61ecb804-3f67-48cf-b503-4431d0c7b461 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e09aab80-d9f5-4c7e-b54d-917399905c56 tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461" status: 404 len: 111 microversion: 2.1 time: 0.050025 Oct 12 22:50:38.164565 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1876/3646] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:38 2022] GET /compute/v2.1/servers/61ecb804-3f67-48cf-b503-4431d0c7b461 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:38.167478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:38.168811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:38.176221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.176711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.177146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.177842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.178288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.178704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.551582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:38.567189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4f6fdd0-f046-419c-bf78-5c0333b65806 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 0.403115 Oct 12 22:50:38.571417 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1877/3647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:38 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:38.580273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cb75de6-260a-4f70-a031-b15bf4c908ca tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] Calling method '.version_select at 0x7f44fec8f940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:38.616710 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cb75de6-260a-4f70-a031-b15bf4c908ca tempest-ServersTestManualDisk-1439966259 tempest-ServersTestManualDisk-1439966259-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657903649" status: 202 len: 0 microversion: 2.1 time: 0.039855 Oct 12 22:50:38.618068 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1878/3648] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 22:50:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657903649 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:50:38.625070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:38.625873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:38.637415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.641650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.647162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.649185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.650511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.652571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.849080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:38.863222 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0fb578b-3347-415f-aea8-7b6efae4f10c tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324" status: 200 len: 1474 microversion: 2.1 time: 0.243532 Oct 12 22:50:38.874009 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1879/3649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:38 2022] GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 => generated 1474 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:38.881459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:38.882080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:38.889390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.889812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.890240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.891234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:38.891869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:38.892496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:38.969469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:38.987463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:38.989399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:38.992017 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a96ee5e2-dbeb-4065-993c-947b4b0746c7 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.116072 Oct 12 22:50:38.992979 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1880/3650] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:38 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:39.132146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-42fa5eb8-eb9c-4dbd-a4a9-fb25604c10e9 req-8ecc4bdd-7d9b-48be-af14-176e15e2a313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd009ac-e125-453d-9b46-6efd41f2e324", "name": "network-vif-unplugged", "status": "completed", "tag": "78b5e6f5-e053-46d0-92f6-2c366f98c8d5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:39.158823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-42fa5eb8-eb9c-4dbd-a4a9-fb25604c10e9 req-8ecc4bdd-7d9b-48be-af14-176e15e2a313 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:39.162170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-42fa5eb8-eb9c-4dbd-a4a9-fb25604c10e9 req-8ecc4bdd-7d9b-48be-af14-176e15e2a313 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:39.164312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-42fa5eb8-eb9c-4dbd-a4a9-fb25604c10e9 req-8ecc4bdd-7d9b-48be-af14-176e15e2a313 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:39.192449 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-42fa5eb8-eb9c-4dbd-a4a9-fb25604c10e9 req-8ecc4bdd-7d9b-48be-af14-176e15e2a313 service nova] Creating event network-vif-unplugged:78b5e6f5-e053-46d0-92f6-2c366f98c8d5 for instance 1fd009ac-e125-453d-9b46-6efd41f2e324 on n-h1-860864-8 Oct 12 22:50:39.198370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-42fa5eb8-eb9c-4dbd-a4a9-fb25604c10e9 req-8ecc4bdd-7d9b-48be-af14-176e15e2a313 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076002 Oct 12 22:50:39.199975 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1881/3651] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:39.208401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:39.209367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:39.215144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:39.217710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:39.218682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:39.219344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:39.221056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:39.221741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:39.222414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:39.420476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:39.433926 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-917ed109-a5ba-4563-90ae-f3cecbbf65cd tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.229027 Oct 12 22:50:39.434603 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1882/3652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:39 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:39.597753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:39.598447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:39.612753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:39.613437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:39.614034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:39.617406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:39.617406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:39.631793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:39.978079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:50:39.978546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:50:39.979064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:50:39.979543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:50:39.980166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:50:40.002016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.003561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.006328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.008695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.009340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.010158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.010735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:40.025728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b307fda-b841-4723-9e43-d85a32d10ae9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 0.434968 Oct 12 22:50:40.027608 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1883/3653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:39 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:40.036953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:40.040844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:40.053946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.055809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.058166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.059334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.063147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.064351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.086369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Getting quotas for project a66be98919db45fea109dafa4ef9e6e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:50:40.099218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Getting quotas for user fc8d4daee8c1405eba6c0cc30772f7ca and project a66be98919db45fea109dafa4ef9e6e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:50:40.155456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:50:40.179167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:50:40.215670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:40.227202 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-20ad9517-c6d9-41a9-b8b7-962d677f7bc7 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324" status: 200 len: 1432 microversion: 2.1 time: 0.198324 Oct 12 22:50:40.227790 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1884/3654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:40 2022] GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 => generated 1432 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:40.267149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:40.269386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:40.281770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.296455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.297203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.299491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.300209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.300796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.307521 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec0876a1-8e33-4d43-892c-2c371078ba2a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.105173 Oct 12 22:50:40.318332 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1771/3655] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:50:40.334718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-34c308c6-417c-4cfe-8d0a-3c743cccdc03 req-a58f6459-224d-4e30-bf23-a2f5d4ea1aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd009ac-e125-453d-9b46-6efd41f2e324", "name": "network-vif-deleted", "tag": "78b5e6f5-e053-46d0-92f6-2c366f98c8d5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:40.394321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-34c308c6-417c-4cfe-8d0a-3c743cccdc03 req-a58f6459-224d-4e30-bf23-a2f5d4ea1aff service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.394821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-34c308c6-417c-4cfe-8d0a-3c743cccdc03 req-a58f6459-224d-4e30-bf23-a2f5d4ea1aff service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.401374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-34c308c6-417c-4cfe-8d0a-3c743cccdc03 req-a58f6459-224d-4e30-bf23-a2f5d4ea1aff service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.488314 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-34c308c6-417c-4cfe-8d0a-3c743cccdc03 req-a58f6459-224d-4e30-bf23-a2f5d4ea1aff service nova] Creating event network-vif-deleted:78b5e6f5-e053-46d0-92f6-2c366f98c8d5 for instance 1fd009ac-e125-453d-9b46-6efd41f2e324 on n-h1-860864-8 Oct 12 22:50:40.499961 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-34c308c6-417c-4cfe-8d0a-3c743cccdc03 req-a58f6459-224d-4e30-bf23-a2f5d4ea1aff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178167 Oct 12 22:50:40.501325 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1772/3656] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:40.507196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c70c93ad-9801-4a6e-8056-69ee82ef30ee tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:40.508173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c70c93ad-9801-4a6e-8056-69ee82ef30ee tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:40.618500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:40.641233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:40.652845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:40.657699 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-964f712b-72ae-4096-8ec8-8c3c75340b51 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.407009 Oct 12 22:50:40.660776 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1885/3657] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:40 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:40.672249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:40.674028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:40.712204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.712834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.713640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:40.714411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:40.716123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:40.717802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.053270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:41.062113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40276bab-c1f4-4cdc-bc89-960942739042 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.400038 Oct 12 22:50:41.062702 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1886/3658] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:40 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:41.069061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:41.069679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:41.076038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.076535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.076970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.096454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.097339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.097946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.397000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c70c93ad-9801-4a6e-8056-69ee82ef30ee tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:41.410119 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c70c93ad-9801-4a6e-8056-69ee82ef30ee tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1214 microversion: 2.1 time: 0.907293 Oct 12 22:50:41.410725 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1773/3659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:40 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1214 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:41.424430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c698f73f-a3c2-4da3-80f4-9c6c1eec2909 req-db312f6b-1785-4a7c-9c67-84000c7dbce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ff794d-fb40-4973-9e43-016499c8b0db", "name": "network-vif-plugged", "status": "completed", "tag": "4265e58f-4c90-41c1-a759-e0822c795377"}, {"server_uuid": "733fab40-dabb-4977-a8b7-0ff7ee75fea3", "name": "network-vif-unplugged", "status": "completed", "tag": "cfb7ba63-28a6-46cf-a11e-869d5c685f36"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:41.450776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c698f73f-a3c2-4da3-80f4-9c6c1eec2909 req-db312f6b-1785-4a7c-9c67-84000c7dbce0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.451524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c698f73f-a3c2-4da3-80f4-9c6c1eec2909 req-db312f6b-1785-4a7c-9c67-84000c7dbce0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.452145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c698f73f-a3c2-4da3-80f4-9c6c1eec2909 req-db312f6b-1785-4a7c-9c67-84000c7dbce0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.480416 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c698f73f-a3c2-4da3-80f4-9c6c1eec2909 req-db312f6b-1785-4a7c-9c67-84000c7dbce0 service nova] Creating event network-vif-plugged:4265e58f-4c90-41c1-a759-e0822c795377 for instance 80ff794d-fb40-4973-9e43-016499c8b0db on n-h2-860864-8 Oct 12 22:50:41.480928 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c698f73f-a3c2-4da3-80f4-9c6c1eec2909 req-db312f6b-1785-4a7c-9c67-84000c7dbce0 service nova] Creating event network-vif-unplugged:cfb7ba63-28a6-46cf-a11e-869d5c685f36 for instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 on n-h2-860864-8 Oct 12 22:50:41.498102 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c698f73f-a3c2-4da3-80f4-9c6c1eec2909 req-db312f6b-1785-4a7c-9c67-84000c7dbce0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.086119 Oct 12 22:50:41.501658 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1774/3660] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:41.520034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:41.520999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 1fd009ac-e125-453d-9b46-6efd41f2e324] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:41.528770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.534373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.535007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.535943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.536545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.537117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.572350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance 1fd009ac-e125-453d-9b46-6efd41f2e324 could not be found. Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 HTTP/1.1 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 1fd009ac-e125-453d-9b46-6efd41f2e324 could not be found. Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '1fd009ac-e125-453d-9b46-6efd41f2e324'} Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd009ac-e125-453d-9b46-6efd41f2e324 could not be found. Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd009ac-e125-453d-9b46-6efd41f2e324 could not be found. Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:41.575135 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:41.579294 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:41.579294 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:41.579294 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:41.579294 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:41.579294 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:41.579294 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd009ac-e125-453d-9b46-6efd41f2e324 could not be found. Oct 12 22:50:41.579294 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:41.580959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance 1fd009ac-e125-453d-9b46-6efd41f2e324 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:41.584016 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-42936082-1cd5-4523-97e9-b8872c4af0d1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324" status: 404 len: 111 microversion: 2.1 time: 0.079972 Oct 12 22:50:41.585649 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1775/3661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:41 2022] GET /compute/v2.1/servers/1fd009ac-e125-453d-9b46-6efd41f2e324 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:41.589948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:41.602485 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e44c19ea-ae43-46e8-8ea9-10a2a38e5fcb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 0.537288 Oct 12 22:50:41.623628 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1887/3662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:41 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:41.627677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:41.630389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:41.637827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.638508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.639229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.640206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.640822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.641437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.693477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:41.694484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:41.710838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.712144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.713920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.716091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:41.717262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:41.718589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:41.966830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:41.995584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:41.999174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:42.004696 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b3125f0-712b-4a1c-9c72-784013391985 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.317399 Oct 12 22:50:42.006407 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1888/3663] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:41 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:42.091511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:42.092224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:42.108976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:42.109477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:42.113267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:42.114129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:42.118716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:42.119181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:42.141057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:42.711425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:42.726618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8bcbc059-d469-4f56-9f7e-df252ee37d5e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 200 len: 1432 microversion: 2.1 time: 1.124589 Oct 12 22:50:42.727939 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1776/3664] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:41 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 1432 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:42.736593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:42.738035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:42.749655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:42.750532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:42.753557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:42.755772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:42.756612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:42.757454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:42.946198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:42.962702 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34a15d63-abf4-48a6-9918-8c1a64ece921 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1272 microversion: 2.1 time: 0.232633 Oct 12 22:50:42.965740 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1777/3665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:42 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:42.973658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-022c3ce2-cd1d-473c-a2d8-517ee8af300a req-b64ebd41-5a06-4859-abe9-4323cb0754c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52aab5d-b3c8-4fe6-ba03-419b8e660bd4", "tag": "7a2c0921-5dfc-4ff1-b503-d90e9fb18604"}, {"server_uuid": "733fab40-dabb-4977-a8b7-0ff7ee75fea3", "name": "network-vif-deleted", "tag": "cfb7ba63-28a6-46cf-a11e-869d5c685f36"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:42.991522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-022c3ce2-cd1d-473c-a2d8-517ee8af300a req-b64ebd41-5a06-4859-abe9-4323cb0754c8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:42.992456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-022c3ce2-cd1d-473c-a2d8-517ee8af300a req-b64ebd41-5a06-4859-abe9-4323cb0754c8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:42.993095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-022c3ce2-cd1d-473c-a2d8-517ee8af300a req-b64ebd41-5a06-4859-abe9-4323cb0754c8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.012410 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-022c3ce2-cd1d-473c-a2d8-517ee8af300a req-b64ebd41-5a06-4859-abe9-4323cb0754c8 service nova] Creating event network-changed:7a2c0921-5dfc-4ff1-b503-d90e9fb18604 for instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 on n-h2-860864-8 Oct 12 22:50:43.013464 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-022c3ce2-cd1d-473c-a2d8-517ee8af300a req-b64ebd41-5a06-4859-abe9-4323cb0754c8 service nova] Creating event network-vif-deleted:cfb7ba63-28a6-46cf-a11e-869d5c685f36 for instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 on n-h2-860864-8 Oct 12 22:50:43.039313 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-022c3ce2-cd1d-473c-a2d8-517ee8af300a req-b64ebd41-5a06-4859-abe9-4323cb0754c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071267 Oct 12 22:50:43.040435 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1778/3666] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:43.046683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.047538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:43.055476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.056225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.057189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.058440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.059070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.059818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.129500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:43.141102 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e07bc1f6-52f7-46a9-992f-1699aa3efcb8 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 1.054173 Oct 12 22:50:43.151094 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1889/3667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:42 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:43.158230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.159158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:43.173781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.174592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.177026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.180478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.181206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.188622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.334733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:43.345786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:43.347868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:43.349257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93365f35-2f68-4fa4-92b7-6448a6a8fb77 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.195836 Oct 12 22:50:43.350350 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1890/3668] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:43 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:43.451755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:43.454887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:43.467152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8449b22b-95c3-4cfb-bb1a-7f2b0241bef3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1314 microversion: 2.1 time: 0.424002 Oct 12 22:50:43.468470 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1779/3669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:43 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:43.751134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.751667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 733fab40-dabb-4977-a8b7-0ff7ee75fea3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:43.764060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.764834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.767441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.768398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.769079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.771267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.791481 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 could not be found. Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 HTTP/1.1 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 could not be found. Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '733fab40-dabb-4977-a8b7-0ff7ee75fea3'} Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 could not be found. Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 could not be found. Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:43.793487 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:43.798255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:43.798255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:43.798255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:43.798255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:43.798255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:43.798255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 could not be found. Oct 12 22:50:43.798255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:43.799438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance 733fab40-dabb-4977-a8b7-0ff7ee75fea3 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:43.800554 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-df4de9ad-bd77-4073-b0e2-c67a6fe3f332 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3" status: 404 len: 111 microversion: 2.1 time: 0.053986 Oct 12 22:50:43.809643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2dc4845-2dc9-412b-81fe-63a8d8ef8591 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.816000 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1891/3670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:43 2022] GET /compute/v2.1/servers/733fab40-dabb-4977-a8b7-0ff7ee75fea3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:43.841995 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2dc4845-2dc9-412b-81fe-63a8d8ef8591 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/9980a58a-9df8-4633-acee-db5158b1c9c8" status: 204 len: 0 microversion: 2.1 time: 0.036276 Oct 12 22:50:43.853018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.853833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:43.859335 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1780/3671] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:50:43 2022] DELETE /compute/v2.1/os-server-groups/9980a58a-9df8-4633-acee-db5158b1c9c8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:50:43.864283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.865124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.865773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.867101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:43.867713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:43.868359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:43.901298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:43.989720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:43.990831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:43.999263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.000143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.002016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.002985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.003642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.004245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.038329 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-433381b7-670b-4237-8a34-86228c0856e1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 204 len: 0 microversion: 2.1 time: 0.186209 Oct 12 22:50:44.043071 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1892/3672] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:43 2022] DELETE /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:50:44.051000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:44.051795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:44.058847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.060177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.060734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.061575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.062150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.062826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.098544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:44.249290 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b6c9cdc-5d08-47ef-a8eb-290acadf222d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 204 len: 0 microversion: 2.1 time: 0.201653 Oct 12 22:50:44.253427 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1893/3673] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:44 2022] DELETE /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:50:44.264778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:44.265791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:44.273611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.274531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.275693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.276589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.277197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.277775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.303197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:44.314656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f578b63a-17f9-4e84-b277-a7b71f970e97 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1314 microversion: 2.1 time: 0.330655 Oct 12 22:50:44.315572 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1781/3674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:43 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:44.325976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:44.326656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:44.340501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.341276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.341872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.342854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.343461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.344071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.638240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:44.646331 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d90337da-8a23-417c-8f9d-ea991adb9c4d tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 200 len: 1473 microversion: 2.1 time: 0.329665 Oct 12 22:50:44.660611 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1782/3675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:44 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:44.668227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:44.669008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:44.674175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:44.687389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.688805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.690079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.691377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.692124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.692762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.693102 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4308534-56dc-455d-8526-acf986631295 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.436440 Oct 12 22:50:44.693710 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1894/3676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:44 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:44.698247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:44.698860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:44.714376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.714376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.714675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.715928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:44.715928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:44.718068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:44.886806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:44.902879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:44.911000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:44.912522 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7a9087e-5966-4dbb-86d6-66fdcdd3ce7d tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1603 microversion: 2.42 time: 0.251139 Oct 12 22:50:44.913479 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1783/3677] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:44 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1603 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:45.340033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:45.340934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:45.359700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.363091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.364712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.379079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.383257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.386961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.623301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:45.631987 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27d1885b-00f0-47ca-beee-d255c4bb84bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1314 microversion: 2.1 time: 0.296923 Oct 12 22:50:45.632561 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1784/3678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:45 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:45.637526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8d490630-3bea-4ae5-ab79-48c2a03fae92 req-e4200c98-09a6-480f-8693-927c9302f5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33826208-9404-48e6-808a-2b048f6f33ca", "tag": "b5315992-ff06-4847-a5a2-cb25371e147d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:45.649188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d490630-3bea-4ae5-ab79-48c2a03fae92 req-e4200c98-09a6-480f-8693-927c9302f5ac service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.649658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d490630-3bea-4ae5-ab79-48c2a03fae92 req-e4200c98-09a6-480f-8693-927c9302f5ac service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.650223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d490630-3bea-4ae5-ab79-48c2a03fae92 req-e4200c98-09a6-480f-8693-927c9302f5ac service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.651223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:45.667437 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8d490630-3bea-4ae5-ab79-48c2a03fae92 req-e4200c98-09a6-480f-8693-927c9302f5ac service nova] Creating event network-changed:b5315992-ff06-4847-a5a2-cb25371e147d for instance 33826208-9404-48e6-808a-2b048f6f33ca on n-h1-860864-8 Oct 12 22:50:45.672552 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b12fabce-c7a7-4f82-ae92-24739e8cbf1b tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1501 microversion: 2.1 time: 0.977743 Oct 12 22:50:45.673438 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8d490630-3bea-4ae5-ab79-48c2a03fae92 req-e4200c98-09a6-480f-8693-927c9302f5ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039425 Oct 12 22:50:45.674395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1785/3679] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:45.680309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:45.681518 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1895/3680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:44 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1501 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:45.703387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:45.712095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0858f916-0cb7-4c88-ae91-ea41964d99ef tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:45.713716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.714251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.714685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.715438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.716432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.716861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.724679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0858f916-0cb7-4c88-ae91-ea41964d99ef tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.725269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0858f916-0cb7-4c88-ae91-ea41964d99ef tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.728783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0858f916-0cb7-4c88-ae91-ea41964d99ef tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.793471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0858f916-0cb7-4c88-ae91-ea41964d99ef tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:50:45.883252 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0858f916-0cb7-4c88-ae91-ea41964d99ef tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db/action" status: 202 len: 0 microversion: 2.1 time: 0.175840 Oct 12 22:50:45.884815 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1896/3681] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:50:45 2022] POST /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:50:45.892906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:45.893827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:45.913752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.918753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.919215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:45.920955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:45.921748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:45.922398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.058795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:46.068854 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ef98336-5cb8-48a2-b3c3-3b9ec62a65b8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 200 len: 1473 microversion: 2.1 time: 0.392622 Oct 12 22:50:46.070915 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1786/3682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:45 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 1473 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:46.075809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:46.076735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:46.092565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.092913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.093609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.094622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.095906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.096849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.583194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:46.592420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b96e6ba-1fe7-46e1-aff4-1ca224411124 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.520141 Oct 12 22:50:46.593014 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1787/3683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:46 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:46.604263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:46.618582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2ddb94c7-2281-4e80-a45b-ed013426feda tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.732064 Oct 12 22:50:46.620419 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1897/3684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:45 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:46.627879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:46.628394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:46.644676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.645179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.645626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.646340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.646795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.647223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.658791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:46.659572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:46.674460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.674973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.677159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.679831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.680929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.682927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.694033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:46.705141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:46.724975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:46.726863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lazy-loading 'fault' on Instance uuid 337ba34e-9f41-4a02-b6cf-1be43c118524 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:47.099131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:47.107638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:47.118523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f0b7c499c1d4dd894483b19308e0439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c2331d1e204eea916beba9eec9acf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:47.120087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f17cf61-8f83-4580-8862-ff796fdde080 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 200 len: 1370 microversion: 2.42 time: 0.526074 Oct 12 22:50:47.120877 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1788/3685] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:46 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 1370 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:50:47.131837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:47.132751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:47.144313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:47.145104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:47.152701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:47.154007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:47.154639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:47.155227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:47.428617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:47.439272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3475cbdb-d0b9-4caa-88d2-8b7f4e930ff7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1314 microversion: 2.1 time: 0.786424 Oct 12 22:50:47.468817 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1898/3686] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:46 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:47.617078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:47.618064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:47.624575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:47.625410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:47.626747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:47.627681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:47.628408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:47.629048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.114983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:48.160441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:48.184777 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a573b274-9b36-46a5-903c-85e2106eaee8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 200 len: 1473 microversion: 2.1 time: 1.056157 Oct 12 22:50:48.197755 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b6c55e33-63bf-47ad-99fc-8e00f6dbde88 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.571898 Oct 12 22:50:48.200880 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1789/3687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:47 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 1473 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:48.202487 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1899/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:47 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:48.212452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:48.218092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:48.218727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:48.220598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:48.240083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.240573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.240730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.241031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.241738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.243938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.244620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.245207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.248079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.252706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.253202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.253652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.301794 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] HTTP exception thrown: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Request method failure captured: Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 HTTP/1.1 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0MJzIP1nhFxwR9f2p1-uFiz9iQeLMVxUvLiHpIQgMpJSIxhM9OgWiQAejsxzi0dQQbebTWUu8XvZL0OjL0OLPBR5BRwdWyvzRvCaCv_3wSzUwORfrlpm4dMdKGzjsl0em-Vq-BmoJf5w_Yfaf31IsBZzehzHZ3Hl-yneNho34evqGs Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 81c2331d1e204eea916beba9eec9acf1 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81c2331d1e204eea916beba9eec9acf1"}]}] Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 81c2331d1e204eea916beba9eec9acf1 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TaggedBootDevicesTest_v242-2026638053-project Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4f0b7c499c1d4dd894483b19308e0439 Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2026638053-project Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '337ba34e-9f41-4a02-b6cf-1be43c118524'} Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:48.304441 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:48.311804 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:48.315388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Returning 404 to user: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:48.317519 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c7ede33-d9f9-445e-82b7-62684cc1abbe tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 404 len: 111 microversion: 2.42 time: 0.113172 Oct 12 22:50:48.318671 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1900/3689] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:48 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:50:48.326994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b83e7d71-7ca8-4867-af8a-741faf5c962a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '.version_select at 0x7f44ff47e700>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:48.401922 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b83e7d71-7ca8-4867-af8a-741faf5c962a tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249118699" status: 204 len: 0 microversion: 2.42 time: 0.078713 Oct 12 22:50:48.402740 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1901/3690] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Oct 12 22:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249118699 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:50:48.463545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-237f592c-a2ae-4108-9726-39edf7c9b9b5 req-57e0a4bb-7382-4b50-a54d-5fd19cbef570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52aab5d-b3c8-4fe6-ba03-419b8e660bd4", "name": "network-vif-plugged", "status": "completed", "tag": "7a2c0921-5dfc-4ff1-b503-d90e9fb18604"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:48.476988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-237f592c-a2ae-4108-9726-39edf7c9b9b5 req-57e0a4bb-7382-4b50-a54d-5fd19cbef570 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.477469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-237f592c-a2ae-4108-9726-39edf7c9b9b5 req-57e0a4bb-7382-4b50-a54d-5fd19cbef570 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.484423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-237f592c-a2ae-4108-9726-39edf7c9b9b5 req-57e0a4bb-7382-4b50-a54d-5fd19cbef570 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.514607 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-237f592c-a2ae-4108-9726-39edf7c9b9b5 req-57e0a4bb-7382-4b50-a54d-5fd19cbef570 service nova] Creating event network-vif-plugged:7a2c0921-5dfc-4ff1-b503-d90e9fb18604 for instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 on n-h2-860864-8 Oct 12 22:50:48.537443 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-237f592c-a2ae-4108-9726-39edf7c9b9b5 req-57e0a4bb-7382-4b50-a54d-5fd19cbef570 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076677 Oct 12 22:50:48.539783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1902/3691] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:50:48.582203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:48.582936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:48.603708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.604245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.607608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.608705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:48.611250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:48.612052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:48.760906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:48.769843 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d02aa90-0565-4ace-93bc-5d1eb5f19a6c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.567771 Oct 12 22:50:48.771087 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1790/3692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:48 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:49.227982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-55f6c878-3285-48ae-9f4b-92a4851f85a2 req-35280661-c073-4b18-ad63-f4e52024de33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03760a13-75c4-44cb-b498-ff14a833463c", "name": "network-vif-deleted", "tag": "10c74ac6-c97c-432c-b9af-48879266484f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:49.248306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55f6c878-3285-48ae-9f4b-92a4851f85a2 req-35280661-c073-4b18-ad63-f4e52024de33 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.260858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55f6c878-3285-48ae-9f4b-92a4851f85a2 req-35280661-c073-4b18-ad63-f4e52024de33 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.261619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55f6c878-3285-48ae-9f4b-92a4851f85a2 req-35280661-c073-4b18-ad63-f4e52024de33 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.274933 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-55f6c878-3285-48ae-9f4b-92a4851f85a2 req-35280661-c073-4b18-ad63-f4e52024de33 service nova] Creating event network-vif-deleted:10c74ac6-c97c-432c-b9af-48879266484f for instance 03760a13-75c4-44cb-b498-ff14a833463c on n-h2-860864-8 Oct 12 22:50:49.293864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-55f6c878-3285-48ae-9f4b-92a4851f85a2 req-35280661-c073-4b18-ad63-f4e52024de33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069678 Oct 12 22:50:49.295123 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1791/3693] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:50:49.301337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:49.302373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:49.319186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.320010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.320669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.321607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.322258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.322959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.465562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:49.482531 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8604cacf-0f48-4530-8c5e-18b96f2d47a8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 200 len: 1431 microversion: 2.1 time: 0.185782 Oct 12 22:50:49.483119 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1792/3694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:49 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 1431 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:49.497075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:49.498092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:49.527769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.528607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.529060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.529790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.530240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.530747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.861782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:49.882431 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-652b1145-315f-4788-bb0d-bf1cfec2c871 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.394361 Oct 12 22:50:49.902973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1793/3695] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:49 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:49.905111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:49.912403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7efa1e60-e150-4098-acbb-fd1fe4e6c902 req-cb33cc6d-48d8-4019-8506-6a6ca9b189a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dff7c05-b126-48d1-ada6-35441f8fb917", "name": "network-vif-deleted", "tag": "038f3805-a57c-4c92-a9a3-1749c35b07e5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:49.921481 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4c6df31-c670-4506-8dd3-23a5397353b2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1314 microversion: 2.1 time: 1.362937 Oct 12 22:50:49.922122 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1903/3696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:48 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1314 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:49.928708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7efa1e60-e150-4098-acbb-fd1fe4e6c902 req-cb33cc6d-48d8-4019-8506-6a6ca9b189a0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.929510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7efa1e60-e150-4098-acbb-fd1fe4e6c902 req-cb33cc6d-48d8-4019-8506-6a6ca9b189a0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.930170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7efa1e60-e150-4098-acbb-fd1fe4e6c902 req-cb33cc6d-48d8-4019-8506-6a6ca9b189a0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.938870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:49.939513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:49.944075 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7efa1e60-e150-4098-acbb-fd1fe4e6c902 req-cb33cc6d-48d8-4019-8506-6a6ca9b189a0 service nova] Creating event network-vif-deleted:038f3805-a57c-4c92-a9a3-1749c35b07e5 for instance 4dff7c05-b126-48d1-ada6-35441f8fb917 on n-h2-860864-8 Oct 12 22:50:49.951760 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7efa1e60-e150-4098-acbb-fd1fe4e6c902 req-cb33cc6d-48d8-4019-8506-6a6ca9b189a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046308 Oct 12 22:50:49.953307 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1794/3697] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:49.956635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.959156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.959634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:49.960999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:49.961658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:49.962361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.003052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:50.539673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:50.541917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:50.560426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:50.604489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.605034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.608857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.612113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.613632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.615721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.688822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.689361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.689849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.690506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lazy-loading 'fault' on Instance uuid 4dff7c05-b126-48d1-ada6-35441f8fb917 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:50.696368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:50.705126 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3a5362b-d073-488c-81f7-ab282a75fa6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1313 microversion: 2.1 time: 0.781351 Oct 12 22:50:50.705708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1904/3698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:49 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:50.907644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:50.909131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:50.918533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.919155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.922266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:50.923364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:50.924144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:50.924808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:51.041156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:51.055653 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-14b3734a-a6d9-4095-b7c6-f57e4993120a tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 200 len: 1308 microversion: 2.1 time: 0.543105 Oct 12 22:50:51.060875 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1795/3699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:50 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 1308 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:51.066754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:51.071067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:51.091054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:51.091878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:51.093302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:51.094304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:51.095089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:51.095677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:51.401092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:51.535537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:51.544835 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4993ec25-a576-48b2-ae2c-0adf6f4f2868 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.641275 Oct 12 22:50:51.546180 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1905/3700] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:50 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:51.730651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:51.731561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:51.741428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:51.742311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:51.743352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:51.744928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:51.746228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:51.748566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:51.851282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:51.860715 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d9e5f73-ee3e-4e56-817e-9bede453565f tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1314 microversion: 2.1 time: 0.797935 Oct 12 22:50:51.867790 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1796/3701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:51 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:52.081702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:52.082467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 4dff7c05-b126-48d1-ada6-35441f8fb917] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:52.095797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.096430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.096980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.097794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.100463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.103420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.124490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:52.132866 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-520a62b2-a70f-4051-817f-21f2c6d1e1d0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1497 microversion: 2.1 time: 0.406101 Oct 12 22:50:52.133369 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance 4dff7c05-b126-48d1-ada6-35441f8fb917 could not be found. Oct 12 22:50:52.133517 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1906/3702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:51 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1497 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 HTTP/1.1 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 4dff7c05-b126-48d1-ada6-35441f8fb917 could not be found. Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '4dff7c05-b126-48d1-ada6-35441f8fb917'} Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dff7c05-b126-48d1-ada6-35441f8fb917 could not be found. Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dff7c05-b126-48d1-ada6-35441f8fb917 could not be found. Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:52.138380 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.145309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:52.145309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:52.145309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:52.145309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:52.145309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:52.145309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dff7c05-b126-48d1-ada6-35441f8fb917 could not be found. Oct 12 22:50:52.145309 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.147485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance 4dff7c05-b126-48d1-ada6-35441f8fb917 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:52.148802 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be25cfc8-9365-4de2-8937-757b3efefe95 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917" status: 404 len: 111 microversion: 2.1 time: 0.071786 Oct 12 22:50:52.160533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:52.161373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: 03760a13-75c4-44cb-b498-ff14a833463c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:52.171345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.172069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.172723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.173589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.175832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.176540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.181525 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1797/3703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:52 2022] GET /compute/v2.1/servers/4dff7c05-b126-48d1-ada6-35441f8fb917 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:50:52.213494 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance 03760a13-75c4-44cb-b498-ff14a833463c could not be found. Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c HTTP/1.1 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 03760a13-75c4-44cb-b498-ff14a833463c could not be found. Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '03760a13-75c4-44cb-b498-ff14a833463c'} Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03760a13-75c4-44cb-b498-ff14a833463c could not be found. Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03760a13-75c4-44cb-b498-ff14a833463c could not be found. Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:52.220638 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.225318 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:52.225318 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:52.225318 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:52.225318 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:52.225318 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:52.225318 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03760a13-75c4-44cb-b498-ff14a833463c could not be found. Oct 12 22:50:52.225318 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:52.227786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance 03760a13-75c4-44cb-b498-ff14a833463c could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:52.230115 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db616325-0872-4ce6-888c-c8081bd237b1 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c" status: 404 len: 111 microversion: 2.1 time: 0.074146 Oct 12 22:50:52.232923 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1907/3704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:52 2022] GET /compute/v2.1/servers/03760a13-75c4-44cb-b498-ff14a833463c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:50:52.241190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53fd1371-5be4-40fc-b495-ece128e479fc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:52.273978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:52.298475 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53fd1371-5be4-40fc-b495-ece128e479fc tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/112a4117-b377-4c0c-a5b1-88551154bd46" status: 204 len: 0 microversion: 2.1 time: 0.061509 Oct 12 22:50:52.299675 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1798/3705] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:50:52 2022] DELETE /compute/v2.1/os-server-groups/112a4117-b377-4c0c-a5b1-88551154bd46 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:52.308154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:52.308885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:52.319580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.322553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.323087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.324429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.325081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.325713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.373255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:52.573571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:52.573571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:52.595582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9645d087-1827-4e5d-9ccf-75f37f39798e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 204 len: 0 microversion: 2.1 time: 0.291719 Oct 12 22:50:52.596308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.598200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.601268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.601982 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1908/3706] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:52 2022] DELETE /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:50:52.603757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.605056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.607447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.647729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:52.654247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:52.683449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.686055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.688517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.691276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:52.691947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:52.692568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:52.970888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:52.988327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6bec30dc-dfdc-475a-ab02-7e4150216995 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.422434 Oct 12 22:50:52.989114 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1799/3707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:52 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:53.010886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:53.011525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:53.026228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:53.026723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:53.027170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:53.027916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:53.028647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:53.029280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:53.081852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:53.725037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:53.734334 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-15f2e6dd-cc21-4bef-a409-276285808cf8 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1471 microversion: 2.1 time: 1.126972 Oct 12 22:50:53.735648 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1909/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:52 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1471 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:53.742517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:53.743312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:53.754797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:53.755871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:53.756563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:53.757819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:53.759785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:53.760869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:53.802206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:50:53.823868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:53.836528 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00146342-1176-402a-9464-f0e2718a17bc tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1314 microversion: 2.1 time: 0.841311 Oct 12 22:50:53.837162 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1800/3709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:52 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:53.987185 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54aa6cda-05df-44cd-846b-aa18896fcc6d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 204 len: 0 microversion: 2.1 time: 0.249271 Oct 12 22:50:53.990941 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1910/3710] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:50:53 2022] DELETE /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:50:53.996512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:53.998746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:54.010406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.010903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.011348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.012097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.012560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.012995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.018145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:54.019270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:54.034116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.034853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.035458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.036196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.036650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.037072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.336302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:54.395214 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-378af87a-008f-4d9d-8b84-430241fb2f11 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1503 microversion: 2.1 time: 0.402795 Oct 12 22:50:54.396311 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1801/3711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:53 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:54.403087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1a819a74-46d6-420f-b95c-bb4573aedca5 req-14279040-e038-4555-9377-3e92197e44ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33826208-9404-48e6-808a-2b048f6f33ca", "name": "network-vif-plugged", "status": "completed", "tag": "b5315992-ff06-4847-a5a2-cb25371e147d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:54.425113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1a819a74-46d6-420f-b95c-bb4573aedca5 req-14279040-e038-4555-9377-3e92197e44ba service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.425599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1a819a74-46d6-420f-b95c-bb4573aedca5 req-14279040-e038-4555-9377-3e92197e44ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.426030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1a819a74-46d6-420f-b95c-bb4573aedca5 req-14279040-e038-4555-9377-3e92197e44ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.444358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:54.454386 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-305512b9-3d78-48e7-bb5d-21dccc504ecd tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.442660 Oct 12 22:50:54.462239 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1a819a74-46d6-420f-b95c-bb4573aedca5 req-14279040-e038-4555-9377-3e92197e44ba service nova] Creating event network-vif-plugged:b5315992-ff06-4847-a5a2-cb25371e147d for instance 33826208-9404-48e6-808a-2b048f6f33ca on n-h1-860864-8 Oct 12 22:50:54.463569 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1911/3712] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:54 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:54.475408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1a819a74-46d6-420f-b95c-bb4573aedca5 req-14279040-e038-4555-9377-3e92197e44ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078288 Oct 12 22:50:54.476155 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1802/3713] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:54.767693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:54.768457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:54.781981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.782486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.785065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.785852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.787537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.790365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.860296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:54.861011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:54.878112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.878621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.879070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:54.879792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:54.880276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:54.880706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:55.318842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:55.327011 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe52a5ce-2ae4-40b6-b076-a68e89ff60d3 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1471 microversion: 2.1 time: 0.565759 Oct 12 22:50:55.331435 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1912/3714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:54 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1471 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:55.423144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:55.423999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:55.438761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:55.440338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:55.445448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:55.446500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:55.447441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:55.448068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:55.591993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:55.604938 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-117fe8a4-4e52-4efa-9b10-4cc9b2854232 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1314 microversion: 2.1 time: 0.749380 Oct 12 22:50:55.614698 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1803/3715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:54 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:55.627371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:55.628031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:55.641953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:55.642677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:55.643282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:55.645680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:55.647007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:55.647617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:55.945250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:55.958691 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2b7e745-0600-4e84-a381-1d280394a749 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1503 microversion: 2.1 time: 0.539736 Oct 12 22:50:55.971659 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1913/3716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:55 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:56.137526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:56.146625 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99aae938-62c5-4041-8532-2610bb62f854 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.528438 Oct 12 22:50:56.147216 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1804/3717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:55 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:56.354455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:56.356067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:56.376391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:56.377494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:56.379616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:56.384400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:56.385213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:56.387938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:56.642976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:56.643619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:56.656297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:56.656849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:56.657305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:56.658034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:56.658665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:56.659275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:57.000778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:57.012155 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-29ab8f10-af1b-416c-92f3-39a1ca72688e tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1471 microversion: 2.1 time: 0.663749 Oct 12 22:50:57.014055 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1914/3718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:56 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1471 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:57.029197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:57.029907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:57.037053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:57.037828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:57.038847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:57.039736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:57.040591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:57.041185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:57.201113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:57.216946 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec4c0837-ec8b-4cfe-984b-e21a8e5a68b3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1500 microversion: 2.1 time: 0.576372 Oct 12 22:50:57.241742 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1805/3719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:56 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1500 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:57.259643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:57.260443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:57.269838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:57.271579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:57.272078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:57.272817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:57.276223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:57.276693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:57.968346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:57.989455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c0d14400-d913-4a36-9bb8-f2659525f58f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1503 microversion: 2.1 time: 0.969034 Oct 12 22:50:57.989455 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1915/3720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:57 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1503 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:57.993896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:57.994666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.005525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.006154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.006454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.007167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.007681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.008378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.130856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:58.150265 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ad82b312-347c-4ced-a7e8-8aadbd44c901 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.907335 Oct 12 22:50:58.160156 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1806/3721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:57 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:58.168318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:58.168814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.179702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.180234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.180680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.181445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.183130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.183571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.317002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695c23f6a65d47168088cc346c99b8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115ba104dfa745dd9fa95a23fbd90474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:58.330039 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cecefe47-0fbb-4cfe-b76d-2f0fe4266baf tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 200 len: 1429 microversion: 2.1 time: 0.171414 Oct 12 22:50:58.330782 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1807/3722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:58 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:58.342302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b1608322-1bad-474c-af71-5d498c20879d req-e9c20e10-194c-456e-bb32-b465f878c633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b422b505-f575-4ff4-af58-1d9eeec9c2c2", "name": "network-vif-deleted", "tag": "abc46808-34fa-4625-9480-25b69b824c88"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:58.355220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1608322-1bad-474c-af71-5d498c20879d req-e9c20e10-194c-456e-bb32-b465f878c633 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.356227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1608322-1bad-474c-af71-5d498c20879d req-e9c20e10-194c-456e-bb32-b465f878c633 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.357121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1608322-1bad-474c-af71-5d498c20879d req-e9c20e10-194c-456e-bb32-b465f878c633 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.372064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b1608322-1bad-474c-af71-5d498c20879d req-e9c20e10-194c-456e-bb32-b465f878c633 service nova] Creating event network-vif-deleted:abc46808-34fa-4625-9480-25b69b824c88 for instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 on n-h2-860864-8 Oct 12 22:50:58.381669 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b1608322-1bad-474c-af71-5d498c20879d req-e9c20e10-194c-456e-bb32-b465f878c633 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049683 Oct 12 22:50:58.382977 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1808/3723] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:50:58.446311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:58.457018 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ae1833a5-85ac-4089-a251-2563e2a1fa62 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1500 microversion: 2.1 time: 0.468353 Oct 12 22:50:58.472260 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1916/3724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:57 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1500 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:58.482149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:50:58.483202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.496012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.501838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.502630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.504050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.505015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.505824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.542881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lazy-loading 'flavor' on Instance uuid 33826208-9404-48e6-808a-2b048f6f33ca {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:58.659099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:58.659614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.674473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.675168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.675782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.676668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.677722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.678649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.712708 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] HTTP exception thrown: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Request method failure captured: Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 HTTP/1.1 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0MJzIP1nhFxwR9f2p1-uFiz9iQeLMVxUvLiHpIQgMpJSIxhM9OgWiQAejsxzi0dQQbebTWUu8XvZL0OjL0OLPBR5BRwdWyvzRvCaCv_3wSzUwORfrlpm4dMdKGzjsl0em-Vq-BmoJf5w_Yfaf31IsBZzehzHZ3Hl-yneNho34evqGs Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 81c2331d1e204eea916beba9eec9acf1 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81c2331d1e204eea916beba9eec9acf1"}]}] Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 81c2331d1e204eea916beba9eec9acf1 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TaggedBootDevicesTest_v242-2026638053-project Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4f0b7c499c1d4dd894483b19308e0439 Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2026638053-project Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '337ba34e-9f41-4a02-b6cf-1be43c118524'} Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:58.716457 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.721859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Returning 404 to user: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:58.722761 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5168b76d-0103-4f88-81c8-15c14f651984 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "DELETE /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 404 len: 111 microversion: 2.42 time: 0.068142 Oct 12 22:50:58.723417 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1917/3725] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:50:58 2022] DELETE /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:50:58.735755 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-952149b7-99a9-4a9f-abf5-a5132803f9e2 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action" status: 202 len: 0 microversion: 2.1 time: 0.257847 Oct 12 22:50:58.738385 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1809/3726] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:50:58 2022] POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:50:58.742079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:58.748118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] [instance: 337ba34e-9f41-4a02-b6cf-1be43c118524] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.754252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:58.756755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:58.764942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.768195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.768901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.770905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.772964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.774763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.780371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.782018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.784572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.785414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:58.786906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:58.787568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:58.809544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] HTTP exception thrown: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Request method failure captured: Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 HTTP/1.1 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0MJzIP1nhFxwR9f2p1-uFiz9iQeLMVxUvLiHpIQgMpJSIxhM9OgWiQAejsxzi0dQQbebTWUu8XvZL0OjL0OLPBR5BRwdWyvzRvCaCv_3wSzUwORfrlpm4dMdKGzjsl0em-Vq-BmoJf5w_Yfaf31IsBZzehzHZ3Hl-yneNho34evqGs Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 81c2331d1e204eea916beba9eec9acf1 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81c2331d1e204eea916beba9eec9acf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81c2331d1e204eea916beba9eec9acf1"}]}] Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 81c2331d1e204eea916beba9eec9acf1 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2026638053 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TaggedBootDevicesTest_v242-2026638053-project Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4f0b7c499c1d4dd894483b19308e0439 Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2026638053-project Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '337ba34e-9f41-4a02-b6cf-1be43c118524'} Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.812015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. Oct 12 22:50:58.816762 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:58.818038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] Returning 404 to user: Instance 337ba34e-9f41-4a02-b6cf-1be43c118524 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:58.819066 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-77f0c124-80fd-4a46-be39-dabeef59cb23 tempest-TaggedBootDevicesTest_v242-2026638053 tempest-TaggedBootDevicesTest_v242-2026638053-project] 10.222.0.20 "GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524" status: 404 len: 111 microversion: 2.42 time: 0.090861 Oct 12 22:50:58.820730 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1918/3727] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:50:58 2022] GET /compute/v2.1/servers/337ba34e-9f41-4a02-b6cf-1be43c118524 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:50:59.015392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:59.017163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:59.021200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:59.026386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.027843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.032298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.033796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.034807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.035408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.159547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.160709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.161907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.162654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lazy-loading 'fault' on Instance uuid a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:50:59.167732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:50:59.174472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:59.182952 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d67946b0-a3d7-4db2-bf9a-adc5a2cc0c28 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1508 microversion: 2.1 time: 0.439315 Oct 12 22:50:59.186020 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1810/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:58 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:50:59.197566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:59.198449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:59.212408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.216660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.217402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.218356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.219152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.220848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.263650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:59.273337 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7e04433c-667e-4470-928e-5f9fa3ea4891 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 200 len: 1303 microversion: 2.1 time: 0.263110 Oct 12 22:50:59.274004 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1919/3729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:59 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 1303 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:50:59.361263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:50:59.362445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] [instance: b422b505-f575-4ff4-af58-1d9eeec9c2c2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:50:59.399302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.399927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.404110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.406694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:50:59.407685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:50:59.408165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:50:59.440063 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] HTTP exception thrown: Instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 could not be found. Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Request method failure captured: Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 HTTP/1.1 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0QNdSFJ_eOhnKoJOmV_z3FoLqUEaLPqtZ9Y31uYLW4zlbNNhqqwnd6573VaHupgGQeMw_AZvKSoD02Nz9EXMmHgYkQW5Hpf1oi1uMZW5pUNPK8v_jB19j5Obk09vexltKRbSOX-bDkgu8r5_EicTsA-GjU-fPG_X4HLjPKheRETEJk Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_115ba104dfa745dd9fa95a23fbd90474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/115ba104dfa745dd9fa95a23fbd90474"}]}] Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 115ba104dfa745dd9fa95a23fbd90474 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1520899113 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 695c23f6a65d47168088cc346c99b8b7 Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersOnMultiNodesTest-1520899113-project Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 could not be found. Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'b422b505-f575-4ff4-af58-1d9eeec9c2c2'} Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 could not be found. Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 could not be found. Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:50:59.442225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 could not be found. Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] Returning 404 to user: Instance b422b505-f575-4ff4-af58-1d9eeec9c2c2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8eebd867-53b9-41bf-9ed3-672cb0c7fd50 tempest-ServersOnMultiNodesTest-1520899113 tempest-ServersOnMultiNodesTest-1520899113-project] 10.222.0.20 "GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2" status: 404 len: 111 microversion: 2.1 time: 0.091651 Oct 12 22:50:59.446455 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1920/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:59 2022] GET /compute/v2.1/servers/b422b505-f575-4ff4-af58-1d9eeec9c2c2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:50:59.890171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:50:59.898308 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60037853-d247-4c8c-9cec-9d171b979ffc tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.709541 Oct 12 22:50:59.901358 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1811/3731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:50:59 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:00.210924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:00.211541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:00.219845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.220554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.220994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.221696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.222150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.222571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.300542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:00.301086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: a52aab5d-b3c8-4fe6-ba03-419b8e660bd4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:00.314312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.315029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.315626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.316525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.317135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.317720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.351727 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] HTTP exception thrown: Instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 could not be found. Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Request method failure captured: Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 HTTP/1.1 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0SsgBDt01Xv6xuFAN4vF37Jna-09TkdmeaUNcSYJ4y8vDMuvDsZpEqyw0gQv_Mod0tUolNkzw6VyMf9RqCFFQ6s2sZwh4IxLkIJMpmacpFtVfdUf55lKw4hEa7HuO0ti6serKvaUPkb4OdelIls-OSb8COtTXQv7XB8yuP6-AAYwtQ Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 32e848bceee740759ad1aef081c0a248 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesActionsTest-404109807 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32e848bceee740759ad1aef081c0a248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/32e848bceee740759ad1aef081c0a248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_32e848bceee740759ad1aef081c0a248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32e848bceee740759ad1aef081c0a248"}]}] Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesActionsTest-404109807 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 32e848bceee740759ad1aef081c0a248 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesActionsTest-404109807 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesActionsTest-404109807-project Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4e1a67c76bbd4817b865da0f8da65165 Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesActionsTest-404109807-project Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 could not be found. Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a52aab5d-b3c8-4fe6-ba03-419b8e660bd4'} Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 could not be found. Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 could not be found. Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:00.354448 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:00.360068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:00.360068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:00.360068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:00.360068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:00.360068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:00.360068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 could not be found. Oct 12 22:51:00.360068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:00.363217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Returning 404 to user: Instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:00.368339 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65de1ce3-6ed0-4cb2-95fd-7c4360221284 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4" status: 404 len: 111 microversion: 2.1 time: 0.072170 Oct 12 22:51:00.369624 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1812/3732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:00 2022] GET /compute/v2.1/servers/a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:51:00.443002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-aaf3ae4d-f596-4d34-b350-1dfd87c38f03 req-48e6a10e-d56e-415e-9987-27432e62e5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52aab5d-b3c8-4fe6-ba03-419b8e660bd4", "name": "network-vif-deleted", "tag": "7a2c0921-5dfc-4ff1-b503-d90e9fb18604"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:00.464652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aaf3ae4d-f596-4d34-b350-1dfd87c38f03 req-48e6a10e-d56e-415e-9987-27432e62e5cf service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.465507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aaf3ae4d-f596-4d34-b350-1dfd87c38f03 req-48e6a10e-d56e-415e-9987-27432e62e5cf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.466412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aaf3ae4d-f596-4d34-b350-1dfd87c38f03 req-48e6a10e-d56e-415e-9987-27432e62e5cf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.480680 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-aaf3ae4d-f596-4d34-b350-1dfd87c38f03 req-48e6a10e-d56e-415e-9987-27432e62e5cf service nova] Creating event network-vif-deleted:7a2c0921-5dfc-4ff1-b503-d90e9fb18604 for instance a52aab5d-b3c8-4fe6-ba03-419b8e660bd4 on n-h2-860864-8 Oct 12 22:51:00.486720 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-aaf3ae4d-f596-4d34-b350-1dfd87c38f03 req-48e6a10e-d56e-415e-9987-27432e62e5cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047520 Oct 12 22:51:00.488002 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1813/3733] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:00.575423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-17136331", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "42a96352-7d4f-4102-8c5e-541ea547a93d"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:00.614750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:00.634416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44cfae4b-08ee-4138-b24d-c35d54fe6c83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1491 microversion: 2.1 time: 0.427366 Oct 12 22:51:00.642460 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1921/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:00 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1491 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:00.671430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:00.672570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:00.678363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] validate_networks() for [('42a96352-7d4f-4102-8c5e-541ea547a93d', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:51:00.683063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.683565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.684035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.684746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.685199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.693227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.893681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7fb272c7-45cc-4a4f-aad5-617f511a9ba8 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action" status: 202 len: 0 microversion: 2.1 time: 0.224594 Oct 12 22:51:00.895770 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1922/3735] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:51:00 2022] POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:51:00.905870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:00.910725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:00.924982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.925480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.930431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:00.931201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:00.931666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:00.933542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:01.148368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:01.158377 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-759d9b86-b475-4ad6-882d-57ef2965bc29 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1497 microversion: 2.1 time: 0.259129 Oct 12 22:51:01.160825 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1923/3736] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:00 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:01.166391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:01.167594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:01.190824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:01.192383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:01.193664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:01.199746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:01.200436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:01.201242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:02.084151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:02.100909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7926e516-80a7-4869-a0a2-3fbae5730964 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.938518 Oct 12 22:51:02.101700 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1924/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:01 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:02.201978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:02.202635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:02.217764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:02.219138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:02.219632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:02.223386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:02.223850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:02.224750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:02.641091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:02.661417 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7382a7e4-60de-4ece-bf83-48379699156a tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1497 microversion: 2.1 time: 0.462953 Oct 12 22:51:02.663255 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1925/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:02 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1497 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:03.135380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:03.136148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:03.149785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.150485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.151145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:03.151869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.154003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.154449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:03.220329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:51:03.223078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:51:03.224768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:51:03.225387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:51:03.225989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:51:03.245746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.246475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.247122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:03.248176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.249149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.252406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:03.283442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Getting quotas for project 32e848bceee740759ad1aef081c0a248. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:51:03.293220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Getting quotas for user 4e1a67c76bbd4817b865da0f8da65165 and project 32e848bceee740759ad1aef081c0a248. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:51:03.342900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:51:03.347509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:51:03.514440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b49b1820-6b85-4c47-8945-7a423904e20f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.942767 Oct 12 22:51:03.517837 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1814/3739] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:51:03.530619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:03.539678 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4690bf9b-cdbf-4e3c-a552-8c73d3feca25 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.419561 Oct 12 22:51:03.564877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d8ca4b5-a031-457b-bf67-e4506dff9c3d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:03.564877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d8ca4b5-a031-457b-bf67-e4506dff9c3d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:03.565744 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1926/3740] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:03 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:03.689509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:03.690298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:03.710608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.713188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.713894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:03.717535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:03.718679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:03.720799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:04.058208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d8ca4b5-a031-457b-bf67-e4506dff9c3d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:04.080904 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d8ca4b5-a031-457b-bf67-e4506dff9c3d tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1212 microversion: 2.1 time: 0.554618 Oct 12 22:51:04.084031 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1815/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:03 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1212 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:04.266019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:04.282252 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-856cb14d-f087-4b89-a2cf-ea47e1eceb3e tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1497 microversion: 2.1 time: 0.597875 Oct 12 22:51:04.285384 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1927/3742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:03 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1497 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:04.570814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:04.571558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:04.595936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:04.596440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:04.596941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:04.597668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:04.598126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:04.598554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.102562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:05.103201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:05.110115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.110612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.116099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.117250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.127633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.129148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.262690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:05.280484 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1e7c58a5-1290-4ff5-bcb6-beac6c25ec45 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.709699 Oct 12 22:51:05.282357 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1816/3743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:04 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:05.291419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:05.315523 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cbc63478-1a7a-46ef-97a3-e35cbef82b67 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1264 microversion: 2.1 time: 0.213598 Oct 12 22:51:05.329122 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1928/3744] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:05 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:05.346150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:05.349587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:05.364028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.369307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.370140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.371146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.371793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.372484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.576803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Action: 'update', calling method: .version_select at 0x7f44ff769c10>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:05.592091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.595396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.596434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.628496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.629550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.630269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.652084 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] HTTP exception thrown: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Request method failure captured: Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789 HTTP/1.1 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 56 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0TY99SsX0wo6DXt83cLuGqN2Pru63SYD1UoTtjO3YT2BvGjhNIXf7J4VtwKegnvvNYiXyaT0TcVitmr6NjwEXp-V5yzVRhV3kWLkihiDUlakJ-asXjQrd3R-N2ZlLIeiZv7tB0mhtS2x8KMUEzQBVdoZxxyR-JOgqghWhu4jOMm-rU Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fcd0ffa3193243139a725b68a2bf1fb7 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcd0ffa3193243139a725b68a2bf1fb7"}]}] Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fcd0ffa3193243139a725b68a2bf1fb7 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5a6a2a14239040b985fab0a519f23269 Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: exception: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '53e948ee-065e-47ef-8588-f018934e6789', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:51:05.654946 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.658992 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.662925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Returning 404 to user: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:05.664208 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7258c0af-46b4-4b07-b221-47d0083994c9 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789" status: 404 len: 110 microversion: 2.53 time: 0.379977 Oct 12 22:51:05.665408 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1817/3745] 10.222.0.20 () {62 vars in 1309 bytes} [Wed Oct 12 22:51:05 2022] PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789 => generated 110 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:51:05.676526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Action: 'update', calling method: .version_select at 0x7f4507acfdc0>, body: {"status": "disabled"} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:05.693210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.694189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.694855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.701766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.702703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.704019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.710403 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] HTTP exception thrown: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Request method failure captured: Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789 HTTP/1.1 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 22 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0TY99SsX0wo6DXt83cLuGqN2Pru63SYD1UoTtjO3YT2BvGjhNIXf7J4VtwKegnvvNYiXyaT0TcVitmr6NjwEXp-V5yzVRhV3kWLkihiDUlakJ-asXjQrd3R-N2ZlLIeiZv7tB0mhtS2x8KMUEzQBVdoZxxyR-JOgqghWhu4jOMm-rU Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fcd0ffa3193243139a725b68a2bf1fb7 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcd0ffa3193243139a725b68a2bf1fb7"}]}] Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fcd0ffa3193243139a725b68a2bf1fb7 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5a6a2a14239040b985fab0a519f23269 Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: {"status": "disabled"} Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: exception: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '53e948ee-065e-47ef-8588-f018934e6789', 'body': {'status': 'disabled'}} Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:51:05.712829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.716829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.719149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Returning 404 to user: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:05.720603 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32538697-9fac-4913-94fe-cd43cc89bd62 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789" status: 404 len: 110 microversion: 2.53 time: 0.048154 Oct 12 22:51:05.721829 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1818/3746] 10.222.0.20 () {62 vars in 1309 bytes} [Wed Oct 12 22:51:05 2022] PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789 => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:51:05.741847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Action: 'update', calling method: .version_select at 0x7f44ff7c08b0>, body: {"status": "enabled"} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:05.757466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.759585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.764200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.791159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.795490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.800487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.819189 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] HTTP exception thrown: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Request method failure captured: Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789 HTTP/1.1 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 21 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0TY99SsX0wo6DXt83cLuGqN2Pru63SYD1UoTtjO3YT2BvGjhNIXf7J4VtwKegnvvNYiXyaT0TcVitmr6NjwEXp-V5yzVRhV3kWLkihiDUlakJ-asXjQrd3R-N2ZlLIeiZv7tB0mhtS2x8KMUEzQBVdoZxxyR-JOgqghWhu4jOMm-rU Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: fcd0ffa3193243139a725b68a2bf1fb7 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcd0ffa3193243139a725b68a2bf1fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcd0ffa3193243139a725b68a2bf1fb7"}]}] Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: fcd0ffa3193243139a725b68a2bf1fb7 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5a6a2a14239040b985fab0a519f23269 Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: {"status": "enabled"} Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: exception: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '53e948ee-065e-47ef-8588-f018934e6789', 'body': {'status': 'enabled'}} Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:51:05.826738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. Oct 12 22:51:05.831987 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:05.833219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Returning 404 to user: Service 53e948ee-065e-47ef-8588-f018934e6789 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:05.833813 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37e903b8-8af5-4a11-9bd1-b5e77080be74 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789" status: 404 len: 110 microversion: 2.53 time: 0.105908 Oct 12 22:51:05.834324 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1819/3747] 10.222.0.20 () {62 vars in 1309 bytes} [Wed Oct 12 22:51:05 2022] PUT /compute/v2.1/os-services/53e948ee-065e-47ef-8588-f018934e6789 => generated 110 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:51:05.857221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:05.866736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.867243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.867702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.868463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.868912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.869347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.912915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a72a069-aff1-40e6-a0ac-06bc75be41ee tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.067573 Oct 12 22:51:05.914991 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1820/3748] 10.222.0.20 () {60 vars in 1178 bytes} [Wed Oct 12 22:51:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:51:05.929721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:05.934613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.936152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.936992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.938784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:05.941254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:05.941940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:05.978088 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ad07e7d7-fe5a-46fa-9905-fc1d02172d72 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.054663 Oct 12 22:51:05.979039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1821/3749] 10.222.0.20 () {60 vars in 1211 bytes} [Wed Oct 12 22:51:05 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:51:05.997104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:06.009804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.010608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.011984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.014344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.015616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.017018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.082966 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36ec208b-7445-434a-97c9-c4e160712c52 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.093268 Oct 12 22:51:06.084122 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1822/3750] 10.222.0.20 () {60 vars in 1178 bytes} [Wed Oct 12 22:51:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:51:06.096871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:06.104937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.106559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.106559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.106762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.109808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.110465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.150844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:06.159156 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9cf9d933-2f00-4d86-82c9-5d244faa6d83 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1500 microversion: 2.1 time: 0.828628 Oct 12 22:51:06.172804 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1929/3751] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:05 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1500 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:06.181206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a4c8bde-aaba-49d2-ae9e-f246466ef4fe tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-860864-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.083440 Oct 12 22:51:06.181206 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1823/3752] 10.222.0.20 () {60 vars in 1235 bytes} [Wed Oct 12 22:51:06 2022] GET /compute/v2.1/os-services?host=n-d-860864-8&binary=xxx => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:06.189948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:06.190578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:06.193371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:06.198594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.200391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.200856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.201624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.208926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.209357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.210524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.216235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.216915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.217790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.218418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.218983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.240284 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8093c93c-212e-4bfe-b362-877c0243ff89 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.054795 Oct 12 22:51:06.241166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1824/3753] 10.222.0.20 () {60 vars in 1178 bytes} [Wed Oct 12 22:51:06 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:51:06.256200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:06.273450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.273896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lazy-loading 'flavor' on Instance uuid 33826208-9404-48e6-808a-2b048f6f33ca {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:51:06.274140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.274582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.275317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.275909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.276340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.280795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:06.339828 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b579c1f3-b3bb-435e-a686-31064ecaf792 tempest-ServicesAdminNegativeV253TestJSON-831536866 tempest-ServicesAdminNegativeV253TestJSON-831536866-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.084783 Oct 12 22:51:06.347769 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1825/3754] 10.222.0.20 () {60 vars in 1239 bytes} [Wed Oct 12 22:51:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:06.353786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:06.354724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:06.362565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.363158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.363599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.364429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.364886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.365372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.389759 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9caad7c0-bbca-444d-8aef-ea20baa4c1a9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action" status: 202 len: 0 microversion: 2.1 time: 0.203901 Oct 12 22:51:06.393396 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1930/3755] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:51:06 2022] POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:51:06.401642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:06.403789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:06.423193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.424103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.425853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.427536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:06.428832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:06.429355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:06.674341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:06.683693 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38dbcf8c-0f29-4ace-a7e9-93b07399dad1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1270 microversion: 2.1 time: 0.291291 Oct 12 22:51:06.698382 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1931/3756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:06 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1270 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:06.932620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6bd44b0-6a33-4014-b53d-0a1b6382d827 tempest-ServicesAdminNegativeV253TestJSON-1666428463 tempest-ServicesAdminNegativeV253TestJSON-1666428463-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:06.944966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6bd44b0-6a33-4014-b53d-0a1b6382d827 tempest-ServicesAdminNegativeV253TestJSON-1666428463 tempest-ServicesAdminNegativeV253TestJSON-1666428463-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'abcc4a4af4464b8484102db968dbf6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd6a7c31989419ab088c3ea3b5b810b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6bd44b0-6a33-4014-b53d-0a1b6382d827 tempest-ServicesAdminNegativeV253TestJSON-1666428463 tempest-ServicesAdminNegativeV253TestJSON-1666428463-project] Request method failure captured: Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0TXdnRMAVgTgXYAWP0d_siRepr9QY0QEY_x6o7jcUnlV8ZeKZ8n2no9k6jNIadxKxgH9nxFNAe36pUGgYGelQ6LfmK65xfGYni4g8ACPCYgvuKo3ZzzI2m3be7zCDqfiUAEF_UXBiB4MFU_bt0DFC_MNjo-4DhnvXxS40u_h8f97Ck Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 7fd6a7c31989419ab088c3ea3b5b810b Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1666428463 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fd6a7c31989419ab088c3ea3b5b810b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7fd6a7c31989419ab088c3ea3b5b810b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7fd6a7c31989419ab088c3ea3b5b810b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fd6a7c31989419ab088c3ea3b5b810b"}]}] Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1666428463 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 7fd6a7c31989419ab088c3ea3b5b810b Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1666428463 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1666428463-project Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: abcc4a4af4464b8484102db968dbf6d2 Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1666428463-project Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 22:51:06.951640 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 22:51:06.955790 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:06.958998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6bd44b0-6a33-4014-b53d-0a1b6382d827 tempest-ServicesAdminNegativeV253TestJSON-1666428463 tempest-ServicesAdminNegativeV253TestJSON-1666428463-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:06.961594 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6bd44b0-6a33-4014-b53d-0a1b6382d827 tempest-ServicesAdminNegativeV253TestJSON-1666428463 tempest-ServicesAdminNegativeV253TestJSON-1666428463-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.259312 Oct 12 22:51:06.981297 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1932/3757] 10.222.0.20 () {60 vars in 1178 bytes} [Wed Oct 12 22:51:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 282 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:51:07.029836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:07.030600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:07.062941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:07.063468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:07.063931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:07.064819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:07.065275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:07.065701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:07.322238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:07.333975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-07f7a503-2281-47e9-8f7d-4d49126c261a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.984823 Oct 12 22:51:07.335693 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1826/3758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:06 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:07.710347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:07.711162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:07.725559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:07.726097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:07.728153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:07.730193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:07.731606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:07.732884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:07.926981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:07.941392 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21c2b4bb-fc6e-4613-adb8-099add4afa80 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1270 microversion: 2.1 time: 0.235282 Oct 12 22:51:07.942220 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1827/3759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:07 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:08.028948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:08.044960 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ddfe2bf-f3f3-4c6e-b95f-30a37ec7864c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1491 microversion: 2.1 time: 1.056817 Oct 12 22:51:08.047761 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1933/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:06 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1491 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:08.070241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:08.070703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:08.081967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.082461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.082894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.092884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.094002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.096478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.250549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-86ed6c8d-105d-4637-8271-6659200b4dc7 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action" status: 202 len: 0 microversion: 2.1 time: 0.183578 Oct 12 22:51:08.255663 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1828/3761] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:51:08 2022] POST /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:51:08.261804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:08.262427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:08.278335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.278853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.279372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.286590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.291315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.291849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.369703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:08.372619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:08.392408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.396381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.416327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.419804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.423702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.428332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.928562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:08.944983 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-18efd1cd-a4cf-4e20-afcd-f10a65287963 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1497 microversion: 2.1 time: 0.685881 Oct 12 22:51:08.945571 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1934/3762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:08 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1497 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:08.965949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:08.966995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:08.980191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.980968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.981638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.982533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:08.983135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:08.983715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:08.988339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:09.128145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:09.139082 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6b8aaf8-b384-4dbf-9397-8074da870673 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.784168 Oct 12 22:51:09.142957 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1829/3763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:08 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:09.432748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:09.450073 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ba4dfa5-55cf-4461-9651-848774eebb49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 0.487692 Oct 12 22:51:09.453307 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1935/3764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:08 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:09.969847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:09.970481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:09.980010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:09.980514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:09.980962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:09.981962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:09.982113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:09.999387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:10.175870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:10.176812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:10.190533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:10.192243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:10.194299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:10.196657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:10.198095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:10.199108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:11.042375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:11.069626 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad6a780f-37c3-44f1-af8c-1ab6de47fee9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1511 microversion: 2.1 time: 0.891272 Oct 12 22:51:11.072422 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1936/3765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:10 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1511 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:11.077370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:11.083700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:11.104755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:11.105255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:11.105698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:11.106423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:11.106889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:11.107318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:12.034189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:12.043527 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75ef216c-b68d-4fdd-bbed-75306fd807b0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 0.969739 Oct 12 22:51:12.045670 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1937/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:11 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:12.099406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:12.100946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:12.115709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:12.117710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:12.118485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:12.119581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:12.120368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:12.121160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:12.191005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:12.211441 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b089c26-5a7e-410b-9976-e2e0035f6209 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1497 microversion: 2.1 time: 2.237421 Oct 12 22:51:12.214181 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1830/3767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:09 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1497 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:12.754659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:12.769610 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-63cd42af-32ea-4250-8e0a-f02c2fd39115 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1488 microversion: 2.1 time: 0.676828 Oct 12 22:51:12.782450 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1938/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:12 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1488 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:12.798982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:12.799709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:12.818208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:12.822607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:12.823528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:12.826248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:12.832009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:12.833080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:12.898766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:51:13.069196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:13.070052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:13.083073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:13.083704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:13.084269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:13.085079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:13.093222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:13.093992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:13.127332 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b18e2fe-33ac-47fd-808f-c4bbc66f4602 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 204 len: 0 microversion: 2.1 time: 0.332610 Oct 12 22:51:13.128385 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1831/3769] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:12 2022] DELETE /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:51:13.141598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:13.142598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:13.154967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:13.156340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:13.156958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:13.157821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:13.158431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:13.159227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:13.605649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:13.618182 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-185dd7c9-08fa-408d-9b6d-680287190f49 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 0.553240 Oct 12 22:51:13.619017 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1939/3770] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:13 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:13.639467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:13.641227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:13.649014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:13.649690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:13.650310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:13.651160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:13.651613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:13.652068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:13.725242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:13.741614 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0bfeb732-29ba-4957-98c9-99c26e97bb5f tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1494 microversion: 2.1 time: 0.604609 Oct 12 22:51:13.742951 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1832/3771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:13 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1494 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:13.760901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fc05a3b6-ffb9-4163-9efc-3a4d2f953bd6 req-8732c43f-defd-4e23-8346-a68ae1a3cc48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04adf4fa-1c67-493e-8e0c-9c917f66a834", "tag": "192822ec-b7b8-4b6a-a2d4-a7053c50ee69"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:13.781234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fc05a3b6-ffb9-4163-9efc-3a4d2f953bd6 req-8732c43f-defd-4e23-8346-a68ae1a3cc48 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:13.781958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fc05a3b6-ffb9-4163-9efc-3a4d2f953bd6 req-8732c43f-defd-4e23-8346-a68ae1a3cc48 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:13.782390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fc05a3b6-ffb9-4163-9efc-3a4d2f953bd6 req-8732c43f-defd-4e23-8346-a68ae1a3cc48 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:13.800828 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fc05a3b6-ffb9-4163-9efc-3a4d2f953bd6 req-8732c43f-defd-4e23-8346-a68ae1a3cc48 service nova] Creating event network-changed:192822ec-b7b8-4b6a-a2d4-a7053c50ee69 for instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 on n-h2-860864-8 Oct 12 22:51:13.807817 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fc05a3b6-ffb9-4163-9efc-3a4d2f953bd6 req-8732c43f-defd-4e23-8346-a68ae1a3cc48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059982 Oct 12 22:51:13.809500 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1833/3772] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:14.621854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:14.637052 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-76904593-49b6-4244-bf4c-f53a64363b9c tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1500 microversion: 2.1 time: 1.014720 Oct 12 22:51:14.649374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:14.658624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:14.659642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:14.661586 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1940/3773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:13 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1500 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:14.664716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:14.674952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:14.675470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:14.678287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:14.679071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:14.680034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:14.681010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:14.681633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:14.682246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:14.690520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:14.691021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:14.691487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:14.692199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:14.692658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:14.693086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:14.750281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:51:14.951938 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef92aa02-9180-445f-a37f-60e7a8b0ab66 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 204 len: 0 microversion: 2.1 time: 0.288813 Oct 12 22:51:14.953132 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1941/3774] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:14 2022] DELETE /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:51:14.959229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:14.972993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:14.979229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:14.979712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:14.980228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:14.980968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:14.981419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:14.981840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:15.460143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:15.467774 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8397745b-dd84-4813-b4ee-95cd01fca921 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 0.819450 Oct 12 22:51:15.468954 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1834/3775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:14 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:15.489525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:15.490507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:15.497485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:15.498414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:15.499033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:15.500620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:15.501250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:15.501845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:15.677229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:15.686335 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22efd672-2c36-405a-b629-314a4fd4adf8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1494 microversion: 2.1 time: 0.731552 Oct 12 22:51:15.688113 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1942/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:14 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1494 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:15.910222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:15.922179 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bdcc9c36-e662-4f75-b58d-d0fdf6971ea3 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1506 microversion: 2.1 time: 0.436513 Oct 12 22:51:15.932552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1835/3777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:15 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:16.491083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:16.491979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:16.500662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:16.501678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:16.504912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:16.505811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:16.506536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:16.507317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:16.712477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:16.713943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:16.717140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=20 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:16.722696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:16.723284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:16.724072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:16.724773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:16.725317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:16.725914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:16.924347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:16.968581 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4905ab8d-5364-434d-813c-de0a609f4fbe tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1452 microversion: 2.1 time: 0.257085 Oct 12 22:51:16.970292 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1836/3778] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:16 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1452 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:16.989818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:16.990754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:17.006165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:17.006998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:17.008911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:17.009674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:17.010340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:17.010941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:17.138474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:17.155181 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65452853-eebe-4994-9169-97ead02c4c75 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 0.664522 Oct 12 22:51:17.168000 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1943/3779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:16 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:17.284957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e94dbe8e-104f-4d97-bd01-ca33d9d42cf8 req-1428a40b-d474-4dc5-b28d-c31ec02b55da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ff794d-fb40-4973-9e43-016499c8b0db", "name": "network-vif-deleted", "tag": "4265e58f-4c90-41c1-a759-e0822c795377"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:17.315808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e94dbe8e-104f-4d97-bd01-ca33d9d42cf8 req-1428a40b-d474-4dc5-b28d-c31ec02b55da service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:17.316332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e94dbe8e-104f-4d97-bd01-ca33d9d42cf8 req-1428a40b-d474-4dc5-b28d-c31ec02b55da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:17.316773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e94dbe8e-104f-4d97-bd01-ca33d9d42cf8 req-1428a40b-d474-4dc5-b28d-c31ec02b55da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:17.341982 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e94dbe8e-104f-4d97-bd01-ca33d9d42cf8 req-1428a40b-d474-4dc5-b28d-c31ec02b55da service nova] Creating event network-vif-deleted:4265e58f-4c90-41c1-a759-e0822c795377 for instance 80ff794d-fb40-4973-9e43-016499c8b0db on n-h2-860864-8 Oct 12 22:51:17.348658 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e94dbe8e-104f-4d97-bd01-ca33d9d42cf8 req-1428a40b-d474-4dc5-b28d-c31ec02b55da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069635 Oct 12 22:51:17.350065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1944/3780] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:17.701177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:17.715169 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-081aa545-a035-4087-8013-607192f35356 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1506 microversion: 2.1 time: 0.742938 Oct 12 22:51:17.717351 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1837/3781] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:16 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:18.001004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:18.001701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:18.012639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.013417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.015017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.016985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.017691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.018573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.068345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.069624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.070212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.071247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lazy-loading 'fault' on Instance uuid 80ff794d-fb40-4973-9e43-016499c8b0db {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:51:18.183328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:18.187795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:18.188774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:18.197382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a1f2885-985a-41a2-9896-2bf3575c59f8 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 200 len: 1304 microversion: 2.1 time: 0.201921 Oct 12 22:51:18.209787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.216364 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1945/3782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:17 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 1304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:18.219040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.219555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.220407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.222340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.222942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.636425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:18.646947 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63f3cc6f-a467-4ce4-a3e9-8bdd1012287c tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 0.465448 Oct 12 22:51:18.651077 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1838/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:18 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:18.702217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7ddd3071-15e1-46f0-9de8-19eb08b7ccac req-eb939287-9b37-484b-83a0-2d3b8d9876a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33826208-9404-48e6-808a-2b048f6f33ca", "name": "network-vif-deleted", "tag": "b5315992-ff06-4847-a5a2-cb25371e147d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:18.728794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7ddd3071-15e1-46f0-9de8-19eb08b7ccac req-eb939287-9b37-484b-83a0-2d3b8d9876a2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.731982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7ddd3071-15e1-46f0-9de8-19eb08b7ccac req-eb939287-9b37-484b-83a0-2d3b8d9876a2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.732473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7ddd3071-15e1-46f0-9de8-19eb08b7ccac req-eb939287-9b37-484b-83a0-2d3b8d9876a2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.742724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:18.743337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:18.772923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.773843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.774191 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7ddd3071-15e1-46f0-9de8-19eb08b7ccac req-eb939287-9b37-484b-83a0-2d3b8d9876a2 service nova] Creating event network-vif-deleted:b5315992-ff06-4847-a5a2-cb25371e147d for instance 33826208-9404-48e6-808a-2b048f6f33ca on n-h1-860864-8 Oct 12 22:51:18.774462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.775252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.775776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.776231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.784031 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7ddd3071-15e1-46f0-9de8-19eb08b7ccac req-eb939287-9b37-484b-83a0-2d3b8d9876a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.500949 Oct 12 22:51:18.785627 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1946/3784] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:18.852923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:18.853717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:18.854315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:18.854926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lazy-loading 'fault' on Instance uuid 33826208-9404-48e6-808a-2b048f6f33ca {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:51:19.162871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d4daee8c1405eba6c0cc30772f7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66be98919db45fea109dafa4ef9e6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:19.173744 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-86a60110-fd84-453b-912b-5b7877779819 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 200 len: 1304 microversion: 2.1 time: 0.435072 Oct 12 22:51:19.175242 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1839/3785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:18 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 1304 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:19.231208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:19.234173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:19.251975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:19.252995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:19.254860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:19.256962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:19.257762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:19.259178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:19.278906 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db HTTP/1.1 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '80ff794d-fb40-4973-9e43-016499c8b0db'} Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:19.281927 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:19.286918 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:19.286918 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:19.286918 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:19.286918 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:19.286918 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:19.286918 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:19.286918 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:19.288699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:19.289917 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92947254-d0e1-4550-91d8-7a6920fa3979 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 404 len: 111 microversion: 2.1 time: 0.070739 Oct 12 22:51:19.290978 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1947/3786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:19 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:19.538583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2119715884", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6857b740-c8f6-435b-b880-87bc9b4758e7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:19.598128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] validate_networks() for [('6857b740-c8f6-435b-b880-87bc9b4758e7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:51:19.683038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:19.685739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:19.704590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:19.705625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:19.709245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:19.710805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:19.712442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:19.713139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:20.504057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:51:20.505135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:51:20.505957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:51:20.506641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:51:20.507306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:51:20.523399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:20.528072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:20.528884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:20.529914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:20.530557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:20.531761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:20.539759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:20.569185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:51:20.587811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Getting quotas for user 1353d2e3246c44cf8d4501c0f4455790 and project 0e08242b0d6d455c879400097c56275a. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:51:20.606228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:51:20.610061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:51:20.669096 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0503bf9a-0ab4-4321-ace2-1642b10ad762 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134552 Oct 12 22:51:20.676837 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1840/3787] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:51:20.684944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:20.686505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] [instance: 33826208-9404-48e6-808a-2b048f6f33ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:20.697170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:20.698028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:20.698702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:20.699717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:20.700432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:20.701559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:20.734240 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] HTTP exception thrown: Instance 33826208-9404-48e6-808a-2b048f6f33ca could not be found. Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Request method failure captured: Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca HTTP/1.1 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0S1vmEGRK0hr8xxv1QG5dFA7xeXhZbtL_UBWpHJ0CxGowOuj3LPuEMGbrzV7f08Lw2EyW37jk0ygLDsJDPb0ZO8mSjrs0tpXIgFo_yN4eFl5B8hth8iyIbS5lyYgFELHdgAPezNMQ4jY-iYQHhdW78C-wFDfj5UOkWNOFhHZa1jd08 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a66be98919db45fea109dafa4ef9e6e8 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestServerAdvancedOps-76458418 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66be98919db45fea109dafa4ef9e6e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a66be98919db45fea109dafa4ef9e6e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a66be98919db45fea109dafa4ef9e6e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66be98919db45fea109dafa4ef9e6e8"}]}] Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestServerAdvancedOps-76458418 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a66be98919db45fea109dafa4ef9e6e8 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestServerAdvancedOps-76458418 Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestServerAdvancedOps-76458418-project Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fc8d4daee8c1405eba6c0cc30772f7ca Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestServerAdvancedOps-76458418-project Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 33826208-9404-48e6-808a-2b048f6f33ca could not be found. Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '33826208-9404-48e6-808a-2b048f6f33ca'} Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33826208-9404-48e6-808a-2b048f6f33ca could not be found. Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33826208-9404-48e6-808a-2b048f6f33ca could not be found. Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:20.740345 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:20.745956 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:20.745956 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:20.745956 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:20.745956 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:20.745956 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:20.745956 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33826208-9404-48e6-808a-2b048f6f33ca could not be found. Oct 12 22:51:20.745956 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:20.755628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] Returning 404 to user: Instance 33826208-9404-48e6-808a-2b048f6f33ca could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:20.756586 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c09386e1-519d-419c-b6d2-65a57fc48aa9 tempest-TestServerAdvancedOps-76458418 tempest-TestServerAdvancedOps-76458418-project] 10.222.0.20 "GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca" status: 404 len: 111 microversion: 2.1 time: 0.078604 Oct 12 22:51:20.757159 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1841/3788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:20 2022] GET /compute/v2.1/servers/33826208-9404-48e6-808a-2b048f6f33ca => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:20.783533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97f2567f-a8e5-43a4-a088-1389a7c24e5e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:20.789836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-97f2567f-a8e5-43a4-a088-1389a7c24e5e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:21.138828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:21.154033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5ce7da25-e0f0-4770-82b6-b1f3387e1209 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 1.479626 Oct 12 22:51:21.154550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-97f2567f-a8e5-43a4-a088-1389a7c24e5e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:21.156587 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1948/3789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:19 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:21.177613 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-97f2567f-a8e5-43a4-a088-1389a7c24e5e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1215 microversion: 2.1 time: 0.419205 Oct 12 22:51:21.192309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1842/3790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:20 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:22.019144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-46851136-ecae-45e1-8ba3-b1b3a03e368f req-4a374b3a-fcc1-4f74-9d57-a9fa444da970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04adf4fa-1c67-493e-8e0c-9c917f66a834", "name": "network-vif-plugged", "status": "completed", "tag": "192822ec-b7b8-4b6a-a2d4-a7053c50ee69"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:22.059814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-46851136-ecae-45e1-8ba3-b1b3a03e368f req-4a374b3a-fcc1-4f74-9d57-a9fa444da970 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:22.061377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-46851136-ecae-45e1-8ba3-b1b3a03e368f req-4a374b3a-fcc1-4f74-9d57-a9fa444da970 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:22.063982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-46851136-ecae-45e1-8ba3-b1b3a03e368f req-4a374b3a-fcc1-4f74-9d57-a9fa444da970 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:22.107640 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-46851136-ecae-45e1-8ba3-b1b3a03e368f req-4a374b3a-fcc1-4f74-9d57-a9fa444da970 service nova] Creating event network-vif-plugged:192822ec-b7b8-4b6a-a2d4-a7053c50ee69 for instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 on n-h2-860864-8 Oct 12 22:51:22.123842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-46851136-ecae-45e1-8ba3-b1b3a03e368f req-4a374b3a-fcc1-4f74-9d57-a9fa444da970 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111049 Oct 12 22:51:22.128759 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1949/3791] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:22.181467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:22.182094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:22.197319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:22.203699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:22.204439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:22.207759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:22.208365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:22.209118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:22.216257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:22.217037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:22.219229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:22.226439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:22.227104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:22.229498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:22.230969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:22.231565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:23.020276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:23.043773 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a88f3d1-6475-40cd-b796-b17ac57e35d9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1267 microversion: 2.1 time: 0.842886 Oct 12 22:51:23.044941 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1950/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:22 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1267 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:23.057429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:23.062853 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-897d8bd2-6e47-4229-aa69-b01d7d955596 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 0.885061 Oct 12 22:51:23.078103 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1843/3793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:22 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:24.073880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:24.075391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:24.090344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:24.091085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:24.091830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:24.093299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:24.095685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:24.097287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:24.098366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:24.098832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:24.106959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:24.108519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:24.110028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:24.110905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:24.111705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:24.112328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:24.435987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:24.459841 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-488c9e63-624a-4cd4-bbe4-a5c342254cb6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1273 microversion: 2.1 time: 0.388836 Oct 12 22:51:24.460524 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1951/3794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:24 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1273 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:25.194696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:25.231409 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-83716a00-7831-4c04-865b-c26706a0d0c0 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1312 microversion: 2.1 time: 1.141269 Oct 12 22:51:25.234583 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1844/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:24 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1312 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:25.485483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:25.486111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:25.503523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:25.504328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:25.504927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:25.505796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:25.506410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:25.506997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:25.531595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:25.630605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:25.642513 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ada4d0bb-8541-4e66-8ef6-ebc91bec60b6 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1273 microversion: 2.1 time: 0.161394 Oct 12 22:51:25.643421 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1952/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:25 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:26.260251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:26.262493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:26.316083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:26.317197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:26.317857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:26.318878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:26.323977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:26.325703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:26.672592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:26.673272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:26.693062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:26.693862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:26.694530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:26.695453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:26.695936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:26.696360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:26.856814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:26.873412 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85f996ee-1542-4730-b900-45edf2a9c039 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1273 microversion: 2.1 time: 0.205337 Oct 12 22:51:26.874826 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1953/3797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:26 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:27.379657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:27.395237 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38e124f4-2700-4a12-9426-5483f6b7aea9 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1497 microversion: 2.1 time: 1.142128 Oct 12 22:51:27.397229 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1845/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:26 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1497 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:27.898833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:27.904549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:27.918499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:27.920676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:27.921339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:27.922249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:27.922866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:27.928496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:28.197857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:28.198383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:28.218906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:28.221044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:28.221881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:28.222860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:28.223556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:28.224229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:28.285943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:51:28.443110 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd35c62b-c8e9-48f2-87a8-8ced6df0b2e1 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 204 len: 0 microversion: 2.1 time: 0.249329 Oct 12 22:51:28.444164 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1846/3799] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:28 2022] DELETE /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:51:28.456792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:28.458609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:28.466708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:28.467253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:28.468819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:28.469616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:28.470081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:28.470560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:28.839972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:28.849447 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b330d67f-596f-41b5-bc4c-dfe9a5dce824 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1503 microversion: 2.1 time: 0.400076 Oct 12 22:51:28.850676 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1847/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:28 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:29.037370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:29.057333 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b4f267bd-c616-42f1-9556-f98756b10c07 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1315 microversion: 2.1 time: 1.162791 Oct 12 22:51:29.062621 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1954/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:27 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1315 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:29.182574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9d3580e1-4729-4b71-80a5-2416ac2ebeca req-6ca1d8a9-70b7-4abe-ba42-81105a8c9818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3225dc7-7307-4232-a498-aa234a721ed5", "tag": "9088e8dc-4ddf-4ffe-904a-377757319798"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:29.204750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9d3580e1-4729-4b71-80a5-2416ac2ebeca req-6ca1d8a9-70b7-4abe-ba42-81105a8c9818 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:29.207529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9d3580e1-4729-4b71-80a5-2416ac2ebeca req-6ca1d8a9-70b7-4abe-ba42-81105a8c9818 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:29.208230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9d3580e1-4729-4b71-80a5-2416ac2ebeca req-6ca1d8a9-70b7-4abe-ba42-81105a8c9818 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:29.235868 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9d3580e1-4729-4b71-80a5-2416ac2ebeca req-6ca1d8a9-70b7-4abe-ba42-81105a8c9818 service nova] Creating event network-changed:9088e8dc-4ddf-4ffe-904a-377757319798 for instance c3225dc7-7307-4232-a498-aa234a721ed5 on n-h1-860864-8 Oct 12 22:51:29.251115 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9d3580e1-4729-4b71-80a5-2416ac2ebeca req-6ca1d8a9-70b7-4abe-ba42-81105a8c9818 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072235 Oct 12 22:51:29.257522 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1848/3802] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:29.881513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:29.882410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:29.890177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:29.900707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:29.901669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:29.903252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:29.904030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:29.907081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:29.907750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:30.087344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:30.088080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:30.106563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:30.119381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:30.119842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:30.120632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:30.121102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:30.128629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:30.438772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:30.449227 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f807cd55-0b68-44e9-ba6a-a1093ef346e9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1315 microversion: 2.1 time: 0.367304 Oct 12 22:51:30.466394 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1849/3803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:30 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:31.074927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:31.083613 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46b357d9-9dcc-4be4-bf65-7d683a328b35 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1503 microversion: 2.1 time: 1.213286 Oct 12 22:51:31.091110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1955/3804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:29 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1503 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:31.472812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:31.473428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:31.489437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:31.496719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:31.523939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:31.524439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:31.532867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:31.534837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:31.535332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:31.535775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:32.125874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:32.126487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:32.133437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:32.133930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:32.134378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:32.135068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:32.135693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:32.136321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:32.535972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:32.559529 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0746e963-7eed-4ebd-bc9e-ac21e9add80f tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1503 microversion: 2.1 time: 0.438006 Oct 12 22:51:32.561623 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1956/3805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:32 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:32.653979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:32.676260 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-64e2121e-71d3-45ef-93c5-44bd7a9740b9 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1315 microversion: 2.1 time: 1.204014 Oct 12 22:51:32.678118 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1850/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:31 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1315 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:32.953367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1ac45944-1fba-490a-84a2-6fecaf643a2b req-9f987017-58a0-4b05-9232-28b98e7895b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04adf4fa-1c67-493e-8e0c-9c917f66a834", "name": "network-vif-deleted", "tag": "192822ec-b7b8-4b6a-a2d4-a7053c50ee69"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:32.966605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ac45944-1fba-490a-84a2-6fecaf643a2b req-9f987017-58a0-4b05-9232-28b98e7895b7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:32.969827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ac45944-1fba-490a-84a2-6fecaf643a2b req-9f987017-58a0-4b05-9232-28b98e7895b7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:32.970438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ac45944-1fba-490a-84a2-6fecaf643a2b req-9f987017-58a0-4b05-9232-28b98e7895b7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:32.994552 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1ac45944-1fba-490a-84a2-6fecaf643a2b req-9f987017-58a0-4b05-9232-28b98e7895b7 service nova] Creating event network-vif-deleted:192822ec-b7b8-4b6a-a2d4-a7053c50ee69 for instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 on n-h2-860864-8 Oct 12 22:51:33.001028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1ac45944-1fba-490a-84a2-6fecaf643a2b req-9f987017-58a0-4b05-9232-28b98e7895b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056623 Oct 12 22:51:33.002539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1957/3807] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:33.590112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:33.590727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:33.599254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:33.599750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:33.600204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:33.608754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:33.609240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:33.609686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:33.688999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:33.690517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:33.691162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:33.700504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:33.701594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:33.703555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lazy-loading 'fault' on Instance uuid 04adf4fa-1c67-493e-8e0c-9c917f66a834 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:51:33.727141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:33.727845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:33.729522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:33.730428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:33.733842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:33.734362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:33.929124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1a67c76bbd4817b865da0f8da65165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e848bceee740759ad1aef081c0a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:33.936896 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a02970fb-15e8-449a-8199-40984eeedc41 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 200 len: 1302 microversion: 2.1 time: 0.350453 Oct 12 22:51:33.952394 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1851/3808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:33 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 1302 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:34.104985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:34.120869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cdb91c2-cb4e-4258-bb10-4ab6406044df tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1315 microversion: 2.1 time: 0.424925 Oct 12 22:51:34.124265 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1958/3809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:33 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:34.760723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-103967649", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "f35dcdc9-68e8-4f79-9aad-9742dda82a05"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:34.898170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] validate_networks() for [('f35dcdc9-68e8-4f79-9aad-9742dda82a05', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:51:34.960428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:34.961047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] [instance: 04adf4fa-1c67-493e-8e0c-9c917f66a834] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:34.973794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:34.982016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:34.982966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:34.984149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:34.984985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:34.985625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:35.014768 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] HTTP exception thrown: Instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 could not be found. Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Request method failure captured: Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 HTTP/1.1 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0SsgBDt01Xv6xuFAN4vF37Jna-09TkdmeaUNcSYJ4y8vDMuvDsZpEqyw0gQv_Mod0tUolNkzw6VyMf9RqCFFQ6s2sZwh4IxLkIJMpmacpFtVfdUf55lKw4hEa7HuO0ti6serKvaUPkb4OdelIls-OSb8COtTXQv7XB8yuP6-AAYwtQ Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 32e848bceee740759ad1aef081c0a248 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesActionsTest-404109807 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32e848bceee740759ad1aef081c0a248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/32e848bceee740759ad1aef081c0a248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_32e848bceee740759ad1aef081c0a248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32e848bceee740759ad1aef081c0a248"}]}] Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesActionsTest-404109807 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 32e848bceee740759ad1aef081c0a248 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesActionsTest-404109807 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesActionsTest-404109807-project Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4e1a67c76bbd4817b865da0f8da65165 Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesActionsTest-404109807-project Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 could not be found. Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '04adf4fa-1c67-493e-8e0c-9c917f66a834'} Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 could not be found. Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 could not be found. Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:35.018953 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 could not be found. Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] Returning 404 to user: Instance 04adf4fa-1c67-493e-8e0c-9c917f66a834 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:35.022921 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a70a226-0035-4464-a7c1-9d1738a27540 tempest-VolumesActionsTest-404109807 tempest-VolumesActionsTest-404109807-project] 10.222.0.20 "GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834" status: 404 len: 111 microversion: 2.1 time: 0.064188 Oct 12 22:51:35.028260 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1959/3810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:34 2022] GET /compute/v2.1/servers/04adf4fa-1c67-493e-8e0c-9c917f66a834 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:51:35.146461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:35.147332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:35.158086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:35.158831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:35.160464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:35.161374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:35.168682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:35.169926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:36.431805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:36.440734 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ba17fd3-4fd9-40b5-8dbe-43ca0ebecab5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1315 microversion: 2.1 time: 1.298175 Oct 12 22:51:36.441332 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1960/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:35 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1315 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:37.466859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:37.469718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:37.492861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:37.494389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:37.496795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:37.498094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:37.500787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:37.502519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.749689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:51:38.750869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:51:38.751643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:51:38.752592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:51:38.752592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:51:38.774722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.775214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.777212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.781714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:38.782559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:38.785107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:38.824842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Getting quotas for project dac82d48217a412b8f9da673cbed0520. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:51:38.832613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Getting quotas for user 55c612e09c1141e0981359245d0f4132 and project dac82d48217a412b8f9da673cbed0520. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:51:38.843977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:38.854352 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74d0737f-7711-46ea-be7e-6ffea495037d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1315 microversion: 2.1 time: 1.391532 Oct 12 22:51:38.861726 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1961/3812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:37 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1315 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:38.877631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:51:38.882464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:51:39.005023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fbfde052-6b61-4f4f-a487-777d4e785f5a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.480421 Oct 12 22:51:39.009463 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1852/3813] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:51:39.020564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d75b62ee-7da6-4b2e-b69c-a41452df9190 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.021182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d75b62ee-7da6-4b2e-b69c-a41452df9190 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:39.168795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d75b62ee-7da6-4b2e-b69c-a41452df9190 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:39.181013 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d75b62ee-7da6-4b2e-b69c-a41452df9190 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1223 microversion: 2.1 time: 0.162753 Oct 12 22:51:39.198432 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1962/3814] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:39 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1223 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:39.324047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e79542c7-510c-4042-b2de-3023c0043af9 req-f783dabf-3780-435f-b3fa-393111e37b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3225dc7-7307-4232-a498-aa234a721ed5", "name": "network-vif-plugged", "status": "completed", "tag": "9088e8dc-4ddf-4ffe-904a-377757319798"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:39.348466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e79542c7-510c-4042-b2de-3023c0043af9 req-f783dabf-3780-435f-b3fa-393111e37b73 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.355587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e79542c7-510c-4042-b2de-3023c0043af9 req-f783dabf-3780-435f-b3fa-393111e37b73 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.356562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e79542c7-510c-4042-b2de-3023c0043af9 req-f783dabf-3780-435f-b3fa-393111e37b73 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.390139 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e79542c7-510c-4042-b2de-3023c0043af9 req-f783dabf-3780-435f-b3fa-393111e37b73 service nova] Creating event network-vif-plugged:9088e8dc-4ddf-4ffe-904a-377757319798 for instance c3225dc7-7307-4232-a498-aa234a721ed5 on n-h1-860864-8 Oct 12 22:51:39.429478 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e79542c7-510c-4042-b2de-3023c0043af9 req-f783dabf-3780-435f-b3fa-393111e37b73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091933 Oct 12 22:51:39.431064 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1853/3815] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:39.886204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:39.886808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:39.923819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.940714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.951857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:39.953037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:39.955553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:39.956199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:40.210474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2d06872-29a3-440d-9247-c31a32934ec3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:40.211199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2d06872-29a3-440d-9247-c31a32934ec3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:40.476732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2d06872-29a3-440d-9247-c31a32934ec3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:40.490302 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2d06872-29a3-440d-9247-c31a32934ec3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1223 microversion: 2.1 time: 0.286312 Oct 12 22:51:40.493271 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1854/3816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:40 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1223 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:41.230265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:41.241712 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34330576-b3e6-43b5-b69b-13631bf299eb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1315 microversion: 2.1 time: 1.359389 Oct 12 22:51:41.249307 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1963/3817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:39 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1315 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:41.520494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:41.522360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:41.538398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:41.539236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:41.539837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:41.540834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:41.542106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:41.542834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:41.743674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:41.754107 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29b7e0d2-2e53-418a-8e93-7adbecd4a765 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1275 microversion: 2.1 time: 0.240916 Oct 12 22:51:41.764844 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1855/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:41 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1275 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:42.267197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:42.267833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:42.295618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:42.296181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:42.297919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:42.300466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:42.302570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:42.303263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:42.791419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:42.793123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:42.810002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:42.817127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:42.819697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:42.821266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:42.824025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:42.826857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:43.093320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:43.103460 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa3764a3-6f55-40a1-95ae-829643aa499f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1281 microversion: 2.1 time: 0.317427 Oct 12 22:51:43.105129 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1856/3819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:42 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:44.130678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:44.132429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:44.146637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:44.147145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:44.147601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:44.148388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:44.148853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:44.149291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:44.800065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:44.830868 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb00f1d9-f6c8-4086-ad0b-d9d62a574958 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1501 microversion: 2.1 time: 2.559167 Oct 12 22:51:44.843946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1964/3820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:42 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1501 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:44.881223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:44.881766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:44.922146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:44.923513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:44.924739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:44.927671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:44.933769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:44.935254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:44.940218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:44.950016 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9202d9c2-2509-4ca4-882d-050ca4e2fdf7 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1281 microversion: 2.1 time: 0.824133 Oct 12 22:51:44.967751 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1857/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:44 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1281 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:45.008750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lazy-loading 'flavor' on Instance uuid c3225dc7-7307-4232-a498-aa234a721ed5 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:51:45.223204 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13179dcc-2c46-49e5-a0ed-3202d7166a0e tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "POST /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5/action" status: 202 len: 0 microversion: 2.1 time: 0.367468 Oct 12 22:51:45.234872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:45.235736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:45.237859 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1965/3822] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:51:44 2022] POST /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:51:45.242880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:45.254427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:45.254950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:45.256579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:45.257477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:45.259662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:45.260636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:45.562150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:45.573466 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3098db91-2b87-43a0-a947-7221337d6f09 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1509 microversion: 2.1 time: 0.343801 Oct 12 22:51:45.591185 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1858/3823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:45 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:45.975624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:45.976370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:45.988512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:45.998744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:45.999458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:46.002958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:46.003518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:46.003997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:46.505998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:46.515680 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-922f6253-3019-446e-ac33-5505fe7c6cbc tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1281 microversion: 2.1 time: 0.545456 Oct 12 22:51:46.537093 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1966/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:45 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1281 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:46.606909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:46.608973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:46.619813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:46.622545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:46.623865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:46.629295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:46.630011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:46.630666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:47.542586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:47.543216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:47.553627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:47.554116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:47.554561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:47.555275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:47.555737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:47.556203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:48.148521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:48.162310 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff178ab1-67ed-436b-a7ea-d2b51f032980 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 0.620324 Oct 12 22:51:48.162722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:48.172095 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c128933-4ce7-462c-b704-a1a2ae0aa87c tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1492 microversion: 2.1 time: 1.569245 Oct 12 22:51:48.176282 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1967/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:47 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:48.181132 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1859/3826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:46 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1492 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:48.208002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:48.210845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:48.246791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:48.251146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:48.252811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:48.255983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:48.256650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:48.258432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:48.310780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:48.329383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:51:48.569925 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f2a96d40-8a32-4657-9145-aa9c34d43e06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 204 len: 0 microversion: 2.1 time: 0.365631 Oct 12 22:51:48.571237 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1860/3827] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:48 2022] DELETE /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:51:48.581053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:48.582414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:48.601309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:48.604627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:48.608370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:48.618756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:48.623693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:48.624360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:49.174637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:49.202105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:49.202808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:49.207493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:49.217616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:49.218106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:49.218550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:49.219255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:49.246982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:49.248725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:50.027937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:50.039855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c44cb29c-7c8a-4e40-85e4-355ea6c778ca tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1498 microversion: 2.1 time: 1.463184 Oct 12 22:51:50.044085 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1968/3828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:48 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1498 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:50.483592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:50.744754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:50.762951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a6bcd45-3b2e-4497-8aa3-e1fd63f81ecb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 1.565044 Oct 12 22:51:50.789999 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1861/3829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:49 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:51.066563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:51.068290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:51.086653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:51.087185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:51.095264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:51.096152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:51.096638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:51.105780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:51.718580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:51.726082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:51:51.728654 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f78ce4ad-77a2-4a4a-9c62-d46a1343bb65 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1498 microversion: 2.1 time: 0.666908 Oct 12 22:51:51.734503 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1969/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:51 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1498 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:51.801004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:51.801690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:51.833723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:51.835943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:51.836440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:51.837153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:51.837705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:51.838031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:53.208522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:53.209145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:53.222174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:53.222681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:53.225623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:53.226380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:53.226850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:53.232484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:53.417925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1353d2e3246c44cf8d4501c0f4455790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08242b0d6d455c879400097c56275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:53.433151 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c15a10d-2e6f-4a4c-8465-6ead9f8ecb4a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 200 len: 1456 microversion: 2.1 time: 0.671529 Oct 12 22:51:53.434307 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1970/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:52 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 1456 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:53.516774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-adc89bfe-2d96-4cdc-a0f6-3ceb488f2dee req-04a5d564-59d3-48e0-9fab-44bf7e85459c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3225dc7-7307-4232-a498-aa234a721ed5", "name": "network-vif-deleted", "tag": "9088e8dc-4ddf-4ffe-904a-377757319798"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:53.548434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-adc89bfe-2d96-4cdc-a0f6-3ceb488f2dee req-04a5d564-59d3-48e0-9fab-44bf7e85459c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:53.549507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-adc89bfe-2d96-4cdc-a0f6-3ceb488f2dee req-04a5d564-59d3-48e0-9fab-44bf7e85459c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:53.551192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-adc89bfe-2d96-4cdc-a0f6-3ceb488f2dee req-04a5d564-59d3-48e0-9fab-44bf7e85459c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:53.596455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-adc89bfe-2d96-4cdc-a0f6-3ceb488f2dee req-04a5d564-59d3-48e0-9fab-44bf7e85459c service nova] Creating event network-vif-deleted:9088e8dc-4ddf-4ffe-904a-377757319798 for instance c3225dc7-7307-4232-a498-aa234a721ed5 on n-h1-860864-8 Oct 12 22:51:53.621367 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-adc89bfe-2d96-4cdc-a0f6-3ceb488f2dee req-04a5d564-59d3-48e0-9fab-44bf7e85459c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105702 Oct 12 22:51:53.623789 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1971/3832] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:51:53.740473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e51e8fbf-6ff1-4350-8f1d-7e6f239fda39 req-03ec6cb5-7424-49ba-bb17-5c6142844d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae744a67-c6e6-4946-989a-717e472b7a86", "tag": "3be0fa93-e344-46c7-ba2b-825fcfdd091c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:51:53.773720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e51e8fbf-6ff1-4350-8f1d-7e6f239fda39 req-03ec6cb5-7424-49ba-bb17-5c6142844d0e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:53.780663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e51e8fbf-6ff1-4350-8f1d-7e6f239fda39 req-03ec6cb5-7424-49ba-bb17-5c6142844d0e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:53.787483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e51e8fbf-6ff1-4350-8f1d-7e6f239fda39 req-03ec6cb5-7424-49ba-bb17-5c6142844d0e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:53.830832 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e51e8fbf-6ff1-4350-8f1d-7e6f239fda39 req-03ec6cb5-7424-49ba-bb17-5c6142844d0e service nova] Creating event network-changed:3be0fa93-e344-46c7-ba2b-825fcfdd091c for instance ae744a67-c6e6-4946-989a-717e472b7a86 on n-h2-860864-8 Oct 12 22:51:53.839851 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e51e8fbf-6ff1-4350-8f1d-7e6f239fda39 req-03ec6cb5-7424-49ba-bb17-5c6142844d0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106443 Oct 12 22:51:53.842200 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1972/3833] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:51:54.463636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:54.465980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:54.496230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.499821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.500307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:54.509755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.516026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.517613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:54.611093 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 HTTP/1.1 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'c3225dc7-7307-4232-a498-aa234a721ed5'} Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:54.623806 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.630816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:54.631470 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d639f160-566d-47a2-bcae-8d1d9765b022 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 404 len: 111 microversion: 2.1 time: 0.173555 Oct 12 22:51:54.639730 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1973/3834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:54 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:51:54.669619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:54.677423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:54.698010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.702281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.703925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:54.708647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.709176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.712961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:54.767100 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 HTTP/1.1 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'c3225dc7-7307-4232-a498-aa234a721ed5'} Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:54.770284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:54.774338 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:54.784016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:54.787591 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce38403b-9a53-4834-aef1-572d4d3236c7 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 404 len: 111 microversion: 2.1 time: 0.147023 Oct 12 22:51:54.792405 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1974/3835] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:54 2022] DELETE /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:54.819483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:54.824199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: c3225dc7-7307-4232-a498-aa234a721ed5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:54.850805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:54.861467 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2925ccc6-8f17-41be-afcb-6cd60f9a37cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 3.067007 Oct 12 22:51:54.862064 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1862/3836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:51 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 3068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:51:54.895674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.897791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.898760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:54.902567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:54.906239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:54.909640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.000006 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 HTTP/1.1 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'c3225dc7-7307-4232-a498-aa234a721ed5'} Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.001615 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance c3225dc7-7307-4232-a498-aa234a721ed5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a25f18b6-0b7b-47e5-8871-18b91489cc2d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5" status: 404 len: 111 microversion: 2.1 time: 0.206979 Oct 12 22:51:55.008935 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1975/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:54 2022] GET /compute/v2.1/servers/c3225dc7-7307-4232-a498-aa234a721ed5 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.011858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.012401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.020432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.020927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.038469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.040467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.042201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.044952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.094730 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db HTTP/1.1 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '80ff794d-fb40-4973-9e43-016499c8b0db'} Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.103041 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.107479 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.117545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.118957 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-194e61d6-5ee9-410f-b63b-e10ef18f6fa4 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 404 len: 111 microversion: 2.1 time: 0.111016 Oct 12 22:51:55.126967 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1863/3838] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:55 2022] DELETE /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.132747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.133444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 80ff794d-fb40-4973-9e43-016499c8b0db] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.147006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.147337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.147916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.148522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.148981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.149425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.222058 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db HTTP/1.1 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '80ff794d-fb40-4973-9e43-016499c8b0db'} Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.239581 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.245461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 80ff794d-fb40-4973-9e43-016499c8b0db could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.249610 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0bacf066-3c7a-4150-b332-007987b2b7a3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db" status: 404 len: 111 microversion: 2.1 time: 0.118663 Oct 12 22:51:55.253491 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1976/3839] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:55 2022] GET /compute/v2.1/servers/80ff794d-fb40-4973-9e43-016499c8b0db => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.258800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.259294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.273895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.280250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.280250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.280250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.299550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.302526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.357589 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 HTTP/1.1 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '3f4bb0ee-be3d-44c3-874e-ba0a423adfd1'} Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.366225 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.378478 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b37f7d47-5a4b-4085-a8c2-4473bbcca7d5 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 404 len: 111 microversion: 2.1 time: 0.115342 Oct 12 22:51:55.381780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.381780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.386046 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1864/3840] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:55 2022] DELETE /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.397342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.398744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.399640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.403535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.404550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.405187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.465089 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 HTTP/1.1 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3f4bb0ee-be3d-44c3-874e-ba0a423adfd1'} Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.467931 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.472030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.472030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.472030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.472030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.472030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.472030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. Oct 12 22:51:55.472030 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.476509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.482729 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4adea338-3494-4b8e-ac2a-7f08ffa8d705 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1" status: 404 len: 111 microversion: 2.1 time: 0.105112 Oct 12 22:51:55.483346 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1977/3841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:55 2022] GET /compute/v2.1/servers/3f4bb0ee-be3d-44c3-874e-ba0a423adfd1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.492759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.493555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.518285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.518740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.519198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.519948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.525488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.526429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.561447 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd HTTP/1.1 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd'} Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.564698 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.570078 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.582587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.583977 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb66a348-dbd8-450c-84ba-415b596e888a tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 404 len: 111 microversion: 2.1 time: 0.096116 Oct 12 22:51:55.587523 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1865/3842] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:55 2022] DELETE /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.603232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.604450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.636805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.637634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.639808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.641060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.643046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.644904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.693221 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd HTTP/1.1 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd'} Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.699960 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.704671 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.704671 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.704671 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.704671 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.704671 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.704671 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. Oct 12 22:51:55.704671 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.710883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.713012 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-28c8ee46-f446-486e-ae2b-621bceb794bf tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd" status: 404 len: 111 microversion: 2.1 time: 0.120907 Oct 12 22:51:55.723209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ee69cc9-0ed4-4d60-a98a-0b5ca6c96187 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.724247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ee69cc9-0ed4-4d60-a98a-0b5ca6c96187 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.728831 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1978/3843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:55 2022] GET /compute/v2.1/servers/5f62c9a7-7184-45d3-b3a2-bb7c4ffbe8dd => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.737680 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9ee69cc9-0ed4-4d60-a98a-0b5ca6c96187 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ee69cc9-0ed4-4d60-a98a-0b5ca6c96187 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 HTTP/1.1 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '37d40994-fa10-48ce-abfb-e9e390d57c26'} Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.740270 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.744061 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.750751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ee69cc9-0ed4-4d60-a98a-0b5ca6c96187 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.752844 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ee69cc9-0ed4-4d60-a98a-0b5ca6c96187 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26" status: 404 len: 111 microversion: 2.1 time: 0.034198 Oct 12 22:51:55.753770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1866/3844] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:51:55 2022] DELETE /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:51:55.762921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-241d4180-d01e-4fb4-bd0e-4b07a4c061c3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.763933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-241d4180-d01e-4fb4-bd0e-4b07a4c061c3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 37d40994-fa10-48ce-abfb-e9e390d57c26] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.774597 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-241d4180-d01e-4fb4-bd0e-4b07a4c061c3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-241d4180-d01e-4fb4-bd0e-4b07a4c061c3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 HTTP/1.1 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '37d40994-fa10-48ce-abfb-e9e390d57c26'} Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:51:55.776631 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:51:55.780778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:51:55.780778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:51:55.780778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:51:55.780778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. Oct 12 22:51:55.780778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:51:55.786296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-241d4180-d01e-4fb4-bd0e-4b07a4c061c3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 37d40994-fa10-48ce-abfb-e9e390d57c26 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:51:55.788005 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-241d4180-d01e-4fb4-bd0e-4b07a4c061c3 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26" status: 404 len: 111 microversion: 2.1 time: 0.029510 Oct 12 22:51:55.790947 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1979/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:55 2022] GET /compute/v2.1/servers/37d40994-fa10-48ce-abfb-e9e390d57c26 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:51:55.888851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:55.889540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:55.907850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.908368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.914624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:55.922993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:55.924482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:55.927165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:57.424173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:57.434032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-85396dff-db49-4bc4-963c-a0a5a63bb76a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 1.550022 Oct 12 22:51:57.444603 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1867/3846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:55 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:58.457592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:58.460285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:58.500767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:58.503063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:58.505116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:58.507449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:51:58.508217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:51:58.511096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:51:58.933500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:51:58.954992 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c0bf9a2-0408-4f6f-99e9-1aeed1aabeef tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 0.500916 Oct 12 22:51:58.985533 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1980/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:58 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:51:59.981049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:51:59.982411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:51:59.999920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:00.000750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:00.004638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:00.006699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:00.022739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:00.025527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:00.495713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:00.510335 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9de54dea-c6f8-43e5-9948-a9635dbf73e8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 0.533491 Oct 12 22:52:00.515023 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1868/3848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:51:59 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:01.541336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:01.542707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:01.546258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=54 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:01.573755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:01.578004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:01.578467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:01.586008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:01.587601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:01.592855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:02.569920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-969033866", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "438ef697-2288-4672-9d1c-ac87b4a198b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:02.809590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:02.824640 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1650d29c-5833-4a3a-9c5a-ace67394c030 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 1.285912 Oct 12 22:52:02.832360 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1981/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:01 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:03.853507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:03.855587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:03.883200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:03.891364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:03.894422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:03.895722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:03.896257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:03.896669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:04.817946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:04.833293 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d155c946-d052-463d-9dd5-f62afcecc612 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 0.984952 Oct 12 22:52:04.845944 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1982/3850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:03 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:04.866383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:04.868982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:04.901004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:04.905253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:04.905622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:04.906385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:04.912132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:04.916218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:04.977432 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c HTTP/1.1 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '361c1555-4595-4f25-8e04-a81993718e1c'} Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:52:04.989846 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce0be318-e66c-49ac-a409-baf9c3e0db78 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 404 len: 111 microversion: 2.1 time: 0.144298 Oct 12 22:52:04.994669 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1983/3851] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:52:04 2022] DELETE /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:52:05.010865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:05.015230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 361c1555-4595-4f25-8e04-a81993718e1c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:05.046474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.046985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.047435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.053579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.057472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.058074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.120066 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c HTTP/1.1 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '361c1555-4595-4f25-8e04-a81993718e1c'} Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:05.127560 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.132200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 361c1555-4595-4f25-8e04-a81993718e1c could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:52:05.133920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e4e30e1d-6a3e-41a6-b79c-973a820527cb tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c" status: 404 len: 111 microversion: 2.1 time: 0.137070 Oct 12 22:52:05.136374 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1984/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:04 2022] GET /compute/v2.1/servers/361c1555-4595-4f25-8e04-a81993718e1c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:52:05.150480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:05.156315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:05.175535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.176081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.176526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.177237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.177693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.189962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.249481 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 HTTP/1.1 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '753b80e8-dd52-4d1a-9cb7-a4dc58cf2485'} Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:52:05.254753 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.259231 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.260566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:52:05.264692 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fcf4ac7f-fd23-45fb-b9ba-98b240f5066d tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "DELETE /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 404 len: 111 microversion: 2.1 time: 0.125557 Oct 12 22:52:05.271767 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1985/3853] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:52:05 2022] DELETE /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:52:05.301587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:05.302226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] [instance: 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:05.330228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.335055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.335616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.336400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.336875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.337315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.396842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] HTTP exception thrown: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Request method failure captured: Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 HTTP/1.1 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0PbtvXLXN9Mqc_VZYw3-jc2SFMzYmS9JEkl2d4eSng7nNXYey2t5hFhTovtH7A-aqATe8piAVOpI__etPQNyU-40sYudSRHHJY3xAI2rTKb75OThqJHR_tEhF_Rjzf4hwZy1CsIkKkiO5iVH-YD5GJBDGJp-5RkJyvMHNVu0i2cGQY Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e08242b0d6d455c879400097c56275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e08242b0d6d455c879400097c56275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e08242b0d6d455c879400097c56275a"}]}] Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 0e08242b0d6d455c879400097c56275a Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298764790 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1353d2e3246c44cf8d4501c0f4455790 Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-1298764790-project Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '753b80e8-dd52-4d1a-9cb7-a4dc58cf2485'} Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:52:05.401184 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.406708 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:52:05.406708 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:52:05.406708 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:52:05.406708 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:52:05.406708 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:52:05.406708 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. Oct 12 22:52:05.406708 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:52:05.410642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] Returning 404 to user: Instance 753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:52:05.417797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3850849a-e812-4be8-9897-62672062bf06 tempest-DeleteServersTestJSON-1298764790 tempest-DeleteServersTestJSON-1298764790-project] 10.222.0.20 "GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485" status: 404 len: 111 microversion: 2.1 time: 0.143158 Oct 12 22:52:05.418610 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1986/3854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:05 2022] GET /compute/v2.1/servers/753b80e8-dd52-4d1a-9cb7-a4dc58cf2485 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:52:05.867290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:05.868823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:05.897128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.897744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.898162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:05.898903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:05.899363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:05.899784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:07.552303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:07.578519 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49da38aa-6daf-4475-8f23-214758b644df tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 1.713149 Oct 12 22:52:07.598129 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1987/3855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:05 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:08.101940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a259d844-f84d-485b-8bab-7abc2bfb68b1 req-6b86d0de-3b97-4232-b2ab-b3398f0ea16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae744a67-c6e6-4946-989a-717e472b7a86", "name": "network-vif-plugged", "status": "completed", "tag": "3be0fa93-e344-46c7-ba2b-825fcfdd091c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:08.134293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a259d844-f84d-485b-8bab-7abc2bfb68b1 req-6b86d0de-3b97-4232-b2ab-b3398f0ea16e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:08.137075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a259d844-f84d-485b-8bab-7abc2bfb68b1 req-6b86d0de-3b97-4232-b2ab-b3398f0ea16e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:08.140776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a259d844-f84d-485b-8bab-7abc2bfb68b1 req-6b86d0de-3b97-4232-b2ab-b3398f0ea16e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:08.177886 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a259d844-f84d-485b-8bab-7abc2bfb68b1 req-6b86d0de-3b97-4232-b2ab-b3398f0ea16e service nova] Creating event network-vif-plugged:3be0fa93-e344-46c7-ba2b-825fcfdd091c for instance ae744a67-c6e6-4946-989a-717e472b7a86 on n-h2-860864-8 Oct 12 22:52:08.196214 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a259d844-f84d-485b-8bab-7abc2bfb68b1 req-6b86d0de-3b97-4232-b2ab-b3398f0ea16e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.595383 Oct 12 22:52:08.199516 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1988/3856] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:08.608931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:08.609650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:08.631859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:08.632400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:08.632850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:08.641612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:08.642396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:08.642854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:10.014254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:10.022586 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fc86d8e-b743-4b4e-a33c-f7e05632bbe8 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1323 microversion: 2.1 time: 1.419790 Oct 12 22:52:10.031041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1989/3857] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:08 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1323 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:10.510453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:11.060582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:11.061276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:11.120821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:11.128821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:11.136568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:11.137944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:11.148211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:11.149193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:11.669064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] validate_networks() for [('438ef697-2288-4672-9d1c-ac87b4a198b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:52:12.362594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:12.391852 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e70f406-cf72-44fa-b296-c6f2e22159b5 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1515 microversion: 2.1 time: 1.335898 Oct 12 22:52:12.410182 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1990/3858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:11 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1515 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:12.426622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-895b8238-9b49-4471-bf4f-6f4d908cdd71 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'create', calling method: .version_select at 0x7f44ff5fb8b0>, body: {"pool": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:12.627004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:14.115033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:52:14.115592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:52:14.116201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:52:14.119461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:52:14.119461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:52:14.134269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:14.135124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:14.135802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:14.137760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:14.138473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:14.139142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:14.163835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Getting quotas for project e66a5b463b1e4cc68ec26e9ab2288d07. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:14.171165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Getting quotas for user 6f300f44cb214a52afa6ece5cec9921b and project e66a5b463b1e4cc68ec26e9ab2288d07. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:14.191783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:52:14.194914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:52:14.284922 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0460925a-da9a-4140-97af-45e89fbed6e3 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.019908 Oct 12 22:52:14.285570 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1869/3859] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 12023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:52:14.581416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2140047043", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "438ef697-2288-4672-9d1c-ac87b4a198b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:14.879275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] validate_networks() for [('438ef697-2288-4672-9d1c-ac87b4a198b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:52:16.920891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:52:16.921532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:52:16.921769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:52:16.923049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:52:16.923493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:52:16.947815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:16.948626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:16.949085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:16.950025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:16.950494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:16.950923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:17.055120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Getting quotas for project e66a5b463b1e4cc68ec26e9ab2288d07. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:17.066840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Getting quotas for user 6f300f44cb214a52afa6ece5cec9921b and project e66a5b463b1e4cc68ec26e9ab2288d07. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:17.088025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:52:17.093128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:52:17.176612 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6fec53d5-9f93-405d-bc46-57102e73b8a4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.598708 Oct 12 22:52:17.178166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1870/3860] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:52:17.309800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2004149354", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "451", "networks": [{"uuid": "438ef697-2288-4672-9d1c-ac87b4a198b7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:17.452403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] validate_networks() for [('438ef697-2288-4672-9d1c-ac87b4a198b7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:52:19.647332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:52:19.648506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:52:19.649162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:52:19.649740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:52:19.650314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:52:19.670521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:19.673372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:19.674357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:19.675565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:19.678006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:19.679869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:19.752159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Getting quotas for project e66a5b463b1e4cc68ec26e9ab2288d07. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:19.758142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Getting quotas for user 6f300f44cb214a52afa6ece5cec9921b and project e66a5b463b1e4cc68ec26e9ab2288d07. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:19.788937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:52:19.807091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:52:19.906665 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d9c6a44-0143-44f9-a333-ee065d2a93fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.601017 Oct 12 22:52:19.912830 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1871/3861] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:52:19.921550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58b7898c-e39a-49ac-a925-645dda766daf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:19.925139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58b7898c-e39a-49ac-a925-645dda766daf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:20.452745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-58b7898c-e39a-49ac-a925-645dda766daf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:20.462426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58b7898c-e39a-49ac-a925-645dda766daf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1221 microversion: 2.1 time: 0.548182 Oct 12 22:52:20.470070 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1872/3862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:19 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1221 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:21.075311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=19 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:21.493980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:21.495438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:21.505603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:21.508231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:21.510244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:21.511294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:21.512066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:21.512883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:21.669956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:21.678555 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4a42cf4-4644-4485-9f81-f0f1a7f0661b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1273 microversion: 2.1 time: 0.189940 Oct 12 22:52:21.685164 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1873/3863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:21 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:22.368242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=69 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:22.710749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:22.711318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:22.717567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:22.718480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:22.719081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:22.720008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:22.720674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:22.721258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:22.971082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:22.980999 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01b3837a-cc2f-40d4-b024-7411557c4426 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1279 microversion: 2.1 time: 0.274940 Oct 12 22:52:22.992707 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1874/3864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:22 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1279 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:23.167438 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-895b8238-9b49-4471-bf4f-6f4d908cdd71 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.750035 Oct 12 22:52:23.170058 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1991/3865] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:52:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:23.477328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-215048067", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "f35dcdc9-68e8-4f79-9aad-9742dda82a05"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:23.623348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] validate_networks() for [('f35dcdc9-68e8-4f79-9aad-9742dda82a05', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:52:23.849148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ed77db92-b000-48f2-8b2f-aa4a0af4ce61 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Action: 'create', calling method: .version_select at 0x7f44ff561c10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-393713541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiKYffy5cpNURgC63LrbTm0YzIinR3Ts1BGx3UN4NrFmXsm2vLscUjxfxLDZ35qNL3mRB/4aQN2SI3/4d8brkYUBN4wPILEpnlGwbgNMaGhZnnZG0loP8TGCOh2A9/V/g=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:23.912224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ed77db92-b000-48f2-8b2f-aa4a0af4ce61 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Getting quotas for project c9e4a59e36204b8d89834efe11217f36. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:23.949837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ed77db92-b000-48f2-8b2f-aa4a0af4ce61 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Getting quotas for user cbf02c31b918401f99a99b525da1c347 and project c9e4a59e36204b8d89834efe11217f36. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:24.015979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ed77db92-b000-48f2-8b2f-aa4a0af4ce61 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.671424 Oct 12 22:52:24.017162 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1875/3866] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:52:23 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:24.032879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:24.033812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:24.043404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:24.048740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:24.049537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:24.050532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:24.054831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:24.056100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:24.506942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:24.518620 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a371f36d-d9a4-4bfe-af6c-74110ae0b917 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1279 microversion: 2.1 time: 0.500104 Oct 12 22:52:24.520563 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1876/3867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:24 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1279 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:24.538741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6fdc20de-8034-4c7c-ab96-e6517bcd18b4 req-625e10a6-72b5-4ddd-ba9f-0501bf6dcea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7", "tag": "fa423897-cb10-447d-be9b-dad6607bd1eb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:24.569020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6fdc20de-8034-4c7c-ab96-e6517bcd18b4 req-625e10a6-72b5-4ddd-ba9f-0501bf6dcea2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:24.570311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6fdc20de-8034-4c7c-ab96-e6517bcd18b4 req-625e10a6-72b5-4ddd-ba9f-0501bf6dcea2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:24.571279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6fdc20de-8034-4c7c-ab96-e6517bcd18b4 req-625e10a6-72b5-4ddd-ba9f-0501bf6dcea2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:24.590100 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6fdc20de-8034-4c7c-ab96-e6517bcd18b4 req-625e10a6-72b5-4ddd-ba9f-0501bf6dcea2 service nova] Creating event network-changed:fa423897-cb10-447d-be9b-dad6607bd1eb for instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 on n-h1-860864-8 Oct 12 22:52:24.596492 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6fdc20de-8034-4c7c-ab96-e6517bcd18b4 req-625e10a6-72b5-4ddd-ba9f-0501bf6dcea2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074205 Oct 12 22:52:24.597930 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1877/3868] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:25.544697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:25.546240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:25.563809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:25.564607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:25.565298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:25.566633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:25.568486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:25.570033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:26.184905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:26.217190 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a5d05b5-9efe-46c1-adcb-f146a850626c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1279 microversion: 2.1 time: 0.673796 Oct 12 22:52:26.219029 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1878/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:25 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1279 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:27.244014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:27.245080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:27.264134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:27.265121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:27.266139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:27.267446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:27.268272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:27.269880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:27.473029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:27.495600 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54277b3b-7784-4e41-aa73-2c58eec2267c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1279 microversion: 2.1 time: 0.250198 Oct 12 22:52:27.499908 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1879/3870] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:27 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:28.200793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:52:28.201271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:52:28.206913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:52:28.207344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:52:28.207765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:52:28.242077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:28.259099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:28.259824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:28.260884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:28.264760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:28.265442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:28.365054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Getting quotas for project dac82d48217a412b8f9da673cbed0520. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:28.387751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Getting quotas for user 55c612e09c1141e0981359245d0f4132 and project dac82d48217a412b8f9da673cbed0520. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:28.469242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:52:28.485435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:52:28.525549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:28.526356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:28.547361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:28.547828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:28.555832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:28.556639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:28.557505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:28.557645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:28.757406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84126273-f541-49b5-8a49-c702cdcb290a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.281282 Oct 12 22:52:28.766801 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1992/3871] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:52:28.783364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dafcaafb-5c09-4750-9ad0-f27c9d93bfc9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:28.784859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dafcaafb-5c09-4750-9ad0-f27c9d93bfc9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:29.122990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dafcaafb-5c09-4750-9ad0-f27c9d93bfc9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:29.140606 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dafcaafb-5c09-4750-9ad0-f27c9d93bfc9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1223 microversion: 2.1 time: 0.372558 Oct 12 22:52:29.146261 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1993/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:28 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1223 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:29.714041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:30.170952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:30.171765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:30.188382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:30.193131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:30.193880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:30.195853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:30.199832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:30.201571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:30.606135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:30.620544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-065d259d-406f-4a3d-a6ce-b9b04410f487 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1227 microversion: 2.1 time: 0.452250 Oct 12 22:52:30.625019 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1994/3873] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:30 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1227 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:30.716800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:30.737446 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e145c9a9-e809-4f22-a945-5df413819aaf tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 2.207654 Oct 12 22:52:30.765742 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1880/3874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:28 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:31.657862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:31.659124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:31.670539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:31.673112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:31.674248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:31.675175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:31.675973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:31.676573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:31.780497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:31.783260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:31.813128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:31.813964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:31.815096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:31.816272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:31.819914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:31.820733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:32.004796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:32.030974 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec7bb7af-f093-475d-b515-2661d89898cd tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1281 microversion: 2.1 time: 0.379394 Oct 12 22:52:32.041336 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1995/3875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:31 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1281 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:32.277518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:32.294958 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8ee56fa-7c71-4a89-aa0e-2b817f32f831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 0.521254 Oct 12 22:52:32.298944 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1881/3876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:31 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:33.066039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:33.067403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:33.088510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:33.089863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:33.090641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:33.091525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:33.092414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:33.096971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:33.499111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:33.515966 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0657eb2b-00e6-4905-806f-25c609b7a035 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1281 microversion: 2.1 time: 0.454332 Oct 12 22:52:33.537009 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1996/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:33 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1281 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:33.566275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:33.570917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:33.587639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:33.588385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:33.589048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:33.589987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:33.594804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:33.599540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:34.010145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d50f586e-29c0-4b7f-b95a-cea3ab8c3827 req-a8e6688e-6e63-4154-8b37-f77787b1795c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5369244-5c2f-413f-a8e7-0f33e9c14cde", "tag": "045258f4-b318-4b15-b6c5-248b42946281"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:34.010145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d50f586e-29c0-4b7f-b95a-cea3ab8c3827 req-a8e6688e-6e63-4154-8b37-f77787b1795c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:34.010145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d50f586e-29c0-4b7f-b95a-cea3ab8c3827 req-a8e6688e-6e63-4154-8b37-f77787b1795c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:34.010145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d50f586e-29c0-4b7f-b95a-cea3ab8c3827 req-a8e6688e-6e63-4154-8b37-f77787b1795c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:34.010145 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d50f586e-29c0-4b7f-b95a-cea3ab8c3827 req-a8e6688e-6e63-4154-8b37-f77787b1795c service nova] Creating event network-changed:045258f4-b318-4b15-b6c5-248b42946281 for instance b5369244-5c2f-413f-a8e7-0f33e9c14cde on n-h1-860864-8 Oct 12 22:52:34.010145 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d50f586e-29c0-4b7f-b95a-cea3ab8c3827 req-a8e6688e-6e63-4154-8b37-f77787b1795c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.767919 Oct 12 22:52:34.010145 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1882/3878] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:52:34.406629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b4754945-f17d-47bb-9379-c7053abba7bb req-0c6930ca-b689-46e8-9cb1-98c94842377e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7", "name": "network-vif-plugged", "status": "completed", "tag": "fa423897-cb10-447d-be9b-dad6607bd1eb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:34.429029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=24 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:34.458188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b4754945-f17d-47bb-9379-c7053abba7bb req-0c6930ca-b689-46e8-9cb1-98c94842377e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:34.461554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b4754945-f17d-47bb-9379-c7053abba7bb req-0c6930ca-b689-46e8-9cb1-98c94842377e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:34.463333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b4754945-f17d-47bb-9379-c7053abba7bb req-0c6930ca-b689-46e8-9cb1-98c94842377e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:34.518083 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b4754945-f17d-47bb-9379-c7053abba7bb req-0c6930ca-b689-46e8-9cb1-98c94842377e service nova] Creating event network-vif-plugged:fa423897-cb10-447d-be9b-dad6607bd1eb for instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 on n-h1-860864-8 Oct 12 22:52:34.552231 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b4754945-f17d-47bb-9379-c7053abba7bb req-0c6930ca-b689-46e8-9cb1-98c94842377e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154085 Oct 12 22:52:34.553512 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1883/3879] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:52:34.566065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:34.569258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:34.582220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:34.589860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:34.590552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:34.591806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:34.592475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:34.593123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:34.794275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:34.808958 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-454bb473-b469-482b-9ad0-9e7bba5fccc9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 1.263715 Oct 12 22:52:34.810824 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1997/3880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:33 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:35.234920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:35.244348 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c512fd99-978c-4913-b9fa-348f3c57feb9 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1281 microversion: 2.1 time: 0.684786 Oct 12 22:52:35.247855 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1884/3881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:34 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1281 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:35.693821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-238633638", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-393713541", "security_groups": [{"name": "tempest-secgroup-smoke-733164384"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "9ae158b2-e5e5-4c9d-9d92-cdef7949efe4"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:35.837341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:35.839777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:35.852554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:35.854560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:35.856453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:35.857506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:35.859370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:35.860084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:35.936427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] validate_networks() for [('9ae158b2-e5e5-4c9d-9d92-cdef7949efe4', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:52:36.187357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:36.200766 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88f19864-867d-4c20-acd9-27b11668ee6f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 0.368213 Oct 12 22:52:36.218199 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1885/3882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:35 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:36.267340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:36.268618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:36.280207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.283237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.284188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:36.285144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.287818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.288468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:36.403095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:36.413786 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-231f1a41-ec0b-4ffa-a44c-2670128f11c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1281 microversion: 2.1 time: 0.150346 Oct 12 22:52:36.416866 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1886/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:36 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:36.536535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ffb2999a-176d-4fcb-9f9d-cc107e928f4c req-c1ffb04a-3fd1-43e1-aa66-a6d6d1031ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23c2955-a1e2-4abd-9cf6-4da97081b8ab", "tag": "44636f35-f845-4a17-a12d-365a9fb2164c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:36.555387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ffb2999a-176d-4fcb-9f9d-cc107e928f4c req-c1ffb04a-3fd1-43e1-aa66-a6d6d1031ab0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:36.555885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ffb2999a-176d-4fcb-9f9d-cc107e928f4c req-c1ffb04a-3fd1-43e1-aa66-a6d6d1031ab0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:36.556351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ffb2999a-176d-4fcb-9f9d-cc107e928f4c req-c1ffb04a-3fd1-43e1-aa66-a6d6d1031ab0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:36.577818 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ffb2999a-176d-4fcb-9f9d-cc107e928f4c req-c1ffb04a-3fd1-43e1-aa66-a6d6d1031ab0 service nova] Creating event network-changed:44636f35-f845-4a17-a12d-365a9fb2164c for instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab on n-h2-860864-8 Oct 12 22:52:36.588354 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ffb2999a-176d-4fcb-9f9d-cc107e928f4c req-c1ffb04a-3fd1-43e1-aa66-a6d6d1031ab0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056355 Oct 12 22:52:36.592722 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1887/3884] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:37.239730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:37.240521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:37.259064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:37.262743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:37.264086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:37.265015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:37.266377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:37.269546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:38.168792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:38.184271 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-73e50cfb-0547-4d5a-ae7b-6b1a57bdcb6e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 0.956053 Oct 12 22:52:38.185283 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1888/3885] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:37 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:38.203317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:38.203317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:38.213041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:38.214743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:38.216061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:38.217663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:38.218592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:38.221063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:38.317527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:38.503544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Getting quotas for project c9e4a59e36204b8d89834efe11217f36. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:38.520807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Getting quotas for user cbf02c31b918401f99a99b525da1c347 and project c9e4a59e36204b8d89834efe11217f36. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:38.562153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:52:38.562575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:52:38.563053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:52:38.563457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:52:38.564090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:52:38.578037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:38.580041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:38.582248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:38.584431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:38.585086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:38.586446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:38.634269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Getting quotas for project c9e4a59e36204b8d89834efe11217f36. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:38.640890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Getting quotas for user cbf02c31b918401f99a99b525da1c347 and project c9e4a59e36204b8d89834efe11217f36. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:38.668933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:52:38.671164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:52:38.726505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75731885-3dd4-4fe2-8317-b85c4fbeac76 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.036292 Oct 12 22:52:38.727783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1998/3886] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:52:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 3038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:52:38.740570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66839f9b-3b2f-4caa-9fd6-a7273977675d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:38.741452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-66839f9b-3b2f-4caa-9fd6-a7273977675d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:38.840665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:38.876246 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cc852439-de39-4045-9f78-6ef74d38e982 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 0.683547 Oct 12 22:52:38.880236 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1889/3887] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:38 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:38.943661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-66839f9b-3b2f-4caa-9fd6-a7273977675d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:38.956235 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-66839f9b-3b2f-4caa-9fd6-a7273977675d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1301 microversion: 2.1 time: 0.216803 Oct 12 22:52:38.957123 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1999/3888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:38 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1301 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:39.217072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:39.217703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:39.229416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:39.229952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:39.236459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:39.238324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:39.239570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:39.240298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:39.729295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:39.807104 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09420b85-f01f-4807-8354-11ade4d08b2f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 0.594606 Oct 12 22:52:39.831213 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1890/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:39 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:39.909674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:39.910291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:39.925401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:39.925924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:39.926395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:39.931489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:39.932356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:39.940163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:39.985156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:39.985700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:40.000120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:40.000640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:40.001159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:40.001826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:40.002283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:40.002714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:40.147217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:40.156219 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b364a088-12fa-4dc4-aafa-cf42a2d514ba tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1305 microversion: 2.1 time: 0.175651 Oct 12 22:52:40.160200 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1891/3890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:39 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:40.841796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:40.842809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:40.853955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:40.863136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:40.864077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:40.864766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:40.866532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:40.867251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:40.867928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:40.878428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:41.264263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:41.274120 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e6c4caa-52f8-4164-98bb-ab51e9d7088f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 0.436206 Oct 12 22:52:41.295919 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1892/3891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:40 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:41.296460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:41.299079 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6dc19239-f62a-42aa-ac57-1e53914620ad tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 1.398046 Oct 12 22:52:41.300171 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2000/3892] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:39 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:41.311610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9798cc1b-758a-4bfe-9e44-a05128127a4f req-975afdeb-a93e-4b06-ab6b-efe0cfba2bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5369244-5c2f-413f-a8e7-0f33e9c14cde", "name": "network-vif-plugged", "status": "completed", "tag": "045258f4-b318-4b15-b6c5-248b42946281"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:41.312034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:41.312873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:41.329745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:41.330516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:41.331118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:41.332037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:41.332682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:41.333332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:41.343586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9798cc1b-758a-4bfe-9e44-a05128127a4f req-975afdeb-a93e-4b06-ab6b-efe0cfba2bb2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:41.344614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9798cc1b-758a-4bfe-9e44-a05128127a4f req-975afdeb-a93e-4b06-ab6b-efe0cfba2bb2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:41.345059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9798cc1b-758a-4bfe-9e44-a05128127a4f req-975afdeb-a93e-4b06-ab6b-efe0cfba2bb2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:41.373640 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9798cc1b-758a-4bfe-9e44-a05128127a4f req-975afdeb-a93e-4b06-ab6b-efe0cfba2bb2 service nova] Creating event network-vif-plugged:045258f4-b318-4b15-b6c5-248b42946281 for instance b5369244-5c2f-413f-a8e7-0f33e9c14cde on n-h1-860864-8 Oct 12 22:52:41.384802 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9798cc1b-758a-4bfe-9e44-a05128127a4f req-975afdeb-a93e-4b06-ab6b-efe0cfba2bb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098064 Oct 12 22:52:41.386552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1893/3893] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:41.622200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:41.633635 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37b4711f-d950-452a-93ca-fcbf879af172 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1359 microversion: 2.1 time: 0.330055 Oct 12 22:52:41.649252 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2001/3894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:41 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:42.312248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:42.313658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:42.323585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:42.324383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:42.324994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:42.325868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:42.326466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:42.326604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:42.327379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:42.328918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:42.354340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:42.355385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:42.369211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:42.371311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:42.371800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:42.379990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:42.783624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:42.797334 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b30dfca7-4bb6-4347-b8b7-ca5b44866515 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 0.489925 Oct 12 22:52:42.799908 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1894/3895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:42 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:42.834548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:42.835565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:42.850120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:42.859097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:42.859837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:42.860750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:42.861617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:42.862106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:43.130936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:43.160440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb6408cd-af2f-473b-9746-312b82224159 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1359 microversion: 2.1 time: 0.338809 Oct 12 22:52:43.177992 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1895/3896] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:42 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1359 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:43.607202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:43.627136 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ae7733ff-5302-4e91-aa91-807cf5714ef6 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 1.302876 Oct 12 22:52:43.629924 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2002/3897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:42 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:43.792849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fee92652-6777-49ed-b23c-d60d536f55d5 req-aeb79984-b953-4a2a-a630-77e6ec42d1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25333e77-51da-4212-bc0a-2e4770b1b05b", "tag": "e4052271-2b74-4ed3-b778-a7b228694a36"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:43.825763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:43.826398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:43.831719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fee92652-6777-49ed-b23c-d60d536f55d5 req-aeb79984-b953-4a2a-a630-77e6ec42d1a0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:43.847468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fee92652-6777-49ed-b23c-d60d536f55d5 req-aeb79984-b953-4a2a-a630-77e6ec42d1a0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:43.848012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fee92652-6777-49ed-b23c-d60d536f55d5 req-aeb79984-b953-4a2a-a630-77e6ec42d1a0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:43.857676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:43.859353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:43.859794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:43.860538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:43.860991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:43.861412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:43.905602 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fee92652-6777-49ed-b23c-d60d536f55d5 req-aeb79984-b953-4a2a-a630-77e6ec42d1a0 service nova] Creating event network-changed:e4052271-2b74-4ed3-b778-a7b228694a36 for instance 25333e77-51da-4212-bc0a-2e4770b1b05b on n-h2-860864-8 Oct 12 22:52:43.934649 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fee92652-6777-49ed-b23c-d60d536f55d5 req-aeb79984-b953-4a2a-a630-77e6ec42d1a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132526 Oct 12 22:52:43.935369 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1896/3898] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:44.186756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:44.187685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:44.202809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:44.203546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:44.205155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:44.207453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:44.208121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:44.209204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:44.439319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:44.453168 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-950e6069-9806-433a-a4a2-f01698724fad tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1359 microversion: 2.1 time: 0.271491 Oct 12 22:52:44.475342 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1897/3899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:44 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:44.656089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:44.656763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:44.674164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:44.675112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:44.675559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:44.681074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:44.681574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:44.682015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:45.098667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:45.114224 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3ba4089-73b4-480f-b7fa-6b5b53d7d7cf tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 0.463456 Oct 12 22:52:45.117753 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1898/3900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:44 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:45.133024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-03d27ba8-ca66-4194-b91c-ee66381395da req-03b48069-1e16-49d9-a6db-7aaa41191c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23c2955-a1e2-4abd-9cf6-4da97081b8ab", "name": "network-vif-plugged", "status": "completed", "tag": "44636f35-f845-4a17-a12d-365a9fb2164c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:45.157722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-03d27ba8-ca66-4194-b91c-ee66381395da req-03b48069-1e16-49d9-a6db-7aaa41191c65 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:45.158505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-03d27ba8-ca66-4194-b91c-ee66381395da req-03b48069-1e16-49d9-a6db-7aaa41191c65 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:45.159106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-03d27ba8-ca66-4194-b91c-ee66381395da req-03b48069-1e16-49d9-a6db-7aaa41191c65 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:45.196200 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-03d27ba8-ca66-4194-b91c-ee66381395da req-03b48069-1e16-49d9-a6db-7aaa41191c65 service nova] Creating event network-vif-plugged:44636f35-f845-4a17-a12d-365a9fb2164c for instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab on n-h2-860864-8 Oct 12 22:52:45.232350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-03d27ba8-ca66-4194-b91c-ee66381395da req-03b48069-1e16-49d9-a6db-7aaa41191c65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103341 Oct 12 22:52:45.235192 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1899/3901] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:45.484883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:45.485593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:45.493758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:45.494259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:45.494699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:45.495456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:45.495932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:45.496371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:45.675798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:45.694503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29ce2fae-fcc1-4522-a88b-6419052f27b9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1359 microversion: 2.1 time: 0.213748 Oct 12 22:52:45.701609 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1900/3902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:45 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:46.113517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:46.129207 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5f388add-b344-484e-97b1-450f62124fec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 2.309347 Oct 12 22:52:46.130516 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2003/3903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:43 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:46.145057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:46.146407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:46.160306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:46.167405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:46.168223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:46.169254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:46.169877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:46.170470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:46.439284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:46.450813 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63a01047-427c-46d4-8048-bf8740b98387 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 0.307079 Oct 12 22:52:46.451587 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1901/3904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:46 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:46.729097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:46.730633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:46.748055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:46.751329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:46.753079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:46.754080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:46.754554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:46.756311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:47.156301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:47.158186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:47.170589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:47.171094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:47.171540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:47.172306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:47.172772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:47.173198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:47.538774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:47.578730 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8895587-0083-4786-9faf-27c706f2f27f tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1321 microversion: 2.1 time: 0.426181 Oct 12 22:52:47.583278 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1902/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:47 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:47.626144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:47.627204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:47.659304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:47.661897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:47.662987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:47.666851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:47.669582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:47.672699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:48.051924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:48.067931 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65d94506-92be-46d0-a24c-ded823b0e199 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 0.480307 Oct 12 22:52:48.068550 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1903/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:47 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:48.133462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:48.144607 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd756ae4-843b-405f-a4d8-7fd9d6b4195d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 1.420189 Oct 12 22:52:48.147858 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2004/3907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:46 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:48.623548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:48.624925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:48.638458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:48.640857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:48.641489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:48.647421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:48.648188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:48.648790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.098364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:49.099695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:49.106282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:49.115732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=20 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:49.146487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.147111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.147455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.149985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.150180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.153503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.190224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:49.217881 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d5164b7-188f-4449-9203-e5f46b430d15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1512 microversion: 2.1 time: 0.612349 Oct 12 22:52:49.225060 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1904/3908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:48 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:49.249665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:49.262162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:49.287604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.288483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.293364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.296060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.296729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.301901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.665556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:49.675563 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-652c5f38-90b3-4a39-a082-473b1de64b1d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 0.444935 Oct 12 22:52:49.677169 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1905/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:49 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:49.681910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:49.682569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:49.716963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.717465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.717911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:49.718627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:49.719270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:49.719862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.046988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:50.067549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-55908f38-a218-47d3-bbf5-557f2d4c9b35 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1512 microversion: 2.1 time: 0.389278 Oct 12 22:52:50.070736 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1906/3910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:49 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1512 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:50.100823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:50.101935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:50.116148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.118731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.119561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.122478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.123581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.127798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.386842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:50.398694 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3750f73c-da47-4dd1-acf6-0cd63f6598da tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 1.305809 Oct 12 22:52:50.400133 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2005/3911] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:49 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:50.474037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:50.490656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f681b154-8dce-4f25-9d67-5c3af60cc1e5 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 200 len: 1512 microversion: 2.1 time: 0.394415 Oct 12 22:52:50.491882 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1907/3912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:50 2022] GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:50.521317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:50.534864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:50.535794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:50.572525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.574959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.576591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.578230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.580464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.580918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.701072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:50.702219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:50.715407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.716164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.724601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.725807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.726438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.727046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:50.748307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:50.879592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:50.893109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:50.893840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:50.894506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:51.019832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:51.046135 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ed88615-b9e2-49c1-8c0f-076c607a7dbe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 0.345920 Oct 12 22:52:51.047956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1908/3913] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:50 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:51.430233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:51.430854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:51.457415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:51.457918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:51.458373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:51.459090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:51.459549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:51.460008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:51.804685 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb63b21a-844b-46f1-87c5-3edd5e7b84ab tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.287394 Oct 12 22:52:51.821033 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2006/3914] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 12 22:52:50 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:51.838122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:51.844254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:51.852896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-969033866', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:51.862090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:51.867360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:51.868170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:51.868786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:51.870979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:51.880939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:51.881651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:52.107123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:52.224860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:52.238286 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3de53cb4-e45c-41fc-a438-6a5dd8048243 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 0.812453 Oct 12 22:52:52.264309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1909/3915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:51 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:52.274561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:52.275182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:52.302188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:52.310786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:52.311523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:52.312448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:52.313056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:52.313692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:52.330512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:52.348142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:52.349825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:52.353341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:52.757826 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92eec261-d22e-4690-8233-c682ac6430fb tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-969033866" status: 200 len: 1515 microversion: 2.1 time: 0.923969 Oct 12 22:52:52.758986 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2007/3916] 10.222.0.20 () {58 vars in 1261 bytes} [Wed Oct 12 22:52:51 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-969033866 => generated 1515 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:52.801801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:52.827389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:52.832720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:52.852539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:52.855309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:52.857801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:52.868759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:52.871458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:52.872533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:53.009088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=85 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:53.041440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:53.197961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:53.214922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:53.215555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:53.215833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:53.668681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-463ee162-617a-4f5c-9b12-a66fe331f398 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.884602 Oct 12 22:52:53.669323 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2008/3917] 10.222.0.20 () {58 vars in 1173 bytes} [Wed Oct 12 22:52:52 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:53.675558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a4c5ca26-6824-4023-a8c7-95a986d307b4 req-37a56f35-bb99-4b50-9621-5493772f781b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ebc986-cced-4189-b659-8838d2f9747f", "tag": "38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:53.733037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4c5ca26-6824-4023-a8c7-95a986d307b4 req-37a56f35-bb99-4b50-9621-5493772f781b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:53.733667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4c5ca26-6824-4023-a8c7-95a986d307b4 req-37a56f35-bb99-4b50-9621-5493772f781b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:53.736392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4c5ca26-6824-4023-a8c7-95a986d307b4 req-37a56f35-bb99-4b50-9621-5493772f781b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:53.769476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a4c5ca26-6824-4023-a8c7-95a986d307b4 req-37a56f35-bb99-4b50-9621-5493772f781b service nova] Creating event network-changed:38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1 for instance 98ebc986-cced-4189-b659-8838d2f9747f on n-h1-860864-8 Oct 12 22:52:53.804338 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a4c5ca26-6824-4023-a8c7-95a986d307b4 req-37a56f35-bb99-4b50-9621-5493772f781b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114197 Oct 12 22:52:53.814096 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2009/3918] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:53.844466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:53.846304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:53.888211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:53.888941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:53.897605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:53.898735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:53.902511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:53.903138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:54.174750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:54.177447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:52:54.201322 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd0a5603-0e91-4baa-b386-195a46576e53 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 1.935790 Oct 12 22:52:54.216283 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1910/3919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:52 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:54.238047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:54.252705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:54.260444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.servers [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Removing options 'limit' from query {{(pid=120543) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:52:54.261789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:54.281984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:54.287408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:54.288041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:54.290236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:54.294121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:54.294819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:54.436608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:54.450649 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90ed6a22-ec54-46dc-a222-0174939c5355 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 0.634417 Oct 12 22:52:54.451428 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2010/3920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:53 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:54.463098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:54.467710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ef5ba5b3-2f1a-4e6b-a40a-0003961af3ac req-41f4aefe-9eb7-458c-9159-dfcf8476be13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25333e77-51da-4212-bc0a-2e4770b1b05b", "name": "network-vif-plugged", "status": "completed", "tag": "e4052271-2b74-4ed3-b778-a7b228694a36"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:54.486489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ef5ba5b3-2f1a-4e6b-a40a-0003961af3ac req-41f4aefe-9eb7-458c-9159-dfcf8476be13 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:54.487001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ef5ba5b3-2f1a-4e6b-a40a-0003961af3ac req-41f4aefe-9eb7-458c-9159-dfcf8476be13 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:54.487440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ef5ba5b3-2f1a-4e6b-a40a-0003961af3ac req-41f4aefe-9eb7-458c-9159-dfcf8476be13 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:54.495411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:54.496705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:54.497520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:54.516505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ef5ba5b3-2f1a-4e6b-a40a-0003961af3ac req-41f4aefe-9eb7-458c-9159-dfcf8476be13 service nova] Creating event network-vif-plugged:e4052271-2b74-4ed3-b778-a7b228694a36 for instance 25333e77-51da-4212-bc0a-2e4770b1b05b on n-h2-860864-8 Oct 12 22:52:54.527827 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ef5ba5b3-2f1a-4e6b-a40a-0003961af3ac req-41f4aefe-9eb7-458c-9159-dfcf8476be13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075154 Oct 12 22:52:54.537525 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2011/3921] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:55.236513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:55.239037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:55.264442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.265208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.265841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.267349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.267817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.268279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.287306 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f19ecc6c-f4da-477d-b6d6-61fa1f50f589 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.078248 Oct 12 22:52:55.288493 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1911/3922] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 22:52:54 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:55.334362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:55.341146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:55.348885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:55.363733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.365803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.366644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.368724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.369957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.372445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.457263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:55.523497 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b74f2c43-2ac2-4842-be84-6fb4b8537f93 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.198662 Oct 12 22:52:55.540482 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1912/3923] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:52:55 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:55.557881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:55.559883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:55.574232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.574637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.582056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.583101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:55.588228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:55.588933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:55.957276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:55.974392 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5498c69f-91d5-4f7d-93cc-da68bf9a8cb9 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 0.744346 Oct 12 22:52:55.994487 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2012/3924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:55 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:56.002535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:56.032833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:56.033647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.compute.servers [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Removing options 'limit' from query {{(pid=120542) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:52:56.044806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:56.064287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.065253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.071248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.077728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.078570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.092623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.184312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:56.265636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-64daf8f3-9afe-4cff-b751-27b9506dae13 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.269717 Oct 12 22:52:56.269176 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2013/3925] 10.222.0.20 () {58 vars in 1150 bytes} [Wed Oct 12 22:52:55 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:56.284624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:56.298172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:56.300921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:56.316941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.323130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.323717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.324822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.332240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.332770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.425197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:56.484713 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-697b907d-a92e-4abf-8b10-b2f1a057080d tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.204676 Oct 12 22:52:56.493854 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2014/3926] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 22:52:56 2022] GET /compute/v2.1/servers => generated 1011 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:56.511117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:56.533855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:56.540988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:56.577590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.578083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.578520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.579241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:56.582774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:56.582774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:56.661451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:56.684374 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56c37129-50b6-4a07-bb93-447158a59328 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1323 microversion: 2.1 time: 1.138940 Oct 12 22:52:56.684639 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1913/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:55 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1323 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:56.715019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d094174-65e6-45af-a4cb-6b8a683063eb tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Action: 'create', calling method: .version_select at 0x7f44ff3e50d0>, body: {"keypair": {"name": "tempest-keypair-1990537770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV34GPi01vIXXr9lrfaCQIm9SP/T+z04oaZZHZRu9ytk97fLeyu2RyNvW3CU/zmjwlACPpEe7LoAwCGGmpRQirfG6zCvXEj2ATfgmds7cxiJrryrUTnKLpDfQ2t1i53Nw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:56.739713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9d094174-65e6-45af-a4cb-6b8a683063eb tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Getting quotas for project e166451124234653b4ebda1b54d31af9. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:52:56.747674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9d094174-65e6-45af-a4cb-6b8a683063eb tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Getting quotas for user 6c0944ea55824ccb8b6c8c812439293b and project e166451124234653b4ebda1b54d31af9. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:52:56.797817 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d094174-65e6-45af-a4cb-6b8a683063eb tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.095222 Oct 12 22:52:56.798717 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1914/3928] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:52:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:52:56.865925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:57.002010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:57.002885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:57.025179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.026403 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3d8a1343-da1d-4c5d-b8d7-81c4982062ca tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.518011 Oct 12 22:52:57.028138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.029128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.032611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.033322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.033923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.040985 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2015/3929] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:52:56 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:52:57.059235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:57.070354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:57.070815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.compute.servers [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Removing options 'limit' from query {{(pid=120542) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:52:57.071481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:57.086602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.087142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.089329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.091441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.092163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.092853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.149894 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aba54726-543e-4021-bfb7-10587dc29cb0 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.106827 Oct 12 22:52:57.166427 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2016/3930] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Oct 12 22:52:57 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:57.171563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:57.180826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:57.187652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-969033866', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:52:57.212296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.216118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.218036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.220196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.220858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.222581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.387708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:52:57.509770 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6968027-e8d3-4db9-a451-b0f405c0b831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-969033866" status: 200 len: 345 microversion: 2.1 time: 0.341620 Oct 12 22:52:57.518320 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2017/3931] 10.222.0.20 () {58 vars in 1240 bytes} [Wed Oct 12 22:52:57 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-969033866 => generated 345 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:52:57.523924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f73707e-e08e-4f2d-a60d-99021a5533d8 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:57.537678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f73707e-e08e-4f2d-a60d-99021a5533d8 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.539837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f73707e-e08e-4f2d-a60d-99021a5533d8 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.540494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f73707e-e08e-4f2d-a60d-99021a5533d8 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.574851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f73707e-e08e-4f2d-a60d-99021a5533d8 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:52:57.644046 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f73707e-e08e-4f2d-a60d-99021a5533d8 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "POST /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7/action" status: 202 len: 0 microversion: 2.1 time: 0.122021 Oct 12 22:52:57.645982 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2018/3932] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:52:57 2022] POST /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:52:57.672287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:57.674031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:57.703517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.714447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.720968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.721773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.722299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.722732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.866608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:57.881535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4044ec97-545b-4040-b7fb-00f718b8d21e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 0.883943 Oct 12 22:52:57.884578 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1915/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:56 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:57.924083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:57.925254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:57.950680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.958061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.958542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:57.959309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:57.959764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:57.967021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.089495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:58.101019 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce0cfdcd-cf3c-4d24-a3b6-6d23a7f5b5d9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1522 microversion: 2.1 time: 0.450110 Oct 12 22:52:58.104432 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2019/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:57 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:58.678295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:58.691220 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d746ccb-0c9e-4720-8141-34dc268f600f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 200 len: 1516 microversion: 2.1 time: 0.802883 Oct 12 22:52:58.692401 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1916/3935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:57 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 1516 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:52:58.723321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'action', calling method: .version_select at 0x7f4505f578b0>, body: {"addFloatingIp": {"address": "172.25.6.219"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:52:58.727168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.746455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.748195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.748720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.751380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.751977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.755020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.856351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:52:58.856906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquired lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:52:58.909837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:58.910986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:58.926332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.928205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.928841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:58.930147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:58.931078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:58.932215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:59.287055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:59.296834 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e8b1c923-2a7c-4679-b92b-dada4df6dcc1 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 0.391935 Oct 12 22:52:59.297431 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1917/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:58 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:52:59.319752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:52:59.320403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:52:59.339595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:59.348257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:59.348764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:59.351571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:52:59.352096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:52:59.352542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:52:59.740230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:52:59.752237 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32e12f5f-4f04-4058-93b1-0f8c5d7e3d24 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1522 microversion: 2.1 time: 0.452464 Oct 12 22:52:59.752856 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1918/3937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:52:59 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:00.271208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-33e32c84-88ba-47aa-ba48-83d0d7ed5815 req-19b72df4-f1bb-44e6-93f2-6b3e0e693ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ebc986-cced-4189-b659-8838d2f9747f", "name": "network-vif-plugged", "status": "completed", "tag": "38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:00.294386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-33e32c84-88ba-47aa-ba48-83d0d7ed5815 req-19b72df4-f1bb-44e6-93f2-6b3e0e693ffc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:00.294917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-33e32c84-88ba-47aa-ba48-83d0d7ed5815 req-19b72df4-f1bb-44e6-93f2-6b3e0e693ffc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:00.300644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-33e32c84-88ba-47aa-ba48-83d0d7ed5815 req-19b72df4-f1bb-44e6-93f2-6b3e0e693ffc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:00.331716 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-33e32c84-88ba-47aa-ba48-83d0d7ed5815 req-19b72df4-f1bb-44e6-93f2-6b3e0e693ffc service nova] Creating event network-vif-plugged:38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1 for instance 98ebc986-cced-4189-b659-8838d2f9747f on n-h1-860864-8 Oct 12 22:53:00.346665 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-33e32c84-88ba-47aa-ba48-83d0d7ed5815 req-19b72df4-f1bb-44e6-93f2-6b3e0e693ffc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079023 Oct 12 22:53:00.347549 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1919/3938] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:53:00.361328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:00.362664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:00.382783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:00.383280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:00.383722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:00.388480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:00.389149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:00.389771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:01.486191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:01.495826 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-06d1304e-3c15-4b7e-b1ac-3bd37f010a2d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1426 microversion: 2.1 time: 1.146880 Oct 12 22:53:01.502792 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1920/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:00 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1426 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:01.511548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:01.513021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:01.524605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:01.525375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:01.526744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:01.527623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:01.528287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:01.528892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:01.926873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:01.942021 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b932a90-b344-42e4-a770-f07bdaa768e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1522 microversion: 2.1 time: 0.437746 Oct 12 22:53:01.942752 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1921/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:01 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:02.112169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Building network info cache for instance {{(pid=120542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:53:02.305633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1915277434", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "a26150b6-8031-4646-a2e6-a52d04e853f2"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:02.455427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] validate_networks() for [('a26150b6-8031-4646-a2e6-a52d04e853f2', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:53:03.187061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:03.417590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Updating instance_info_cache with network_info: [{"id": "3be0fa93-e344-46c7-ba2b-825fcfdd091c", "address": "fa:16:3e:e2:b1:e4", "network": {"id": "f35dcdc9-68e8-4f79-9aad-9742dda82a05", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-630338-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dac82d48217a412b8f9da673cbed0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3be0fa93-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:53:03.451238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Releasing lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:53:03.453924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c33e6d2f-9d04-4ab4-afaf-f87e4adacc0f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action" status: 202 len: 0 microversion: 2.1 time: 4.739271 Oct 12 22:53:03.460097 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2020/3941] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:52:58 2022] POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action => generated 0 bytes in 4747 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:53:03.467590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-71688e18-7f4f-4c22-8927-9ee571e76d3b req-90d093d1-4179-4ea3-8970-771214f53a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae744a67-c6e6-4946-989a-717e472b7a86", "tag": "3be0fa93-e344-46c7-ba2b-825fcfdd091c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:03.492188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-71688e18-7f4f-4c22-8927-9ee571e76d3b req-90d093d1-4179-4ea3-8970-771214f53a8f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:03.492745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-71688e18-7f4f-4c22-8927-9ee571e76d3b req-90d093d1-4179-4ea3-8970-771214f53a8f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:03.493183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-71688e18-7f4f-4c22-8927-9ee571e76d3b req-90d093d1-4179-4ea3-8970-771214f53a8f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:03.524553 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-71688e18-7f4f-4c22-8927-9ee571e76d3b req-90d093d1-4179-4ea3-8970-771214f53a8f service nova] Creating event network-changed:3be0fa93-e344-46c7-ba2b-825fcfdd091c for instance ae744a67-c6e6-4946-989a-717e472b7a86 on n-h2-860864-8 Oct 12 22:53:03.534370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-71688e18-7f4f-4c22-8927-9ee571e76d3b req-90d093d1-4179-4ea3-8970-771214f53a8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072623 Oct 12 22:53:03.534983 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2021/3942] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:03.547153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:03.548951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:03.585421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:03.586700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:03.591263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:03.593643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:03.594295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:03.596067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:03.961566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:03.971866 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5fae02b0-54e5-49de-a776-4db03fd20045 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1606 microversion: 2.1 time: 0.433498 Oct 12 22:53:03.979150 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2022/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:03 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1606 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:03.989819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:03.991653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:04.006031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.006539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.006978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.007693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.014470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.015235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.048529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:04.322811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:04.342606 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9b04c3d-3167-4f31-bf0f-edc6220fce3a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1522 microversion: 2.1 time: 0.362102 Oct 12 22:53:04.346410 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2023/3944] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:03 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:04.364293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1774326146", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f5766aba-0840-4f1f-97c5-a7d770bedbac"}, {"port": "78d4498f-290d-4b83-8c13-f0c4ad007e45", "tag": "port-1"}, {"port": "406142d3-0aee-4227-aea2-74207b0b35d4", "tag": "port-2"}, {"uuid": "906ddd25-e78c-4283-be7c-107d6fb47653", "tag": "net-1"}, {"uuid": "906ddd25-e78c-4283-be7c-107d6fb47653"}, {"uuid": "1669d1a6-aa6b-4838-8dc4-e4b520124b5c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1669d1a6-aa6b-4838-8dc4-e4b520124b5c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9a76d3d7-a8f3-4d11-b27b-b9d2f90691e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f1a1df49-f6c3-4390-84e5-4c970dd469f1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9307c764-1c3c-45f9-830b-df466fbd529e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--5791377"}], "key_name": "tempest-keypair-1990537770", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:04.602075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:53:04.602740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:53:04.603230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:53:04.603684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:53:04.604169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:53:04.622449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.623329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.623957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.624896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.625514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.627296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.659442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Getting quotas for project f48cc681f28a453bbb5760393835626d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:53:04.666249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Getting quotas for user 3f7de714923b4c6eb8a209a04e441613 and project f48cc681f28a453bbb5760393835626d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:53:04.683461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:53:04.687042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:53:04.773538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] validate_networks() for [('f5766aba-0840-4f1f-97c5-a7d770bedbac', None, None, None, None, None), (None, None, '78d4498f-290d-4b83-8c13-f0c4ad007e45', None, None, None), (None, None, '406142d3-0aee-4227-aea2-74207b0b35d4', None, None, None), ('906ddd25-e78c-4283-be7c-107d6fb47653', None, None, None, None, None), ('906ddd25-e78c-4283-be7c-107d6fb47653', None, None, None, None, None), ('1669d1a6-aa6b-4838-8dc4-e4b520124b5c', '10.2.2.100', None, None, None, None), ('1669d1a6-aa6b-4838-8dc4-e4b520124b5c', '10.2.2.200', None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:53:04.780939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-28cd2bcf-8f51-4485-b94f-b44102ce1f86 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.836978 Oct 12 22:53:04.802182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1922/3945] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:53:04.809893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.219"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:04.813715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:04.821581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.822902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.823666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.824562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:04.825256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:04.825934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:04.909476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "refresh_cache-25333e77-51da-4212-bc0a-2e4770b1b05b" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:53:04.910159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquired lock "refresh_cache-25333e77-51da-4212-bc0a-2e4770b1b05b" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:53:07.261045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:08.898434 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.network.neutron [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] re-assign floating IP 172.25.6.219 from instance ae744a67-c6e6-4946-989a-717e472b7a86 Oct 12 22:53:09.081190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:53:10.164992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Updating instance_info_cache with network_info: [{"id": "3be0fa93-e344-46c7-ba2b-825fcfdd091c", "address": "fa:16:3e:e2:b1:e4", "network": {"id": "f35dcdc9-68e8-4f79-9aad-9742dda82a05", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-630338-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dac82d48217a412b8f9da673cbed0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3be0fa93-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:53:10.183612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:53:11.097969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Updating instance_info_cache with network_info: [{"id": "e4052271-2b74-4ed3-b778-a7b228694a36", "address": "fa:16:3e:d5:ed:2e", "network": {"id": "f35dcdc9-68e8-4f79-9aad-9742dda82a05", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-630338-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dac82d48217a412b8f9da673cbed0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape4052271-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:53:11.122928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Releasing lock "refresh_cache-25333e77-51da-4212-bc0a-2e4770b1b05b" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:53:11.124304 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7b69dc5-1c93-4728-900a-b0615d68554f tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b/action" status: 202 len: 0 microversion: 2.1 time: 6.320705 Oct 12 22:53:11.126054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1923/3946] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:04 2022] POST /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b/action => generated 0 bytes in 6323 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:53:11.137750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:11.138390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:11.166434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:11.169617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:11.170519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:11.171162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:11.172264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:11.172924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:11.173593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:11.407399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:11.418829 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bca9a7e9-0125-41fc-ae3b-fdffffa27f12 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1606 microversion: 2.1 time: 0.291478 Oct 12 22:53:11.421954 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1924/3947] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:11 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1606 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:11.459766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:11.461707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:11.477319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:11.479432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:11.482371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:11.483416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:11.485869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:11.486636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:11.755476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:11.768094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:11.783589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:11.785097 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-92fe31de-ea39-4103-8bcf-fad48fa4c12e tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1359 microversion: 2.21 time: 0.345397 Oct 12 22:53:11.788803 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1925/3948] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:11 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:11.808400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:11.809357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:11.823382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:11.824456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:11.825055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:11.826409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:11.827010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:11.827645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:12.120008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:12.129608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e07e09f-bc40-43c7-b32e-a8d6bf68fd47 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1499 microversion: 2.1 time: 0.339558 Oct 12 22:53:12.132749 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1926/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:11 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1499 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:12.148789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fa903dba-a656-41ab-8c99-6cee6a781409 req-05d3ae7f-ca44-4e1d-9856-016d15006945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae744a67-c6e6-4946-989a-717e472b7a86", "tag": "3be0fa93-e344-46c7-ba2b-825fcfdd091c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:12.189276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa903dba-a656-41ab-8c99-6cee6a781409 req-05d3ae7f-ca44-4e1d-9856-016d15006945 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:12.189837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa903dba-a656-41ab-8c99-6cee6a781409 req-05d3ae7f-ca44-4e1d-9856-016d15006945 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:12.190178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa903dba-a656-41ab-8c99-6cee6a781409 req-05d3ae7f-ca44-4e1d-9856-016d15006945 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:12.208869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:12.229098 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fa903dba-a656-41ab-8c99-6cee6a781409 req-05d3ae7f-ca44-4e1d-9856-016d15006945 service nova] Creating event network-changed:3be0fa93-e344-46c7-ba2b-825fcfdd091c for instance ae744a67-c6e6-4946-989a-717e472b7a86 on n-h2-860864-8 Oct 12 22:53:12.240227 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fa903dba-a656-41ab-8c99-6cee6a781409 req-05d3ae7f-ca44-4e1d-9856-016d15006945 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106009 Oct 12 22:53:12.243136 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1927/3950] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:12.258048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.219"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:12.638324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:12.645317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:12.645966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:12.647925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:12.649969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:12.652312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:12.655211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.317766 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] HTTP exception thrown: Floating IP 172.25.6.219 is not associated with instance ae744a67-c6e6-4946-989a-717e472b7a86. Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Request method failure captured: Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action HTTP/1.1 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 49 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0T2IwORgW9YHj36-LMUjbhkDZQCZHU6i7qGvgSfPmGozZnCglDkGkCI30eQSl7Et-2T3yYgefBbWiGnvUKFybpbVkMKplquyZ3DDGkhAoakzxlCupF0F7RT4hY_-zPwlCSiwwt4EnzG_DEl_LCv0ZRBuq1_xlKfJYR4v9Rabj6vjm4 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dac82d48217a412b8f9da673cbed0520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}] Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 55c612e09c1141e0981359245d0f4132 Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: {"removeFloatingIp": {"address": "172.25.6.219"}} Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: exception: Floating IP 172.25.6.219 is not associated with instance ae744a67-c6e6-4946-989a-717e472b7a86. Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ae744a67-c6e6-4946-989a-717e472b7a86', 'body': {'removeFloatingIp': {'address': '172.25.6.219'}}} Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.219 is not associated with instance ae744a67-c6e6-4946-989a-717e472b7a86. Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.219 is not associated with instance ae744a67-c6e6-4946-989a-717e472b7a86. Oct 12 22:53:13.319303 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:13.328375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Returning 409 to user: Floating IP 172.25.6.219 is not associated with instance ae744a67-c6e6-4946-989a-717e472b7a86. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:13.328375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6c826df-402b-4909-b070-0eec9dc4452e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action" status: 409 len: 146 microversion: 2.1 time: 1.075286 Oct 12 22:53:13.328375 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1928/3951] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:12 2022] POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action => generated 146 bytes in 1077 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:53:13.328375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:13.328375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:13.341273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.342882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.346384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.347500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.348164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.348765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.613967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:53:13.615689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:53:13.616999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:53:13.617547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:53:13.618130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:53:13.631578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.632341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.632887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.633750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.634921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.636513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.655409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Getting quotas for project e166451124234653b4ebda1b54d31af9. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:53:13.661601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Getting quotas for user 6c0944ea55824ccb8b6c8c812439293b and project e166451124234653b4ebda1b54d31af9. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:53:13.723431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:13.741623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc4b4bca-b7ca-4859-9c74-16f6b64d32fe tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1606 microversion: 2.1 time: 0.415447 Oct 12 22:53:13.742264 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1929/3952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:13 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1606 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:13.752409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:13.765989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:13.766937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:13.780123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.784413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.784880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.785657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.787959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.788529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.889634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:13.952416 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b9810396-1a51-41a7-953a-323b0e207186 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.208917 Oct 12 22:53:13.956840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1930/3953] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Oct 12 22:53:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:13.965612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:13.971355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:13.984166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.984665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.985106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.988218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:13.994218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:53:13.994745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:13.996205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:13.997586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9a76d3d7-a8f3-4d11-b27b-b9d2f90691e3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f1a1df49-f6c3-4390-84e5-4c970dd469f1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9307c764-1c3c-45f9-830b-df466fbd529e',volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:53:14.259104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:14.268568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:14.274097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:14.278846 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-66f89ec1-4a74-4fa1-8b32-e590bb996a35 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1359 microversion: 2.21 time: 0.320882 Oct 12 22:53:14.285114 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1931/3954] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:13 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:14.295943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6c64ca3e-0954-477e-86db-6f105e026a9d req-74e6adc3-2146-4f38-829c-c6bc843decbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22973024-c2ce-4bed-9b95-d0aefdd5a2e2", "tag": "1b0435df-6267-4065-b011-91968596880a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:14.312694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6c64ca3e-0954-477e-86db-6f105e026a9d req-74e6adc3-2146-4f38-829c-c6bc843decbe service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:14.314056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6c64ca3e-0954-477e-86db-6f105e026a9d req-74e6adc3-2146-4f38-829c-c6bc843decbe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:14.314899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6c64ca3e-0954-477e-86db-6f105e026a9d req-74e6adc3-2146-4f38-829c-c6bc843decbe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:14.340942 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6c64ca3e-0954-477e-86db-6f105e026a9d req-74e6adc3-2146-4f38-829c-c6bc843decbe service nova] Creating event network-changed:1b0435df-6267-4065-b011-91968596880a for instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 on n-h2-860864-8 Oct 12 22:53:14.346627 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6c64ca3e-0954-477e-86db-6f105e026a9d req-74e6adc3-2146-4f38-829c-c6bc843decbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059971 Oct 12 22:53:14.347512 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1932/3955] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:14.356987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.219"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:14.559789 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-023eb0b3-92a8-4fda-bc57-e2967c9b5ebf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 10.211207 Oct 12 22:53:14.561101 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2024/3956] 10.222.0.20 () {62 vars in 1189 bytes} [Wed Oct 12 22:53:04 2022] POST /compute/v2.1/servers => generated 403 bytes in 10213 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:53:14.582752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c4d50d0-f39f-45a8-b4c2-9e92c736c81c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:14.609694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4d50d0-f39f-45a8-b4c2-9e92c736c81c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:14.611995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4d50d0-f39f-45a8-b4c2-9e92c736c81c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:14.612702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4d50d0-f39f-45a8-b4c2-9e92c736c81c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:14.613463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:14.629247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:14.630808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:14.634091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:14.635778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:14.645687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:14.649168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c4d50d0-f39f-45a8-b4c2-9e92c736c81c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Going to try to start instance {{(pid=120542) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:53:14.650825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:14.686481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:14.736292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c4d50d0-f39f-45a8-b4c2-9e92c736c81c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "POST /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7/action" status: 202 len: 0 microversion: 2.1 time: 0.172477 Oct 12 22:53:14.736981 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2025/3957] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:14 2022] POST /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:53:14.751930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-96514f43-49f2-48e9-8448-cab8a3f1f221 req-3817efa0-1137-4343-a3cc-4f7efcb4ee72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25333e77-51da-4212-bc0a-2e4770b1b05b", "tag": "e4052271-2b74-4ed3-b778-a7b228694a36"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:14.767147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96514f43-49f2-48e9-8448-cab8a3f1f221 req-3817efa0-1137-4343-a3cc-4f7efcb4ee72 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:14.769750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96514f43-49f2-48e9-8448-cab8a3f1f221 req-3817efa0-1137-4343-a3cc-4f7efcb4ee72 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:14.770478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-96514f43-49f2-48e9-8448-cab8a3f1f221 req-3817efa0-1137-4343-a3cc-4f7efcb4ee72 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:14.788824 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-96514f43-49f2-48e9-8448-cab8a3f1f221 req-3817efa0-1137-4343-a3cc-4f7efcb4ee72 service nova] Creating event network-changed:e4052271-2b74-4ed3-b778-a7b228694a36 for instance 25333e77-51da-4212-bc0a-2e4770b1b05b on n-h2-860864-8 Oct 12 22:53:14.796912 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-96514f43-49f2-48e9-8448-cab8a3f1f221 req-3817efa0-1137-4343-a3cc-4f7efcb4ee72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057511 Oct 12 22:53:14.798181 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2026/3958] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:14.804455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81e65abd-32e2-419f-b362-4d0e8d75553d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:14.805498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-81e65abd-32e2-419f-b362-4d0e8d75553d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:15.128490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-81e65abd-32e2-419f-b362-4d0e8d75553d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:15.142736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-81e65abd-32e2-419f-b362-4d0e8d75553d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:15.144229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-81e65abd-32e2-419f-b362-4d0e8d75553d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:15.153222 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81e65abd-32e2-419f-b362-4d0e8d75553d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1286 microversion: 2.32 time: 0.353485 Oct 12 22:53:15.156188 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2027/3959] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:14 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1286 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:15.166931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:15.169350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:15.180879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:15.181382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:15.181823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:15.194273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:15.194780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:15.197881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:15.740099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "refresh_cache-25333e77-51da-4212-bc0a-2e4770b1b05b" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:53:15.747356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquired lock "refresh_cache-25333e77-51da-4212-bc0a-2e4770b1b05b" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:53:15.815775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:15.834127 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2a247d9-edba-48c1-9ec1-97ce6e1ce2ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1508 microversion: 2.1 time: 0.674529 Oct 12 22:53:15.903638 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2028/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:15 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:15.918452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:15.919121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:15.936168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:15.937041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:15.937687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:15.938591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:15.939237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:15.939852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:16.678073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:16.704725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:16.707336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:16.709210 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6203ee2-0d82-42fd-a7f9-1eecf057bd14 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1359 microversion: 2.21 time: 0.804230 Oct 12 22:53:16.728313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2029/3961] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:15 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1359 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:16.787999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:16.790053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:16.815065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:16.815571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:16.816065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:16.816740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:16.817186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:16.822664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:17.592257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:17.645998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:17.656887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:17.658652 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-767c8e02-cd14-4402-ace4-f92455027173 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1520 microversion: 2.32 time: 0.919905 Oct 12 22:53:17.659493 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2030/3962] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:16 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1520 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:17.687548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:17.688538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:17.700506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:17.701363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:17.702044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:17.703017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:17.703713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:17.704382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:18.870297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:18.878680 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12c6aa76-9248-4277-947c-617d5ab335c9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1508 microversion: 2.1 time: 1.202725 Oct 12 22:53:18.879281 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2031/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:17 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1508 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:18.904718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:18.906631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:18.922310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:18.922799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:18.932457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:18.933508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:18.934137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:18.935437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:19.291966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:53:19.357674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:19.366905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:19.386424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:19.387927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d100845f-9161-40c2-ac85-3fc01a5cae16 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1359 microversion: 2.21 time: 0.494561 Oct 12 22:53:19.388676 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2032/3964] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:18 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1359 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:19.393595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:19.402356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:19.418269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:19.418838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:19.419287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:19.420070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:19.424561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:19.425167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:19.779871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:19.793453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:19.801445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:19.802637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2bc5e0ea-a7af-44ae-bfb3-ae40ceabf39d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1594 microversion: 2.32 time: 0.412857 Oct 12 22:53:19.803214 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2033/3965] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:19 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1594 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:19.824519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-31a53b72-4b7b-4913-84dc-6ed74c017d08 req-61425221-7119-463b-ac16-547ae0b2c5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22973024-c2ce-4bed-9b95-d0aefdd5a2e2", "name": "network-vif-plugged", "status": "completed", "tag": "1b0435df-6267-4065-b011-91968596880a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:19.860576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-31a53b72-4b7b-4913-84dc-6ed74c017d08 req-61425221-7119-463b-ac16-547ae0b2c5e1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:19.862761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-31a53b72-4b7b-4913-84dc-6ed74c017d08 req-61425221-7119-463b-ac16-547ae0b2c5e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:19.863240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-31a53b72-4b7b-4913-84dc-6ed74c017d08 req-61425221-7119-463b-ac16-547ae0b2c5e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:19.903160 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-31a53b72-4b7b-4913-84dc-6ed74c017d08 req-61425221-7119-463b-ac16-547ae0b2c5e1 service nova] Creating event network-vif-plugged:1b0435df-6267-4065-b011-91968596880a for instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 on n-h2-860864-8 Oct 12 22:53:19.921935 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-31a53b72-4b7b-4913-84dc-6ed74c017d08 req-61425221-7119-463b-ac16-547ae0b2c5e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112472 Oct 12 22:53:19.922549 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2034/3966] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:19.930936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6c70d2c5-5985-48b0-b0d4-091662d2866c req-7d5f4536-7725-4da8-9acf-5253c2e5d0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25333e77-51da-4212-bc0a-2e4770b1b05b", "tag": "e4052271-2b74-4ed3-b778-a7b228694a36"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:19.976508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6c70d2c5-5985-48b0-b0d4-091662d2866c req-7d5f4536-7725-4da8-9acf-5253c2e5d0ba service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:19.980500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6c70d2c5-5985-48b0-b0d4-091662d2866c req-7d5f4536-7725-4da8-9acf-5253c2e5d0ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:19.980945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6c70d2c5-5985-48b0-b0d4-091662d2866c req-7d5f4536-7725-4da8-9acf-5253c2e5d0ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:20.020710 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6c70d2c5-5985-48b0-b0d4-091662d2866c req-7d5f4536-7725-4da8-9acf-5253c2e5d0ba service nova] Creating event network-changed:e4052271-2b74-4ed3-b778-a7b228694a36 for instance 25333e77-51da-4212-bc0a-2e4770b1b05b on n-h2-860864-8 Oct 12 22:53:20.041253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6c70d2c5-5985-48b0-b0d4-091662d2866c req-7d5f4536-7725-4da8-9acf-5253c2e5d0ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114309 Oct 12 22:53:20.047677 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2035/3967] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:20.059039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:20.060330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:20.080844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:20.083019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:20.083664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:20.085322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:20.087446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:20.088153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:20.476329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:20.489163 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c23dc006-17bc-42a7-a99e-c03f2bb2945e tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1512 microversion: 2.1 time: 0.439074 Oct 12 22:53:20.490930 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2036/3968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:20 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:20.522834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-648adf8d-b72d-4c7c-a163-e28eb1ddc296 req-bb35d0a0-c241-4e0c-baf0-12abf0f65d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ebc986-cced-4189-b659-8838d2f9747f", "tag": "38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:20.545845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-648adf8d-b72d-4c7c-a163-e28eb1ddc296 req-bb35d0a0-c241-4e0c-baf0-12abf0f65d97 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:20.548365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-648adf8d-b72d-4c7c-a163-e28eb1ddc296 req-bb35d0a0-c241-4e0c-baf0-12abf0f65d97 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:20.549133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-648adf8d-b72d-4c7c-a163-e28eb1ddc296 req-bb35d0a0-c241-4e0c-baf0-12abf0f65d97 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:20.573712 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-648adf8d-b72d-4c7c-a163-e28eb1ddc296 req-bb35d0a0-c241-4e0c-baf0-12abf0f65d97 service nova] Creating event network-changed:38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1 for instance 98ebc986-cced-4189-b659-8838d2f9747f on n-h1-860864-8 Oct 12 22:53:20.586370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-648adf8d-b72d-4c7c-a163-e28eb1ddc296 req-bb35d0a0-c241-4e0c-baf0-12abf0f65d97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076065 Oct 12 22:53:20.587836 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2037/3969] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:20.602009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:20.604717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:20.620741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:20.622257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:20.624698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:20.626128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:20.626837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:20.628672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:21.202392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:21.216571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:21.218125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:21.219422 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0191a4be-da9f-48ac-8467-74171a8dddce tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1359 microversion: 2.21 time: 0.629064 Oct 12 22:53:21.232621 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2038/3970] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:20 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1359 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:21.243799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:21.249893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:21.250682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.compute.servers [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Removing options 'limit' from query {{(pid=120542) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 22:53:21.251793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:21.253488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:21.254204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:21.254868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:21.255821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:21.256585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:21.257244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:21.258898 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e1d9fd69-776d-4c3f-b1fa-f72d42f93c45 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.025581 Oct 12 22:53:21.259708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2039/3971] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Oct 12 22:53:21 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:53:21.273445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:21.274713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:21.287862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:21.288885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:21.289573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:21.292672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:21.293386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:21.294035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.072135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Updating instance_info_cache with network_info: [{"id": "e4052271-2b74-4ed3-b778-a7b228694a36", "address": "fa:16:3e:d5:ed:2e", "network": {"id": "f35dcdc9-68e8-4f79-9aad-9742dda82a05", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-630338-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dac82d48217a412b8f9da673cbed0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape4052271-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:53:22.104206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Releasing lock "refresh_cache-25333e77-51da-4212-bc0a-2e4770b1b05b" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:53:22.105786 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f544fa95-147b-4e58-ba65-0b019da6820a tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b/action" status: 202 len: 0 microversion: 2.1 time: 7.756718 Oct 12 22:53:22.110289 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1933/3972] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:14 2022] POST /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b/action => generated 0 bytes in 7759 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:53:22.134258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:22.135231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:22.158118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.163599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.169361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.171179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.173747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.174524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.175302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.181181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.182516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.183821 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26e90c03-9522-46a6-8db3-bf455d2d447a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1659 microversion: 2.32 time: 0.914846 Oct 12 22:53:22.188313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2040/3973] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:21 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1659 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:22.201168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:22.201984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:22.215461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:22.225971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.226855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.228504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.229686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.230333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.233087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.315610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:53:22.455908 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e72b3cb-8d2e-446b-a13a-4168eddb4712 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 204 len: 0 microversion: 2.1 time: 0.265554 Oct 12 22:53:22.462896 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2041/3974] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:53:22 2022] DELETE /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:53:22.472162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:22.474099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:22.491491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.491934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.494129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.494965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.496054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.498543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.876301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.889588 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5696f01e-c2d2-4261-b6f3-7bb8f260bdef tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1512 microversion: 2.1 time: 0.765385 Oct 12 22:53:22.890227 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1934/3975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:22 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:22.903323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.219"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:22.909309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:22.916798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.919274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:22.923404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.923941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.927252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.928330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.929150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.929639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.930057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.941293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:22.943434 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-df7a5a11-8207-4121-b49d-116cbb06f680 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1552 microversion: 2.21 time: 0.482730 Oct 12 22:53:22.944311 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2042/3976] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:22 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1552 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:22.949594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:22.960150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:22.967781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.967781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.968338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:22.973836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:22.974405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:22.974928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:23.004922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:53:23.005409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquired lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:53:23.318962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:23.335527 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d9c2b64-e1af-480f-a816-408759c3650b tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 200 len: 1512 microversion: 2.1 time: 0.390087 Oct 12 22:53:23.336473 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2043/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:22 2022] GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:23.349246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:23.349753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:23.367311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:23.369464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:23.372031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:23.373194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:23.374277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:23.374928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:23.410538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:53:23.543520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6082b9d9-892f-4ff0-986d-ee099e4b63b6 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 204 len: 0 microversion: 2.21 time: 0.197854 Oct 12 22:53:23.544517 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2044/3978] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:53:23 2022] DELETE /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:53:23.554700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:23.559414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:23.569720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:23.570370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:23.570974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:23.571883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:23.572549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:23.573118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:23.645340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:23.837257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:24.088248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:24.105645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:24.109339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:24.111521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca735e4e-17b5-41a6-a8db-04d6c44a55f3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1659 microversion: 2.32 time: 0.565380 Oct 12 22:53:24.115194 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2045/3979] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:23 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1659 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:24.126215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:24.127593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:24.146844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:24.148313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:24.150040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:24.153012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:24.153598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:24.155217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:24.420373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:24.444360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f7817776-73ea-466e-bec9-aceabb2da8e7 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1512 microversion: 2.1 time: 0.325663 Oct 12 22:53:24.464045 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2046/3980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:24 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:24.476342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:24.480775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:24.497529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:24.501107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:24.504132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:24.505399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:24.506010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:24.506623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:25.141066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:26.059040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:26.093122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:26.098519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:26.104348 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c555b24-0ac8-45cd-8bab-4676c3961f5f tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1558 microversion: 2.21 time: 1.633847 Oct 12 22:53:26.124192 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2047/3981] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:24 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1558 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:26.144878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:26.163938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:26.168970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:26.506575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:26.507069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:26.507504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:26.509601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:26.510064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:26.510493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:26.685496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:26.870354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2316332e-81fe-413a-be38-631d3dd22f0c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 345 microversion: 2.1 time: 0.743412 Oct 12 22:53:26.884310 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2048/3982] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Oct 12 22:53:26 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 345 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:26.895359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:26.902687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:26.917143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:26.917932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:26.921066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:26.922152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:26.925275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:26.925957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:27.596563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:27.638354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:27.640606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:27.643111 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62b82816-b172-4caf-861b-ca97c0c996b5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1703 microversion: 2.32 time: 0.757612 Oct 12 22:53:27.663958 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2049/3983] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:26 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1703 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:27.667836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:27.668793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:27.684417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:27.686136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:27.686317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:27.689227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:27.689725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:27.694181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:28.245005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:28.261302 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5a4cf53-b295-464c-babc-056ddc50a38a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1512 microversion: 2.1 time: 0.600446 Oct 12 22:53:28.261900 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2050/3984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:27 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1512 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:28.272780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:28.273846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:28.288163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:28.299597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:28.300126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:28.300867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:28.301502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:28.302088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:29.173857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:29.221939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:29.223378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f7de714923b4c6eb8a209a04e441613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48cc681f28a453bbb5760393835626d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:29.238035 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ade8711e-d014-4123-aec3-9db13afd6ead tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 200 len: 1558 microversion: 2.21 time: 0.975007 Oct 12 22:53:29.243675 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2051/3985] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:28 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 1558 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:29.248790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-df333841-d82a-4121-bc60-c38d58990087 req-6a3ebefb-48eb-413d-b6ae-86c03b3be2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22973024-c2ce-4bed-9b95-d0aefdd5a2e2", "name": "network-vif-unplugged", "status": "completed", "tag": "1b0435df-6267-4065-b011-91968596880a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:29.301993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-df333841-d82a-4121-bc60-c38d58990087 req-6a3ebefb-48eb-413d-b6ae-86c03b3be2b9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:29.302789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-df333841-d82a-4121-bc60-c38d58990087 req-6a3ebefb-48eb-413d-b6ae-86c03b3be2b9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:29.303405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-df333841-d82a-4121-bc60-c38d58990087 req-6a3ebefb-48eb-413d-b6ae-86c03b3be2b9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:29.320404 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-df333841-d82a-4121-bc60-c38d58990087 req-6a3ebefb-48eb-413d-b6ae-86c03b3be2b9 service nova] Creating event network-vif-unplugged:1b0435df-6267-4065-b011-91968596880a for instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 on n-h2-860864-8 Oct 12 22:53:29.329517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-df333841-d82a-4121-bc60-c38d58990087 req-6a3ebefb-48eb-413d-b6ae-86c03b3be2b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084468 Oct 12 22:53:29.331716 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2052/3986] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:29.339998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:29.341152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:29.366849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:29.373040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:29.373925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:29.396073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:29.397025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:29.397664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.177622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:30.191288 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cf5a493-89a1-4def-9fd2-fa709954a057 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 200 len: 1512 microversion: 2.1 time: 0.857986 Oct 12 22:53:30.192936 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2053/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:29 2022] GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 1512 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:30.202091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:30.202992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:30.214625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.215399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.216177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.217714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.218508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.219155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.585921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:53:30.809038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:30.823362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:30.824911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:30.826110 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d396b8cd-000c-4e87-a854-8969e2a68c60 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1747 microversion: 2.32 time: 0.631425 Oct 12 22:53:30.826758 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2054/3988] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:30 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1747 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:30.843391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-de083ef1-e5f8-4d95-8e97-11a8c70cd2ce req-2b1963f7-0889-45b0-83d1-a7802a4bec60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22973024-c2ce-4bed-9b95-d0aefdd5a2e2", "name": "network-vif-deleted", "tag": "1b0435df-6267-4065-b011-91968596880a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:30.874934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-de083ef1-e5f8-4d95-8e97-11a8c70cd2ce req-2b1963f7-0889-45b0-83d1-a7802a4bec60 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.875734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-de083ef1-e5f8-4d95-8e97-11a8c70cd2ce req-2b1963f7-0889-45b0-83d1-a7802a4bec60 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.878100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-de083ef1-e5f8-4d95-8e97-11a8c70cd2ce req-2b1963f7-0889-45b0-83d1-a7802a4bec60 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.901913 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-de083ef1-e5f8-4d95-8e97-11a8c70cd2ce req-2b1963f7-0889-45b0-83d1-a7802a4bec60 service nova] Creating event network-vif-deleted:1b0435df-6267-4065-b011-91968596880a for instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 on n-h2-860864-8 Oct 12 22:53:30.918469 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-de083ef1-e5f8-4d95-8e97-11a8c70cd2ce req-2b1963f7-0889-45b0-83d1-a7802a4bec60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090466 Oct 12 22:53:30.919341 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2055/3989] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:30.942484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:30.953213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:30.982900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.983697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.984474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:30.985604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:30.986296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:30.987174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:31.345788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:31.372203 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6860c5f4-de52-4b9c-bafd-f4d8bf3f9a33 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1512 microversion: 2.1 time: 0.433727 Oct 12 22:53:31.384190 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2056/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:30 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:31.390766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:31.391596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:31.422015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:31.422505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:31.422935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:31.423637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:31.430992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:31.431552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:31.474450 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] HTTP exception thrown: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Request method failure captured: Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 HTTP/1.1 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0VNtL6cXD4W0Pj1CcJY6zAQr-s4V8FuMKUKUnI0HQIGzkCMw5oRdC8aHHbOcIMGWd76mjnxGf0U2tAZdffqwyO8n-4zQKLTH1CE03Tu4lNOiziUN9xUHmUpkxR2JU6wtGgT5hIiQMAAblY_VqCrerBGZ_d_5hHgUIPU_9yqcox-U4c Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f48cc681f28a453bbb5760393835626d Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f48cc681f28a453bbb5760393835626d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f48cc681f28a453bbb5760393835626d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f48cc681f28a453bbb5760393835626d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f48cc681f28a453bbb5760393835626d"}]}] Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f48cc681f28a453bbb5760393835626d Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-InstanceActionsV221TestJSON-416679252-project Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3f7de714923b4c6eb8a209a04e441613 Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-InstanceActionsV221TestJSON-416679252-project Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '22973024-c2ce-4bed-9b95-d0aefdd5a2e2'} Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:31.484869 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:31.490032 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:31.494736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Returning 404 to user: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:31.498588 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec12fdb5-b32f-420b-aa57-2c07ecf88665 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 404 len: 111 microversion: 2.21 time: 0.124609 Oct 12 22:53:31.500839 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2057/3991] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:31 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:53:31.513614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-becf1a45-6e46-45a6-a781-dc18782c8994 req-4462385f-fa5a-412d-ba7c-157e7f9cd0ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae744a67-c6e6-4946-989a-717e472b7a86", "tag": "3be0fa93-e344-46c7-ba2b-825fcfdd091c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:31.549984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-becf1a45-6e46-45a6-a781-dc18782c8994 req-4462385f-fa5a-412d-ba7c-157e7f9cd0ef service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:31.553204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-becf1a45-6e46-45a6-a781-dc18782c8994 req-4462385f-fa5a-412d-ba7c-157e7f9cd0ef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:31.553935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-becf1a45-6e46-45a6-a781-dc18782c8994 req-4462385f-fa5a-412d-ba7c-157e7f9cd0ef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:31.592195 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-becf1a45-6e46-45a6-a781-dc18782c8994 req-4462385f-fa5a-412d-ba7c-157e7f9cd0ef service nova] Creating event network-changed:3be0fa93-e344-46c7-ba2b-825fcfdd091c for instance ae744a67-c6e6-4946-989a-717e472b7a86 on n-h2-860864-8 Oct 12 22:53:31.603305 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-becf1a45-6e46-45a6-a781-dc18782c8994 req-4462385f-fa5a-412d-ba7c-157e7f9cd0ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099866 Oct 12 22:53:31.606509 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2058/3992] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:31.619842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:31.632215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:31.635856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:31.650069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:31.652463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:31.654326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:31.655304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:31.657250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:31.658158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:31.725493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:31.767220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:31.862736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:31.885141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:31.885641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:31.886085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.445923 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4fadf8a-d6e9-4452-b3a4-ee4218845b50 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.837738 Oct 12 22:53:32.447590 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2059/3993] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 22:53:31 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:32.477407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '.version_select at 0x7f44fe6e6f70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:32.478213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:32.486192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.487258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.487868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.488787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.489395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.489970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.606486 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-60dc14a9-217b-4e61-90db-3574a7733b9a tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.157388 Oct 12 22:53:32.618372 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2060/3994] 10.222.0.20 () {60 vars in 1337 bytes} [Wed Oct 12 22:53:32 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2/os-instance-actions => generated 611 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:53:32.625512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:32.626673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:32.633884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.635172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.635994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.637125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:32.637750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:32.638459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:32.922776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=23 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:33.064328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Updating instance_info_cache with network_info: [{"id": "3be0fa93-e344-46c7-ba2b-825fcfdd091c", "address": "fa:16:3e:e2:b1:e4", "network": {"id": "f35dcdc9-68e8-4f79-9aad-9742dda82a05", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-630338-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dac82d48217a412b8f9da673cbed0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3be0fa93-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:53:33.092324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Releasing lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:53:33.093490 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62ead9f9-10ad-4034-9780-ad62517bd47e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action" status: 202 len: 0 microversion: 2.1 time: 10.200547 Oct 12 22:53:33.094319 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1935/3995] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:22 2022] POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action => generated 0 bytes in 10204 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:53:33.132213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:33.180123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:33.181116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:33.511123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.511620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.512102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.512270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:33.516546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.517513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.519522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.541401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:33.545981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:33.559379 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec6336d0-3bb1-4e57-bfe4-f07ce5b23adf tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1747 microversion: 2.32 time: 0.935817 Oct 12 22:53:33.560283 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2061/3996] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:32 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1747 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:33.573891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:33.575489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:33.591876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.593584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.593918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.598092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.598574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.599105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.634106 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] HTTP exception thrown: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Request method failure captured: Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 HTTP/1.1 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0VNtL6cXD4W0Pj1CcJY6zAQr-s4V8FuMKUKUnI0HQIGzkCMw5oRdC8aHHbOcIMGWd76mjnxGf0U2tAZdffqwyO8n-4zQKLTH1CE03Tu4lNOiziUN9xUHmUpkxR2JU6wtGgT5hIiQMAAblY_VqCrerBGZ_d_5hHgUIPU_9yqcox-U4c Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: f48cc681f28a453bbb5760393835626d Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f48cc681f28a453bbb5760393835626d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f48cc681f28a453bbb5760393835626d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f48cc681f28a453bbb5760393835626d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f48cc681f28a453bbb5760393835626d"}]}] Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: f48cc681f28a453bbb5760393835626d Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-InstanceActionsV221TestJSON-416679252-project Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3f7de714923b4c6eb8a209a04e441613 Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-InstanceActionsV221TestJSON-416679252-project Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '22973024-c2ce-4bed-9b95-d0aefdd5a2e2'} Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:33.635884 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Returning 404 to user: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:33.640543 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c050fc29-6d1b-4231-a066-bbda243c3a05 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 404 len: 111 microversion: 2.21 time: 0.075683 Oct 12 22:53:33.644510 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2062/3997] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:53:33 2022] DELETE /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:53:33.654287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ccc3f74-7d6c-43ef-9f7f-5e9ad84457bb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '.version_select at 0x7f44fe698700>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:33.719398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:33.877705 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9079b03-045e-4ae8-974f-9295f0cd903a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.781878 Oct 12 22:53:33.878659 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1936/3998] 10.222.0.20 () {58 vars in 1150 bytes} [Wed Oct 12 22:53:33 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:33.883463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d4ef8cea-5078-444f-add4-87f267081896 req-e80c2e23-aac3-43ef-855f-707e97653210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25333e77-51da-4212-bc0a-2e4770b1b05b", "name": "network-vif-deleted", "tag": "e4052271-2b74-4ed3-b778-a7b228694a36"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:33.893920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d4ef8cea-5078-444f-add4-87f267081896 req-e80c2e23-aac3-43ef-855f-707e97653210 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.894312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d4ef8cea-5078-444f-add4-87f267081896 req-e80c2e23-aac3-43ef-855f-707e97653210 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.894738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d4ef8cea-5078-444f-add4-87f267081896 req-e80c2e23-aac3-43ef-855f-707e97653210 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.907568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d4ef8cea-5078-444f-add4-87f267081896 req-e80c2e23-aac3-43ef-855f-707e97653210 service nova] Creating event network-vif-deleted:e4052271-2b74-4ed3-b778-a7b228694a36 for instance 25333e77-51da-4212-bc0a-2e4770b1b05b on n-h2-860864-8 Oct 12 22:53:33.915122 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d4ef8cea-5078-444f-add4-87f267081896 req-e80c2e23-aac3-43ef-855f-707e97653210 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Oct 12 22:53:33.916451 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1937/3999] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:33.922082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:33.922790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] [instance: 22973024-c2ce-4bed-9b95-d0aefdd5a2e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:33.930530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.931271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.931883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.932968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.933575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.934156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.959324 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] HTTP exception thrown: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Request method failure captured: Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 HTTP/1.1 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0VNtL6cXD4W0Pj1CcJY6zAQr-s4V8FuMKUKUnI0HQIGzkCMw5oRdC8aHHbOcIMGWd76mjnxGf0U2tAZdffqwyO8n-4zQKLTH1CE03Tu4lNOiziUN9xUHmUpkxR2JU6wtGgT5hIiQMAAblY_VqCrerBGZ_d_5hHgUIPU_9yqcox-U4c Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: f48cc681f28a453bbb5760393835626d Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f48cc681f28a453bbb5760393835626d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f48cc681f28a453bbb5760393835626d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f48cc681f28a453bbb5760393835626d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f48cc681f28a453bbb5760393835626d"}]}] Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: f48cc681f28a453bbb5760393835626d Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-416679252 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-InstanceActionsV221TestJSON-416679252-project Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3f7de714923b4c6eb8a209a04e441613 Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-InstanceActionsV221TestJSON-416679252-project Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '22973024-c2ce-4bed-9b95-d0aefdd5a2e2'} Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.961615 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. Oct 12 22:53:33.966220 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:33.967485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] Returning 404 to user: Instance 22973024-c2ce-4bed-9b95-d0aefdd5a2e2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:33.971039 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-11db4ecd-3fca-4ca9-be93-225324b46701 tempest-InstanceActionsV221TestJSON-416679252 tempest-InstanceActionsV221TestJSON-416679252-project] 10.222.0.20 "GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2" status: 404 len: 111 microversion: 2.21 time: 0.053329 Oct 12 22:53:33.972148 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1938/4000] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:33 2022] GET /compute/v2.1/servers/22973024-c2ce-4bed-9b95-d0aefdd5a2e2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:53:33.977651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:33.983311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:33.986801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:33.994154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.994899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.995507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:33.996453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:33.997070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:33.997658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.165856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:34.276744 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5265575e-1ddf-45ac-9788-9626963b93ec tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.303248 Oct 12 22:53:34.284904 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1939/4001] 10.222.0.20 () {58 vars in 1212 bytes} [Wed Oct 12 22:53:33 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:34.301692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:34.314215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:34.315635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:34.332005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.334841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.335515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.339119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.339801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.340387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.468847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:34.573206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-446463ca-02a7-428d-bae0-e399e4d8f863 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.286561 Oct 12 22:53:34.581462 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1940/4002] 10.222.0.20 () {58 vars in 1196 bytes} [Wed Oct 12 22:53:34 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:34.587172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:34.592584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:34.593257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'name': '-969033866', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:34.598770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.599249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.599679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.600427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.600861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.601429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.721024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:34.876724 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e961a568-04ca-40cf-bb00-8d3ca926ad4c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-969033866" status: 200 len: 345 microversion: 2.1 time: 0.292538 Oct 12 22:53:34.879500 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1941/4003] 10.222.0.20 () {58 vars in 1156 bytes} [Wed Oct 12 22:53:34 2022] GET /compute/v2.1/servers?name=-969033866 => generated 345 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:34.892425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:34.893306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:34.900191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.901359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.902240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:34.903163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:34.903830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:34.904465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:35.019344 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ccc3f74-7d6c-43ef-9f7f-5e9ad84457bb tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/9d983f75-c2c0-46fd-bbff-ebba180b2097" status: 200 len: 184 microversion: 2.1 time: 1.370575 Oct 12 22:53:35.019942 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2063/4004] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:53:33 2022] GET /compute/v2.1/os-floating-ips/9d983f75-c2c0-46fd-bbff-ebba180b2097 => generated 184 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:35.025226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:35.035006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:35.039668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:35.057024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:35.057744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:35.058334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:35.060920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:35.061538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:35.063506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:35.668681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:35.684904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:35.691602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:35.697594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7017db52-bbbf-4e6a-aace-49ffd69d3924 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1835 microversion: 2.32 time: 0.816631 Oct 12 22:53:35.700543 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1942/4005] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:34 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1835 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:35.721301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.219"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:35.941562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:36.123176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-414572e3-3e9a-4383-89bd-8dc07dce6e15 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 1.101859 Oct 12 22:53:36.131851 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2064/4006] 10.222.0.20 () {58 vars in 1154 bytes} [Wed Oct 12 22:53:35 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:36.138093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:36.148770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:36.149482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-96903386', 'deleted': False, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 22:53:36.161937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.163812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.167992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.168938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.169436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.169984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.234828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:36.241340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.241844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.242882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.247482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.248186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.248653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.299994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:36.395380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 22:53:36.548081 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5388e005-c709-4a97-a624-7fb6fff7c1b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-96903386" status: 200 len: 345 microversion: 2.1 time: 0.413192 Oct 12 22:53:36.551001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2065/4007] 10.222.0.20 () {58 vars in 1226 bytes} [Wed Oct 12 22:53:36 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-96903386 => generated 345 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:53:36.563265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:36.564025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:36.577569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.580087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.582811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.590095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.593979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.594688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.659107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:53:36.829054 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8985c1e1-7fc8-462a-9c1d-0190191935b6 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 204 len: 0 microversion: 2.1 time: 0.269715 Oct 12 22:53:36.833948 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2066/4008] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:53:36 2022] DELETE /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:53:36.840351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:36.841066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:36.861000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.863607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.864265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:36.866530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:36.873875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:36.874577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:37.147607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:53:37.153529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquired lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:53:37.538536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:37.556627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:37.558258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:37.563173 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc5768eb-968d-47e7-a809-034ea80b6e41 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1835 microversion: 2.32 time: 0.727407 Oct 12 22:53:37.580386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2067/4009] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:36 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1835 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:37.603717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:37.606360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:37.627227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:37.630415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:37.631606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:37.635129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:37.636388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:37.639167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:37.980981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:37.990864 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a19dea44-5633-4d3d-950b-ac19bb25afa1 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1518 microversion: 2.1 time: 0.406891 Oct 12 22:53:38.010135 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2068/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:37 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1518 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:38.600013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:38.600649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:38.623558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:38.626486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:38.626779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:38.628874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:38.630577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:38.631201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:39.316492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:39.339176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:39.345565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:39.357569 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82143a3d-b7b9-4bd0-8d09-0f166fab516c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1835 microversion: 2.32 time: 0.762634 Oct 12 22:53:39.368476 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2069/4011] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:38 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1835 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:53:39.375616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:39.391965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:39.419708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:39.422963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:39.424518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:39.431877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:39.447126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:39.449854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:39.715840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:39.740290 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-06d72573-c032-48fd-ab86-0c42ad6e2335 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1476 microversion: 2.1 time: 0.365768 Oct 12 22:53:39.743472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2070/4012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:39 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:39.881057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-305ae8b8-a839-4c26-8ea3-27889d054b1c req-23251a72-b264-4a39-aa9f-3612e3cc1b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23c2955-a1e2-4abd-9cf6-4da97081b8ab", "name": "network-vif-deleted", "tag": "44636f35-f845-4a17-a12d-365a9fb2164c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:39.897057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-305ae8b8-a839-4c26-8ea3-27889d054b1c req-23251a72-b264-4a39-aa9f-3612e3cc1b50 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:39.898228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-305ae8b8-a839-4c26-8ea3-27889d054b1c req-23251a72-b264-4a39-aa9f-3612e3cc1b50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:39.899314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-305ae8b8-a839-4c26-8ea3-27889d054b1c req-23251a72-b264-4a39-aa9f-3612e3cc1b50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:39.922211 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-305ae8b8-a839-4c26-8ea3-27889d054b1c req-23251a72-b264-4a39-aa9f-3612e3cc1b50 service nova] Creating event network-vif-deleted:44636f35-f845-4a17-a12d-365a9fb2164c for instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab on n-h2-860864-8 Oct 12 22:53:39.928920 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-305ae8b8-a839-4c26-8ea3-27889d054b1c req-23251a72-b264-4a39-aa9f-3612e3cc1b50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059964 Oct 12 22:53:39.933952 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2071/4013] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:53:40.398416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:40.399772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:40.416094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:40.417520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:40.418947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:40.420707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:40.422485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:40.426130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:40.801272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:40.828317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:40.836168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:40.840452 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-28a8561a-a810-4d66-835d-e0d63371b45b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1835 microversion: 2.32 time: 0.448966 Oct 12 22:53:40.841402 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2072/4014] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:40 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1835 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:40.876821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:40.878986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:40.898228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:40.902015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:40.902785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:40.905139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:40.906058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:40.909691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:41.001052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:41.003806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:41.004636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:41.005183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lazy-loading 'fault' on Instance uuid f23c2955-a1e2-4abd-9cf6-4da97081b8ab {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:53:41.126667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:41.139394 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa4ca9c0-3b59-4011-a03e-083d9975321a tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 200 len: 1311 microversion: 2.1 time: 0.274060 Oct 12 22:53:41.139987 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2073/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:40 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 1311 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:41.148977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2fc2cde5-ad67-4983-808d-d665f3e3b38f req-1bc2014e-c53d-474f-b6e2-8bf062d05a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "8b1947f9-175e-4530-af30-9442135dbdc1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:41.174190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fc2cde5-ad67-4983-808d-d665f3e3b38f req-1bc2014e-c53d-474f-b6e2-8bf062d05a58 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:41.174668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fc2cde5-ad67-4983-808d-d665f3e3b38f req-1bc2014e-c53d-474f-b6e2-8bf062d05a58 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:41.175110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fc2cde5-ad67-4983-808d-d665f3e3b38f req-1bc2014e-c53d-474f-b6e2-8bf062d05a58 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:41.208435 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2fc2cde5-ad67-4983-808d-d665f3e3b38f req-1bc2014e-c53d-474f-b6e2-8bf062d05a58 service nova] Creating event network-changed:8b1947f9-175e-4530-af30-9442135dbdc1 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:53:41.217894 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2fc2cde5-ad67-4983-808d-d665f3e3b38f req-1bc2014e-c53d-474f-b6e2-8bf062d05a58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076712 Oct 12 22:53:41.220911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2074/4016] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:41.682192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:41.683460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:41.694320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:41.695752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:41.696338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:41.697168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:41.697716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:41.698238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:41.729028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be729571-2f36-4f1c-89c0-21e1c5cfb50c tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.052328 Oct 12 22:53:41.730477 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2075/4017] 10.222.0.20 () {58 vars in 1293 bytes} [Wed Oct 12 22:53:41 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f/os-server-password => generated 116 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:41.875313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:41.880667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:41.882135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:41.901876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:41.904127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:41.904877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:41.905808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:41.906485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:41.907178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.144603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:42.153457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:42.159401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:42.161096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:42.163179 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2fb5574-9a4f-4f5b-9028-81a7cf27d2e6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1835 microversion: 2.32 time: 0.290161 Oct 12 22:53:42.169450 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2076/4018] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:41 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1835 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:42.174327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:42.174739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: f23c2955-a1e2-4abd-9cf6-4da97081b8ab] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:42.194648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.195221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.195783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.196536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.196982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.197404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.214910 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] HTTP exception thrown: Instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab could not be found. Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Request method failure captured: Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab HTTP/1.1 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0URn-xb1hB62y4sp_x1nObvdDr85BPQTe46JesxYALqEjlA8Gh7gVRs1T5dCQ6oyhE-SmOkSWqYZzY3iH6z4enylW_QqJT-AQH58jtTtA15f9YdSWyCrDJgC5vMq5joGqr-drrtOudKrtioqMo6z2PkMIdS_NhK2vdh1nApyfm3QIo Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: e66a5b463b1e4cc68ec26e9ab2288d07 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e66a5b463b1e4cc68ec26e9ab2288d07"}]}] Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: e66a5b463b1e4cc68ec26e9ab2288d07 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListServerFiltersTestJSON-1166398666-project Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 6f300f44cb214a52afa6ece5cec9921b Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListServerFiltersTestJSON-1166398666-project Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab could not be found. Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f23c2955-a1e2-4abd-9cf6-4da97081b8ab'} Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab could not be found. Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab could not be found. Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:42.216609 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab could not be found. Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Returning 404 to user: Instance f23c2955-a1e2-4abd-9cf6-4da97081b8ab could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:42.221544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e81fee0e-70a5-4218-b126-b53a0f995d32 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab" status: 404 len: 111 microversion: 2.1 time: 0.047701 Oct 12 22:53:42.222317 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2077/4019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:42 2022] GET /compute/v2.1/servers/f23c2955-a1e2-4abd-9cf6-4da97081b8ab => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:53:42.227225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:42.227662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:42.234313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.234801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.235232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.235945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.236679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.236814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.274696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:53:42.366275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:53:42.536112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e1f1949-6de9-450a-a0d4-42d7a57bc94c tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 204 len: 0 microversion: 2.1 time: 0.312818 Oct 12 22:53:42.537744 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2078/4020] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:53:42 2022] DELETE /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:53:42.550671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:42.560155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:42.573412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:42.575200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.575697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.580022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.580805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:42.581272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:42.584140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:42.907237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:42.920834 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cab8fde4-d1b7-4f15-8d6d-d2bf1210f3ba tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 200 len: 1518 microversion: 2.1 time: 0.378323 Oct 12 22:53:42.922939 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2079/4021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:42 2022] GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 1518 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:43.193353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:43.194549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:43.205831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:43.212032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:43.212943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:43.213969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:43.215521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:43.216941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:43.582524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:43.593286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:43.595266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:43.598838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc31e0de-6a9d-4f24-bba0-e99e1f85e6fe tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1835 microversion: 2.32 time: 0.409394 Oct 12 22:53:43.616864 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2080/4022] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:43 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1835 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:43.634378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3cf7e180-4dc6-4bed-bbcb-1ff6556d3c18 req-c2ddd366-9c77-4e07-9038-7e55f9127e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae744a67-c6e6-4946-989a-717e472b7a86", "tag": "3be0fa93-e344-46c7-ba2b-825fcfdd091c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:43.657358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cf7e180-4dc6-4bed-bbcb-1ff6556d3c18 req-c2ddd366-9c77-4e07-9038-7e55f9127e7e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:43.658189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cf7e180-4dc6-4bed-bbcb-1ff6556d3c18 req-c2ddd366-9c77-4e07-9038-7e55f9127e7e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:43.659704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cf7e180-4dc6-4bed-bbcb-1ff6556d3c18 req-c2ddd366-9c77-4e07-9038-7e55f9127e7e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:43.697481 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3cf7e180-4dc6-4bed-bbcb-1ff6556d3c18 req-c2ddd366-9c77-4e07-9038-7e55f9127e7e service nova] Creating event network-changed:3be0fa93-e344-46c7-ba2b-825fcfdd091c for instance ae744a67-c6e6-4946-989a-717e472b7a86 on n-h2-860864-8 Oct 12 22:53:43.709498 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3cf7e180-4dc6-4bed-bbcb-1ff6556d3c18 req-c2ddd366-9c77-4e07-9038-7e55f9127e7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081326 Oct 12 22:53:43.710427 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2081/4023] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:43.955711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:43.957181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:43.973732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:43.977815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:43.978351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:43.982910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:43.984429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:43.986387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:44.627393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:45.295551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:45.309113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-329998d9-b5d4-4b05-a7fa-c2bf87c793b9 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 200 len: 1518 microversion: 2.1 time: 1.362471 Oct 12 22:53:45.315423 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2082/4024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:43 2022] GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 1518 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:53:45.329141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:45.331921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:45.354285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:45.354898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:45.355360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:45.356825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:45.357301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:45.357737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:45.859812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:45.884202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:45.885800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:45.891777 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5726c286-817d-4805-8920-90d839a058c6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1856 microversion: 2.32 time: 0.572546 Oct 12 22:53:45.898056 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2083/4025] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:45 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1856 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:46.241194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=14 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:46.284162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Updating instance_info_cache with network_info: [{"id": "3be0fa93-e344-46c7-ba2b-825fcfdd091c", "address": "fa:16:3e:e2:b1:e4", "network": {"id": "f35dcdc9-68e8-4f79-9aad-9742dda82a05", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-630338-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dac82d48217a412b8f9da673cbed0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3be0fa93-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:53:46.320343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Releasing lock "refresh_cache-ae744a67-c6e6-4946-989a-717e472b7a86" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:53:46.322510 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1cb90652-ae77-434d-965d-d97b71034905 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action" status: 202 len: 0 microversion: 2.1 time: 10.615113 Oct 12 22:53:46.329328 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1943/4026] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:53:35 2022] POST /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86/action => generated 0 bytes in 10623 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:53:46.332773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:46.333265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:46.336355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:46.339587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:46.344896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.346421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.347178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.348491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.349212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.349957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.356948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:46.372132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.377398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.377858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.378596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.379049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.379470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.399537 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] HTTP exception thrown: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Request method failure captured: Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b HTTP/1.1 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0T2IwORgW9YHj36-LMUjbhkDZQCZHU6i7qGvgSfPmGozZnCglDkGkCI30eQSl7Et-2T3yYgefBbWiGnvUKFybpbVkMKplquyZ3DDGkhAoakzxlCupF0F7RT4hY_-zPwlCSiwwt4EnzG_DEl_LCv0ZRBuq1_xlKfJYR4v9Rabj6vjm4 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dac82d48217a412b8f9da673cbed0520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}] Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 55c612e09c1141e0981359245d0f4132 Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '25333e77-51da-4212-bc0a-2e4770b1b05b'} Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:46.405207 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.409313 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.411252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Returning 404 to user: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:46.412922 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-863d40eb-81e9-4318-a8e6-9c11483dae18 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 404 len: 111 microversion: 2.1 time: 0.084147 Oct 12 22:53:46.413507 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2084/4027] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:53:46 2022] DELETE /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:53:46.432383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:46.433341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: 25333e77-51da-4212-bc0a-2e4770b1b05b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:46.454039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.458689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.459332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.461567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.462107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.463311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.501337 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] HTTP exception thrown: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Request method failure captured: Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b HTTP/1.1 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0T2IwORgW9YHj36-LMUjbhkDZQCZHU6i7qGvgSfPmGozZnCglDkGkCI30eQSl7Et-2T3yYgefBbWiGnvUKFybpbVkMKplquyZ3DDGkhAoakzxlCupF0F7RT4hY_-zPwlCSiwwt4EnzG_DEl_LCv0ZRBuq1_xlKfJYR4v9Rabj6vjm4 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dac82d48217a412b8f9da673cbed0520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}] Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 55c612e09c1141e0981359245d0f4132 Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '25333e77-51da-4212-bc0a-2e4770b1b05b'} Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.503237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:46.508986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Returning 404 to user: Instance 25333e77-51da-4212-bc0a-2e4770b1b05b could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:46.512894 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7e2140d1-a189-4f04-b3bc-6aafa4b7d187 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b" status: 404 len: 111 microversion: 2.1 time: 0.094233 Oct 12 22:53:46.523106 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2085/4028] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:46 2022] GET /compute/v2.1/servers/25333e77-51da-4212-bc0a-2e4770b1b05b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:53:46.537139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c00489b9-25dd-42c1-ad8d-858ce4c424c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '.version_select at 0x7f4507a68790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:46.719184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:46.731109 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f882f85b-77cd-4216-9456-51c3c3b79bf4 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 200 len: 1476 microversion: 2.1 time: 0.396792 Oct 12 22:53:46.731756 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1944/4029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:46 2022] GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:53:46.754140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-20c41d7c-2c61-4270-9f3c-c625d5560026 req-a1369194-d4d1-45cc-a2f0-2fc879cc63d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "78d4498f-290d-4b83-8c13-f0c4ad007e45"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:46.790835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-20c41d7c-2c61-4270-9f3c-c625d5560026 req-a1369194-d4d1-45cc-a2f0-2fc879cc63d3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.796652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-20c41d7c-2c61-4270-9f3c-c625d5560026 req-a1369194-d4d1-45cc-a2f0-2fc879cc63d3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.800066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-20c41d7c-2c61-4270-9f3c-c625d5560026 req-a1369194-d4d1-45cc-a2f0-2fc879cc63d3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.826621 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-20c41d7c-2c61-4270-9f3c-c625d5560026 req-a1369194-d4d1-45cc-a2f0-2fc879cc63d3 service nova] Creating event network-changed:78d4498f-290d-4b83-8c13-f0c4ad007e45 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:53:46.869778 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-20c41d7c-2c61-4270-9f3c-c625d5560026 req-a1369194-d4d1-45cc-a2f0-2fc879cc63d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123776 Oct 12 22:53:46.873265 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1945/4030] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:46.927346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:46.928191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:46.941457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.942335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.942989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:46.946510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:46.947239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:46.947878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:48.926400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:48.940263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:48.949549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:48.951479 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a48d23f3-f414-4a97-b057-403b02b7b1c3 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1856 microversion: 2.32 time: 2.028463 Oct 12 22:53:48.968823 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1946/4031] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:46 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1856 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:48.982907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-51ecce7d-9ab2-4071-9883-ecf552bbb47d req-1d5f3cca-a03e-4b87-8664-8ef16756d69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5369244-5c2f-413f-a8e7-0f33e9c14cde", "name": "network-vif-deleted", "tag": "045258f4-b318-4b15-b6c5-248b42946281"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:48.994010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-51ecce7d-9ab2-4071-9883-ecf552bbb47d req-1d5f3cca-a03e-4b87-8664-8ef16756d69f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:48.994587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-51ecce7d-9ab2-4071-9883-ecf552bbb47d req-1d5f3cca-a03e-4b87-8664-8ef16756d69f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:48.995344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-51ecce7d-9ab2-4071-9883-ecf552bbb47d req-1d5f3cca-a03e-4b87-8664-8ef16756d69f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.009774 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-51ecce7d-9ab2-4071-9883-ecf552bbb47d req-1d5f3cca-a03e-4b87-8664-8ef16756d69f service nova] Creating event network-vif-deleted:045258f4-b318-4b15-b6c5-248b42946281 for instance b5369244-5c2f-413f-a8e7-0f33e9c14cde on n-h1-860864-8 Oct 12 22:53:49.021049 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-51ecce7d-9ab2-4071-9883-ecf552bbb47d req-1d5f3cca-a03e-4b87-8664-8ef16756d69f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048582 Oct 12 22:53:49.022809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1947/4032] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:49.034339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:49.035592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: b5369244-5c2f-413f-a8e7-0f33e9c14cde] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:49.044163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.045318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.045970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.046890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.047548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.048232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.066987 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] HTTP exception thrown: Instance b5369244-5c2f-413f-a8e7-0f33e9c14cde could not be found. Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Request method failure captured: Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde HTTP/1.1 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0URn-xb1hB62y4sp_x1nObvdDr85BPQTe46JesxYALqEjlA8Gh7gVRs1T5dCQ6oyhE-SmOkSWqYZzY3iH6z4enylW_QqJT-AQH58jtTtA15f9YdSWyCrDJgC5vMq5joGqr-drrtOudKrtioqMo6z2PkMIdS_NhK2vdh1nApyfm3QIo Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: e66a5b463b1e4cc68ec26e9ab2288d07 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e66a5b463b1e4cc68ec26e9ab2288d07"}]}] Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: e66a5b463b1e4cc68ec26e9ab2288d07 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ListServerFiltersTestJSON-1166398666-project Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6f300f44cb214a52afa6ece5cec9921b Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ListServerFiltersTestJSON-1166398666-project Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance b5369244-5c2f-413f-a8e7-0f33e9c14cde could not be found. Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'b5369244-5c2f-413f-a8e7-0f33e9c14cde'} Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5369244-5c2f-413f-a8e7-0f33e9c14cde could not be found. Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5369244-5c2f-413f-a8e7-0f33e9c14cde could not be found. Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:49.069000 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:49.074047 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:49.074047 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:49.074047 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:49.074047 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:49.074047 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:49.074047 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5369244-5c2f-413f-a8e7-0f33e9c14cde could not be found. Oct 12 22:53:49.074047 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:49.075797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Returning 404 to user: Instance b5369244-5c2f-413f-a8e7-0f33e9c14cde could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:49.077025 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3342e3fc-9fed-4608-bd0e-653a750c63be tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde" status: 404 len: 111 microversion: 2.1 time: 0.048378 Oct 12 22:53:49.081231 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1948/4033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:49 2022] GET /compute/v2.1/servers/b5369244-5c2f-413f-a8e7-0f33e9c14cde => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:53:49.087937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:49.088649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:49.094805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.095810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.096603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.097669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.098289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.098891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.134275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c00489b9-25dd-42c1-ad8d-858ce4c424c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/9d983f75-c2c0-46fd-bbff-ebba180b2097" status: 202 len: 0 microversion: 2.1 time: 2.605032 Oct 12 22:53:49.134981 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2086/4034] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:53:46 2022] DELETE /compute/v2.1/os-floating-ips/9d983f75-c2c0-46fd-bbff-ebba180b2097 => generated 0 bytes in 2611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:53:49.142752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:49.144098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:49.151420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:53:49.155056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.160697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.161198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.162084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.162662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.163200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.225485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:53:49.359654 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ec364f7-08c2-4981-a457-3860086af714 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 204 len: 0 microversion: 2.1 time: 0.274694 Oct 12 22:53:49.360606 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1949/4035] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:53:49 2022] DELETE /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:53:49.396270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:49.397133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:49.410218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.411296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.412237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.413128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.415076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.415700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.447202 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-afa51d2a-ca7d-42dd-9dee-88f25bdd23c4 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 204 len: 0 microversion: 2.1 time: 0.307640 Oct 12 22:53:49.447814 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2087/4036] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:53:49 2022] DELETE /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:53:49.462221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:49.467748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:49.483998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.488278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.489911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.492846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:49.493573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:49.495969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:49.792140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:49.800655 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54b15564-04fd-47ec-84c8-7f2b7a19d67e tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1521 microversion: 2.1 time: 0.346337 Oct 12 22:53:49.801795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2088/4037] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:49 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:49.920143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:49.934459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29186b87-4497-4c25-b86e-d16411230941 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1518 microversion: 2.1 time: 0.568591 Oct 12 22:53:49.936853 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1950/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:49 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1518 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:49.985012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:49.985998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:49.999335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:50.005843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:50.006555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:50.009701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:50.010346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:50.012412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:50.825737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:50.826430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:50.868957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:50.869763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:50.870480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:50.871381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:50.872138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:50.872751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:51.097102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:51.130939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:51.136563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:51.139441 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8485e2b8-dde2-4b99-a779-144d28d0d466 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.157693 Oct 12 22:53:51.141922 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2089/4039] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:49 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:51.155260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:51.157128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:51.176526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:51.178398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:51.178858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:51.181871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:51.182374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:51.183020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:51.258969 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 22:53:51.258969 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 22:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 (ip 10.222.0.20) !!! Oct 12 22:53:51.815522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:51.833556 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d043bc83-ded4-4fcc-bb78-06d0ab2d68e3 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1521 microversion: 2.1 time: 1.012303 Oct 12 22:53:51.836443 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1951/4040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:50 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1521 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:51.863701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-015a659b-cfd1-4db3-82e2-d457c0bd1ef4 req-0032946f-b728-4bcc-831b-cda9c026a5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "406142d3-0aee-4227-aea2-74207b0b35d4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:51.890749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-015a659b-cfd1-4db3-82e2-d457c0bd1ef4 req-0032946f-b728-4bcc-831b-cda9c026a5d0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:51.892842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-015a659b-cfd1-4db3-82e2-d457c0bd1ef4 req-0032946f-b728-4bcc-831b-cda9c026a5d0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:51.893520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-015a659b-cfd1-4db3-82e2-d457c0bd1ef4 req-0032946f-b728-4bcc-831b-cda9c026a5d0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:51.945025 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-015a659b-cfd1-4db3-82e2-d457c0bd1ef4 req-0032946f-b728-4bcc-831b-cda9c026a5d0 service nova] Creating event network-changed:406142d3-0aee-4227-aea2-74207b0b35d4 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:53:51.965557 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-015a659b-cfd1-4db3-82e2-d457c0bd1ef4 req-0032946f-b728-4bcc-831b-cda9c026a5d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115391 Oct 12 22:53:51.966854 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1952/4041] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:52.174856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:52.175576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:52.182596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:52.183094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:52.183538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:52.184329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:52.184790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:52.185222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:54.123067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:54.168046 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0a3c856a-561c-4f57-8cae-f78631063831 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1518 microversion: 2.1 time: 3.019641 Oct 12 22:53:54.176072 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2090/4042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:51 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1518 bytes in 3033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:54.212357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:54.213160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:54.237860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:54.239680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:54.240951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:54.242069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:54.242771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:54.244167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:54.449228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:54.457927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47731e62-cf9a-4849-9417-5f57d632a41d tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1479 microversion: 2.1 time: 0.279949 Oct 12 22:53:54.467867 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2091/4043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:54 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1479 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:54.474164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-db786e4c-16b3-46d7-a801-7e49d54b8721 req-3a5d9bf8-27d6-4e5f-83ec-022bcc8dabef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae744a67-c6e6-4946-989a-717e472b7a86", "name": "network-vif-deleted", "tag": "3be0fa93-e344-46c7-ba2b-825fcfdd091c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:54.489556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-db786e4c-16b3-46d7-a801-7e49d54b8721 req-3a5d9bf8-27d6-4e5f-83ec-022bcc8dabef service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:54.492769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-db786e4c-16b3-46d7-a801-7e49d54b8721 req-3a5d9bf8-27d6-4e5f-83ec-022bcc8dabef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:54.496278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-db786e4c-16b3-46d7-a801-7e49d54b8721 req-3a5d9bf8-27d6-4e5f-83ec-022bcc8dabef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:54.512856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:54.539224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:54.540647 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-db786e4c-16b3-46d7-a801-7e49d54b8721 req-3a5d9bf8-27d6-4e5f-83ec-022bcc8dabef service nova] Creating event network-vif-deleted:3be0fa93-e344-46c7-ba2b-825fcfdd091c for instance ae744a67-c6e6-4946-989a-717e472b7a86 on n-h2-860864-8 Oct 12 22:53:54.545334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:54.551762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99df037c-f7ea-4271-9028-fe096fb3295d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 2.381135 Oct 12 22:53:54.555187 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-db786e4c-16b3-46d7-a801-7e49d54b8721 req-3a5d9bf8-27d6-4e5f-83ec-022bcc8dabef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085622 Oct 12 22:53:54.563928 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1953/4045] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:52 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:54.564616 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2092/4045] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:54.602876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f5840e37-7591-440a-898f-5eb6dbe8b883 req-3c303c9e-4570-427a-ac4f-815dd9cfe653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7", "name": "network-vif-deleted", "tag": "fa423897-cb10-447d-be9b-dad6607bd1eb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:54.631203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f5840e37-7591-440a-898f-5eb6dbe8b883 req-3c303c9e-4570-427a-ac4f-815dd9cfe653 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:54.642340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f5840e37-7591-440a-898f-5eb6dbe8b883 req-3c303c9e-4570-427a-ac4f-815dd9cfe653 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:54.643230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f5840e37-7591-440a-898f-5eb6dbe8b883 req-3c303c9e-4570-427a-ac4f-815dd9cfe653 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:54.672668 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f5840e37-7591-440a-898f-5eb6dbe8b883 req-3c303c9e-4570-427a-ac4f-815dd9cfe653 service nova] Creating event network-vif-deleted:fa423897-cb10-447d-be9b-dad6607bd1eb for instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 on n-h1-860864-8 Oct 12 22:53:54.704531 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f5840e37-7591-440a-898f-5eb6dbe8b883 req-3c303c9e-4570-427a-ac4f-815dd9cfe653 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106398 Oct 12 22:53:54.712392 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1954/4046] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:55.195725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:55.196485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:55.215126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.217086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.217573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.218379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.218843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.219311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.297067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.297556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.297993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.298450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lazy-loading 'fault' on Instance uuid 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:53:55.442072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f300f44cb214a52afa6ece5cec9921b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66a5b463b1e4cc68ec26e9ab2288d07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:55.453972 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b732d462-75f9-4b44-a11d-ab5921e2dba2 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 200 len: 1310 microversion: 2.1 time: 0.262608 Oct 12 22:53:55.462207 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2093/4047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:55 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 1310 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:55.493533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:55.494242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:55.517998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.518695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.518955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.519917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.520387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.520802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.590158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:55.591354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:55.605771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.606585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.607231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.608478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.609141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.610263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:55.610744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:55.611183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.611456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:55.611628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lazy-loading 'fault' on Instance uuid ae744a67-c6e6-4946-989a-717e472b7a86 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:53:55.637414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:53:55.822040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c612e09c1141e0981359245d0f4132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac82d48217a412b8f9da673cbed0520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:55.838050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37338f90-924f-4e60-9d4c-99cdbbeeae57 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 200 len: 1313 microversion: 2.1 time: 0.350684 Oct 12 22:53:55.839008 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1955/4048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:55 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:53:56.320057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:56.344027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:56.349080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:56.356351 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f5b7dbe-d8d7-4bca-93a2-dbd3d597b570 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.770598 Oct 12 22:53:56.359199 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2094/4049] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:55 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:56.487300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:56.488937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] [instance: 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:56.509454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:56.510576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:56.513334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:56.514408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:56.525579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:56.526227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:56.590060 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] HTTP exception thrown: Instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 could not be found. Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Request method failure captured: Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 HTTP/1.1 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0URn-xb1hB62y4sp_x1nObvdDr85BPQTe46JesxYALqEjlA8Gh7gVRs1T5dCQ6oyhE-SmOkSWqYZzY3iH6z4enylW_QqJT-AQH58jtTtA15f9YdSWyCrDJgC5vMq5joGqr-drrtOudKrtioqMo6z2PkMIdS_NhK2vdh1nApyfm3QIo Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: e66a5b463b1e4cc68ec26e9ab2288d07 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e66a5b463b1e4cc68ec26e9ab2288d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e66a5b463b1e4cc68ec26e9ab2288d07"}]}] Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: e66a5b463b1e4cc68ec26e9ab2288d07 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1166398666 Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ListServerFiltersTestJSON-1166398666-project Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6f300f44cb214a52afa6ece5cec9921b Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ListServerFiltersTestJSON-1166398666-project Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 could not be found. Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7'} Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 could not be found. Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 could not be found. Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:56.601742 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 could not be found. Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] Returning 404 to user: Instance 9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:56.607222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-49868312-777e-4c85-a64c-dd569e804386 tempest-ListServerFiltersTestJSON-1166398666 tempest-ListServerFiltersTestJSON-1166398666-project] 10.222.0.20 "GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7" status: 404 len: 111 microversion: 2.1 time: 0.119872 Oct 12 22:53:56.618342 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1956/4050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:56 2022] GET /compute/v2.1/servers/9c667dd7-7d8f-4fc5-80de-f1c41b3d27c7 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:53:56.868293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:56.869636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] [instance: ae744a67-c6e6-4946-989a-717e472b7a86] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:56.890497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:56.891445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:56.892199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:56.903009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:56.907211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:56.910251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:56.977183 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] HTTP exception thrown: Instance ae744a67-c6e6-4946-989a-717e472b7a86 could not be found. Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Request method failure captured: Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 HTTP/1.1 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0T2IwORgW9YHj36-LMUjbhkDZQCZHU6i7qGvgSfPmGozZnCglDkGkCI30eQSl7Et-2T3yYgefBbWiGnvUKFybpbVkMKplquyZ3DDGkhAoakzxlCupF0F7RT4hY_-zPwlCSiwwt4EnzG_DEl_LCv0ZRBuq1_xlKfJYR4v9Rabj6vjm4 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dac82d48217a412b8f9da673cbed0520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dac82d48217a412b8f9da673cbed0520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dac82d48217a412b8f9da673cbed0520"}]}] Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: dac82d48217a412b8f9da673cbed0520 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-689844182 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 55c612e09c1141e0981359245d0f4132 Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-689844182-project Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance ae744a67-c6e6-4946-989a-717e472b7a86 could not be found. Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ae744a67-c6e6-4946-989a-717e472b7a86'} Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae744a67-c6e6-4946-989a-717e472b7a86 could not be found. Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae744a67-c6e6-4946-989a-717e472b7a86 could not be found. Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.978924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae744a67-c6e6-4946-989a-717e472b7a86 could not be found. Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] Returning 404 to user: Instance ae744a67-c6e6-4946-989a-717e472b7a86 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:53:56.984301 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0dea2e75-1455-4346-b8dd-0dec32e8b363 tempest-FloatingIPsAssociationTestJSON-689844182 tempest-FloatingIPsAssociationTestJSON-689844182-project] 10.222.0.20 "GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86" status: 404 len: 111 microversion: 2.1 time: 0.117974 Oct 12 22:53:56.988443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2095/4051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:53:56 2022] GET /compute/v2.1/servers/ae744a67-c6e6-4946-989a-717e472b7a86 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:53:57.336688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1f5679a6-f482-46e4-9ff5-53ec400e8d50 req-92833720-65d4-4f6a-864e-72c1a7190a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "c6d91645-1f22-43c7-8819-f3f37de52ad7"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:57.353745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1f5679a6-f482-46e4-9ff5-53ec400e8d50 req-92833720-65d4-4f6a-864e-72c1a7190a47 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:57.358125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1f5679a6-f482-46e4-9ff5-53ec400e8d50 req-92833720-65d4-4f6a-864e-72c1a7190a47 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:57.358749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1f5679a6-f482-46e4-9ff5-53ec400e8d50 req-92833720-65d4-4f6a-864e-72c1a7190a47 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:57.383331 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1f5679a6-f482-46e4-9ff5-53ec400e8d50 req-92833720-65d4-4f6a-864e-72c1a7190a47 service nova] Creating event network-changed:c6d91645-1f22-43c7-8819-f3f37de52ad7 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:53:57.390333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:57.391003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:57.400744 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1f5679a6-f482-46e4-9ff5-53ec400e8d50 req-92833720-65d4-4f6a-864e-72c1a7190a47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063460 Oct 12 22:53:57.401645 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1957/4052] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:57.407907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:57.412354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:57.413997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:57.414751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:57.421514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:57.422132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:58.643537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:58.661992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:58.663485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:53:58.664721 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dd3b82a8-b9e5-44dc-9baf-fde27e4dcbc5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.279412 Oct 12 22:53:58.665266 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2096/4053] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:57 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:53:59.604124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0644e880-b397-4c9a-b520-4c044ab7c3fb req-4b3e53bb-ffb6-4f29-a473-56970f7bcc86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "9d644e7b-03a4-428b-b875-0a7ca3e67f92"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:53:59.638949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0644e880-b397-4c9a-b520-4c044ab7c3fb req-4b3e53bb-ffb6-4f29-a473-56970f7bcc86 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:59.641711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0644e880-b397-4c9a-b520-4c044ab7c3fb req-4b3e53bb-ffb6-4f29-a473-56970f7bcc86 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:59.644070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0644e880-b397-4c9a-b520-4c044ab7c3fb req-4b3e53bb-ffb6-4f29-a473-56970f7bcc86 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:59.669887 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0644e880-b397-4c9a-b520-4c044ab7c3fb req-4b3e53bb-ffb6-4f29-a473-56970f7bcc86 service nova] Creating event network-changed:9d644e7b-03a4-428b-b875-0a7ca3e67f92 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:53:59.679952 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0644e880-b397-4c9a-b520-4c044ab7c3fb req-4b3e53bb-ffb6-4f29-a473-56970f7bcc86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081449 Oct 12 22:53:59.684255 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1958/4054] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:53:59.693786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:53:59.694492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:53:59.705323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:59.705811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:59.706238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:53:59.711349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:53:59.712179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:53:59.714666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:00.929248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:00.962153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:00.964590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:00.968382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7e6a819e-5ce0-46b5-9931-daf3c975b264 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.276330 Oct 12 22:54:00.970526 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2097/4055] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:53:59 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:02.017441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:02.023875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:02.041471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:02.041747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:02.042152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:02.042866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:02.055685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:02.056283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:02.413635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-734061873", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5d35d626-9e7a-4fe7-b514-ce59cd7f629e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:02.517207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:02.799986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:02.814225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:02.814716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:02.817995 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb0098e7-82b8-42db-991e-9df5d34ffc65 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.816092 Oct 12 22:54:02.819313 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1959/4056] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:02 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:02.906681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5f9cc8d3-4081-4b82-adf1-f4e3c1bba915 req-f27a1352-129a-42a5-b78a-8fd393a73d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "e9bd88d0-de17-424f-83f1-820986fe73d2"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:02.926364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5f9cc8d3-4081-4b82-adf1-f4e3c1bba915 req-f27a1352-129a-42a5-b78a-8fd393a73d34 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:02.927095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5f9cc8d3-4081-4b82-adf1-f4e3c1bba915 req-f27a1352-129a-42a5-b78a-8fd393a73d34 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:02.927852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5f9cc8d3-4081-4b82-adf1-f4e3c1bba915 req-f27a1352-129a-42a5-b78a-8fd393a73d34 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:02.958351 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5f9cc8d3-4081-4b82-adf1-f4e3c1bba915 req-f27a1352-129a-42a5-b78a-8fd393a73d34 service nova] Creating event network-changed:e9bd88d0-de17-424f-83f1-820986fe73d2 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:02.969293 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5f9cc8d3-4081-4b82-adf1-f4e3c1bba915 req-f27a1352-129a-42a5-b78a-8fd393a73d34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072724 Oct 12 22:54:02.970299 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1960/4057] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:03.855372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:03.856082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:03.879215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:03.880181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:03.880440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:03.881363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:03.882723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:03.883431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:04.313201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:04.341621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:04.343086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:04.344297 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eb0c3fe1-d6ef-461b-9221-eb1dca6e3161 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.498640 Oct 12 22:54:04.366258 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1961/4058] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:03 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:05.032289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-01406dc4-63a3-4358-b7d7-8738ac9256e8 req-38fa6a52-83f2-470b-bcd6-ce2dc9fc5644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "ab6471ab-ea73-4402-ae24-2340cb39c507"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:05.048797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-01406dc4-63a3-4358-b7d7-8738ac9256e8 req-38fa6a52-83f2-470b-bcd6-ce2dc9fc5644 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:05.051091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-01406dc4-63a3-4358-b7d7-8738ac9256e8 req-38fa6a52-83f2-470b-bcd6-ce2dc9fc5644 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:05.051855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-01406dc4-63a3-4358-b7d7-8738ac9256e8 req-38fa6a52-83f2-470b-bcd6-ce2dc9fc5644 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:05.075470 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-01406dc4-63a3-4358-b7d7-8738ac9256e8 req-38fa6a52-83f2-470b-bcd6-ce2dc9fc5644 service nova] Creating event network-changed:ab6471ab-ea73-4402-ae24-2340cb39c507 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:05.082869 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-01406dc4-63a3-4358-b7d7-8738ac9256e8 req-38fa6a52-83f2-470b-bcd6-ce2dc9fc5644 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058038 Oct 12 22:54:05.084395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1962/4059] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:05.209552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:05.210476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:05.211326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:05.212109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:05.212821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:05.223302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:05.224111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:05.224737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:05.226155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:05.226859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:05.227567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:05.264873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:05.272756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:05.373834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:05.375942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d35d626-9e7a-4fe7-b514-ce59cd7f629e',volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:05.399611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:05.401577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:05.423074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:05.424452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:05.426349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:05.427308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:05.429627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:05.430288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:05.620799 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e99f1d58-08ab-4f2b-b944-7a449c5917aa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.211784 Oct 12 22:54:05.628825 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2098/4060] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:54:05.634657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aaa2d912-aa81-4a95-990b-e84e1815b5f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:05.635570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aaa2d912-aa81-4a95-990b-e84e1815b5f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:05.722141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aaa2d912-aa81-4a95-990b-e84e1815b5f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:05.730561 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aaa2d912-aa81-4a95-990b-e84e1815b5f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1056 microversion: 2.1 time: 0.100270 Oct 12 22:54:05.733610 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2099/4061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:05 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1056 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:06.323524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:06.344003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:06.350069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:06.352691 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cf12c166-3f17-4ac9-a39a-e1c8d30cb7ce tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.963829 Oct 12 22:54:06.381428 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1963/4062] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:05 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:06.761294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:06.762204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:06.788262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:06.790124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:06.792236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:06.797237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:06.799479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:06.800434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:07.268350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:07.291485 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e8e6470-cfca-4072-a569-7642b9247d37 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1154 microversion: 2.1 time: 0.537280 Oct 12 22:54:07.297583 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2100/4063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:06 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1154 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:07.386340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:07.387123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:07.394702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:07.396389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:07.398165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:07.399138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:07.400294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:07.401282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:07.408542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:08.325250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:08.325872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:08.333800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:08.335296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:08.335942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:08.336864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:08.337504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:08.338173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:08.522522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:08.534369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:08.536863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:08.541273 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bfbdfc81-2403-4d52-8c12-1d670dae1ba4 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.158998 Oct 12 22:54:08.543936 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1964/4064] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:07 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:08.897381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:08.914874 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-680ffadc-bbdf-483c-9639-d0fc7f7e6056 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1172 microversion: 2.1 time: 0.593237 Oct 12 22:54:08.917230 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2101/4065] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:08 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1172 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:09.576220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:09.577545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:09.604565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:09.604967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:09.605594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:09.606481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:09.607095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:09.607679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:09.940338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:09.941218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:09.955876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:09.956621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:09.957681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:09.960403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:09.963121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:09.963791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:10.609011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:10.622637 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11b458b5-146e-4ad2-a4fc-ca50aad2127a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1214 microversion: 2.1 time: 0.687118 Oct 12 22:54:10.624001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2102/4066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:09 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1214 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:11.168705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:11.178109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:11.179700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:11.180976 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0c07c5c5-5eea-4ca3-bc47-a662fde48b8f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.610494 Oct 12 22:54:11.182071 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1965/4067] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:09 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:11.655183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:11.656752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:11.675117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:11.677198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:11.685285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:11.687932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:11.688659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:11.690397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:12.212628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:12.214007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:12.227707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:12.228586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:12.229280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:12.230214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:12.232438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:12.233114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:12.356397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:12.366471 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6edc248d-1d9a-4654-bc6c-44710d28165a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1214 microversion: 2.1 time: 0.723294 Oct 12 22:54:12.370108 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2103/4068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:11 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1214 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:13.325965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3cc4b32b-59b7-40a8-b870-86c0c4ef5b2c req-5396b7c0-4add-46fd-ab06-439b1ea3bb25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb21116-0046-4508-b045-0e33f5b4410c", "tag": "3dbe30d8-3cbf-467b-9673-b98e73967054"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:13.346144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:13.348020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cc4b32b-59b7-40a8-b870-86c0c4ef5b2c req-5396b7c0-4add-46fd-ab06-439b1ea3bb25 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:13.348771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cc4b32b-59b7-40a8-b870-86c0c4ef5b2c req-5396b7c0-4add-46fd-ab06-439b1ea3bb25 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:13.349391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cc4b32b-59b7-40a8-b870-86c0c4ef5b2c req-5396b7c0-4add-46fd-ab06-439b1ea3bb25 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:13.388330 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3cc4b32b-59b7-40a8-b870-86c0c4ef5b2c req-5396b7c0-4add-46fd-ab06-439b1ea3bb25 service nova] Creating event network-changed:3dbe30d8-3cbf-467b-9673-b98e73967054 for instance fdb21116-0046-4508-b045-0e33f5b4410c on n-h2-860864-8 Oct 12 22:54:13.420477 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3cc4b32b-59b7-40a8-b870-86c0c4ef5b2c req-5396b7c0-4add-46fd-ab06-439b1ea3bb25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088104 Oct 12 22:54:13.424594 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2104/4069] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:13.431606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:13.437093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:13.455489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:13.456025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:13.456512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:13.457903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:13.458520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:13.459712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:13.607318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:13.629079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:13.634974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:13.641228 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09f7565f-f03e-41dc-8f09-c8fb7aa4a00d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.433006 Oct 12 22:54:13.648481 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1966/4070] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:12 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:54:13.965969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:13.976092 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-97f83065-52ff-409f-b40f-3a8a375a2fad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1214 microversion: 2.1 time: 0.549959 Oct 12 22:54:13.981196 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2105/4071] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:13 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1214 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:14.679146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:14.680058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:14.695190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:14.695913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:14.696472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:14.699785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:14.700466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:14.702087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:15.004183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:15.004814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:15.015015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:15.015519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:15.015989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:15.016712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:15.017175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:15.017609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:15.248433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:15.533216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:15.550223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:15.556550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:15.565859 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ee5b103-f032-45bc-9067-c5b2c1df5b88 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.891751 Oct 12 22:54:15.583917 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1967/4072] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:14 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:15.686877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:15.695845 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6934140e-b1e7-4b2e-940c-f17468cf8126 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1214 microversion: 2.1 time: 0.695391 Oct 12 22:54:15.720013 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2106/4073] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:14 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1214 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:16.437999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-273683854", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d66ee827-cdbf-47c7-bea5-6c5ad2e47941"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:16.477794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:16.535006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:16.601519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:16.601519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:16.604096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:16.619620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:16.620329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:16.621071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:16.621839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:16.623835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:16.626293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:17.024935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:17.064027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:17.066560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:17.068016 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-20c1241d-776c-47c1-93bc-649885df50dc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.472222 Oct 12 22:54:17.069339 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2107/4074] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:16 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:17.084889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:17.085823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:17.099674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:17.100209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:17.100659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:17.101370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:17.101834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:17.102268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:17.498567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:17.509567 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-173af99a-3fd0-4248-b250-d9a7907061f7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.438843 Oct 12 22:54:17.524909 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2108/4075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:17 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:18.103879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:18.104526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:18.130439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.133063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.134252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:18.136400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.139391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.140119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:18.445740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:18.466638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:18.468545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:18.476459 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65a6601c-e089-4283-9a3b-67de74e8bc23 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.379588 Oct 12 22:54:18.477684 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2109/4076] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:18 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:18.537347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:18.538405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:18.551756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:18.553908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:18.554947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:18.555555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:18.556201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:18.564410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.570034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.571933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:18.573757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.574185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.574916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.575628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.576341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:18.581699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:18.582796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:18.587976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:18.588812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:18.634820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:18.646181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:18.668679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:18.677306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:18.795172 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3d765f6-d492-4652-ae5f-0cdc1442042d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.588134 Oct 12 22:54:18.795939 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1968/4077] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:54:18.818166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-efa591a2-df8b-4439-8d7c-e524285201a3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:18.818823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-efa591a2-df8b-4439-8d7c-e524285201a3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:19.007984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-efa591a2-df8b-4439-8d7c-e524285201a3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:19.022462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-efa591a2-df8b-4439-8d7c-e524285201a3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1192 microversion: 2.1 time: 0.215112 Oct 12 22:54:19.052616 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1969/4078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:18 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1192 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:19.447645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:19.456341 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6715e275-fcec-41de-9815-8f3a997be00d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.924401 Oct 12 22:54:19.460653 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2110/4079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:18 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:19.511159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:19.512192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:19.530801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:19.531547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:19.532985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:19.534340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:19.535756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:19.536872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:20.059623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:20.060576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:20.067371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:20.069665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:20.075109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:20.076162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:20.077082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:20.077469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:20.213729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:20.231069 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-adf5cade-de06-421d-a77e-6f55bca5e9f8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1188 microversion: 2.1 time: 0.174178 Oct 12 22:54:20.233203 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2111/4080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:20 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1188 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:20.504517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:20.505415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:20.517421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:20.518096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:20.518743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:20.519584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:20.522368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:20.524454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:20.539660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:20.569471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:20.571379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:20.573165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f53fbf8a-9e60-420b-bd03-0069637cf90d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.067922 Oct 12 22:54:20.574626 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1970/4081] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:19 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:21.063353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:21.085809 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b68b2830-f3b1-42cd-834c-3ec90d56b50f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.585117 Oct 12 22:54:21.086717 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2112/4082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:20 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:21.261853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:21.262985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:21.269958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.270963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.272241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.273146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.273777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.274991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.434093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:21.460441 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa08398d-768f-411d-bd8e-3e8ba81eccd7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1250 microversion: 2.1 time: 0.205069 Oct 12 22:54:21.460817 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1971/4083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:21 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1250 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:21.606802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:21.607529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:21.622502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.623312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.624145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:21.625122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:21.625826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:21.627038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:22.082870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:22.087931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:22.110549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:22.112134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:22.139520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:22.140056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:22.140504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:22.143352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:22.144790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:22.149739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:22.149918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:22.150573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:22.152692 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b9949a5-210d-4c09-8eaf-b7269e2ca30e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.543210 Oct 12 22:54:22.155191 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2113/4084] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:21 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:22.493661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:22.494363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:22.505847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:22.512737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:22.513332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:22.514185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:22.514735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:22.515246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:22.645547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:22.666569 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65af39d2-7cd5-4800-b37a-3e599158d912 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1250 microversion: 2.1 time: 0.179480 Oct 12 22:54:22.669418 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2114/4085] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:22 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1250 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:23.057689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:23.070328 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65b8416e-dda7-4095-81f6-913c0ee1e893 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.962705 Oct 12 22:54:23.077237 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1972/4086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:22 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:23.181650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.182419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.191550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.196481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.201169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.216312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.217158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.217771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.431791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a6742bf-3506-407a-9844-58be14c68664 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'create', calling method: .version_select at 0x7f44ff836dc0>, body: {"keypair": {"name": "tempest-keypair-14197385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIx4sCsLuzHA68gSxRoqkpEbzBTpWmfrOU4jvUD9BYR7jMnI6Fa/ichuH6Q9NssqdaEkC/dXeH3Yi3p/wnTWpvFRN/s8ykxjiea8ZM7olm6cbeFaQKEKzj11G3/tzjY/g=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:23.478413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6a6742bf-3506-407a-9844-58be14c68664 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for project d1909b9808794051a8d86451506ca5bb. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:23.495874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6a6742bf-3506-407a-9844-58be14c68664 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for user b103c953780a4dce8d8872ee8b47d186 and project d1909b9808794051a8d86451506ca5bb. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:23.561685 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a6742bf-3506-407a-9844-58be14c68664 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.438640 Oct 12 22:54:23.568116 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2115/4087] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:54:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:23.700455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:23.701122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:23.726547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.729402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.730274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.736481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:23.737321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:23.740580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:23.892970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:23.903739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:23.905247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:23.906440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2631aa7-f331-49ab-b8df-14f4216c7ea6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.729640 Oct 12 22:54:23.907022 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1973/4088] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:23 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:24.098735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:24.099464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:24.114522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:24.115364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:24.116012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:24.116908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:24.117528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:24.118122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:24.429286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:24.444581 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-580eb2a6-db7e-4e43-9378-6701762b6c53 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.752654 Oct 12 22:54:24.452342 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2116/4089] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:23 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:24.506484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:24.517421 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b33c36ae-7415-4310-8003-7ea731dc356d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.419561 Oct 12 22:54:24.519747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1974/4090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:24 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:24.942716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:24.943552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:24.964794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:24.965647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:24.966269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:24.967183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:24.967818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:24.968467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:25.467947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:25.468499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:25.495683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:25.497594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:25.498437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:25.500319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:25.500807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:25.501240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:25.781811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:25.793719 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca15872f-74ed-439b-a5f6-694d005b220c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.329597 Oct 12 22:54:25.796218 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1975/4091] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:25 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:25.805368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:25.807863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:25.818918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:25.823686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:25.828655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:25.829740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:25.830395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:25.831029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:26.101472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:26.118749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:26.121882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:26.123138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2432b877-57f2-4478-9b8c-8611106fe404 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 1.187553 Oct 12 22:54:26.142914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2117/4092] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:24 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:26.312849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:26.327050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-769e0836-3517-446b-aef8-846593f76e67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.527476 Oct 12 22:54:26.328603 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1976/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:25 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:26.469392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-65542394", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41c00e0a-6171-41b3-913b-03da316da8e7"}], "security_groups": [{"name": "tempest-securitygroup--722341201"}], "key_name": "tempest-keypair-14197385", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:26.562581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4cc29a21-bbf9-43de-8795-bc378847411a req-19b3d5d5-c12e-487a-b5bd-8593c5c897dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d", "tag": "e2e0ac2e-05a8-40ac-a187-195df3e0e09c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:26.609882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4cc29a21-bbf9-43de-8795-bc378847411a req-19b3d5d5-c12e-487a-b5bd-8593c5c897dc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:26.611201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4cc29a21-bbf9-43de-8795-bc378847411a req-19b3d5d5-c12e-487a-b5bd-8593c5c897dc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:26.612005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4cc29a21-bbf9-43de-8795-bc378847411a req-19b3d5d5-c12e-487a-b5bd-8593c5c897dc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:26.637538 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4cc29a21-bbf9-43de-8795-bc378847411a req-19b3d5d5-c12e-487a-b5bd-8593c5c897dc service nova] Creating event network-changed:e2e0ac2e-05a8-40ac-a187-195df3e0e09c for instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d on n-h2-860864-8 Oct 12 22:54:26.643423 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4cc29a21-bbf9-43de-8795-bc378847411a req-19b3d5d5-c12e-487a-b5bd-8593c5c897dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090521 Oct 12 22:54:26.649290 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1977/4094] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:26.818948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:26.820621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:26.835394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:26.835792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:26.836540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:26.837564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:26.838013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:26.838545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:26.893830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] validate_networks() for [('41c00e0a-6171-41b3-913b-03da316da8e7', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:27.045540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:27.058563 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1819a03d-42a0-462a-ad30-1e4f9b1a0bf7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.244747 Oct 12 22:54:27.060138 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1978/4095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:26 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:27.153030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:27.153789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:27.165658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.168058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.169710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.174155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.174923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.175509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.514326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:27.528745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:27.538554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:27.539794 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a53deb47-ec72-4c5e-bb69-f7e885757f81 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.392215 Oct 12 22:54:27.540492 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1979/4096] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:27 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:27.551567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:27.552436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:27.565950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.567478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.570272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.571448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:27.572121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:27.577628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:27.900910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:27.912715 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9927f2ec-5dbf-4d26-8738-20060f9a2d63 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.369043 Oct 12 22:54:27.915141 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1980/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:27 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:28.042124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:28.042940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:28.043532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:28.044192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:28.044684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:28.062751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.064103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.064619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.066284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.067545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.068616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.083001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:28.084480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:28.096597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.097423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.097774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.099080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.106750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.108721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.128105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:28.144471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for user b103c953780a4dce8d8872ee8b47d186 and project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:28.188877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:28.196116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:28.266963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ddda0e86-9695-4743-9ce7-00dd99311ee3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.801982 Oct 12 22:54:28.268136 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2118/4098] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:54:28.280426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d55d57a9-5e9c-4af9-a20d-77564da99d32 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:28.281889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d55d57a9-5e9c-4af9-a20d-77564da99d32 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:28.370995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:28.383819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-da55b54f-333f-4fc0-9e87-e1c5b16bfee8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.303586 Oct 12 22:54:28.400039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1981/4099] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:28 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:28.570410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:28.571249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:28.585633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.586138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.586572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.587282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.587730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.588178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.612957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:28.862746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d55d57a9-5e9c-4af9-a20d-77564da99d32 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:28.871264 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d55d57a9-5e9c-4af9-a20d-77564da99d32 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1235 microversion: 2.1 time: 0.595329 Oct 12 22:54:28.875285 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2119/4100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:28 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1235 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:28.898279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-15ad079e-f5e5-477b-9217-9ef193f483b9 req-16340681-4cb3-49b1-ae82-7e44362e67d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb21116-0046-4508-b045-0e33f5b4410c", "name": "network-vif-plugged", "status": "completed", "tag": "3dbe30d8-3cbf-467b-9673-b98e73967054"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:28.923414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-15ad079e-f5e5-477b-9217-9ef193f483b9 req-16340681-4cb3-49b1-ae82-7e44362e67d3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.924137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-15ad079e-f5e5-477b-9217-9ef193f483b9 req-16340681-4cb3-49b1-ae82-7e44362e67d3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.924595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-15ad079e-f5e5-477b-9217-9ef193f483b9 req-16340681-4cb3-49b1-ae82-7e44362e67d3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.939064 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-15ad079e-f5e5-477b-9217-9ef193f483b9 req-16340681-4cb3-49b1-ae82-7e44362e67d3 service nova] Creating event network-vif-plugged:3dbe30d8-3cbf-467b-9673-b98e73967054 for instance fdb21116-0046-4508-b045-0e33f5b4410c on n-h2-860864-8 Oct 12 22:54:28.947508 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-15ad079e-f5e5-477b-9217-9ef193f483b9 req-16340681-4cb3-49b1-ae82-7e44362e67d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053711 Oct 12 22:54:28.949430 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2120/4101] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:28.960759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:28.962522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:28.982150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.983509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.983653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:28.987818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:28.988860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:28.990057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:29.025759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:29.306906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:29.331333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:29.332914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:29.334301 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4b3bfad-6215-4802-bd4f-f7e8c1e1e135 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.768505 Oct 12 22:54:29.334849 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1982/4102] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:28 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:29.409317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:29.410081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:29.422778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:29.424449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:29.426040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:29.429391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:29.430750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:29.432538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:29.453752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:29.627122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:29.663751 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79dadb54-85bf-453d-9401-2211fed14d7f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.712729 Oct 12 22:54:29.664570 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2121/4103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:28 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:29.811836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:29.820128 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0fb3c86e-323d-4f74-ba6e-9e751fcf555c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.416268 Oct 12 22:54:29.838255 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1983/4104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:29 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:29.901378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:29.902302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:29.915569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:29.916372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:29.916988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:29.917905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:29.918525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:29.919117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:30.070522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:30.088707 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce9de2ec-a422-4ff9-9a89-13dc0df2a80a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1287 microversion: 2.1 time: 0.192563 Oct 12 22:54:30.089798 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2122/4105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:29 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:30.363255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:30.363871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:30.373277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:30.384696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:30.385441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:30.386346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:30.386962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:30.387639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:30.691335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:30.692756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:30.700376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:30.712875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:30.717717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:30.718865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:30.719328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:30.720084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:30.720545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:30.720973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:30.727513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:30.728975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ceaf7a8-1db7-419d-bc8a-68aa19d624ec tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.370097 Oct 12 22:54:30.732191 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1984/4106] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:30 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:30.848430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:30.850032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:30.879454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:30.882138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:30.882812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:30.883775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:30.884541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:30.886239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:31.111813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:31.129082 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce2ec1e5-0015-4aea-9a34-56061b0f7c28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1202 microversion: 2.1 time: 0.442085 Oct 12 22:54:31.129750 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2123/4107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:30 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1202 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:31.143703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:31.144344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:31.156086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:31.156586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:31.157028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:31.157742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:31.158200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:31.158628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:31.166636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:31.192167 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8e95cc86-c3bb-4960-98fe-106af3fff436 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.350789 Oct 12 22:54:31.198684 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1985/4108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:30 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:31.286381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:31.294931 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4baf9954-792a-490b-963c-ac47c252fbd8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1293 microversion: 2.1 time: 0.163404 Oct 12 22:54:31.297008 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2124/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:31 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:31.694519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-236051376", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "47569298-be53-4a95-a07d-a9deaf5ed6dc"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:31.751799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] validate_networks() for [('47569298-be53-4a95-a07d-a9deaf5ed6dc', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:31.757779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:31.759236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:31.768382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:31.773619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:31.774585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:31.775589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:31.776244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:31.777065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.041876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:32.059686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:32.061511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:32.063363 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8cce64a-a7c2-4336-a636-a6a48048fb0f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.310444 Oct 12 22:54:32.072058 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2125/4110] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:31 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:32.155325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:32.156162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:32.173276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.174047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.174669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.175570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.176259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.178444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.418846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:32.427480 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-796633a4-6ae0-4528-a54c-ccb658d63938 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1388 microversion: 2.1 time: 0.276411 Oct 12 22:54:32.448531 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2126/4111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:32 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1388 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:32.455362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:32.455859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:32.474970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.475734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.476368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.477258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.478039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.478639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.669050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:32.677267 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eafd025a-1c96-4ce7-b9d8-6135440cd2d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.227265 Oct 12 22:54:32.679112 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2127/4112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:32 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:32.684261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:32.685107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:32.691585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.692340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.693001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.693896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.694521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.695115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.706207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:32.706824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:32.707325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:32.707837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:32.708941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:32.725629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.731526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.735319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.736153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:32.736737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:32.737271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:32.807284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Getting quotas for project d0640992268d4e90b9285b14b894f397. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:32.827976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Getting quotas for user d000de8d9fa042d8814fb347e5e7adb7 and project d0640992268d4e90b9285b14b894f397. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:32.870093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:32.880731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:32.972408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:32.987796 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33b5c95f-a5b3-4358-9639-cb3c88c0b1c1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490736 Oct 12 22:54:32.990379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1986/4113] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:54:33.001570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:33.002377 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d6cf722e-622b-4b59-ab53-63b62e129cfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.319031 Oct 12 22:54:33.004636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2128/4114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:32 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:33.016269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:33.027552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.033987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.034902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.035837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.037053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.037797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.039502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3736e77c-8a72-43b1-910e-99b9060d4aaf req-86e60e5f-fb16-4f61-9fe8-c296de988ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d", "name": "network-vif-plugged", "status": "completed", "tag": "e2e0ac2e-05a8-40ac-a187-195df3e0e09c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:33.085038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3736e77c-8a72-43b1-910e-99b9060d4aaf req-86e60e5f-fb16-4f61-9fe8-c296de988ca6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.090401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3736e77c-8a72-43b1-910e-99b9060d4aaf req-86e60e5f-fb16-4f61-9fe8-c296de988ca6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.091026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3736e77c-8a72-43b1-910e-99b9060d4aaf req-86e60e5f-fb16-4f61-9fe8-c296de988ca6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.119768 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3736e77c-8a72-43b1-910e-99b9060d4aaf req-86e60e5f-fb16-4f61-9fe8-c296de988ca6 service nova] Creating event network-vif-plugged:e2e0ac2e-05a8-40ac-a187-195df3e0e09c for instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d on n-h2-860864-8 Oct 12 22:54:33.125943 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3736e77c-8a72-43b1-910e-99b9060d4aaf req-86e60e5f-fb16-4f61-9fe8-c296de988ca6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116577 Oct 12 22:54:33.127372 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2129/4115] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:33.137527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d9d116d7-7cc0-41b1-bdb8-a0e1a944eaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:33.138766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d9d116d7-7cc0-41b1-bdb8-a0e1a944eaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:33.243283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d9d116d7-7cc0-41b1-bdb8-a0e1a944eaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:33.252419 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d9d116d7-7cc0-41b1-bdb8-a0e1a944eaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1231 microversion: 2.1 time: 0.122595 Oct 12 22:54:33.253333 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2130/4116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:33 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1231 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:33.258184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:33.258805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:33.288961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.289463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.289910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.290627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.291089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.291522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.373738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:33.386519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7597dfcf-cc9f-48b0-88b4-d54e1d9f0ae1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1388 microversion: 2.1 time: 0.394861 Oct 12 22:54:33.387119 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1987/4117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:32 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1388 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:33.419133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:33.419751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:33.431251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.432468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.434374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.436062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.436708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.439015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.755743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:33.777884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:33.779815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:33.780545 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3e7c8a5-9efb-4deb-be69-ab8a0e49a9c2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.526095 Oct 12 22:54:33.796346 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2131/4118] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:33 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:33.802980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:33.803661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:33.835244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.836081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.836689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:33.837801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:33.838446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:33.839040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.089994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:34.101257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-786d6c27-00d8-4cbb-8150-4764db76b57f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1292 microversion: 2.1 time: 0.303239 Oct 12 22:54:34.119953 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2132/4119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:33 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1292 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:34.125953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:34.126654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:34.141680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.142178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.142621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.143341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.147044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.148412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.332885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:34.341189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6de9d64d-330f-4f51-96d3-33ce1b4171b0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.219999 Oct 12 22:54:34.342082 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2133/4120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:34 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:34.362524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:34.371094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:34.383310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.383849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.384320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.385068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.385511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.385940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.439105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:34.454511 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-599ea26d-6f3d-4daa-900b-75b1d2cdd75d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1388 microversion: 2.1 time: 1.039578 Oct 12 22:54:34.456226 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1988/4121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:33 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1388 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:34.483191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:34.483861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:34.496384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.497313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.497935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.499474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.501766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.502327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.514337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:34.532752 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3fd27f5-b2cf-4f59-baab-e7943ce78dbe tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1227 microversion: 2.1 time: 0.169089 Oct 12 22:54:34.542946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:54:34.549827 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2134/4122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:34 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1227 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:34.723539 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae8f9027-b378-4953-a593-4bfea8d54b6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 204 len: 0 microversion: 2.1 time: 0.245579 Oct 12 22:54:34.725107 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1989/4123] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:54:34 2022] DELETE /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:54:34.734186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:34.734814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:34.758576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.759398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.760058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.761298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.761954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.762550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.796536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:34.808955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:34.809708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:34.820533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.821022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.821483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.822166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:34.822620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:34.823043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:34.975686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:34.987500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-577e6f05-4b42-4c5e-a107-76232e4e7637 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1394 microversion: 2.1 time: 0.257272 Oct 12 22:54:35.004048 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2135/4124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:34 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1394 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:35.128640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:35.130152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:35.148304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:35.149072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:35.149847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:35.150760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:35.151233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:35.151880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:35.366342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:35.383773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:35.389798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:35.393028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa656a3a-9b54-4b85-b785-7f9f9318b204 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.588376 Oct 12 22:54:35.410999 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1990/4125] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:34 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:54:35.430264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:35.431376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:35.443236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:35.443863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:35.444183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:35.445483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:35.450643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:35.451092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:35.453273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:35.471018 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4a7cd4e-66ee-4c97-bc5a-2fd8426970f5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1473 microversion: 2.1 time: 0.347641 Oct 12 22:54:35.481225 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2136/4126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:35 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:35.573136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:35.575250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:35.600980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:35.602004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:35.616467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:35.626062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:35.629629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:35.631760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:35.717594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:35.725650 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-999fdc0d-92c4-4b87-b176-2488861bc49c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1283 microversion: 2.1 time: 0.172303 Oct 12 22:54:35.726731 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2137/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:35 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:35.732175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-264226200", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:35.828710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:36.233296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:36.242777 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2413c6f3-5d34-43ce-92a4-1dbc9e0a5bdf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.829862 Oct 12 22:54:36.243385 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1991/4128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:35 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:36.255181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-db6e7a13-fee7-41c6-a555-a68d2ac22d56 req-1afcfa50-4141-4339-9302-5ac838855d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:36.281513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-db6e7a13-fee7-41c6-a555-a68d2ac22d56 req-1afcfa50-4141-4339-9302-5ac838855d97 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:36.281750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-db6e7a13-fee7-41c6-a555-a68d2ac22d56 req-1afcfa50-4141-4339-9302-5ac838855d97 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:36.282016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-db6e7a13-fee7-41c6-a555-a68d2ac22d56 req-1afcfa50-4141-4339-9302-5ac838855d97 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:36.310082 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-db6e7a13-fee7-41c6-a555-a68d2ac22d56 req-1afcfa50-4141-4339-9302-5ac838855d97 service nova] Creating event network-changed:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:54:36.329222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-db6e7a13-fee7-41c6-a555-a68d2ac22d56 req-1afcfa50-4141-4339-9302-5ac838855d97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077679 Oct 12 22:54:36.329852 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1992/4129] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:36.335195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:36.335932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:36.350721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:36.351221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:36.351669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:36.352424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:36.354874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:36.355623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:36.975551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:36.991172 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8cded3b6-216a-4c91-9978-a0c47491fb67 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1394 microversion: 2.1 time: 0.660071 Oct 12 22:54:36.991768 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1993/4130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:36 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1394 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:37.004233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:37.008219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:37.019582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.020273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.020880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.021849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.022587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.023241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.516015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:37.517100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:37.517924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:37.518725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:37.519316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:37.532448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:37.560067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.560560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.561132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.561722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.562184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.572705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.601870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:37.616473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:37.633975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:37.638651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 400a9894-2ede-4cfd-8920-54548cd92a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:37.660802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:37.680649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:37.687038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:37.691710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c86da22-1cc5-4736-b716-6029b3c8d79c tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.697785 Oct 12 22:54:37.714592 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1994/4131] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:36 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:37.721470 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26adcc09-072c-4e00-9c80-8bf555091768 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992337 Oct 12 22:54:37.730341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:37.732086 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2138/4132] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:54:37.747726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:37.753347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:37.758534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:37.777672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.779326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.780081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.780705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.781549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.782117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.784302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.784980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.798487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.800715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:37.805190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:37.806031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:37.959972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:37.974270 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1be2c558-40a4-4c3d-bc12-771bbdefaf68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1289 microversion: 2.1 time: 0.247663 Oct 12 22:54:37.977034 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1995/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:37 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1289 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:37.987280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5acfb2d1-68f5-475d-844c-d15893e4eaa9 req-e93bb9d6-c697-408a-b918-e33615dd5d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb21116-0046-4508-b045-0e33f5b4410c", "name": "network-vif-deleted", "tag": "3dbe30d8-3cbf-467b-9673-b98e73967054"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:38.018424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5acfb2d1-68f5-475d-844c-d15893e4eaa9 req-e93bb9d6-c697-408a-b918-e33615dd5d21 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:38.018932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5acfb2d1-68f5-475d-844c-d15893e4eaa9 req-e93bb9d6-c697-408a-b918-e33615dd5d21 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:38.019373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5acfb2d1-68f5-475d-844c-d15893e4eaa9 req-e93bb9d6-c697-408a-b918-e33615dd5d21 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:38.062802 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5acfb2d1-68f5-475d-844c-d15893e4eaa9 req-e93bb9d6-c697-408a-b918-e33615dd5d21 service nova] Creating event network-vif-deleted:3dbe30d8-3cbf-467b-9673-b98e73967054 for instance fdb21116-0046-4508-b045-0e33f5b4410c on n-h2-860864-8 Oct 12 22:54:38.084340 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5acfb2d1-68f5-475d-844c-d15893e4eaa9 req-e93bb9d6-c697-408a-b918-e33615dd5d21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102655 Oct 12 22:54:38.084999 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1996/4134] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:38.105976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa845c35-b090-4398-bf33-d76f13d3cdb8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:38.106570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa845c35-b090-4398-bf33-d76f13d3cdb8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 400a9894-2ede-4cfd-8920-54548cd92a46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:38.112022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:38.120973 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93d45b94-e2cf-4584-9e11-ffe8bed4beb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.385479 Oct 12 22:54:38.121568 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2139/4135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:37 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:38.139571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:38.139571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:38.156942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa845c35-b090-4398-bf33-d76f13d3cdb8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 400a9894-2ede-4cfd-8920-54548cd92a46] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:54:38.164470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:38.164800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:38.165247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:38.165957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:38.177472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:38.177925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:38.184147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:38.311385 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa845c35-b090-4398-bf33-d76f13d3cdb8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46" status: 204 len: 0 microversion: 2.1 time: 0.225109 Oct 12 22:54:38.316678 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1997/4136] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:54:38 2022] DELETE /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:54:38.335232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-525f2674-6e6f-4f1c-ac48-97386766f91a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:38.338812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-525f2674-6e6f-4f1c-ac48-97386766f91a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 400a9894-2ede-4cfd-8920-54548cd92a46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:38.359545 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-525f2674-6e6f-4f1c-ac48-97386766f91a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-525f2674-6e6f-4f1c-ac48-97386766f91a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46 HTTP/1.1 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '400a9894-2ede-4cfd-8920-54548cd92a46'} Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 400a9894-2ede-4cfd-8920-54548cd92a46 Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:38.373888 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:54:38.378663 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:38.389753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-525f2674-6e6f-4f1c-ac48-97386766f91a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:54:38.391222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-525f2674-6e6f-4f1c-ac48-97386766f91a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46" status: 404 len: 111 microversion: 2.1 time: 0.072247 Oct 12 22:54:38.404049 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1998/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:38 2022] GET /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:54:38.485650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-771583398", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "d66ee827-cdbf-47c7-bea5-6c5ad2e47941"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:38.606372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:38.658110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:38.672373 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25f1ea8d-fdff-4aed-9909-4b33853a2df7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1187 microversion: 2.1 time: 0.546777 Oct 12 22:54:38.688368 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2140/4138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:38 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1187 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:38.722746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:38.723730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:38.740713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:38.743187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:38.744689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:38.745755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:38.747583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:38.749425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.156661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:39.172597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:39.174384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:39.175997 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e1f2b1e-6bc8-40ed-9708-3bc593db4eb2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.457132 Oct 12 22:54:39.177187 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2141/4139] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:38 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:54:39.182236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:39.183176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:39.190017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.190772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.191432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.193181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.193934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.194578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.708499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:39.721416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:39.721959 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10d6f1d3-02c8-4261-927a-b457d50814cd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.542932 Oct 12 22:54:39.722092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:39.722274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:39.722443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2142/4140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:39 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:39.723042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:39.724183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:39.736544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:39.737296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:39.752449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.753478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.754244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.755213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.755524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.756362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.757036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.757944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:39.759023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.760089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.761958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:39.762633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:39.819490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:39.835458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:39.861778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:39.866847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:39.972408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f1348ba-3c8c-4000-a809-2e1bf30a28fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491324 Oct 12 22:54:39.973162 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1999/4141] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:54:39.989035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:39.993670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:40.011143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.012360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.013288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.015062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.015221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.015978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.115396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:40.129314 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b245f18b-dba8-4c94-8259-2a2c1bd30440 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1187 microversion: 2.1 time: 0.148628 Oct 12 22:54:40.130458 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2000/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:39 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1187 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:40.135091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-acfd74b7-b563-4f9c-b990-3a4d82ac60b1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:40.139484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-acfd74b7-b563-4f9c-b990-3a4d82ac60b1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:40.238301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-acfd74b7-b563-4f9c-b990-3a4d82ac60b1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:40.245792 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-acfd74b7-b563-4f9c-b990-3a4d82ac60b1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1220 microversion: 2.1 time: 0.114156 Oct 12 22:54:40.265777 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2001/4143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:40 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:40.270770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:40.271386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:40.287555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.288097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.288533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.295108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.295577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.296028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.551118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:40.564017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:40.565622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:40.567076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c882404a-5a1a-47fd-b554-bd8fbe69ac2b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.300210 Oct 12 22:54:40.568191 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2002/4144] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:40 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:40.750639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:40.752711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:40.775206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.775971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.776578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.777556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:40.779187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:40.779824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:40.849287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:40.883057 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b26fc61a-2ae4-4ede-8962-4c11a95dc166 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 1.159581 Oct 12 22:54:40.885729 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2143/4145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:39 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:41.018973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:41.023780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:41.036682 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb4de2a3-44d8-4d90-ae82-27e6c5625fbb tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.289628 Oct 12 22:54:41.038307 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2003/4146] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:40 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:41.156240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:41.157176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:41.173724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.174615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.175377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.176349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.177255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.177897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.273991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:41.275003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:41.282872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.283358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.283788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.284498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.285078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.285646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.305621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:41.315533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e6414b6-f32d-430d-8f7d-eea86200204f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1187 microversion: 2.1 time: 0.164173 Oct 12 22:54:41.317591 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2144/4147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:41 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1187 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:41.363677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:41.373445 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9eb64bc9-669d-4093-be42-e830d132f850 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1272 microversion: 2.1 time: 0.103869 Oct 12 22:54:41.374532 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2004/4148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:41 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:41.595033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:41.596208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:41.610743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.611636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.615100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.618338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.619134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.619921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.911137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:41.911750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:41.918529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.929306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.932058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:41.933268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:41.939244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:41.940125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.284630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.294915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-74cdf25f-50d3-4098-8db6-43c75f93fc96 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.387867 Oct 12 22:54:42.297336 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2005/4149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:41 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:42.312566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:42.313449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:42.325789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:42.327309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:42.329335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.331007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:42.332160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:42.334120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.362259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.381988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.385040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.394741 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bbcde894-f43f-4237-8998-42d5de736b5e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.803710 Oct 12 22:54:42.397477 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2145/4150] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:41 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:54:42.407147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:42.414504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:42.435162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:42.438111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:42.438826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.440299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:42.441004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:42.442232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.570038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.578859 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-399ebcbc-ddd5-4b80-b261-d910fc50cca4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1187 microversion: 2.1 time: 0.178058 Oct 12 22:54:42.587327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2146/4151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:42 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1187 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:42.592218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a93a9ede-1653-4fd7-8300-1d45d4b964b1 req-d8da5343-59c9-4b98-8d7d-7d278aec3d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73435c0-2fad-4ce1-b293-98a4070f5a68", "tag": "327c2284-8f69-4539-94aa-72253125a3c2"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:42.614930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a93a9ede-1653-4fd7-8300-1d45d4b964b1 req-d8da5343-59c9-4b98-8d7d-7d278aec3d0a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:42.615550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a93a9ede-1653-4fd7-8300-1d45d4b964b1 req-d8da5343-59c9-4b98-8d7d-7d278aec3d0a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:42.616279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a93a9ede-1653-4fd7-8300-1d45d4b964b1 req-d8da5343-59c9-4b98-8d7d-7d278aec3d0a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.645845 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a93a9ede-1653-4fd7-8300-1d45d4b964b1 req-d8da5343-59c9-4b98-8d7d-7d278aec3d0a service nova] Creating event network-changed:327c2284-8f69-4539-94aa-72253125a3c2 for instance a73435c0-2fad-4ce1-b293-98a4070f5a68 on n-h2-860864-8 Oct 12 22:54:42.659072 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a93a9ede-1653-4fd7-8300-1d45d4b964b1 req-d8da5343-59c9-4b98-8d7d-7d278aec3d0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070234 Oct 12 22:54:42.660442 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2147/4152] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:42.670562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:42.678472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:42.689698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:42.690525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:42.691176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.692176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:42.698938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:42.699692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:42.750273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.759715 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9076c2c0-ea36-4e2c-8ff3-4fc220d09795 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.459138 Oct 12 22:54:42.760331 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2006/4153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:42 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:42.841879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:42.855205 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-538bba14-81c9-4ae6-8212-509af039522c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1278 microversion: 2.1 time: 0.192825 Oct 12 22:54:42.856150 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2148/4154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:42 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:43.322290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:43.324073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:43.336178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:43.337008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:43.337646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:43.338590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:43.339227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:43.339867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:43.430125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:43.431077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:43.448774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:43.449646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:43.450273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:43.451219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:43.451837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:43.452452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:43.961823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:43.980776 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c321d1b8-99ec-4a56-ab55-c999f91f6392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.663564 Oct 12 22:54:43.981373 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2007/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:43 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:44.000053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:44.000938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:44.014263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.015110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.015696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.017017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.017626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.018228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.092016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:44.106259 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce22f065-9fc8-4415-b219-a83c75227625 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 200 len: 1187 microversion: 2.1 time: 0.123515 Oct 12 22:54:44.108339 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2008/4156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:43 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 1187 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:44.119526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:44.122534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:44.136751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.139039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.139667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.142353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.143144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.143742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.359314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:44.373816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:44.375371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:44.376856 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-43aff51f-68f3-4681-9f99-a0a148bbb3e2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.952855 Oct 12 22:54:44.380593 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2149/4157] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:43 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:44.385318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:44.385926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:44.405786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.406788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.406788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.407399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.408061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.408770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.704772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:44.712612 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c89a31a7-886d-41ea-9718-46ef875f13e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.331020 Oct 12 22:54:44.713272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2150/4158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:44 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:44.733027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-cbabbd05-7f95-4bd3-9b8d-d034cc293d04 req-97501517-6533-45e5-88be-a0c2dc50821e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-plugged", "status": "completed", "tag": "406142d3-0aee-4227-aea2-74207b0b35d4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:44.745478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cbabbd05-7f95-4bd3-9b8d-d034cc293d04 req-97501517-6533-45e5-88be-a0c2dc50821e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:44.746177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cbabbd05-7f95-4bd3-9b8d-d034cc293d04 req-97501517-6533-45e5-88be-a0c2dc50821e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:44.746807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cbabbd05-7f95-4bd3-9b8d-d034cc293d04 req-97501517-6533-45e5-88be-a0c2dc50821e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:44.759766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-cbabbd05-7f95-4bd3-9b8d-d034cc293d04 req-97501517-6533-45e5-88be-a0c2dc50821e service nova] Creating event network-vif-plugged:406142d3-0aee-4227-aea2-74207b0b35d4 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:44.765865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-cbabbd05-7f95-4bd3-9b8d-d034cc293d04 req-97501517-6533-45e5-88be-a0c2dc50821e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036455 Oct 12 22:54:44.766461 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2151/4159] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:44.790429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:44.798265 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30127c24-262b-468b-88c8-fc7b64c6ba86 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.688226 Oct 12 22:54:44.798714 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2009/4160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:44 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:45.006366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:45.007110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:45.015990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.016491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.016931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.018193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.018793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.019231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.135280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:45.136401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: fdb21116-0046-4508-b045-0e33f5b4410c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:45.145695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.148217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.148896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.151104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.151803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.152889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.169113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance fdb21116-0046-4508-b045-0e33f5b4410c could not be found. Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c HTTP/1.1 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance fdb21116-0046-4508-b045-0e33f5b4410c could not be found. Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'fdb21116-0046-4508-b045-0e33f5b4410c'} Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb21116-0046-4508-b045-0e33f5b4410c could not be found. Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb21116-0046-4508-b045-0e33f5b4410c could not be found. Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:54:45.171394 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb21116-0046-4508-b045-0e33f5b4410c could not be found. Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance fdb21116-0046-4508-b045-0e33f5b4410c could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08730096-c75b-4f02-bd89-4005fc84a217 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c" status: 404 len: 111 microversion: 2.1 time: 0.042630 Oct 12 22:54:45.177494 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2010/4161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:45 2022] GET /compute/v2.1/servers/fdb21116-0046-4508-b045-0e33f5b4410c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:54:45.212112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:45.229296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-983b5161-b29d-453e-8015-d790a007cc94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.226590 Oct 12 22:54:45.240502 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2152/4162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:45 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:45.268829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-826543c8-6af1-4584-8b87-44536c530e5e req-dd878658-92df-458c-b44d-31f3d739d80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b53753-ede7-453a-94fd-b6c571d367f8", "tag": "dcf24c23-0fea-412e-9448-539a9faf8401"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:45.294696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-826543c8-6af1-4584-8b87-44536c530e5e req-dd878658-92df-458c-b44d-31f3d739d80f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.295177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-826543c8-6af1-4584-8b87-44536c530e5e req-dd878658-92df-458c-b44d-31f3d739d80f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.295748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-826543c8-6af1-4584-8b87-44536c530e5e req-dd878658-92df-458c-b44d-31f3d739d80f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.309944 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-826543c8-6af1-4584-8b87-44536c530e5e req-dd878658-92df-458c-b44d-31f3d739d80f service nova] Creating event network-changed:dcf24c23-0fea-412e-9448-539a9faf8401 for instance d3b53753-ede7-453a-94fd-b6c571d367f8 on n-h1-860864-8 Oct 12 22:54:45.317310 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-826543c8-6af1-4584-8b87-44536c530e5e req-dd878658-92df-458c-b44d-31f3d739d80f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055599 Oct 12 22:54:45.318393 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2011/4163] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:45.408949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:45.409570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:45.427702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.428231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.428674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.429420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.429883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.430305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.658085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:45.668767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:45.670235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:45.671436 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f63badf-ef38-48ba-aebe-1ac1121a88e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.266460 Oct 12 22:54:45.672047 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2153/4164] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:45 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:45.735051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:45.736290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:45.743394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.744097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.744647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.745578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.746223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.747039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.821832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:45.822348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:45.828586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.829067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.829501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.830186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:45.830633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:45.831051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:45.837147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:45.983858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:45.992563 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65d97745-99a0-48b0-9f9e-eded3c72269b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.174562 Oct 12 22:54:45.993161 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2154/4165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:45 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:46.254945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:46.255550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:46.262346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.263189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.263927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.264795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.265436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.266173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.417387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:46.425691 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8702bd28-46ed-423c-94e2-4bd50317817c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.694726 Oct 12 22:54:46.428510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:46.430232 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2012/4166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:45 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:46.438120 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0a3444ae-07c2-4816-b7a6-a64eee3059b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.187232 Oct 12 22:54:46.442390 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2155/4167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:46 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:46.698894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:46.699759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:46.705966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.706517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.706958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.708284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.708738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.709160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.785276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c401cea4-f857-4788-a4aa-46cc2399bf61 req-4e2cb02b-bcda-4889-b748-138d415fe35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-plugged", "status": "completed", "tag": "8b1947f9-175e-4530-af30-9442135dbdc1"}, {"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-plugged", "status": "completed", "tag": "e9bd88d0-de17-424f-83f1-820986fe73d2"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:46.797022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c401cea4-f857-4788-a4aa-46cc2399bf61 req-4e2cb02b-bcda-4889-b748-138d415fe35b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:46.797863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c401cea4-f857-4788-a4aa-46cc2399bf61 req-4e2cb02b-bcda-4889-b748-138d415fe35b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:46.798465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c401cea4-f857-4788-a4aa-46cc2399bf61 req-4e2cb02b-bcda-4889-b748-138d415fe35b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:46.813436 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c401cea4-f857-4788-a4aa-46cc2399bf61 req-4e2cb02b-bcda-4889-b748-138d415fe35b service nova] Creating event network-vif-plugged:8b1947f9-175e-4530-af30-9442135dbdc1 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:46.814258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c401cea4-f857-4788-a4aa-46cc2399bf61 req-4e2cb02b-bcda-4889-b748-138d415fe35b service nova] Creating event network-vif-plugged:e9bd88d0-de17-424f-83f1-820986fe73d2 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:46.821503 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c401cea4-f857-4788-a4aa-46cc2399bf61 req-4e2cb02b-bcda-4889-b748-138d415fe35b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039956 Oct 12 22:54:46.822613 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2156/4168] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:47.002796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:47.016201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:47.017184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:47.018854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:47.023628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:47.025204 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60879ec0-0165-4e7b-a8fc-e12735e9536d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.331186 Oct 12 22:54:47.025792 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2013/4169] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:46 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:47.027597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.032498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.033128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:47.034056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.034685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.035283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:47.260500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:47.275095 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca9c43e3-05fd-4cac-afe5-9a6bce310d8c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.262945 Oct 12 22:54:47.293616 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2157/4170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:47 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:47.450528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:47.451153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:47.458186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.459466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.460320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:47.461313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.462448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.463039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:47.463244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:47.467450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:47.493815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.496808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.497334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:47.500395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:47.500973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:47.501476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:47.588607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:47.625370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=20 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:47.737624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:47.751567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ecc4fcad-75d5-4d7b-8df0-0c375be8a682 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.304764 Oct 12 22:54:47.753170 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2014/4171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:47 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:47.828588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:47.838124 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0c42025-8c75-4f29-83b7-634b98d1956e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.380933 Oct 12 22:54:47.840836 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2158/4172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:47 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:48.052489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:48.053374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:48.062013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.065664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.066326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.067275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.068922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.069554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.307492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:48.309562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:48.324859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.325407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.328510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.329552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.330028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.330464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.528243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:48.548444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:48.550032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:48.553099 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54e35140-c2a0-4911-9c4e-ace4f07bea2d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.505271 Oct 12 22:54:48.556775 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2015/4173] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:48 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:48.722796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:48.731930 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99f7feb5-bf31-46d2-9198-0cf269dab38a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.428850 Oct 12 22:54:48.736664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2159/4174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:48 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:48.775943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:48.776753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:48.793209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.793941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.794552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.795481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.796148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.796740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.853876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-plugged", "status": "completed", "tag": "ab6471ab-ea73-4402-ae24-2340cb39c507"}, {"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-plugged", "status": "completed", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}, {"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-plugged", "status": "completed", "tag": "c6d91645-1f22-43c7-8819-f3f37de52ad7"}, {"server_uuid": "a73435c0-2fad-4ce1-b293-98a4070f5a68", "name": "network-vif-plugged", "status": "completed", "tag": "327c2284-8f69-4539-94aa-72253125a3c2"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:48.898438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:48.901259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:48.902400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:48.938936 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Creating event network-vif-plugged:ab6471ab-ea73-4402-ae24-2340cb39c507 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:48.943039 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Creating event network-vif-plugged:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:54:48.943623 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Creating event network-vif-plugged:c6d91645-1f22-43c7-8819-f3f37de52ad7 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:48.944393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] Creating event network-vif-plugged:327c2284-8f69-4539-94aa-72253125a3c2 for instance a73435c0-2fad-4ce1-b293-98a4070f5a68 on n-h2-860864-8 Oct 12 22:54:48.968626 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9127cca1-df46-40a5-ad2b-3406ffe51e39 req-56107a2b-8ec1-496e-9320-52f6eeb97330 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.123622 Oct 12 22:54:48.970897 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2160/4175] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:48.981247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:48.982650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:49.007102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:49.008849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:49.009518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:49.010711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:49.011371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:49.011981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:49.145385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:49.157096 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc349a53-a747-4fd2-8a86-4a750260e591 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.385854 Oct 12 22:54:49.160802 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2016/4176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:48 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:49.439394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:49.448172 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84d3f825-275b-494e-880b-33edcbbb10fd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1360 microversion: 2.1 time: 0.475526 Oct 12 22:54:49.474139 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2161/4177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:48 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1360 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:49.588052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:49.589364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:49.596975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:49.599643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:49.601006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:49.601914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:49.602544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:49.609837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:49.758651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:49.759483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:49.771342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:49.772143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:49.772803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:49.775496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:49.777036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:49.777977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:49.784496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:49.926226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:49.937388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:49.938921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:49.940301 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ffa01cf-9cd5-42f3-8bc0-7843017f7f25 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.357364 Oct 12 22:54:49.941256 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2017/4178] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:49 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:50.161121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:50.187146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:50.188285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:50.202013 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb58296e-9242-4445-80ce-8337a10a3e2c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1331 microversion: 2.1 time: 0.418649 Oct 12 22:54:50.202706 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2162/4179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:49 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1331 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:50.227402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:50.229339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:50.231043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:50.232007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:50.235086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:50.236271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:50.273381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:50.475849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:50.476873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:50.488461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:50.494621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:50.495575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:50.507331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:50.508240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:50.525983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:50.580983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:50.590853 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2fad495f-a762-4dae-9ceb-de9f99369d03 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.408919 Oct 12 22:54:50.596088 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2018/4180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:50 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:50.970138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:50.970856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:50.985649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:50.986265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:50.987052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:50.988791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:50.990448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:50.990884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.273278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:51.283741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:51.285261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:51.286434 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-827b8c51-0e3b-4fba-8588-9a04f6a019a2 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.320597 Oct 12 22:54:51.287005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2019/4181] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:50 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:54:51.291839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3c9bde57-efc4-4d66-baf0-d998093c7a6f req-8cb328bf-e07b-4b97-bdbb-60499d286a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-plugged", "status": "completed", "tag": "78d4498f-290d-4b83-8c13-f0c4ad007e45"}, {"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-plugged", "status": "completed", "tag": "9d644e7b-03a4-428b-b875-0a7ca3e67f92"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:51.302319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3c9bde57-efc4-4d66-baf0-d998093c7a6f req-8cb328bf-e07b-4b97-bdbb-60499d286a46 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:51.303018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3c9bde57-efc4-4d66-baf0-d998093c7a6f req-8cb328bf-e07b-4b97-bdbb-60499d286a46 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:51.303689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3c9bde57-efc4-4d66-baf0-d998093c7a6f req-8cb328bf-e07b-4b97-bdbb-60499d286a46 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.316444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3c9bde57-efc4-4d66-baf0-d998093c7a6f req-8cb328bf-e07b-4b97-bdbb-60499d286a46 service nova] Creating event network-vif-plugged:78d4498f-290d-4b83-8c13-f0c4ad007e45 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:51.317555 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3c9bde57-efc4-4d66-baf0-d998093c7a6f req-8cb328bf-e07b-4b97-bdbb-60499d286a46 service nova] Creating event network-vif-plugged:9d644e7b-03a4-428b-b875-0a7ca3e67f92 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:54:51.323298 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3c9bde57-efc4-4d66-baf0-d998093c7a6f req-8cb328bf-e07b-4b97-bdbb-60499d286a46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034681 Oct 12 22:54:51.324203 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2020/4182] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:51.330174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:51.330874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:51.338014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:51.338735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:51.339168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.339874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:51.340428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:51.340851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.449982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:51.459455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37fdfc1e-0cd5-4dc0-ae0f-818fda426b95 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1547 microversion: 2.1 time: 0.992035 Oct 12 22:54:51.476944 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2163/4183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:50 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1547 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:51.484498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:51.484998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:51.493435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:51.494141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:51.497771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.498629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:51.499108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:51.499540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.606724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:51.617359 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-50325af1-50d1-4718-9356-b04c5fd35bf2 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1535 microversion: 2.1 time: 0.291770 Oct 12 22:54:51.617940 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2021/4184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:51 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1535 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:51.622677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:51.623283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:51.630465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:51.630643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:51.631291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.632446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:51.633661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:51.634873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:51.652617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:51.688354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d62a5f13-0f7e-4087-9f01-27170fba4626 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207090 Oct 12 22:54:51.689858 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2164/4185] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:54:51 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:54:51.697766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a2504c7d-9024-4b13-9416-8cf1a42c53bd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'create', calling method: .version_select at 0x7f44ff7613a0>, body: {"pool": "803390f5-753f-47de-a009-db74d26740a1"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:51.796935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:51.805608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3314c385-136f-4f04-ac26-bfd82d45a87f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.186645 Oct 12 22:54:51.806453 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2022/4186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:51 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:52.151558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1247735108", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "66a856fd-6e2f-4788-affd-cb6fbf81352a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:52.217010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:54:52.593943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:54:52.594455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:54:52.594924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:54:52.595325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:54:52.596512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:54:52.614588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:52.616137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:52.616748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:52.617652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:52.618280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:52.619410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:52.640680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:54:52.647714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:54:52.717898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:54:52.720854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66a856fd-6e2f-4788-affd-cb6fbf81352a',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:54:52.938801 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dfd28dde-836e-4faf-9ac7-52f29a5f1089 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791680 Oct 12 22:54:52.940211 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2023/4187] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:54:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:54:52.948148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:52.948856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:52.959164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:52.960027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:52.960195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:52.961072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:52.961600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:52.962077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:53.418325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:53.429650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:53.432994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:53.434207 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52457674-8305-4a67-ae6d-13a50c819959 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1865 microversion: 2.32 time: 0.493007 Oct 12 22:54:53.437851 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2024/4188] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:52 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1865 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:53.447877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:53.450341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:53.465098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:53.468172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:53.468807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:53.471005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:53.471719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:53.472657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:53.777093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:53.786824 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-248f7b18-ec42-4813-82bd-99e902b76926 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.343193 Oct 12 22:54:53.807926 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2025/4189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:53 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:53.807926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:53.807926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:53.807926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:54:53.812467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:53.813311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:53.814061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:53.815699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:53.830279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:53.832211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:53.974626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:53.987076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce4b9f01-ab99-49fe-b929-2fb22507f9f4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1107 microversion: 2.1 time: 0.192428 Oct 12 22:54:53.987668 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2026/4190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:53 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1107 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:53.993049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8d336f15-23c8-478e-8bcb-52a5c314505b req-43822187-f3d4-4150-a556-e4c7f20b23b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b53753-ede7-453a-94fd-b6c571d367f8", "name": "network-vif-plugged", "status": "completed", "tag": "dcf24c23-0fea-412e-9448-539a9faf8401"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:54.024524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d336f15-23c8-478e-8bcb-52a5c314505b req-43822187-f3d4-4150-a556-e4c7f20b23b2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:54.025052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d336f15-23c8-478e-8bcb-52a5c314505b req-43822187-f3d4-4150-a556-e4c7f20b23b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:54.025491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d336f15-23c8-478e-8bcb-52a5c314505b req-43822187-f3d4-4150-a556-e4c7f20b23b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:54.071456 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8d336f15-23c8-478e-8bcb-52a5c314505b req-43822187-f3d4-4150-a556-e4c7f20b23b2 service nova] Creating event network-vif-plugged:dcf24c23-0fea-412e-9448-539a9faf8401 for instance d3b53753-ede7-453a-94fd-b6c571d367f8 on n-h1-860864-8 Oct 12 22:54:54.100049 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8d336f15-23c8-478e-8bcb-52a5c314505b req-43822187-f3d4-4150-a556-e4c7f20b23b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106823 Oct 12 22:54:54.110840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2027/4191] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:54.470657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:54.471689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:54.484729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:54.486653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:54.487298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:54.488307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:54.488927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:54.490085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:54.908490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:54.932882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:54.936870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:54.938627 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87bb2537-86bd-4710-bb22-3f22200de5ad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2817 microversion: 2.32 time: 0.478059 Oct 12 22:54:54.942582 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2028/4192] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:54:54 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2817 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:54:54.953484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ab37760b-7315-4772-be5a-9d2ea790f646 req-499c8f9e-2661-4e8f-8601-733a76b3b5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:54.972234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ab37760b-7315-4772-be5a-9d2ea790f646 req-499c8f9e-2661-4e8f-8601-733a76b3b5ab service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:54.974854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ab37760b-7315-4772-be5a-9d2ea790f646 req-499c8f9e-2661-4e8f-8601-733a76b3b5ab service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:54.976209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ab37760b-7315-4772-be5a-9d2ea790f646 req-499c8f9e-2661-4e8f-8601-733a76b3b5ab service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:54.993350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ab37760b-7315-4772-be5a-9d2ea790f646 req-499c8f9e-2661-4e8f-8601-733a76b3b5ab service nova] Creating event network-changed:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:54:55.001148 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ab37760b-7315-4772-be5a-9d2ea790f646 req-499c8f9e-2661-4e8f-8601-733a76b3b5ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057311 Oct 12 22:54:55.002180 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2029/4193] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:55.008427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:55.009200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:55.015728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.016323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.016822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.017584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.018100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.018584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.293398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:55.300327 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a2504c7d-9024-4b13-9416-8cf1a42c53bd tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.608041 Oct 12 22:54:55.302274 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-788b5be1-fc44-4538-8aac-db53d965f8bb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1320 microversion: 2.1 time: 0.298116 Oct 12 22:54:55.304380 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2030/4194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:55 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:55.308828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2165/4195] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:54:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:54:55.314297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:55.314912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:55.315643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:55.317882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:55.326238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.327249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.327855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.328981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.330153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.333393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.334856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.336025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.338469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.339102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.340662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.341639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.487066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:55.505601 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-937fb9b2-e5e8-44df-b394-a71b923e8ac9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1173 microversion: 2.1 time: 0.191314 Oct 12 22:54:55.506267 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2166/4196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:55 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1173 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:55.513397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.237"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:54:55.515955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:55.530346 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c088b1a-7fcd-448f-b943-3c4cdf03675b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.224465 Oct 12 22:54:55.534631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.535384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.536418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.537134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:55.540969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:55.541699 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2031/4197] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 22:54:55 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5/os-interface => generated 1831 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:54:55.542131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:55.612533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:54:55.613741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquired lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:54:56.330045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:56.331911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:56.338324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:56.339118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:56.339818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:56.340775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:56.341452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:56.342097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:56.655632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:56.677462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d64a047d-c89b-41a3-afda-44770510e143 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1501 microversion: 2.1 time: 0.349197 Oct 12 22:54:56.681035 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2032/4198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:56 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1501 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:56.687849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:56.688770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:56.696800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:56.698191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:56.698835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:56.700471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:56.702931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:56.703623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:56.992512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:57.003136 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6dca275-6745-4427-b208-9e00d2856572 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1215 microversion: 2.1 time: 0.319907 Oct 12 22:54:57.004287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2033/4199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:56 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1215 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:57.027255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:57.027868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:57.044142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:57.044633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:57.045062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:57.045760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:57.046207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:57.046624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:57.350728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:57.368892 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70fb17c5-48e1-4988-bf0a-d32119417087 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1501 microversion: 2.1 time: 0.345633 Oct 12 22:54:57.369826 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2034/4200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:57 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:57.405225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:57.405725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:57.412900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:57.413988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:57.414644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:57.415571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:57.416275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:57.416936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:57.454559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:54:57.578540 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d35fe0c9-0569-4442-87bf-e5204dec7d97 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 204 len: 0 microversion: 2.1 time: 0.183608 Oct 12 22:54:57.579851 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2035/4201] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:54:57 2022] DELETE /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:54:57.595288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:57.597019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:57.606362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:57.607009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:57.607545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:57.608535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:57.609094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:57.609668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:57.926843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:57.937559 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4156528c-abde-4cc9-919c-1cd79d1196fd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1507 microversion: 2.1 time: 0.353276 Oct 12 22:54:57.938449 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2036/4202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:57 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:54:58.036087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:58.036723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:58.053066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:58.053699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:58.054317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:58.055175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:58.055688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:58.056408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:58.291329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:58.299426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7b44e595-7fe3-4e3c-bb77-73236308ff24 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1215 microversion: 2.1 time: 0.272632 Oct 12 22:54:58.300097 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2037/4203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:58 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1215 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:58.965604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:58.966315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:58.983206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:58.983206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:58.983655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:58.984274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:58.985568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:58.986952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:59.304223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:54:59.312643 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b61d4dd-c535-4b36-bd7f-0c8af295ffae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1507 microversion: 2.1 time: 0.350871 Oct 12 22:54:59.323915 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2038/4204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:58 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:54:59.334179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:54:59.335121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:54:59.342897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:59.343844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:59.344527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:59.345411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:54:59.346020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:54:59.350581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:54:59.836909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Building network info cache for instance {{(pid=120542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:55:00.248097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:00.251671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:00.264457 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8634e5d5-08d1-42cd-b90f-c4bb69b98644 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1215 microversion: 2.1 time: 0.939186 Oct 12 22:55:00.268973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2039/4205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:54:59 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1215 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:00.275686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-099b0b5f-bfda-4da7-b0e9-c27605d2c811 req-c522162e-a04c-46da-8710-cbcd25088aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "tag": "8b1947f9-175e-4530-af30-9442135dbdc1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:00.297186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-099b0b5f-bfda-4da7-b0e9-c27605d2c811 req-c522162e-a04c-46da-8710-cbcd25088aa3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:00.297747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-099b0b5f-bfda-4da7-b0e9-c27605d2c811 req-c522162e-a04c-46da-8710-cbcd25088aa3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:00.298252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-099b0b5f-bfda-4da7-b0e9-c27605d2c811 req-c522162e-a04c-46da-8710-cbcd25088aa3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:00.331383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-099b0b5f-bfda-4da7-b0e9-c27605d2c811 req-c522162e-a04c-46da-8710-cbcd25088aa3 service nova] Creating event network-changed:8b1947f9-175e-4530-af30-9442135dbdc1 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:55:00.349199 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-099b0b5f-bfda-4da7-b0e9-c27605d2c811 req-c522162e-a04c-46da-8710-cbcd25088aa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078183 Oct 12 22:55:00.352955 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2040/4206] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:00.362022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:00.369225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:00.385514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:00.386687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:00.387553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:00.388489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:00.389162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:00.389805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:01.149295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:01.158587 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aeb23ea6-448a-4f36-9642-cb1648d45118 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1507 microversion: 2.1 time: 0.801011 Oct 12 22:55:01.159165 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2041/4207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:00 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1507 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:01.293635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:01.294246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:01.305197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:01.305690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:01.306812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:01.306812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:01.307276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:01.307750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:01.343238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Updating instance_info_cache with network_info: [{"id": "327c2284-8f69-4539-94aa-72253125a3c2", "address": "fa:16:3e:bd:5a:11", "network": {"id": "47569298-be53-4a95-a07d-a9deaf5ed6dc", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1550875808-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0640992268d4e90b9285b14b894f397", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap327c2284-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:55:01.362419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Releasing lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:55:01.363876 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fae5c7ea-53bd-45f4-98a1-37f7b16abfad tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action" status: 202 len: 0 microversion: 2.1 time: 5.856636 Oct 12 22:55:01.364525 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2167/4208] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:54:55 2022] POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action => generated 0 bytes in 5858 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:55:01.372656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cbca3cec-6d81-489c-b125-b671a695b8da tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'create', calling method: .version_select at 0x7f44ff4764c0>, body: {"pool": "803390f5-753f-47de-a009-db74d26740a1"} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:01.949707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:01.967127 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-412f18af-de71-441e-93e4-331ba2d646d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1215 microversion: 2.1 time: 0.675351 Oct 12 22:55:01.969953 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2042/4209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:01 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1215 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:01.985316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-46fc95f6-2c41-47d9-9f33-f111c82f9753 req-f27ae955-a306-46d4-a020-b14b3bf3f2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b53753-ede7-453a-94fd-b6c571d367f8", "name": "network-vif-deleted", "tag": "dcf24c23-0fea-412e-9448-539a9faf8401"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:02.003945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-46fc95f6-2c41-47d9-9f33-f111c82f9753 req-f27ae955-a306-46d4-a020-b14b3bf3f2a6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:02.004424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-46fc95f6-2c41-47d9-9f33-f111c82f9753 req-f27ae955-a306-46d4-a020-b14b3bf3f2a6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:02.004859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-46fc95f6-2c41-47d9-9f33-f111c82f9753 req-f27ae955-a306-46d4-a020-b14b3bf3f2a6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:02.056357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-46fc95f6-2c41-47d9-9f33-f111c82f9753 req-f27ae955-a306-46d4-a020-b14b3bf3f2a6 service nova] Creating event network-vif-deleted:dcf24c23-0fea-412e-9448-539a9faf8401 for instance d3b53753-ede7-453a-94fd-b6c571d367f8 on n-h1-860864-8 Oct 12 22:55:02.079599 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-46fc95f6-2c41-47d9-9f33-f111c82f9753 req-f27ae955-a306-46d4-a020-b14b3bf3f2a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105597 Oct 12 22:55:02.082100 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2043/4210] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:02.185111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:02.186021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:02.194086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:02.194968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:02.195559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:02.196422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:02.197069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:02.197644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:02.235825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:02.236480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:02.237020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:02.237620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lazy-loading 'fault' on Instance uuid d3b53753-ede7-453a-94fd-b6c571d367f8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:55:02.325549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:02.338905 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f28aba1-abc4-4480-a948-e0b26d252884 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 200 len: 1310 microversion: 2.1 time: 0.160489 Oct 12 22:55:02.339491 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2044/4211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:02 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 1310 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:02.402413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-bb124528-ed46-4285-abf4-88069058bb88 req-042da038-d212-4160-9fa0-69bc073a414c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73435c0-2fad-4ce1-b293-98a4070f5a68", "tag": "327c2284-8f69-4539-94aa-72253125a3c2"}, {"name": "network-changed", "server_uuid": "a621398d-d64f-4a12-951d-c4cd96503b51", "tag": "14c71eeb-676d-4f29-8637-4704101a6547"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:02.412661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bb124528-ed46-4285-abf4-88069058bb88 req-042da038-d212-4160-9fa0-69bc073a414c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:02.413384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bb124528-ed46-4285-abf4-88069058bb88 req-042da038-d212-4160-9fa0-69bc073a414c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:02.414006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bb124528-ed46-4285-abf4-88069058bb88 req-042da038-d212-4160-9fa0-69bc073a414c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:02.428760 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-bb124528-ed46-4285-abf4-88069058bb88 req-042da038-d212-4160-9fa0-69bc073a414c service nova] Creating event network-changed:327c2284-8f69-4539-94aa-72253125a3c2 for instance a73435c0-2fad-4ce1-b293-98a4070f5a68 on n-h2-860864-8 Oct 12 22:55:02.429545 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-bb124528-ed46-4285-abf4-88069058bb88 req-042da038-d212-4160-9fa0-69bc073a414c service nova] Creating event network-changed:14c71eeb-676d-4f29-8637-4704101a6547 for instance a621398d-d64f-4a12-951d-c4cd96503b51 on n-h2-860864-8 Oct 12 22:55:02.436483 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-bb124528-ed46-4285-abf4-88069058bb88 req-042da038-d212-4160-9fa0-69bc073a414c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037812 Oct 12 22:55:02.437150 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2045/4212] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:55:02.990937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:02.991730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:02.995925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:02.996779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:03.007534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:03.008377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:03.010913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:03.015056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:03.015567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:03.016211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:03.609374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:03.617773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a77ad8f-c520-4a90-93b3-4754cf3d7bc4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.627783 Oct 12 22:55:03.618985 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2046/4213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:02 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:03.624702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:03.625312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:03.631441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:03.632310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:03.633650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:03.634510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:03.635115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:03.635695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:03.651767 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 HTTP/1.1 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'd3b53753-ede7-453a-94fd-b6c571d367f8'} Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:03.653743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:03.659016 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:03.659016 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:03.659016 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:03.659016 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:03.659016 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:03.659016 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:55:03.659016 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:03.660866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:03.661895 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27dcfa19-3ed0-49cf-b7ea-e9ffa58a4eae tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 404 len: 111 microversion: 2.1 time: 0.041652 Oct 12 22:55:03.662977 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2047/4214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:03 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:55:03.675077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ba3d2816-0231-4d60-885f-12305557488a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: .version_select at 0x7f4507c07dc0>, body: {"keypair": {"name": "tempest-key-192145014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNeR/ZXAYxj2L8k3FX/uy8BAc6OOA9C7jxedrLMS7XCVl0jSKc7mLee3eY+NGVcmIIdLtzXpso1A7rOjvbcTOWT8Aij1vktnd60L0wyLvemvkbMJB8JRhJG5UISf2FK4g=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:03.692908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ba3d2816-0231-4d60-885f-12305557488a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:03.700085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ba3d2816-0231-4d60-885f-12305557488a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:03.714570 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cbca3cec-6d81-489c-b125-b671a695b8da tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.345618 Oct 12 22:55:03.715310 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2168/4215] 10.222.0.20 () {60 vars in 1170 bytes} [Wed Oct 12 22:55:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:55:03.729142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.153"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:03.731992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:03.736748 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ba3d2816-0231-4d60-885f-12305557488a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.065166 Oct 12 22:55:03.738172 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2048/4216] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:55:03 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:03.739279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:03.739811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:03.740230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:03.740926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:03.741373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:03.741953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:03.748959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbede503-e50d-48d5-bc27-2f2b3c6b944f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '.version_select at 0x7f4507c07310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:03.755652 n-d-860864-8 devstack@n-api.service[120543]: WARNING oslo_db.sqlalchemy.utils [None req-bbede503-e50d-48d5-bc27-2f2b3c6b944f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 22:55:03.765313 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbede503-e50d-48d5-bc27-2f2b3c6b944f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.020225 Oct 12 22:55:03.766402 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2049/4217] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 22:55:03 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:03.771662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:55:03.772279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquired lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:55:03.830421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1295471730", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-key-192145014", "networks": [{"uuid": "d66ee827-cdbf-47c7-bea5-6c5ad2e47941"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:03.893084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:55:04.373911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1.", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:55:04.375302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Releasing lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:55:04.376032 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1. Oct 12 22:55:04.376032 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-4db00423-fe69-4823-9799-68590c83a0e4'] Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Request method failure captured: Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action HTTP/1.1 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 46 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Wn8-7P_J8Vy9qwj1uU0jkIGPgagdqTOlSiF9elxoNlifIQFnc1EuxWaix6HLxXSXHPukraUS3CuaztqVdauQ3MupK4ZtHvWc5gllTymmNa6EotIbEB26bLfG_FyUrldbU_SdIiB-mgezgaAZVnMtGeUcKLBuf8Y7Y8jGtQCoNO8XU Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0640992268d4e90b9285b14b894f397"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0640992268d4e90b9285b14b894f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}] Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d000de8d9fa042d8814fb347e5e7adb7 Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: {"addFloatingIp": {"address": "172.25.6.153"}} Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1. Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-4db00423-fe69-4823-9799-68590c83a0e4'] Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a73435c0-2fad-4ce1-b293-98a4070f5a68', 'body': {'addFloatingIp': {'address': '172.25.6.153'}}} Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:55:04.379450 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1. Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4db00423-fe69-4823-9799-68590c83a0e4'] Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1. Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4db00423-fe69-4823-9799-68590c83a0e4'] Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1. Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4db00423-fe69-4823-9799-68590c83a0e4'] Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1. Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4db00423-fe69-4823-9799-68590c83a0e4'] Oct 12 22:55:04.384537 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:04.392690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Returning 400 to user: Cannot associate floating IP 172.25.6.153 (b6079830-2143-4cbe-b994-cee4afdcf172) with port 327c2284-8f69-4539-94aa-72253125a3c2 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 803390f5-753f-47de-a009-db74d26740a1. Oct 12 22:55:04.392690 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-4db00423-fe69-4823-9799-68590c83a0e4'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:04.392690 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-077548cb-bb84-4fab-b16b-e79762dbf544 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action" status: 400 len: 381 microversion: 2.1 time: 0.661462 Oct 12 22:55:04.392690 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2169/4218] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:03 2022] POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action => generated 381 bytes in 665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:55:04.398462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-98ebe8e4-f5a4-4a49-851e-eb0128cf2311 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '.version_select at 0x7f44ff476040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:04.619780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:55:04.620503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:55:04.620721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:55:04.621063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:55:04.626888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:55:04.638897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:04.639715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:04.640189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:04.640965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:04.644590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:04.645295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:04.671632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:04.693694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:04.709882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:55:04.712689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:55:04.790137 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-64f9891d-08a9-4c41-879d-358f780e095c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963337 Oct 12 22:55:04.790807 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2050/4219] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:55:04.795769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:04.796588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:04.815539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:04.816629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:04.817034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:04.817737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:04.818186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:04.818611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:05.098894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:05.107335 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-17d927ef-5857-4a77-bb52-4541b61a07b5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.315156 Oct 12 22:55:05.110945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2051/4220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:04 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:05.118041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b27bd1d-a856-4e6e-a0e1-9eac041d2502 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:05.121108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b27bd1d-a856-4e6e-a0e1-9eac041d2502 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:05.246404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b27bd1d-a856-4e6e-a0e1-9eac041d2502 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:05.261840 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b27bd1d-a856-4e6e-a0e1-9eac041d2502 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1228 microversion: 2.1 time: 0.146637 Oct 12 22:55:05.263224 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2052/4221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:05 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1228 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:05.907489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-98ebe8e4-f5a4-4a49-851e-eb0128cf2311 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/b6079830-2143-4cbe-b994-cee4afdcf172" status: 202 len: 0 microversion: 2.1 time: 1.513572 Oct 12 22:55:05.908515 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2170/4222] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:55:04 2022] DELETE /compute/v2.1/os-floating-ips/b6079830-2143-4cbe-b994-cee4afdcf172 => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:55:05.919440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.237"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:06.140968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:06.141713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:06.150724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:06.151496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:06.152160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:06.152872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:06.153569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:06.154021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:06.335281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:06.370996 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dcfd182e-41a4-43a4-b998-13765ec30665 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.239705 Oct 12 22:55:06.371631 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2171/4223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:06 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:06.376776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:06.377652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:06.384801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:06.385606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:06.386272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:06.387264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:06.387976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:06.389159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:06.477323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:06.498055 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61f73bfa-8525-4f73-95f8-284454dbfbc6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1288 microversion: 2.1 time: 0.124762 Oct 12 22:55:06.499004 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2172/4224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:06 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:06.573814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:06.580607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:06.582071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:06.582563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:06.583278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:06.583827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:06.584250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:06.980919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:55:06.981520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquired lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:55:07.394563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:07.396069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:07.403418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:07.403932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:07.404961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:07.405787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:07.406421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:07.406910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:07.558858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:07.566852 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d13374b-c08c-41eb-b38d-b81af9e4d592 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.176291 Oct 12 22:55:07.567664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2173/4225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:07 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:07.572112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:07.572736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:07.575544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:07.579445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:07.579864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:07.580348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:07.581028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:07.581505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:07.581927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:07.646843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:07.650720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:07.656442 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3983191b-4445-4029-a2e5-80d8d96d9f1c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1286 microversion: 2.1 time: 0.087268 Oct 12 22:55:07.656729 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2174/4226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:07 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:08.590116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:08.590762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:08.599763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:08.600281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:08.600720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:08.601429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:08.601912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:08.602336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:08.775185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:08.783112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ce688aa-68e8-426b-b539-1f2b68a30c10 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.197047 Oct 12 22:55:08.796784 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2175/4227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:08 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:08.800013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Building network info cache for instance {{(pid=120543) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 22:55:08.805671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:08.806501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:08.813600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:08.814092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:08.815229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:08.816465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:08.817095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:08.817683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:09.007930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:09.028870 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b825b84-6789-4c64-99d6-0e8b3c93d169 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1328 microversion: 2.1 time: 0.228381 Oct 12 22:55:09.030632 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2176/4228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:08 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1328 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:09.038107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0c6e9ac9-8503-4b4c-aa19-84b8a45a61e0 req-d8de084c-13fd-4ecb-b696-576687196ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73435c0-2fad-4ce1-b293-98a4070f5a68", "tag": "327c2284-8f69-4539-94aa-72253125a3c2"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:09.052894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0c6e9ac9-8503-4b4c-aa19-84b8a45a61e0 req-d8de084c-13fd-4ecb-b696-576687196ac5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:09.053721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0c6e9ac9-8503-4b4c-aa19-84b8a45a61e0 req-d8de084c-13fd-4ecb-b696-576687196ac5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:09.054551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0c6e9ac9-8503-4b4c-aa19-84b8a45a61e0 req-d8de084c-13fd-4ecb-b696-576687196ac5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:09.082051 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0c6e9ac9-8503-4b4c-aa19-84b8a45a61e0 req-d8de084c-13fd-4ecb-b696-576687196ac5 service nova] Creating event network-changed:327c2284-8f69-4539-94aa-72253125a3c2 for instance a73435c0-2fad-4ce1-b293-98a4070f5a68 on n-h2-860864-8 Oct 12 22:55:09.091332 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0c6e9ac9-8503-4b4c-aa19-84b8a45a61e0 req-d8de084c-13fd-4ecb-b696-576687196ac5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057798 Oct 12 22:55:09.092851 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2177/4229] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:09.742413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Updating instance_info_cache with network_info: [{"id": "327c2284-8f69-4539-94aa-72253125a3c2", "address": "fa:16:3e:bd:5a:11", "network": {"id": "47569298-be53-4a95-a07d-a9deaf5ed6dc", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1550875808-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0640992268d4e90b9285b14b894f397", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap327c2284-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 22:55:09.771533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Releasing lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:55:09.772945 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-715817b0-ff4f-470c-aa44-779de606f64d tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action" status: 202 len: 0 microversion: 2.1 time: 3.859575 Oct 12 22:55:09.774064 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2053/4230] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:05 2022] POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action => generated 0 bytes in 3862 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 22:55:09.783647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22041d7d-9e35-4519-adcf-c83fab0426b0 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '.version_select at 0x7f4507c30ee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:09.812516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:09.815358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:09.829389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:09.830166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:09.832089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:09.833727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:09.834559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:09.837585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:10.086513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:10.094589 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6cd5b48c-17cf-4d07-b95b-cddb6bc47cf5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.288550 Oct 12 22:55:10.095881 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2054/4231] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:09 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:10.101240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:10.101961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:10.111100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:10.116207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:10.116878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:10.117852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:10.118483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:10.119794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:10.390438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:10.407214 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-087a7e3d-f7f3-467c-b591-1be2415a60ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1328 microversion: 2.1 time: 0.309377 Oct 12 22:55:10.407926 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2055/4232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:10 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1328 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:11.120524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:11.121211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:11.134845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.135350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.141825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.142601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.147273 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22041d7d-9e35-4519-adcf-c83fab0426b0 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/88bd53d2-8b97-48d4-ba6a-a39913c0dae3" status: 202 len: 0 microversion: 2.1 time: 1.367444 Oct 12 22:55:11.147873 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2178/4233] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:55:09 2022] DELETE /compute/v2.1/os-floating-ips/88bd53d2-8b97-48d4-ba6a-a39913c0dae3 => generated 0 bytes in 1370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:55:11.152820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-b08c7e01-6aa9-4553-8e36-10e36bde7265 req-9e70864f-d4fb-4065-950e-8027040f12a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90e16df0-d29d-42ba-83cb-dc2a75472b2f", "tag": "78df6ede-9071-4d69-8497-a1248f5da4c1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:11.156084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.156641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.173946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b08c7e01-6aa9-4553-8e36-10e36bde7265 req-9e70864f-d4fb-4065-950e-8027040f12a8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.174463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b08c7e01-6aa9-4553-8e36-10e36bde7265 req-9e70864f-d4fb-4065-950e-8027040f12a8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.180742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b08c7e01-6aa9-4553-8e36-10e36bde7265 req-9e70864f-d4fb-4065-950e-8027040f12a8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.195550 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-b08c7e01-6aa9-4553-8e36-10e36bde7265 req-9e70864f-d4fb-4065-950e-8027040f12a8 service nova] Creating event network-changed:78df6ede-9071-4d69-8497-a1248f5da4c1 for instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f on n-h1-860864-8 Oct 12 22:55:11.214305 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-b08c7e01-6aa9-4553-8e36-10e36bde7265 req-9e70864f-d4fb-4065-950e-8027040f12a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062289 Oct 12 22:55:11.217877 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2179/4234] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:11.226566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07bc8f9f-a49c-43de-a3a5-6689472c414b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07bc8f9f-a49c-43de-a3a5-6689472c414b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Request method failure captured: Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action HTTP/1.1 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 34 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Wn8-7P_J8Vy9qwj1uU0jkIGPgagdqTOlSiF9elxoNlifIQFnc1EuxWaix6HLxXSXHPukraUS3CuaztqVdauQ3MupK4ZtHvWc5gllTymmNa6EotIbEB26bLfG_FyUrldbU_SdIiB-mgezgaAZVnMtGeUcKLBuf8Y7Y8jGtQCoNO8XU Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0640992268d4e90b9285b14b894f397"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0640992268d4e90b9285b14b894f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}] Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d000de8d9fa042d8814fb347e5e7adb7 Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: {"addFloatingIp": {"address": ""}} Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a73435c0-2fad-4ce1-b293-98a4070f5a68', 'body': {'addFloatingIp': {'address': ''}}} Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi '' Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 22:55:11.230782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 22:55:11.236153 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.238476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07bc8f9f-a49c-43de-a3a5-6689472c414b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:11.239517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-07bc8f9f-a49c-43de-a3a5-6689472c414b tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action" status: 400 len: 142 microversion: 2.1 time: 0.020090 Oct 12 22:55:11.240604 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2180/4235] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:11 2022] POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:55:11.251334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:11.258083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:11.270408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.270905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.271347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.272143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.272537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.272959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.305935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 22:55:11.306666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquired lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 22:55:11.386240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:11.400146 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35305266-24b6-4f2a-8ea0-8b04668d26a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.284704 Oct 12 22:55:11.407580 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2056/4236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:11 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:11.435177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:11.435838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:11.447174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.447664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.448133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.448834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.449287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.449707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.500176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Releasing lock "refresh_cache-a73435c0-2fad-4ce1-b293-98a4070f5a68" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 22:55:11.501032 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] HTTP exception thrown: floating IP not found Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Request method failure captured: Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action HTTP/1.1 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 41 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Wn8-7P_J8Vy9qwj1uU0jkIGPgagdqTOlSiF9elxoNlifIQFnc1EuxWaix6HLxXSXHPukraUS3CuaztqVdauQ3MupK4ZtHvWc5gllTymmNa6EotIbEB26bLfG_FyUrldbU_SdIiB-mgezgaAZVnMtGeUcKLBuf8Y7Y8jGtQCoNO8XU Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0640992268d4e90b9285b14b894f397"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0640992268d4e90b9285b14b894f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}] Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d000de8d9fa042d8814fb347e5e7adb7 Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: exception: floating IP not found Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a73435c0-2fad-4ce1-b293-98a4070f5a68', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 12 22:55:11.502995 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Returning 404 to user: floating IP not found {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:11.508414 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dce2368c-6a61-42ed-8e47-3c5e35010e68 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action" status: 404 len: 67 microversion: 2.1 time: 0.258804 Oct 12 22:55:11.509220 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2181/4237] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:11 2022] POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action => generated 67 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:55:11.520141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2871856e-cc8d-439b-aac1-25c6c7ee3f3c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Action: 'action', calling method: .version_select at 0x7f4505f579d0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:11.577976 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-2871856e-cc8d-439b-aac1-25c6c7ee3f3c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2871856e-cc8d-439b-aac1-25c6c7ee3f3c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Request method failure captured: Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action HTTP/1.1 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 44 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Wn8-7P_J8Vy9qwj1uU0jkIGPgagdqTOlSiF9elxoNlifIQFnc1EuxWaix6HLxXSXHPukraUS3CuaztqVdauQ3MupK4ZtHvWc5gllTymmNa6EotIbEB26bLfG_FyUrldbU_SdIiB-mgezgaAZVnMtGeUcKLBuf8Y7Y8jGtQCoNO8XU Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0640992268d4e90b9285b14b894f397"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0640992268d4e90b9285b14b894f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}] Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d000de8d9fa042d8814fb347e5e7adb7 Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: exception: Floating IP not found for address 0.0.0.0. Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a73435c0-2fad-4ce1-b293-98a4070f5a68', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 12 22:55:11.580442 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2871856e-cc8d-439b-aac1-25c6c7ee3f3c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2871856e-cc8d-439b-aac1-25c6c7ee3f3c tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action" status: 404 len: 88 microversion: 2.1 time: 0.066790 Oct 12 22:55:11.588607 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2182/4238] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:11 2022] POST /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68/action => generated 88 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:55:11.593717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:11.594215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:11.602370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.603146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.603763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.604670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.605294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.605987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.634031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:55:11.740909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d669c763-4deb-4c1e-bbaf-46037f00b748 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 204 len: 0 microversion: 2.1 time: 0.150283 Oct 12 22:55:11.741410 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2183/4239] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:55:11 2022] DELETE /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:55:11.751270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:11.752186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:11.762718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.763551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.764151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.765002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:11.765466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:11.765900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:11.863674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:11.879541 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2c39133-cfb3-4f57-8546-057e2dff015d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1328 microversion: 2.1 time: 0.447178 Oct 12 22:55:11.892814 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2057/4240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:11 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:11.936757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:11.945347 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ed38f73-6622-403e-9f33-22f4b77568f1 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1541 microversion: 2.1 time: 0.198571 Oct 12 22:55:11.946959 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2184/4241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:11 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:12.425266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:12.426458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:12.430475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:12.434189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:12.434657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:12.435088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:12.435780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:12.436255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:12.436784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:12.548119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fbf0d951-0015-420d-b585-c5e88dc8cbf5 req-fb0b8a3f-9b84-4a1e-85da-3d03eaa44949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a621398d-d64f-4a12-951d-c4cd96503b51", "name": "network-vif-plugged", "status": "completed", "tag": "14c71eeb-676d-4f29-8637-4704101a6547"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:12.559418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fbf0d951-0015-420d-b585-c5e88dc8cbf5 req-fb0b8a3f-9b84-4a1e-85da-3d03eaa44949 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:12.560149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fbf0d951-0015-420d-b585-c5e88dc8cbf5 req-fb0b8a3f-9b84-4a1e-85da-3d03eaa44949 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:12.560773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fbf0d951-0015-420d-b585-c5e88dc8cbf5 req-fb0b8a3f-9b84-4a1e-85da-3d03eaa44949 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:12.573432 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fbf0d951-0015-420d-b585-c5e88dc8cbf5 req-fb0b8a3f-9b84-4a1e-85da-3d03eaa44949 service nova] Creating event network-vif-plugged:14c71eeb-676d-4f29-8637-4704101a6547 for instance a621398d-d64f-4a12-951d-c4cd96503b51 on n-h2-860864-8 Oct 12 22:55:12.578871 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fbf0d951-0015-420d-b585-c5e88dc8cbf5 req-fb0b8a3f-9b84-4a1e-85da-3d03eaa44949 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034443 Oct 12 22:55:12.580054 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2185/4242] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:55:12.834805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:12.847064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-51a25738-85d0-4e6e-a1cf-fdf7787fcde8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.423800 Oct 12 22:55:12.862904 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2058/4243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:12 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:12.906434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:12.907323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:12.916094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:12.916837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:12.917385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:12.918313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:12.918990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:12.919711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:12.970339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:12.970966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:12.978503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:12.979096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:12.979608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:12.980473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:12.981005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:12.981502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:13.160273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:13.168999 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22383966-74d6-4a88-891a-07ffd577d3fb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1328 microversion: 2.1 time: 0.267180 Oct 12 22:55:13.169629 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2186/4244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:12 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:13.395430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:13.412211 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-acd80003-d94e-4a06-a460-535ab40c177a tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1541 microversion: 2.1 time: 0.445851 Oct 12 22:55:13.413344 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2059/4245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:12 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1541 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:13.869866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:13.870409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-64fa0f94-ce46-4ccc-9a40-e59570360e37 req-3c4a4115-3f82-4950-b5a7-aa0b9a16448a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73435c0-2fad-4ce1-b293-98a4070f5a68", "name": "network-vif-deleted", "tag": "327c2284-8f69-4539-94aa-72253125a3c2"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:13.870807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:13.882607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:13.884455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:13.886787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:13.887673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:13.889984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:13.890516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:13.896859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-64fa0f94-ce46-4ccc-9a40-e59570360e37 req-3c4a4115-3f82-4950-b5a7-aa0b9a16448a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:13.897348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-64fa0f94-ce46-4ccc-9a40-e59570360e37 req-3c4a4115-3f82-4950-b5a7-aa0b9a16448a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:13.897779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-64fa0f94-ce46-4ccc-9a40-e59570360e37 req-3c4a4115-3f82-4950-b5a7-aa0b9a16448a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:13.963715 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-64fa0f94-ce46-4ccc-9a40-e59570360e37 req-3c4a4115-3f82-4950-b5a7-aa0b9a16448a service nova] Creating event network-vif-deleted:327c2284-8f69-4539-94aa-72253125a3c2 for instance a73435c0-2fad-4ce1-b293-98a4070f5a68 on n-h2-860864-8 Oct 12 22:55:13.970906 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-64fa0f94-ce46-4ccc-9a40-e59570360e37 req-3c4a4115-3f82-4950-b5a7-aa0b9a16448a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118478 Oct 12 22:55:13.977500 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2187/4246] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:14.142268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:14.157100 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-514f4ba1-eca0-482e-a917-7396039f3d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1203 microversion: 2.1 time: 0.291098 Oct 12 22:55:14.172959 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2060/4247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:13 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1203 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:14.195851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:14.197203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:14.211606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:14.212870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:14.213633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:14.215714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:14.216389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:14.216980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:14.438861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:14.439651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:14.446226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:14.446969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:14.447881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:14.448923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:14.449625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:14.450301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:14.474940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:14.486831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:14.501512 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff4e56de-76cd-4b4c-aecd-afab2e5df1ca tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1328 microversion: 2.1 time: 0.313072 Oct 12 22:55:14.520442 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2188/4248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:14 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1328 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:14.521321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:14.522740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:14.523188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:14.524117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lazy-loading 'fault' on Instance uuid a73435c0-2fad-4ce1-b293-98a4070f5a68 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:55:14.575392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd000de8d9fa042d8814fb347e5e7adb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0640992268d4e90b9285b14b894f397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:14.592364 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c73cf6bf-7032-42d1-af2b-08c0e26957fa tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 200 len: 1321 microversion: 2.1 time: 0.154127 Oct 12 22:55:14.593005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2061/4249] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:14 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:14.619272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-85e8da97-3e31-4a93-b34e-c55bc7cecbce req-740dd142-831f-4487-9742-d62f427654f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e16df0-d29d-42ba-83cb-dc2a75472b2f", "name": "network-vif-plugged", "status": "completed", "tag": "78df6ede-9071-4d69-8497-a1248f5da4c1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:14.645686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-85e8da97-3e31-4a93-b34e-c55bc7cecbce req-740dd142-831f-4487-9742-d62f427654f4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:14.646787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-85e8da97-3e31-4a93-b34e-c55bc7cecbce req-740dd142-831f-4487-9742-d62f427654f4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:14.647299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-85e8da97-3e31-4a93-b34e-c55bc7cecbce req-740dd142-831f-4487-9742-d62f427654f4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:14.660576 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-85e8da97-3e31-4a93-b34e-c55bc7cecbce req-740dd142-831f-4487-9742-d62f427654f4 service nova] Creating event network-vif-plugged:78df6ede-9071-4d69-8497-a1248f5da4c1 for instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f on n-h1-860864-8 Oct 12 22:55:14.666309 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-85e8da97-3e31-4a93-b34e-c55bc7cecbce req-740dd142-831f-4487-9742-d62f427654f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050839 Oct 12 22:55:14.667353 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2189/4250] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:15.186112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:15.186738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:15.191012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:15.196217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.196760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.197199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.198053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.198741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.199332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.250735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:15.353053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:15.361778 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f5515de-0e12-4466-a5cf-dc74427d31f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1389 microversion: 2.1 time: 0.179405 Oct 12 22:55:15.365551 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2062/4251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:15 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1389 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:15.387074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:15.388078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:15.408795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.409877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.410326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.411053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.411510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.412386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.535208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:15.535833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:15.543675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.544252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.544956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.545872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.546324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.546745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.727200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:15.741492 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79626206-d97e-449b-af35-aaacf6f28e81 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1328 microversion: 2.1 time: 0.215564 Oct 12 22:55:15.742452 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2063/4252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:15 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1328 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:15.748049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:15.749005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] [instance: a73435c0-2fad-4ce1-b293-98a4070f5a68] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:15.756969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.757871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.758745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.760942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:15.761890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:15.762565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:15.784151 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] HTTP exception thrown: Instance a73435c0-2fad-4ce1-b293-98a4070f5a68 could not be found. Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Request method failure captured: Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 HTTP/1.1 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Wn8-7P_J8Vy9qwj1uU0jkIGPgagdqTOlSiF9elxoNlifIQFnc1EuxWaix6HLxXSXHPukraUS3CuaztqVdauQ3MupK4ZtHvWc5gllTymmNa6EotIbEB26bLfG_FyUrldbU_SdIiB-mgezgaAZVnMtGeUcKLBuf8Y7Y8jGtQCoNO8XU Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0640992268d4e90b9285b14b894f397"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0640992268d4e90b9285b14b894f397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0640992268d4e90b9285b14b894f397"}]}] Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0640992268d4e90b9285b14b894f397 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d000de8d9fa042d8814fb347e5e7adb7 Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a73435c0-2fad-4ce1-b293-98a4070f5a68 could not be found. Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a73435c0-2fad-4ce1-b293-98a4070f5a68'} Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73435c0-2fad-4ce1-b293-98a4070f5a68 could not be found. Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73435c0-2fad-4ce1-b293-98a4070f5a68 could not be found. Oct 12 22:55:15.785741 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73435c0-2fad-4ce1-b293-98a4070f5a68 could not be found. Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] Returning 404 to user: Instance a73435c0-2fad-4ce1-b293-98a4070f5a68 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-358f3ab0-1433-4060-a676-0442a8e95761 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378 tempest-FloatingIPsAssociationNegativeTestJSON-1458232378-project] 10.222.0.20 "GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68" status: 404 len: 111 microversion: 2.1 time: 0.043408 Oct 12 22:55:15.791333 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2064/4253] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:15 2022] GET /compute/v2.1/servers/a73435c0-2fad-4ce1-b293-98a4070f5a68 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:55:16.178772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:16.188288 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-53a65529-9d10-41f6-a912-8a9930d03606 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1389 microversion: 2.1 time: 0.805911 Oct 12 22:55:16.201493 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2190/4254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:15 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1389 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:16.216892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:16.218444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:16.227106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.229393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.229950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.231112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.231835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.232646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.459535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:16.467703 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6229c3e3-037a-4145-9a3b-c4f8fedc8559 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1389 microversion: 2.1 time: 0.254634 Oct 12 22:55:16.468525 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2065/4255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:16 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:16.492692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:16.493211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:16.500502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.501567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.502201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.503200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.503682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.504365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.535795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:55:16.630358 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a74643a-bd38-4912-b9c1-79fdc19f8f57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 204 len: 0 microversion: 2.1 time: 0.142431 Oct 12 22:55:16.631543 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2191/4256] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:55:16 2022] DELETE /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:55:16.641253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:16.643322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:16.650986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.651925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.652656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.653668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.654501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.655018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.776452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:16.777378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:16.784734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.785442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.786065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.786950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:16.787575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:16.788195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:16.887865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:16.896725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2022d935-8b87-43b4-9745-cc2c6713dc8f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1395 microversion: 2.1 time: 0.260438 Oct 12 22:55:16.912566 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2066/4257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:16 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1395 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:17.101602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:17.112285 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-638593f1-ddd9-4ef2-bfa4-d1f7f45b0790 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1509 microversion: 2.1 time: 0.347994 Oct 12 22:55:17.116636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2192/4258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:16 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:17.149976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:17.151193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:17.158794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.160917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.161701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:17.162710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.163517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.164399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:17.470148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:17.493834 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00accd0b-bde2-4799-8db0-8946198c9c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1509 microversion: 2.1 time: 0.355984 Oct 12 22:55:17.498523 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2067/4259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:17 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:17.529936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:17.531915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:17.549774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.550602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.551292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:17.552256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.552913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.553765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:17.598832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:55:17.651597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:17.711413 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b09d1690-7a19-44a8-ad1a-b30b27e5ff0d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 204 len: 0 microversion: 2.1 time: 0.188390 Oct 12 22:55:17.712804 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2193/4260] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:55:17 2022] DELETE /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:55:17.724919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:17.726771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:17.734869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.735725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.736590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:17.738630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.739988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.740883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:17.927950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:17.929011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:17.935227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.935709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.936421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:17.937073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:17.937519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:17.937942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:18.159856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:18.173176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c12d4ed5-e687-45fb-bfa0-e7c3153dec9e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1395 microversion: 2.1 time: 0.250085 Oct 12 22:55:18.184083 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2194/4261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:17 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1395 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:18.469942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:18.490383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a05f0e3d-32e9-4d71-8ef7-3f5156009f57 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1515 microversion: 2.1 time: 0.772142 Oct 12 22:55:18.493306 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2068/4262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:17 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1515 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:18.693204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-dd7e96c9-4264-4192-b23c-e917865c4410 req-a953988b-f1c3-4e76-a45c-8d49cb1bc947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a621398d-d64f-4a12-951d-c4cd96503b51", "name": "network-vif-deleted", "tag": "14c71eeb-676d-4f29-8637-4704101a6547"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:18.711860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dd7e96c9-4264-4192-b23c-e917865c4410 req-a953988b-f1c3-4e76-a45c-8d49cb1bc947 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:18.712490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dd7e96c9-4264-4192-b23c-e917865c4410 req-a953988b-f1c3-4e76-a45c-8d49cb1bc947 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:18.713086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dd7e96c9-4264-4192-b23c-e917865c4410 req-a953988b-f1c3-4e76-a45c-8d49cb1bc947 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:18.734487 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-dd7e96c9-4264-4192-b23c-e917865c4410 req-a953988b-f1c3-4e76-a45c-8d49cb1bc947 service nova] Creating event network-vif-deleted:14c71eeb-676d-4f29-8637-4704101a6547 for instance a621398d-d64f-4a12-951d-c4cd96503b51 on n-h2-860864-8 Oct 12 22:55:18.744094 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-dd7e96c9-4264-4192-b23c-e917865c4410 req-a953988b-f1c3-4e76-a45c-8d49cb1bc947 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055631 Oct 12 22:55:18.746254 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2195/4263] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:19.204660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:19.206290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:19.236399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:19.237447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:19.238084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:19.238815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:19.239278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:19.239714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:19.385944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:19.395263 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00707b45-c2b0-4670-b1dc-115d3691150e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1188 microversion: 2.1 time: 0.201653 Oct 12 22:55:19.395850 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2069/4264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:19 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1188 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:19.520633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:19.521377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:19.528230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:19.528720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:19.529324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:19.530262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:19.530893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:19.531321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:19.745534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:19.754962 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b6092d48-6fc5-4b39-a6a0-30672c7d7eec tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1515 microversion: 2.1 time: 0.240570 Oct 12 22:55:19.773222 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2196/4265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:19 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1515 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:20.420147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:20.420803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:20.431765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:20.434735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:20.435282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:20.436078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:20.436556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:20.437008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:20.700574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:20.710412 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3716efea-3217-45fc-bb57-9ea7dd2339c2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1188 microversion: 2.1 time: 0.294098 Oct 12 22:55:20.725116 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2070/4266] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:20 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:20.780230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:20.780931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:20.793973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:20.794748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:20.795500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:20.796430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:20.797288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:20.797888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:20.943560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:20.959636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d6e7395-b961-4d0a-a678-89f3ad8c6cf8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 200 len: 1473 microversion: 2.1 time: 0.182716 Oct 12 22:55:20.960491 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2197/4267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:20 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:21.034884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3d6b6184-15f8-45a8-9eee-1bb36d2ed13c req-6f7cf0c7-e0d5-4cf3-8768-7707004b03b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e16df0-d29d-42ba-83cb-dc2a75472b2f", "name": "network-vif-deleted", "tag": "78df6ede-9071-4d69-8497-a1248f5da4c1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:21.056569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d6b6184-15f8-45a8-9eee-1bb36d2ed13c req-6f7cf0c7-e0d5-4cf3-8768-7707004b03b9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:21.058692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d6b6184-15f8-45a8-9eee-1bb36d2ed13c req-6f7cf0c7-e0d5-4cf3-8768-7707004b03b9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:21.061187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d6b6184-15f8-45a8-9eee-1bb36d2ed13c req-6f7cf0c7-e0d5-4cf3-8768-7707004b03b9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:21.108152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3d6b6184-15f8-45a8-9eee-1bb36d2ed13c req-6f7cf0c7-e0d5-4cf3-8768-7707004b03b9 service nova] Creating event network-vif-deleted:78df6ede-9071-4d69-8497-a1248f5da4c1 for instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f on n-h1-860864-8 Oct 12 22:55:21.126484 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3d6b6184-15f8-45a8-9eee-1bb36d2ed13c req-6f7cf0c7-e0d5-4cf3-8768-7707004b03b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096642 Oct 12 22:55:21.130992 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2071/4268] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:21.740845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:21.741515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:21.756188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:21.757517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:21.758135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:21.759025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:21.759654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:21.760279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:21.901942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:21.915586 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f414bbc-d37b-426b-9d05-c527afc54668 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1188 microversion: 2.1 time: 0.183002 Oct 12 22:55:21.918575 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2198/4269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:21 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1188 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:21.983974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:21.984780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:21.998406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:22.006519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:22.006912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:22.007665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:22.008514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:22.008628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:22.053028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f HTTP/1.1 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '90e16df0-d29d-42ba-83cb-dc2a75472b2f'} Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:22.066530 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:22.072660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:22.072660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:22.072660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:22.072660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:22.072660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:22.072660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:55:22.072660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:22.074452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:22.075562 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e35723f-a2d1-4a8a-ae8d-3495af36e2b0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 404 len: 111 microversion: 2.1 time: 0.096442 Oct 12 22:55:22.076417 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2072/4270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:21 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:55:22.086997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-511286af-5a4b-4d91-a6c1-d0c0163c866d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '.version_select at 0x7f44fee9ae50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:22.112964 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-511286af-5a4b-4d91-a6c1-d0c0163c866d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-192145014" status: 202 len: 0 microversion: 2.1 time: 0.030069 Oct 12 22:55:22.115426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2199/4271] 10.222.0.20 () {58 vars in 1206 bytes} [Wed Oct 12 22:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-192145014 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:55:22.204444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2009637094", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d66ee827-cdbf-47c7-bea5-6c5ad2e47941"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:22.265071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:55:22.848398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:55:22.848941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:55:22.849485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:55:22.850737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:55:22.851443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:55:22.866955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:22.867949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:22.868723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:22.869336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:22.869893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:22.870379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:22.892339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:22.899555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:22.915099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:55:22.917473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:55:22.948807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:22.950354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:22.959177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:22.959748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:22.960350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:22.961408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:22.962080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:22.962790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:22.982530 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f7bdcc2-7e88-4711-8bd5-d81ce013eb46 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783706 Oct 12 22:55:22.983839 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2073/4272] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:55:23.001148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f70f5ae3-8f5f-429c-901a-e7d78f7ddf5e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:23.002620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f70f5ae3-8f5f-429c-901a-e7d78f7ddf5e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:23.061674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:23.071698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f70f5ae3-8f5f-429c-901a-e7d78f7ddf5e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:23.077946 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b7fdeb7f-f7b2-401f-adc3-b0593cedeb54 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1188 microversion: 2.1 time: 0.134908 Oct 12 22:55:23.079784 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2200/4273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:22 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1188 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:23.090785 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f70f5ae3-8f5f-429c-901a-e7d78f7ddf5e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1209 microversion: 2.1 time: 0.093602 Oct 12 22:55:23.095933 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2074/4274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:22 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:24.105178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:24.106429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:24.115281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:24.116499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:24.126945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:24.127762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:24.128457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:24.129013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:24.129393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:24.129526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:24.130279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:24.130565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:24.130797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:24.131233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:24.131519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:24.132140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:24.233826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:24.239257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:24.252075 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dbb26ab4-74e2-44d0-b004-c815bdafc14a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1261 microversion: 2.1 time: 0.141202 Oct 12 22:55:24.259335 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-53dda855-22ff-49b8-a930-7ab308ecd5ef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 200 len: 1188 microversion: 2.1 time: 0.157803 Oct 12 22:55:24.260132 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2201/4275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:24 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:24.265305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2075/4276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:24 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:25.190714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d54fb624-1e4e-426b-bc60-a135374ed5c8 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f4507c37d30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:25.237517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d54fb624-1e4e-426b-bc60-a135374ed5c8 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7" status: 200 len: 635 microversion: 2.1 time: 0.050616 Oct 12 22:55:25.238376 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2202/4277] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Oct 12 22:55:25 2022] GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7 => generated 635 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:25.253101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae472cbf-932b-464f-919e-2c633bf220b5 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update_all', calling method: .version_select at 0x7f4507a7d160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:25.284482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:25.284938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: a621398d-d64f-4a12-951d-c4cd96503b51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:25.306952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ae472cbf-932b-464f-919e-2c633bf220b5 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:25.310827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.312645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.313148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.313575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ae472cbf-932b-464f-919e-2c633bf220b5 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:25.316535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.317063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.317575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.339869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance a621398d-d64f-4a12-951d-c4cd96503b51 could not be found. Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 HTTP/1.1 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance a621398d-d64f-4a12-951d-c4cd96503b51 could not be found. Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a621398d-d64f-4a12-951d-c4cd96503b51'} Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a621398d-d64f-4a12-951d-c4cd96503b51 could not be found. Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a621398d-d64f-4a12-951d-c4cd96503b51 could not be found. Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:25.343208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:25.349833 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:25.349833 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:25.349833 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:25.349833 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:25.349833 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:25.349833 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a621398d-d64f-4a12-951d-c4cd96503b51 could not be found. Oct 12 22:55:25.349833 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:25.352656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance a621398d-d64f-4a12-951d-c4cd96503b51 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:25.353731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25d9a031-6d2a-48c3-acd0-063905860b44 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51" status: 404 len: 111 microversion: 2.1 time: 0.073600 Oct 12 22:55:25.358159 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2203/4278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:25 2022] GET /compute/v2.1/servers/a621398d-d64f-4a12-951d-c4cd96503b51 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:55:25.364790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:25.365398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:25.371872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.372897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.373058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.373696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:25.374142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:25.374735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:25.532588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:25.564950 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ab9fae1-a747-4515-9171-692fd289d9f1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1267 microversion: 2.1 time: 0.205408 Oct 12 22:55:25.581082 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2204/4279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:25 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:25.842908 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae472cbf-932b-464f-919e-2c633bf220b5 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.594156 Oct 12 22:55:25.844698 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2076/4280] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:55:25 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 61 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:25.864519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-427bb9da-01cf-44bb-a06e-9ebb80f82072 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f44ffc7d0d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:26.283254 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-427bb9da-01cf-44bb-a06e-9ebb80f82072 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "DELETE /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.432025 Oct 12 22:55:26.284449 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2205/4281] 10.222.0.20 () {58 vars in 1296 bytes} [Wed Oct 12 22:55:25 2022] DELETE /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata/os_version => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:55:26.293657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-617cbbac-17fc-478e-883f-acee383a6e2d tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f44ff4b05e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:26.365109 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-617cbbac-17fc-478e-883f-acee383a6e2d tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 37 microversion: 2.1 time: 0.076095 Oct 12 22:55:26.371608 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2077/4282] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:55:26 2022] GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 37 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:26.376448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d2567390-4b49-4598-91fb-57654810cff1 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update_all', calling method: .version_select at 0x7f44feca9790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:26.431975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d2567390-4b49-4598-91fb-57654810cff1 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:26.438204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d2567390-4b49-4598-91fb-57654810cff1 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:26.597958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:26.599855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:26.611110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:26.618882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:26.619473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:26.620246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:26.620714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:26.621137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:26.816164 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d2567390-4b49-4598-91fb-57654810cff1 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.443508 Oct 12 22:55:26.816838 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2206/4283] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:55:26 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 61 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:55:26.826947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-989eda65-1294-47b9-bf48-c9d85d46c334 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f44fee9a040>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:26.910344 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-989eda65-1294-47b9-bf48-c9d85d46c334 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.087831 Oct 12 22:55:26.911296 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2207/4284] 10.222.0.20 () {58 vars in 1290 bytes} [Wed Oct 12 22:55:26 2022] GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata/os_distro => generated 33 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:26.934427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-deb2bf1c-e8b8-4b1c-9eea-9635a6b9ba25 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update_all', calling method: .version_select at 0x7f44feca9430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:27.049931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-deb2bf1c-e8b8-4b1c-9eea-9635a6b9ba25 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:27.068497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-deb2bf1c-e8b8-4b1c-9eea-9635a6b9ba25 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:27.366172 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-deb2bf1c-e8b8-4b1c-9eea-9635a6b9ba25 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.436924 Oct 12 22:55:27.369115 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2208/4285] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:55:26 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 61 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:27.378775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24156c57-83c8-4d54-8a58-912cdae44dd2 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f44ff57aee0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:27.452328 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24156c57-83c8-4d54-8a58-912cdae44dd2 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.078034 Oct 12 22:55:27.463015 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2209/4286] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:55:27 2022] GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 61 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:55:27.473022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-b4282e59-6239-455b-9213-ead848923341 req-8c9e25d1-7c7e-4926-a0e9-3749c858f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1abe2aa3-5fb8-4c1c-855a-3de4a40b1997", "tag": "e884a401-1de9-4ab9-8292-ed20465a7804"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:27.511797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b4282e59-6239-455b-9213-ead848923341 req-8c9e25d1-7c7e-4926-a0e9-3749c858f1bd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:27.512576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b4282e59-6239-455b-9213-ead848923341 req-8c9e25d1-7c7e-4926-a0e9-3749c858f1bd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:27.514144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b4282e59-6239-455b-9213-ead848923341 req-8c9e25d1-7c7e-4926-a0e9-3749c858f1bd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:27.544132 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-b4282e59-6239-455b-9213-ead848923341 req-8c9e25d1-7c7e-4926-a0e9-3749c858f1bd service nova] Creating event network-changed:e884a401-1de9-4ab9-8292-ed20465a7804 for instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 on n-h2-860864-8 Oct 12 22:55:27.550326 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-b4282e59-6239-455b-9213-ead848923341 req-8c9e25d1-7c7e-4926-a0e9-3749c858f1bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081019 Oct 12 22:55:27.556516 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2210/4287] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:27.562213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc996d4f-6e36-4912-8c73-4059380f1d1b tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update_all', calling method: .version_select at 0x7f44ff4fd430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:27.639048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-dc996d4f-6e36-4912-8c73-4059380f1d1b tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:27.645794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-dc996d4f-6e36-4912-8c73-4059380f1d1b tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:27.756013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:27.768197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b56d409-369f-43d0-8aac-fdc2f7ef3e41 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1309 microversion: 2.1 time: 1.175016 Oct 12 22:55:27.773650 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2078/4288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:26 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1309 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:27.925740 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc996d4f-6e36-4912-8c73-4059380f1d1b tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.367371 Oct 12 22:55:27.926482 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2211/4289] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:55:27 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 61 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:27.939715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b86dee27-2eff-4c2a-a0d6-f30af72193d7 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update_all', calling method: .version_select at 0x7f44ff64b670>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:28.011930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b86dee27-2eff-4c2a-a0d6-f30af72193d7 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:28.020821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b86dee27-2eff-4c2a-a0d6-f30af72193d7 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:28.530776 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b86dee27-2eff-4c2a-a0d6-f30af72193d7 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.597590 Oct 12 22:55:28.531919 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2079/4290] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:55:27 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 64 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:28.546724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4dd42108-acdc-4989-bb32-c13d39920010 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f44fec9a8b0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:28.603915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4dd42108-acdc-4989-bb32-c13d39920010 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.066842 Oct 12 22:55:28.604732 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2212/4291] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:55:28 2022] GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 64 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:55:28.616169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9003bcee-8334-4cef-8980-cf0dbf51b1c3 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update_all', calling method: .version_select at 0x7f44fec5bb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:28.669251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9003bcee-8334-4cef-8980-cf0dbf51b1c3 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:28.675635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9003bcee-8334-4cef-8980-cf0dbf51b1c3 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:28.804108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:28.805374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:28.813668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:28.817408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:28.819388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:28.822358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:28.824357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:28.824998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:28.826004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:29.091576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9003bcee-8334-4cef-8980-cf0dbf51b1c3 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.479419 Oct 12 22:55:29.092462 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2080/4292] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:55:28 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 61 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:29.104286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23dd5bb4-cc99-45ac-9281-af1866bb4bee tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update', calling method: .version_select at 0x7f44ff64b3a0>, body: {"meta": {"os_version": "alt"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:29.181248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-23dd5bb4-cc99-45ac-9281-af1866bb4bee tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:29.182906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:29.194001 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5bdf7710-72cd-479a-94a1-400a11fc0a7f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1309 microversion: 2.1 time: 0.395987 Oct 12 22:55:29.201413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-23dd5bb4-cc99-45ac-9281-af1866bb4bee tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:29.214812 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2213/4293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:28 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1309 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:29.591317 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23dd5bb4-cc99-45ac-9281-af1866bb4bee tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.492670 Oct 12 22:55:29.592342 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2081/4294] 10.222.0.20 () {60 vars in 1313 bytes} [Wed Oct 12 22:55:29 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata/os_version => generated 31 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:29.602431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-016ab942-b22f-4e10-83cf-1e2f254a6247 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f44ff4aab80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:29.684508 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-016ab942-b22f-4e10-83cf-1e2f254a6247 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 58 microversion: 2.1 time: 0.086704 Oct 12 22:55:29.706538 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2214/4295] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:55:29 2022] GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 58 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:29.718992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-460a2bb0-fee6-4e31-af07-3928bc9d8517 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'update_all', calling method: .version_select at 0x7f4507c1ba60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:29.794308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-460a2bb0-fee6-4e31-af07-3928bc9d8517 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:29.801441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-460a2bb0-fee6-4e31-af07-3928bc9d8517 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:30.173671 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-460a2bb0-fee6-4e31-af07-3928bc9d8517 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.464499 Oct 12 22:55:30.174861 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2082/4296] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:55:29 2022] PUT /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 61 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:30.184385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f20bd3e5-868c-47d4-9a41-a6fb334bb489 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Action: 'create', calling method: .version_select at 0x7f4507c37ee0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:30.222394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:30.224047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:30.232229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:30.232964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:30.233614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:30.234515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:30.235192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:30.235820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:30.244302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f20bd3e5-868c-47d4-9a41-a6fb334bb489 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:30.249871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f20bd3e5-868c-47d4-9a41-a6fb334bb489 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Getting quotas for user 473e0ddc6c84441586f6fb098cc6240f and project 96f4534337e141799272d1d362345600. Resources: dict_keys(['metadata_items']) {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:30.536905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:30.545857 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cae4ce79-3324-426c-b8ea-62b3c39e7b79 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1309 microversion: 2.1 time: 0.327967 Oct 12 22:55:30.549707 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2083/4297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:30 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1309 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:30.596291 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f20bd3e5-868c-47d4-9a41-a6fb334bb489 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "POST /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.414418 Oct 12 22:55:30.597439 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2215/4298] 10.222.0.20 () {60 vars in 1281 bytes} [Wed Oct 12 22:55:30 2022] POST /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 85 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:30.606932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-647c951d-8c0b-4a73-9318-eac304bbfe62 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] Calling method '.version_select at 0x7f4507c1b670>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:30.657733 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-647c951d-8c0b-4a73-9318-eac304bbfe62 tempest-ImagesMetadataTestJSON-401191218 tempest-ImagesMetadataTestJSON-401191218-project] 10.222.0.20 "GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.054589 Oct 12 22:55:30.658883 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2084/4299] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Oct 12 22:55:30 2022] GET /compute/v2.1/images/c7874629-56f0-44e4-aa0f-67ee85718ef7/metadata => generated 85 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:55:30.731466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:30.732731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:30.741042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:30.741759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:30.742391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:30.743599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:30.744262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:30.745251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.026257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:31.046385 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7583694c-9966-4054-93b1-cd5dc61286ec tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.319947 Oct 12 22:55:31.049112 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2216/4300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:30 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:31.075114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:31.075868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:31.084303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.085131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.085671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.086491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.087471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.088101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.332069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:31.359422 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7fc33c03-79bb-4dda-bf80-a187be1064c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.289533 Oct 12 22:55:31.364310 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2085/4301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:31 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:31.391352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:31.392005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:31.402018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.402518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.402967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.403775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.404187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.404661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.575641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:31.576359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:31.579829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:31.589616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.590633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.591098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.594276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.594927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:31.595281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.596978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.604003 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-abfb607e-5d01-4166-8031-32dc9ea971e8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.216413 Oct 12 22:55:31.609406 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2217/4302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:31 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:31.633102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1694138459"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:31.635771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:31.648749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.650195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.651056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.652369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:31.653003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:31.653628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:31.922863 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-170235e9-47d2-4d2f-920c-eeae76021883 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.298592 Oct 12 22:55:31.924177 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2218/4303] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:55:31 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 22:55:32.163261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:32.178444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-86b52492-028f-4f3e-89c8-54d5ea6df676 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1309 microversion: 2.1 time: 0.607241 Oct 12 22:55:32.196100 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2086/4304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:31 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1309 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:32.672545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6b97ec40-990c-4853-93b7-34d2d9da1940 req-e9b94d34-839f-460c-94a1-b57ee0b89441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abe2aa3-5fb8-4c1c-855a-3de4a40b1997", "name": "network-vif-plugged", "status": "completed", "tag": "e884a401-1de9-4ab9-8292-ed20465a7804"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:32.698083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6b97ec40-990c-4853-93b7-34d2d9da1940 req-e9b94d34-839f-460c-94a1-b57ee0b89441 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:32.699287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6b97ec40-990c-4853-93b7-34d2d9da1940 req-e9b94d34-839f-460c-94a1-b57ee0b89441 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:32.700261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6b97ec40-990c-4853-93b7-34d2d9da1940 req-e9b94d34-839f-460c-94a1-b57ee0b89441 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:32.718116 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6b97ec40-990c-4853-93b7-34d2d9da1940 req-e9b94d34-839f-460c-94a1-b57ee0b89441 service nova] Creating event network-vif-plugged:e884a401-1de9-4ab9-8292-ed20465a7804 for instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 on n-h2-860864-8 Oct 12 22:55:32.726738 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6b97ec40-990c-4853-93b7-34d2d9da1940 req-e9b94d34-839f-460c-94a1-b57ee0b89441 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058615 Oct 12 22:55:32.728323 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2219/4305] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:33.204920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:33.205553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:33.216519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:33.224150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:33.226157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:33.226990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:33.229147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:33.230643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:33.231924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:33.500906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:33.511476 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-141b51b7-7b84-484f-b45c-a25ead08e5df tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1309 microversion: 2.1 time: 0.310496 Oct 12 22:55:33.513036 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2087/4306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:33 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:34.336743 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a95effc-9ebf-4c6e-8479-43af44d2374f tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.275014 Oct 12 22:55:34.338336 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2220/4307] 10.222.0.20 () {58 vars in 1128 bytes} [Wed Oct 12 22:55:34 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 22:55:34.349216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ae4740a-92a6-4183-bfd0-6b32fa8fa155 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Calling method '.version_select at 0x7f44ff64b280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:34.382145 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6ae4740a-92a6-4183-bfd0-6b32fa8fa155 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] HTTP exception thrown: Image not found. Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ae4740a-92a6-4183-bfd0-6b32fa8fa155 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Request method failure captured: Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0XlIdtqINZB0F5RgrOUAf234vdTKTCMt2QqBThOORw5A-AeaUQFl0rJ3gGcndwkEMxFAbydnVoIrMgpxNy-NXwOIIesbeoM4DFdMd-WN9AM13DA5V50t27_AuVJed0WbENvAX1u4EmfHXH8t21Rfaft5YmaIbTeglCraVbfbA-I2vU Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}] Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0ad9d200ab2f457a8993bb8d97f4b260 Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '-1'} Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.384226 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ae4740a-92a6-4183-bfd0-6b32fa8fa155 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ae4740a-92a6-4183-bfd0-6b32fa8fa155 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.043292 Oct 12 22:55:34.398512 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2088/4308] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Oct 12 22:55:34 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:55:34.405207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57e16d07-fd79-484d-8cfe-0d3037347c18 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Calling method '.version_select at 0x7f44fec9ae50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:34.448807 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-57e16d07-fd79-484d-8cfe-0d3037347c18 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] HTTP exception thrown: Image not found. Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57e16d07-fd79-484d-8cfe-0d3037347c18 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Request method failure captured: Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/aaed7413-8960-478a-a703-1b46499a6dej HTTP/1.1 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0XlIdtqINZB0F5RgrOUAf234vdTKTCMt2QqBThOORw5A-AeaUQFl0rJ3gGcndwkEMxFAbydnVoIrMgpxNy-NXwOIIesbeoM4DFdMd-WN9AM13DA5V50t27_AuVJed0WbENvAX1u4EmfHXH8t21Rfaft5YmaIbTeglCraVbfbA-I2vU Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}] Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0ad9d200ab2f457a8993bb8d97f4b260 Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'aaed7413-8960-478a-a703-1b46499a6dej'} Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aaed7413-8960-478a-a703-1b46499a6dej to delete Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aaed7413-8960-478a-a703-1b46499a6dej could not be found. Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.450986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:55:34.457696 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.460940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57e16d07-fd79-484d-8cfe-0d3037347c18 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:34.462021 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57e16d07-fd79-484d-8cfe-0d3037347c18 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] 10.222.0.20 "DELETE /compute/v2.1/images/aaed7413-8960-478a-a703-1b46499a6dej" status: 404 len: 62 microversion: 2.1 time: 0.066238 Oct 12 22:55:34.463019 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2221/4309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:34 2022] DELETE /compute/v2.1/images/aaed7413-8960-478a-a703-1b46499a6dej => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:55:34.473870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-660982cc-13c6-4e6c-996a-08232bb2ac74 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Calling method '.version_select at 0x7f4507c103a0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:34.500740 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-660982cc-13c6-4e6c-996a-08232bb2ac74 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] HTTP exception thrown: Image not found. Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-660982cc-13c6-4e6c-996a-08232bb2ac74 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Request method failure captured: Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/images/71bfe26f-547b-4d60-8b47-f139318ff7f31 HTTP/1.1 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0XlIdtqINZB0F5RgrOUAf234vdTKTCMt2QqBThOORw5A-AeaUQFl0rJ3gGcndwkEMxFAbydnVoIrMgpxNy-NXwOIIesbeoM4DFdMd-WN9AM13DA5V50t27_AuVJed0WbENvAX1u4EmfHXH8t21Rfaft5YmaIbTeglCraVbfbA-I2vU Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}] Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0ad9d200ab2f457a8993bb8d97f4b260 Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: exception: Image not found. Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '71bfe26f-547b-4d60-8b47-f139318ff7f31'} Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 71bfe26f-547b-4d60-8b47-f139318ff7f31 to delete Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 71bfe26f-547b-4d60-8b47-f139318ff7f31 could not be found. Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.503466 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:55:34.508732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.513042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-660982cc-13c6-4e6c-996a-08232bb2ac74 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Returning 404 to user: Image not found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:34.514156 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-660982cc-13c6-4e6c-996a-08232bb2ac74 tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] 10.222.0.20 "DELETE /compute/v2.1/images/71bfe26f-547b-4d60-8b47-f139318ff7f31" status: 404 len: 62 microversion: 2.1 time: 0.045117 Oct 12 22:55:34.514898 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2089/4310] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:55:34 2022] DELETE /compute/v2.1/images/71bfe26f-547b-4d60-8b47-f139318ff7f31 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:55:34.528586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc84fd84-b748-45ca-bb5a-b1b61b5267db tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Calling method '.version_select at 0x7f44ffb96dc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:34.558081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:34.586915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:34.591441 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-bc84fd84-b748-45ca-bb5a-b1b61b5267db tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] HTTP exception thrown: Image not found. Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc84fd84-b748-45ca-bb5a-b1b61b5267db tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Request method failure captured: Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/tempest-invalid-1001159211 HTTP/1.1 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0XlIdtqINZB0F5RgrOUAf234vdTKTCMt2QqBThOORw5A-AeaUQFl0rJ3gGcndwkEMxFAbydnVoIrMgpxNy-NXwOIIesbeoM4DFdMd-WN9AM13DA5V50t27_AuVJed0WbENvAX1u4EmfHXH8t21Rfaft5YmaIbTeglCraVbfbA-I2vU Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}] Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0ad9d200ab2f457a8993bb8d97f4b260 Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'tempest-invalid-1001159211'} Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1001159211 to delete Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1001159211 could not be found. Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.593551 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc84fd84-b748-45ca-bb5a-b1b61b5267db tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc84fd84-b748-45ca-bb5a-b1b61b5267db tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-1001159211" status: 404 len: 62 microversion: 2.1 time: 0.074590 Oct 12 22:55:34.599042 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2222/4311] 10.222.0.20 () {58 vars in 1206 bytes} [Wed Oct 12 22:55:34 2022] DELETE /compute/v2.1/images/tempest-invalid-1001159211 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:55:34.613979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3287818a-cc5a-4b44-901c-5fa8b149487e tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Calling method '.version_select at 0x7f44fec9ae50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:34.654192 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-3287818a-cc5a-4b44-901c-5fa8b149487e tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] HTTP exception thrown: Image not found. Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3287818a-cc5a-4b44-901c-5fa8b149487e tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Request method failure captured: Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/images/eba7e084-505c-4e00-85af-65485a110ff9 HTTP/1.1 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0XlIdtqINZB0F5RgrOUAf234vdTKTCMt2QqBThOORw5A-AeaUQFl0rJ3gGcndwkEMxFAbydnVoIrMgpxNy-NXwOIIesbeoM4DFdMd-WN9AM13DA5V50t27_AuVJed0WbENvAX1u4EmfHXH8t21Rfaft5YmaIbTeglCraVbfbA-I2vU Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3427bc7928d49b781f43744b44e86ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3427bc7928d49b781f43744b44e86ac"}]}] Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: b3427bc7928d49b781f43744b44e86ac Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0ad9d200ab2f457a8993bb8d97f4b260 Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1424485299-project Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: exception: Image not found. Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'eba7e084-505c-4e00-85af-65485a110ff9'} Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eba7e084-505c-4e00-85af-65485a110ff9 to delete Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eba7e084-505c-4e00-85af-65485a110ff9 could not be found. Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.658097 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 22:55:34.665675 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:55:34.670803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3287818a-cc5a-4b44-901c-5fa8b149487e tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] Returning 404 to user: Image not found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:55:34.673729 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3287818a-cc5a-4b44-901c-5fa8b149487e tempest-ImagesDeleteNegativeTestJSON-1424485299 tempest-ImagesDeleteNegativeTestJSON-1424485299-project] 10.222.0.20 "DELETE /compute/v2.1/images/eba7e084-505c-4e00-85af-65485a110ff9" status: 404 len: 62 microversion: 2.1 time: 0.069496 Oct 12 22:55:34.680832 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2223/4312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:34 2022] DELETE /compute/v2.1/images/eba7e084-505c-4e00-85af-65485a110ff9 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:55:34.777898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:34.790061 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-591f417f-37db-47a6-bf30-5f59f781a08f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1490 microversion: 2.1 time: 0.248834 Oct 12 22:55:34.791048 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2090/4313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:34 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1490 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:34.966573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2009637094", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d66ee827-cdbf-47c7-bea5-6c5ad2e47941"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:35.067000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:55:35.993640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:55:35.994295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:55:35.994604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:55:35.995023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:55:35.995445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:55:36.011459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:36.011986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:36.012431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:36.013168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:36.013626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:36.014061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:36.066891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:36.081196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:36.114960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:55:36.117512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:55:36.181454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d36473e5-8747-4427-8937-9003c089c033 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224649 Oct 12 22:55:36.182386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2224/4314] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:55:36.195926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a50614b8-a681-46e9-884c-230c3d390ba0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:36.196912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a50614b8-a681-46e9-884c-230c3d390ba0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:36.390329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c2288f6b-b1cf-4c2e-aeca-3053ca3c59d2 req-2b74fa5a-db8f-46c0-930d-4499090d5d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-plugged", "status": "completed", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:36.415350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c2288f6b-b1cf-4c2e-aeca-3053ca3c59d2 req-2b74fa5a-db8f-46c0-930d-4499090d5d5e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:36.424115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c2288f6b-b1cf-4c2e-aeca-3053ca3c59d2 req-2b74fa5a-db8f-46c0-930d-4499090d5d5e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:36.424934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c2288f6b-b1cf-4c2e-aeca-3053ca3c59d2 req-2b74fa5a-db8f-46c0-930d-4499090d5d5e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:36.448300 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c2288f6b-b1cf-4c2e-aeca-3053ca3c59d2 req-2b74fa5a-db8f-46c0-930d-4499090d5d5e service nova] Creating event network-vif-plugged:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:55:36.461686 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c2288f6b-b1cf-4c2e-aeca-3053ca3c59d2 req-2b74fa5a-db8f-46c0-930d-4499090d5d5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074759 Oct 12 22:55:36.462927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2225/4315] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:36.482552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a50614b8-a681-46e9-884c-230c3d390ba0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:36.494593 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a50614b8-a681-46e9-884c-230c3d390ba0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1209 microversion: 2.1 time: 0.303948 Oct 12 22:55:36.508513 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2091/4316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:36 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1209 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:37.522799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:37.523938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:37.556902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:37.557418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:37.562061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:37.565212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:37.568191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:37.568842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:38.240576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:38.253353 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-51c755d2-3e7f-4c91-a4ad-5957939c0445 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1261 microversion: 2.1 time: 0.737826 Oct 12 22:55:38.260890 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2226/4317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:37 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1261 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:39.278876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:39.280304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:39.292294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:39.293683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:39.295786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:39.297396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:39.299270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:39.299711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:39.564862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:39.581943 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d97f08c-14ea-46fb-8f5f-3aef1a60c5c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1267 microversion: 2.1 time: 0.304135 Oct 12 22:55:39.587687 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2092/4318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:39 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:40.615955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:40.618308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:40.637388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:40.637953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:40.638415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:40.639183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:40.639651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:40.640127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:40.744678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:41.755163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:41.775682 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aecde9e5-c869-4442-859e-208b4c5210a7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 1.159082 Oct 12 22:55:41.778914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2227/4319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:40 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:42.807373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:42.808227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:42.821400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:42.821905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:42.824199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:42.827045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:42.827544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:42.828021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:43.435583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:43.445462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47c1d379-86b6-4f93-8ddc-49c859522d10 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.644004 Oct 12 22:55:43.459934 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2093/4320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:42 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:44.160094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a7c3e177-3b16-45e1-b666-4e46ee6f726a req-f9ba7a25-93a5-4528-9cef-41185c1305a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfb8f9f4-0bea-47e2-8d9b-60150b994572", "tag": "b6b4a9dc-320f-4fa1-b0a2-cf7e40e2c05e"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:44.190347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a7c3e177-3b16-45e1-b666-4e46ee6f726a req-f9ba7a25-93a5-4528-9cef-41185c1305a9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:44.190841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a7c3e177-3b16-45e1-b666-4e46ee6f726a req-f9ba7a25-93a5-4528-9cef-41185c1305a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:44.191277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a7c3e177-3b16-45e1-b666-4e46ee6f726a req-f9ba7a25-93a5-4528-9cef-41185c1305a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:44.237035 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a7c3e177-3b16-45e1-b666-4e46ee6f726a req-f9ba7a25-93a5-4528-9cef-41185c1305a9 service nova] Creating event network-changed:b6b4a9dc-320f-4fa1-b0a2-cf7e40e2c05e for instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 on n-h2-860864-8 Oct 12 22:55:44.253868 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a7c3e177-3b16-45e1-b666-4e46ee6f726a req-f9ba7a25-93a5-4528-9cef-41185c1305a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099953 Oct 12 22:55:44.255118 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2228/4321] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:55:44.488691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:44.490023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:44.523084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:44.523735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:44.524223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:44.525122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:44.525677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:44.525819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:45.322375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:45.330965 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f8c0e84-3fbb-4002-bd89-43c715562440 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.849260 Oct 12 22:55:45.353188 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2094/4322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:44 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:46.362643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:46.364446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=22 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:46.369466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:46.371696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:46.390268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:46.404193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:46.404955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:46.405907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:46.406540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:46.407150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:47.080057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:47.114974 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9596cd73-cfed-4aaf-b389-c99abe39deef tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.743899 Oct 12 22:55:47.130359 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2229/4323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:46 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:48.138134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:48.139430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:48.143120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=30 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:48.160635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:48.162796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:48.163417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:48.164384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:48.165015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:48.165627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:48.759039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:48.768330 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c7c2f6b-4121-4b4e-8cf6-0fbe3ed7e1a6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.633980 Oct 12 22:55:48.769716 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2095/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:48 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:49.796922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:49.797549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:49.820309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:49.820881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:49.821178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:49.821891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:49.822340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:49.822759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:50.424550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:50.442321 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0410ca7d-dfdb-465e-b4f7-d095d2d91a6b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.647307 Oct 12 22:55:50.447141 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2230/4325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:49 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:50.587299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:50.587947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:50.608494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:50.608985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:50.609427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:50.610162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:50.635018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:50.639009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:51.470590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:51.471216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:51.484852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:51.489575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:51.490371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:51.492153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:51.495012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:51.495973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:51.838684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:51.856498 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cab2f069-dc76-404e-930f-615950c5abe4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.390114 Oct 12 22:55:51.858786 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2231/4326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:51 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:52.111067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:52.132619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:52.140209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:52.142774 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6936925c-653f-432b-977a-f6b660540d4d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2936 microversion: 2.32 time: 1.562186 Oct 12 22:55:52.143824 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2096/4327] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:55:50 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2936 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:55:52.176662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:52.177412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:52.186169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.186954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.187576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.188806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.189456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.190255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.355729 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c84cf6be-dd58-4b54-82c7-78168fabe12b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.183198 Oct 12 22:55:52.367077 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2232/4328] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 22:55:52 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5/os-interface => generated 1831 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:55:52.884384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:52.886265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:52.901463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.902005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.902747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:52.907517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:52.908817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:52.910996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:53.601378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:53.622562 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-69c6ed9c-4ce2-4a07-9c70-2d53671e420e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.742186 Oct 12 22:55:53.623727 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2097/4329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:52 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:54.660422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:54.662026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:54.673549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:54.675242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:54.676162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:54.677108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:54.679269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:54.679944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:54.967110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:54.979471 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b64a15a2-8320-4667-b5c9-2436bfcf4ad4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.331030 Oct 12 22:55:54.980598 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2233/4330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:54 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:56.014308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:56.014939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:56.029154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:56.029990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:56.031224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:56.032429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:56.033972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:56.034629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:56.278150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-603e94b8-d440-43be-836b-790f4fc76925 req-e262bb5e-53c1-4914-9a26-c5df54699d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb8f9f4-0bea-47e2-8d9b-60150b994572", "name": "network-vif-plugged", "status": "completed", "tag": "b6b4a9dc-320f-4fa1-b0a2-cf7e40e2c05e"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:56.317590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-603e94b8-d440-43be-836b-790f4fc76925 req-e262bb5e-53c1-4914-9a26-c5df54699d12 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:56.327083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-603e94b8-d440-43be-836b-790f4fc76925 req-e262bb5e-53c1-4914-9a26-c5df54699d12 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:56.331867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-603e94b8-d440-43be-836b-790f4fc76925 req-e262bb5e-53c1-4914-9a26-c5df54699d12 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:56.387594 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-603e94b8-d440-43be-836b-790f4fc76925 req-e262bb5e-53c1-4914-9a26-c5df54699d12 service nova] Creating event network-vif-plugged:b6b4a9dc-320f-4fa1-b0a2-cf7e40e2c05e for instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 on n-h2-860864-8 Oct 12 22:55:56.414131 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-603e94b8-d440-43be-836b-790f4fc76925 req-e262bb5e-53c1-4914-9a26-c5df54699d12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139840 Oct 12 22:55:56.421257 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2234/4331] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:55:56.905100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:56.917795 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a82cc0cd-f537-4fb0-b90b-cad6d6736022 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.914939 Oct 12 22:55:56.921991 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2098/4332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:55 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:57.255635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-070b61cf-87e4-4295-94a0-815ae749e72e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44ffc7de50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-693038617", "description": "tempest-description-1774120380"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:57.617876 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-070b61cf-87e4-4295-94a0-815ae749e72e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.477177 Oct 12 22:55:57.631556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3cd8789-b368-4409-a76c-67be51375365 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44fec5b820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1333345756", "description": "tempest-description-1563893154"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:57.632556 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2235/4333] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:55:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:55:57.944739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:57.945946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:57.964612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:57.967405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:57.968468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:57.970799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:57.980280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:57.981108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:58.385698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:58.391284 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3cd8789-b368-4409-a76c-67be51375365 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.763436 Oct 12 22:55:58.405395 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a91e7d94-57b6-43ff-b638-e04cafdd81d6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1309 microversion: 2.1 time: 0.460441 Oct 12 22:55:58.406125 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2236/4334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:57 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:55:58.407769 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2099/4335] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:55:57 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:55:58.523955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-247968597", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "256ffb36-1fa7-48a5-ad9d-4bb8c741bcb8"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:55:58.660916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] validate_networks() for [('256ffb36-1fa7-48a5-ad9d-4bb8c741bcb8', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:55:59.441453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:59.442323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:59.464422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.464938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.483527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.483527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.483527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.483527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.798640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:55:59.799119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:55:59.799672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:55:59.800179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:55:59.800671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:55:59.803036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:55:59.826892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.827507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.828065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.831738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.832328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.833719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.903882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:55:59.909833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Getting quotas for project 8f26c248bd284a3c86930342bee327a3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:55:59.927284 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb16634b-34eb-4bcf-bb14-5bfb57364f5c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1491 microversion: 2.1 time: 0.502389 Oct 12 22:55:59.927908 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2100/4336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:59 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1491 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:55:59.929600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Getting quotas for user cb0b3f174f9e482985ca9e2f6ab1d07d and project 8f26c248bd284a3c86930342bee327a3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:55:59.952549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:55:59.953160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:55:59.956317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:55:59.962176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:55:59.964485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.964989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.965406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:55:59.966106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:55:59.966552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:55:59.966972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:00.074068 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-efd8b40a-ed3b-44d9-b313-83a20d6f8fb7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554992 Oct 12 22:56:00.076542 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2237/4337] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:56:00.088127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9dbb5d9-0981-428b-ab79-1232d26d774b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:00.089131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9dbb5d9-0981-428b-ab79-1232d26d774b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:00.196233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9dbb5d9-0981-428b-ab79-1232d26d774b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:00.205262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9dbb5d9-0981-428b-ab79-1232d26d774b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1215 microversion: 2.1 time: 0.119379 Oct 12 22:56:00.206295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2238/4338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:00 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:00.412704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:00.431462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0333bd0c-1285-44fd-abbf-38428782fc7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1490 microversion: 2.1 time: 0.475114 Oct 12 22:56:00.432198 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2101/4339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:55:59 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1490 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:00.458915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:00.459591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:00.483742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:00.486754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:00.487933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:00.488863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:00.490180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:00.492605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:00.976080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:00.990738 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be7b003f-049d-4c1f-a047-51d28b68d6e5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1491 microversion: 2.1 time: 0.531052 Oct 12 22:56:00.991384 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2239/4340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:00 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1491 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:01.019256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:01.019800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:01.038280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:01.039093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:01.040371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:01.041283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:01.041902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:01.042488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:01.103031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:56:01.233549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-06ce126b-0404-4a4d-aada-39d56615cf84 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:01.235376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-06ce126b-0404-4a4d-aada-39d56615cf84 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:01.285673 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-349f541d-e699-495e-a42d-2190881acd78 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 204 len: 0 microversion: 2.1 time: 0.271667 Oct 12 22:56:01.287058 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2102/4341] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:56:01 2022] DELETE /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:56:01.296547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:01.298062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:01.313776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:01.314538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:01.315248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:01.318159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:01.318845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:01.319618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:01.452381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-06ce126b-0404-4a4d-aada-39d56615cf84 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:01.461540 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-06ce126b-0404-4a4d-aada-39d56615cf84 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1215 microversion: 2.1 time: 0.233288 Oct 12 22:56:01.470403 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2240/4342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:01 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:02.022618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:02.030878 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-613dfcc9-a7fe-4ddd-be87-f89a28a66c28 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1497 microversion: 2.1 time: 0.739567 Oct 12 22:56:02.038828 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2103/4343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:01 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1497 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:02.495126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:02.495779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:02.517301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:02.520075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:02.520958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:02.521890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:02.525649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:02.526113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:02.817395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:02.841455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1e86548-c6c8-4aa9-8b09-77c8ac35fbfb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1267 microversion: 2.1 time: 0.347650 Oct 12 22:56:02.842141 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2241/4344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:02 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:03.065902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:03.067453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:03.085380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:03.107097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:03.108873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:03.109975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:03.117919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:03.123630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:03.130229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:03.875405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:03.876323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:03.891535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:03.892336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:03.892892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:03.893737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:03.895363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:03.898126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:04.068570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:04.089079 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d63c0a7-d1a0-4542-8179-a1b3bd0c4252 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 200 len: 1497 microversion: 2.1 time: 1.028079 Oct 12 22:56:04.089988 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2104/4345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:03 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 1497 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:04.098967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-66cafd21-779a-4a47-8e09-cd187d9a395f req-e8e59ba2-d0b4-483b-9a7d-f2b5a3942655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb8f9f4-0bea-47e2-8d9b-60150b994572", "name": "network-vif-deleted", "tag": "b6b4a9dc-320f-4fa1-b0a2-cf7e40e2c05e"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:04.137163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66cafd21-779a-4a47-8e09-cd187d9a395f req-e8e59ba2-d0b4-483b-9a7d-f2b5a3942655 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:04.138033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66cafd21-779a-4a47-8e09-cd187d9a395f req-e8e59ba2-d0b4-483b-9a7d-f2b5a3942655 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:04.138773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:04.139425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66cafd21-779a-4a47-8e09-cd187d9a395f req-e8e59ba2-d0b4-483b-9a7d-f2b5a3942655 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:04.150507 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef61a7c4-179c-45de-92eb-93351adf127a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1273 microversion: 2.1 time: 0.283308 Oct 12 22:56:04.155710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-66cafd21-779a-4a47-8e09-cd187d9a395f req-e8e59ba2-d0b4-483b-9a7d-f2b5a3942655 service nova] Creating event network-vif-deleted:b6b4a9dc-320f-4fa1-b0a2-cf7e40e2c05e for instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 on n-h2-860864-8 Oct 12 22:56:04.166163 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-66cafd21-779a-4a47-8e09-cd187d9a395f req-e8e59ba2-d0b4-483b-9a7d-f2b5a3942655 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073663 Oct 12 22:56:04.167265 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2105/4346] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:04.187215 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2242/4347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:03 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:05.118960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:05.120312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:05.138197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.138691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.139129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.139835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.140306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.140769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.195285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:05.196007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:05.204156 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:56:05.208298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 HTTP/1.1 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'bfb8f9f4-0bea-47e2-8d9b-60150b994572'} Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:05.212689 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:05.220898 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:05.220898 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:05.220898 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:05.220898 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:05.220898 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:05.220898 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:56:05.220898 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:05.221429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.221429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.221429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.221429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.229866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.239122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:05.242089 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32737597-4bb5-4e18-b918-ffbcfaf777b2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 404 len: 111 microversion: 2.1 time: 0.127891 Oct 12 22:56:05.243125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:05.246955 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2243/4348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:05 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:56:05.292526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:05.293835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:05.303142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.306840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.308319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.309469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.313036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.313925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.376857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:05.390145 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6ddff46-c1e7-45eb-9eb1-805329fcc060 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1273 microversion: 2.1 time: 0.198882 Oct 12 22:56:05.396695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:56:05.398179 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2106/4349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:05 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:05.603319 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ae7b5ff-c9cb-4262-b4fd-5d9152662c89 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 204 len: 0 microversion: 2.1 time: 0.338606 Oct 12 22:56:05.604891 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2244/4350] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:56:05 2022] DELETE /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:56:05.614229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:05.615089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:05.622687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.628957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.632155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:05.634533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:05.638395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:05.640556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:06.427277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:06.428424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:06.440688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:06.441297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:06.442692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:06.445705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:06.446256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:06.449586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:06.681164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:06.690924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be4792e9-3503-4abf-ac4a-a89846d55c39 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.272465 Oct 12 22:56:06.691997 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2245/4351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:06 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:06.857182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:06.873666 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-555bbf59-910a-4a4c-9f8e-a657cac70aa6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1496 microversion: 2.1 time: 1.264321 Oct 12 22:56:06.877445 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2107/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:05 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1496 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:07.435514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:07.436164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:07.452617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:07.453671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:07.454111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:07.465010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:07.465815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:07.466430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:07.713740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:07.714359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:07.729309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:07.729801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:07.730445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:07.731317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:07.731972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:07.732561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:07.841685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:07.868687 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6cc5ed6d-1cee-46c6-9993-20959f7efca8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.436272 Oct 12 22:56:07.873676 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2246/4353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:07 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:07.884162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4a2a2332-d003-4420-a4ca-cdf4b27cc046 req-5b9ac2f6-a737-4405-af77-1adda389e2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abe2aa3-5fb8-4c1c-855a-3de4a40b1997", "name": "network-vif-deleted", "tag": "e884a401-1de9-4ab9-8292-ed20465a7804"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:07.901012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4a2a2332-d003-4420-a4ca-cdf4b27cc046 req-5b9ac2f6-a737-4405-af77-1adda389e2e5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:07.901886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4a2a2332-d003-4420-a4ca-cdf4b27cc046 req-5b9ac2f6-a737-4405-af77-1adda389e2e5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:07.902549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4a2a2332-d003-4420-a4ca-cdf4b27cc046 req-5b9ac2f6-a737-4405-af77-1adda389e2e5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:07.926041 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4a2a2332-d003-4420-a4ca-cdf4b27cc046 req-5b9ac2f6-a737-4405-af77-1adda389e2e5 service nova] Creating event network-vif-deleted:e884a401-1de9-4ab9-8292-ed20465a7804 for instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 on n-h2-860864-8 Oct 12 22:56:07.935774 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4a2a2332-d003-4420-a4ca-cdf4b27cc046 req-5b9ac2f6-a737-4405-af77-1adda389e2e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059175 Oct 12 22:56:07.947454 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2247/4354] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:07.954240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-226236114"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:07.957067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:07.968516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:07.969406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:07.970177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:07.971195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:07.971883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:07.973108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:08.233472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:08.246338 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41ed0976-dd56-4bb0-a21d-461bb236a95f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.536141 Oct 12 22:56:08.267701 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2108/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:07 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:08.275223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:08.276339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:08.286064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:08.286950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:08.287851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:08.292041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:08.292924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:08.293627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:08.326309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:08.360616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:08.361584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:08.362299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:08.362958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lazy-loading 'fault' on Instance uuid 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:56:08.366949 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35ddc46e-838c-42e8-847f-00679524019b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.417320 Oct 12 22:56:08.368004 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2248/4356] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:07 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 22:56:08.625748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:08.643068 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94502d09-4068-4efa-8829-a09f8049b727 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 200 len: 1299 microversion: 2.1 time: 0.373201 Oct 12 22:56:08.648118 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2109/4357] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:08 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 1299 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:09.090122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a1b8b6d4-b39a-4140-8cc5-85f32d2cbc86 req-4a6764e7-f7f9-4e8d-a4bf-96669d7aa74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b803444-451e-4840-81a0-8b207b378222", "tag": "f8c7b006-7a37-4818-8fa0-1873e27f6eb5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:09.100631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a1b8b6d4-b39a-4140-8cc5-85f32d2cbc86 req-4a6764e7-f7f9-4e8d-a4bf-96669d7aa74e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:09.101110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a1b8b6d4-b39a-4140-8cc5-85f32d2cbc86 req-4a6764e7-f7f9-4e8d-a4bf-96669d7aa74e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:09.101543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a1b8b6d4-b39a-4140-8cc5-85f32d2cbc86 req-4a6764e7-f7f9-4e8d-a4bf-96669d7aa74e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:09.115750 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a1b8b6d4-b39a-4140-8cc5-85f32d2cbc86 req-4a6764e7-f7f9-4e8d-a4bf-96669d7aa74e service nova] Creating event network-changed:f8c7b006-7a37-4818-8fa0-1873e27f6eb5 for instance 8b803444-451e-4840-81a0-8b207b378222 on n-h1-860864-8 Oct 12 22:56:09.120565 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a1b8b6d4-b39a-4140-8cc5-85f32d2cbc86 req-4a6764e7-f7f9-4e8d-a4bf-96669d7aa74e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Oct 12 22:56:09.121535 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2249/4358] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:09.273310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:09.274229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:09.282514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:09.283004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:09.283434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:09.284329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:09.284785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:09.285207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:09.673578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:09.676906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:09.687208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:09.688564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:09.689028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:09.689866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:09.690352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:09.690635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:09.707380 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 HTTP/1.1 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1abe2aa3-5fb8-4c1c-855a-3de4a40b1997'} Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:09.711477 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c399428-f41f-4d58-8cad-40666ed953e1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 404 len: 111 microversion: 2.1 time: 0.047668 Oct 12 22:56:09.724813 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2250/4359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:09 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:56:09.901826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-72855530", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d66ee827-cdbf-47c7-bea5-6c5ad2e47941"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:09.922726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:09.965282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:56:10.016637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:10.027065 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0c0784c8-f866-4bed-a792-0dfa5bcf8dbc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.759398 Oct 12 22:56:10.027950 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2110/4360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:09 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:10.048413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-306686", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8fe72f6a-e073-4cc6-81d4-8127ffd7ee09", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:10.199242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:56:10.580520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:56:10.581005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:56:10.581913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:56:10.582451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:56:10.582745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:56:10.595372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:10.595867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:10.596339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:10.597070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:10.598125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:10.598567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:10.632416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:56:10.638852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:56:10.653741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:56:10.656557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:56:10.763552 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-774e8513-25fa-44b3-a6d6-48181d32bf66 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865236 Oct 12 22:56:10.767176 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2251/4361] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:56:10.777347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a4e3c55a-b827-4e50-84e7-f80333b91d4b req-ca3da494-7de5-436c-bc2c-69d6b875f689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-unplugged", "status": "completed", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:10.801103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4e3c55a-b827-4e50-84e7-f80333b91d4b req-ca3da494-7de5-436c-bc2c-69d6b875f689 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:10.802230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4e3c55a-b827-4e50-84e7-f80333b91d4b req-ca3da494-7de5-436c-bc2c-69d6b875f689 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:10.802888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4e3c55a-b827-4e50-84e7-f80333b91d4b req-ca3da494-7de5-436c-bc2c-69d6b875f689 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:10.816349 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a4e3c55a-b827-4e50-84e7-f80333b91d4b req-ca3da494-7de5-436c-bc2c-69d6b875f689 service nova] Creating event network-vif-unplugged:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:56:10.822141 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a4e3c55a-b827-4e50-84e7-f80333b91d4b req-ca3da494-7de5-436c-bc2c-69d6b875f689 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048391 Oct 12 22:56:10.822761 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2252/4362] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:10.830180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d016151-a48e-4de8-9816-0300dc089397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:10.832905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d016151-a48e-4de8-9816-0300dc089397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:10.898131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d016151-a48e-4de8-9816-0300dc089397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:10.906448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d016151-a48e-4de8-9816-0300dc089397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1207 microversion: 2.1 time: 0.081878 Oct 12 22:56:10.907397 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2253/4363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:10 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1207 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:11.052817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:11.053479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:11.066672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:11.069053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:11.069516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:11.070244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:11.073790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:11.074331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:11.389942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:56:11.390461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:56:11.391027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:56:11.391958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:56:11.394357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:56:11.413206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:11.413697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:11.416274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:11.420411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:11.421161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:11.423421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:11.458956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:11.473480 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0332b5b1-b797-4eef-99f6-bd7787caaca1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.420980 Oct 12 22:56:11.474130 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2254/4364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:11 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:11.495978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:56:11.507782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:56:11.524521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:56:11.526969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8fe72f6a-e073-4cc6-81d4-8127ffd7ee09',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:56:11.628334 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53a6fe58-6932-47e6-a429-ee8bd4d1cc43 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594928 Oct 12 22:56:11.634660 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2111/4365] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:56:11.641424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d3b4720-91cf-4e51-9e21-92dcfa1e4579 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:11.642071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d3b4720-91cf-4e51-9e21-92dcfa1e4579 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:11.818340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d3b4720-91cf-4e51-9e21-92dcfa1e4579 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:11.825656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d3b4720-91cf-4e51-9e21-92dcfa1e4579 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1053 microversion: 2.1 time: 0.188808 Oct 12 22:56:11.841084 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2255/4366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:11 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1053 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:11.931852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:11.932718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:11.950868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:11.953507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:11.953974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:11.954719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:11.955181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:11.955609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:12.116617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:12.124366 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-543b6573-8253-4873-a121-5487dde274d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1259 microversion: 2.1 time: 0.196511 Oct 12 22:56:12.136304 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2112/4367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:11 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:12.510959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:12.512312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:12.540835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:12.541331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:12.548597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:12.552819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:12.553342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:12.553784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:12.849297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:12.849921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:12.861195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:12.861697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:12.862263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:12.865506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:12.866018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:12.866460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:13.019993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:13.028906 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f2a1162c-b02a-446e-858d-57c2e2dab15f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1105 microversion: 2.1 time: 0.183805 Oct 12 22:56:13.029499 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2113/4368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:12 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1105 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:13.060895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:13.076643 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4912944f-e4d6-4480-a18a-8ab9f6311be2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.581440 Oct 12 22:56:13.079482 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2256/4369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:12 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:13.150628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:13.151387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:13.159321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:13.165870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:13.166569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:13.167550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:13.168510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:13.169181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:13.548515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:13.570042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d4e4a137-4b19-4ea8-ae28-f56d3f2cbfc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1265 microversion: 2.1 time: 0.420096 Oct 12 22:56:13.588954 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2114/4370] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:13 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1265 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:14.057519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:14.060763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:14.089068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:14.098108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:14.098854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:14.102993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:14.103227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:14.103726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:14.104719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:14.107345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:14.117869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:14.119804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:14.123171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:14.125635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:14.128158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:14.132668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:14.390543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:14.424006 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-223c3ba0-49f2-4fda-9f0f-ee923a57623b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1123 microversion: 2.1 time: 0.370080 Oct 12 22:56:14.425964 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2257/4371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:14 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1123 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:14.594427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:14.596363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:14.620408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:14.620898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:14.621340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:14.622059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:14.632809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:14.633441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:14.733540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:14.744038 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a835cbf8-89a0-4182-92dc-3950fc4e3e80 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.645823 Oct 12 22:56:14.764292 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2115/4372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:14 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:15.455087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:15.455734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:15.470251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:15.477061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:15.480931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:15.485105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:15.486289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:15.493955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:15.641359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:15.653816 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-339c16a8-6860-4ddc-980b-de3732481280 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 1.064221 Oct 12 22:56:15.656223 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2258/4373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:14 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:15.672400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3a66d543-e7f0-48b4-b321-06d05a346301 req-57a04912-c79a-4ea8-a7a7-2f7a755beacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-plugged", "status": "completed", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:15.700322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3a66d543-e7f0-48b4-b321-06d05a346301 req-57a04912-c79a-4ea8-a7a7-2f7a755beacd service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:15.701785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3a66d543-e7f0-48b4-b321-06d05a346301 req-57a04912-c79a-4ea8-a7a7-2f7a755beacd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:15.704221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3a66d543-e7f0-48b4-b321-06d05a346301 req-57a04912-c79a-4ea8-a7a7-2f7a755beacd service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:15.728682 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3a66d543-e7f0-48b4-b321-06d05a346301 req-57a04912-c79a-4ea8-a7a7-2f7a755beacd service nova] Creating event network-vif-plugged:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:56:15.742427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:15.749716 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3a66d543-e7f0-48b4-b321-06d05a346301 req-57a04912-c79a-4ea8-a7a7-2f7a755beacd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090126 Oct 12 22:56:15.750978 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9bb1029d-051a-4ed9-aaa5-a0bfb4eac24e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1123 microversion: 2.1 time: 0.300662 Oct 12 22:56:15.752801 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2259/4374] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:15.773876 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2116/4375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:15 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1123 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:15.777894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:15.778595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:15.807777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:15.807964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:15.814018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:15.814879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:15.815357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:15.819265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:16.426463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:16.435458 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ffcb056-d71d-4554-a11e-2fdff48750a9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.661808 Oct 12 22:56:16.442931 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2260/4376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:15 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:16.681644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:16.682854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:16.695084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:16.698019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:16.698839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:16.699742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:16.701935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:16.702664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:16.786478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:16.788752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:16.801170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:16.802078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:16.802843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:16.804032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:16.804660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:16.805345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:17.199312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:17.216256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:17.218804 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ee89aa82-f983-4ce1-8065-6bf2b5af2849 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 0.539492 Oct 12 22:56:17.223130 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2117/4377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:16 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:17.234981 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d6d7d44e-c35c-4aff-8998-3af6eda7c531 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.453446 Oct 12 22:56:17.252519 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2261/4378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:16 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:17.470815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:17.471765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:17.493856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:17.494669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:17.495595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:17.496885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:17.497547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:17.499169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:17.986700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:17.999608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-df0c7e94-d224-48ce-87fc-9a5c0348dd29 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.531769 Oct 12 22:56:18.001236 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2118/4379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:17 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:18.247422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:18.248709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:18.258754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:18.263767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:18.266573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:18.268040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:18.274048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:18.274570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:18.279069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:18.280374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:18.292882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:18.293801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:18.295118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:18.299160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:18.300444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:18.301183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:18.807362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:18.817082 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7abb47f3-2c7b-47ab-9546-650a98a07120 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.542133 Oct 12 22:56:18.821296 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2119/4380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:18 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:18.831847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e70125f0-fb5b-468e-925e-00941aa59638 req-dda6c192-4d79-4a03-840c-d5ed9e339481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b803444-451e-4840-81a0-8b207b378222", "name": "network-vif-plugged", "status": "completed", "tag": "f8c7b006-7a37-4818-8fa0-1873e27f6eb5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:18.858225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e70125f0-fb5b-468e-925e-00941aa59638 req-dda6c192-4d79-4a03-840c-d5ed9e339481 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:18.859478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e70125f0-fb5b-468e-925e-00941aa59638 req-dda6c192-4d79-4a03-840c-d5ed9e339481 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:18.860842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e70125f0-fb5b-468e-925e-00941aa59638 req-dda6c192-4d79-4a03-840c-d5ed9e339481 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:18.886046 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e70125f0-fb5b-468e-925e-00941aa59638 req-dda6c192-4d79-4a03-840c-d5ed9e339481 service nova] Creating event network-vif-plugged:f8c7b006-7a37-4818-8fa0-1873e27f6eb5 for instance 8b803444-451e-4840-81a0-8b207b378222 on n-h1-860864-8 Oct 12 22:56:18.901572 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e70125f0-fb5b-468e-925e-00941aa59638 req-dda6c192-4d79-4a03-840c-d5ed9e339481 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078776 Oct 12 22:56:18.902488 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2120/4381] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:18.911521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-17b4bfb8-15e1-4a8b-87af-048f6ad13e5e req-46740d48-8461-4d63-b946-5ae899d106e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adaacc3-adb1-4645-9e7a-047616d8a877", "tag": "557ddd41-7aa2-4934-a6b6-adae690a8ddf"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:18.964567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-17b4bfb8-15e1-4a8b-87af-048f6ad13e5e req-46740d48-8461-4d63-b946-5ae899d106e1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:18.967517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-17b4bfb8-15e1-4a8b-87af-048f6ad13e5e req-46740d48-8461-4d63-b946-5ae899d106e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:18.970406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-17b4bfb8-15e1-4a8b-87af-048f6ad13e5e req-46740d48-8461-4d63-b946-5ae899d106e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:19.001331 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-17b4bfb8-15e1-4a8b-87af-048f6ad13e5e req-46740d48-8461-4d63-b946-5ae899d106e1 service nova] Creating event network-changed:557ddd41-7aa2-4934-a6b6-adae690a8ddf for instance 7adaacc3-adb1-4645-9e7a-047616d8a877 on n-h2-860864-8 Oct 12 22:56:19.010196 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-17b4bfb8-15e1-4a8b-87af-048f6ad13e5e req-46740d48-8461-4d63-b946-5ae899d106e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106001 Oct 12 22:56:19.011200 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2121/4382] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:19.024313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:19.024966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:19.036764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:19.040950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:19.041407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:19.042138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:19.042595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:19.043028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:19.144805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:19.159025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d8d56a7-d004-4272-b65a-bae480c8fb69 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 0.915810 Oct 12 22:56:19.165648 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2262/4383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:18 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:19.353878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:19.366768 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19ca5d4e-7eec-4642-a46d-54eea130b88f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.347142 Oct 12 22:56:19.367389 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2122/4384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:19 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:19.844941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:19.845490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:19.857946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:19.859610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:19.860119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:19.861008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:19.861471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:19.861974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:20.121195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:20.133904 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2cc400a-588d-49b6-9bcc-84cab4019276 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.292811 Oct 12 22:56:20.143993 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2263/4385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:19 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:20.192817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:20.193722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:20.208174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:20.208906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:20.209362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:20.210089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:20.210545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:20.212844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:20.394098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:20.394715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:20.417121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:20.418146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:20.421820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:20.423266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:20.425177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:20.425890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:20.610170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:20.649881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:20.665289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b495527b-b493-48b5-aaba-4ffec873df62 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 0.476585 Oct 12 22:56:20.680470 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2123/4386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:20 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:21.144981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-86b59f9f-54c7-4b30-93a1-e2fa9bd3c249 req-f846fe22-0709-4815-9739-dab64570fb69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984f1775-6842-4f0a-b001-2d6cfc44a8e1", "tag": "eaf8c85a-91ec-4b43-ae2f-c944803ad7d9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:21.165782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-86b59f9f-54c7-4b30-93a1-e2fa9bd3c249 req-f846fe22-0709-4815-9739-dab64570fb69 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:21.166185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-86b59f9f-54c7-4b30-93a1-e2fa9bd3c249 req-f846fe22-0709-4815-9739-dab64570fb69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:21.166617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-86b59f9f-54c7-4b30-93a1-e2fa9bd3c249 req-f846fe22-0709-4815-9739-dab64570fb69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:21.194881 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-86b59f9f-54c7-4b30-93a1-e2fa9bd3c249 req-f846fe22-0709-4815-9739-dab64570fb69 service nova] Creating event network-changed:eaf8c85a-91ec-4b43-ae2f-c944803ad7d9 for instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 on n-h2-860864-8 Oct 12 22:56:21.202269 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-86b59f9f-54c7-4b30-93a1-e2fa9bd3c249 req-f846fe22-0709-4815-9739-dab64570fb69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063033 Oct 12 22:56:21.208703 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2124/4387] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:56:21.218427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:21.219140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:21.236867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:21.237366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:21.237807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:21.238515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:21.239053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:21.239377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:21.294866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:21.297084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:21.321657 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e767da3-3876-4451-aece-91c61871725a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1315 microversion: 2.1 time: 0.934391 Oct 12 22:56:21.348078 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2264/4388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:20 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1315 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:21.456387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:21.516816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:21.676405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:21.696138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b53f2e8-7b61-4515-a4f9-22db257e33af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.485725 Oct 12 22:56:21.696992 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2125/4389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:21 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:21.706879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:21.706879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:21.710401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:21.713703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:21.714708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:21.717339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:21.718608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:21.720839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:21.825995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=20 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:22.061150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:22.070538 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f983b6c-937c-48c8-9823-d8cff899595c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 0.378445 Oct 12 22:56:22.073099 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2265/4390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:21 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:22.358675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:22.360070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:22.372217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:22.377756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:22.378446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:22.379818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:22.395578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:22.396180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:22.722777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:22.723405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:22.731130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:22.732203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:22.733177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:22.734337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:22.736765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:22.737586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:22.937953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:22.955873 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a50e6228-5616-4eb6-9af6-a45faf41b904 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1503 microversion: 2.1 time: 0.602249 Oct 12 22:56:22.976379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2126/4391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:22 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1503 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:23.028621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-693038617"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:23.031544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:23.049905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:23.050719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:23.056225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:23.059347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:23.060276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:23.060886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:23.577735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:23.598679 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ddc64735-8fb6-44bd-b7d0-26ac4c31c5fe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.879675 Oct 12 22:56:23.603994 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2266/4392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:22 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:23.606377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:23.607156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:23.622665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:23.627807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:23.628567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:23.632451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:23.633407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:23.634033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:23.634620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:23.750638 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.network.security_group_api [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Adding security group e4efeb58-249c-4bf7-939f-ca7ed02fc366 to port f8c7b006-7a37-4818-8fa0-1873e27f6eb5 Oct 12 22:56:24.102781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:24.114458 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4676faf8-2e9a-44f9-aacc-e67bf4b0c82c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 0.513220 Oct 12 22:56:24.114974 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2267/4393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:23 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:24.460662 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a53d3f67-1c57-4592-9be9-dd8a156b8726 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222/action" status: 202 len: 0 microversion: 2.1 time: 1.442842 Oct 12 22:56:24.461885 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2127/4394] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:23 2022] POST /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222/action => generated 0 bytes in 1446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:24.472290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1333345756"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:24.472589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:24.497301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:24.497799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:24.498240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:24.503724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:24.504455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:24.504919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:24.626019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ed392a0d-5a2c-4e80-9dfc-f39695c538ef req-1e3c19a8-c2f3-4f7b-8dd9-15a3a23c41c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b803444-451e-4840-81a0-8b207b378222", "tag": "f8c7b006-7a37-4818-8fa0-1873e27f6eb5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:24.639477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ed392a0d-5a2c-4e80-9dfc-f39695c538ef req-1e3c19a8-c2f3-4f7b-8dd9-15a3a23c41c7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:24.641260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ed392a0d-5a2c-4e80-9dfc-f39695c538ef req-1e3c19a8-c2f3-4f7b-8dd9-15a3a23c41c7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:24.642019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ed392a0d-5a2c-4e80-9dfc-f39695c538ef req-1e3c19a8-c2f3-4f7b-8dd9-15a3a23c41c7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:24.660694 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ed392a0d-5a2c-4e80-9dfc-f39695c538ef req-1e3c19a8-c2f3-4f7b-8dd9-15a3a23c41c7 service nova] Creating event network-changed:f8c7b006-7a37-4818-8fa0-1873e27f6eb5 for instance 8b803444-451e-4840-81a0-8b207b378222 on n-h1-860864-8 Oct 12 22:56:24.669540 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ed392a0d-5a2c-4e80-9dfc-f39695c538ef req-1e3c19a8-c2f3-4f7b-8dd9-15a3a23c41c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192545 Oct 12 22:56:24.674088 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2128/4395] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:24.700533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:24.701961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:24.723163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:24.727443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:24.728700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:24.730242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:24.732862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:24.734080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:25.002732 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.network.security_group_api [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Adding security group a33fd96c-fe55-4ede-a465-b32347845bbb to port f8c7b006-7a37-4818-8fa0-1873e27f6eb5 Oct 12 22:56:25.175465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:25.183585 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-15c79816-ced1-4a79-9ad4-a2276e66c883 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.507629 Oct 12 22:56:25.192530 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2129/4396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:24 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:25.208619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:25.208619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:25.231058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:25.244594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:25.245249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:25.246009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:25.246478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:25.246905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:25.662171 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ffc42ea6-5d9b-4416-a4dc-32f839f570e5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222/action" status: 202 len: 0 microversion: 2.1 time: 1.194956 Oct 12 22:56:25.663588 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2268/4397] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:24 2022] POST /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222/action => generated 0 bytes in 1197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:25.678523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:25.679457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:25.681275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:25.689659 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cc9f039b-1d67-4980-b294-907d47245891 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 0.495822 Oct 12 22:56:25.692253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2130/4398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:25 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:25.708602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0fc542d8-2e45-4f70-a7ec-286c18318cfa req-6189d612-a8eb-4350-9c07-b5bb42532981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b803444-451e-4840-81a0-8b207b378222", "tag": "f8c7b006-7a37-4818-8fa0-1873e27f6eb5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:25.711815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:25.712355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:25.713356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:25.714262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:25.715803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:25.717383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:25.730329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0fc542d8-2e45-4f70-a7ec-286c18318cfa req-6189d612-a8eb-4350-9c07-b5bb42532981 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:25.736142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0fc542d8-2e45-4f70-a7ec-286c18318cfa req-6189d612-a8eb-4350-9c07-b5bb42532981 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:25.736869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0fc542d8-2e45-4f70-a7ec-286c18318cfa req-6189d612-a8eb-4350-9c07-b5bb42532981 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:25.768745 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0fc542d8-2e45-4f70-a7ec-286c18318cfa req-6189d612-a8eb-4350-9c07-b5bb42532981 service nova] Creating event network-changed:f8c7b006-7a37-4818-8fa0-1873e27f6eb5 for instance 8b803444-451e-4840-81a0-8b207b378222 on n-h1-860864-8 Oct 12 22:56:25.792824 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0fc542d8-2e45-4f70-a7ec-286c18318cfa req-6189d612-a8eb-4350-9c07-b5bb42532981 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087340 Oct 12 22:56:25.794037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2131/4399] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:25.801295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2c8cc684-0eca-445d-b086-b5f542189a2e req-9f4aa731-ac57-40d1-886a-639971f67a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adaacc3-adb1-4645-9e7a-047616d8a877", "name": "network-vif-plugged", "status": "completed", "tag": "557ddd41-7aa2-4934-a6b6-adae690a8ddf"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:25.831281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2c8cc684-0eca-445d-b086-b5f542189a2e req-9f4aa731-ac57-40d1-886a-639971f67a4f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:25.835528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2c8cc684-0eca-445d-b086-b5f542189a2e req-9f4aa731-ac57-40d1-886a-639971f67a4f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:25.836416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2c8cc684-0eca-445d-b086-b5f542189a2e req-9f4aa731-ac57-40d1-886a-639971f67a4f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:25.866857 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2c8cc684-0eca-445d-b086-b5f542189a2e req-9f4aa731-ac57-40d1-886a-639971f67a4f service nova] Creating event network-vif-plugged:557ddd41-7aa2-4934-a6b6-adae690a8ddf for instance 7adaacc3-adb1-4645-9e7a-047616d8a877 on n-h2-860864-8 Oct 12 22:56:25.874828 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2c8cc684-0eca-445d-b086-b5f542189a2e req-9f4aa731-ac57-40d1-886a-639971f67a4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077493 Oct 12 22:56:25.876365 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2132/4400] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:26.227621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:26.228559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:26.237741 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96f2b644-1762-43b5-9a48-e97e8ea9e70e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.567264 Oct 12 22:56:26.238669 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2269/4401] 10.222.0.20 () {58 vars in 1293 bytes} [Wed Oct 12 22:56:25 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222/os-security-groups => generated 1158 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:26.257712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:26.258555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:26.259204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:26.259791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f009d5e0-adc6-4858-a34d-8520a92d9a75 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44ffc7d0d0>, body: {"security_group": {"name": " tempest-securitygroup -1552074479 ", "description": "tempest-description-488788996"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:26.260601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:26.261280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:26.261919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:26.606928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:26.615804 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f27b186c-49aa-4bc4-aba8-d7e7efb659b1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.393102 Oct 12 22:56:26.620221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2133/4402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:26 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:26.716404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:26.722885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:26.738195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:26.742566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:26.747784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:26.749013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:26.749713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:26.750359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:27.140315 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f009d5e0-adc6-4858-a34d-8520a92d9a75 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.886100 Oct 12 22:56:27.142018 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2270/4403] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:56:26 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:27.159175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d37fed54-5181-46cf-9e85-d82b43034516 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44ff4fd430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:27.207715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:27.217645 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56d0622b-3a78-420d-95fc-a027046ef3c2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1307 microversion: 2.1 time: 0.505074 Oct 12 22:56:27.221464 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2134/4404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:26 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1307 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:27.599112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d37fed54-5181-46cf-9e85-d82b43034516 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa" status: 200 len: 223 microversion: 2.1 time: 0.445014 Oct 12 22:56:27.641157 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2271/4405] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:56:27 2022] GET /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa => generated 223 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:56:27.648925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afe62edb-ab91-4d7a-9cdd-eafab0312008 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f4507c1b1f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:27.681753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:27.683209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:27.730045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:27.730711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:27.731157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:27.732166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:27.732343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:27.738317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:27.824006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:28.330633 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afe62edb-ab91-4d7a-9cdd-eafab0312008 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa" status: 202 len: 0 microversion: 2.1 time: 0.704294 Oct 12 22:56:28.335642 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2135/4406] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:56:27 2022] DELETE /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:28.340939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:28.341560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:28.341709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:28.361672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:28.366260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:28.367409 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ba9d0882-f763-48f9-b0dd-36079cb63841 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.722652 Oct 12 22:56:28.368169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:28.373565 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2272/4407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:27 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:28.374780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:28.375282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:28.375726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:28.391291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81578a48-9095-400b-9f12-b820596ae992 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44ff4ffdc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:28.563004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-81578a48-9095-400b-9f12-b820596ae992 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:56:28.564037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-81578a48-9095-400b-9f12-b820596ae992 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group a55de4f1-1904-46a8-b93b-46b04fd738fa not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:56:28.564731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-81578a48-9095-400b-9f12-b820596ae992 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:56:28.564731 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-3716ba23-b9cf-416b-81b1-6677f18a08a4'] Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81578a48-9095-400b-9f12-b820596ae992 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa HTTP/1.1 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-3716ba23-b9cf-416b-81b1-6677f18a08a4'] Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a55de4f1-1904-46a8-b93b-46b04fd738fa'} Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:56:28.567262 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3716ba23-b9cf-416b-81b1-6677f18a08a4'] Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3716ba23-b9cf-416b-81b1-6677f18a08a4'] Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3716ba23-b9cf-416b-81b1-6677f18a08a4'] Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3716ba23-b9cf-416b-81b1-6677f18a08a4'] Oct 12 22:56:28.573050 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:28.583666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81578a48-9095-400b-9f12-b820596ae992 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:56:28.583666 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-3716ba23-b9cf-416b-81b1-6677f18a08a4'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:28.583666 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81578a48-9095-400b-9f12-b820596ae992 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa" status: 404 len: 194 microversion: 2.1 time: 0.203141 Oct 12 22:56:28.583666 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2273/4408] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:56:28 2022] GET /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:56:28.596622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac8ecdd9-903b-41b8-8165-51a0e76d0a5f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44fec53c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-497165048", "description": "tempest-description-1443414615"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:28.754219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:28.763235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37ebb070-e3c5-48a5-a3c0-45be98ccdba6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1489 microversion: 2.1 time: 0.426303 Oct 12 22:56:28.772719 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2136/4409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:28 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1489 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:28.801334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:28.808003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:28.838929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:28.840740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:28.844213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:28.847767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:28.848887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:28.849522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:28.989298 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c75f61d-134d-4073-95bf-d30a8fbc1c2e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "PUT /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1084 microversion: 2.1 time: 0.192313 Oct 12 22:56:28.993578 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2137/4410] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:56:28 2022] PUT /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1084 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:29.022815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:29.023844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:29.032815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:29.033651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:29.038717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:29.039777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:29.040551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:29.041188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:29.223253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac8ecdd9-903b-41b8-8165-51a0e76d0a5f tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.631097 Oct 12 22:56:29.224443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2274/4411] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:56:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:29.238107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90ac35fc-53f6-4067-abaa-204213d392b5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44fec533a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1808483417", "description": "tempest-description-1971918691"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:29.337593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:29.350361 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a9dab5f8-f609-4d32-b0d0-d71daa8b6397 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1510 microversion: 2.1 time: 0.333293 Oct 12 22:56:29.367309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2138/4412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:29 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:29.386793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:29.390061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:29.416112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:29.433253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:29.433253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:29.433878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:29.434324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:29.451459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:29.750686 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90ac35fc-53f6-4067-abaa-204213d392b5 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.517655 Oct 12 22:56:29.752452 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2275/4413] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:56:29 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:29.758365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:29.759875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:29.777513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:29.778071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:29.778507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:29.779434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:29.779937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:29.780371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:30.109941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:30.126410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:30.130841 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-97dbd534-4b42-4e21-83db-215c925274e3 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1510 microversion: 2.1 time: 0.754538 Oct 12 22:56:30.131997 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2139/4414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:29 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1510 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:30.146297 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35e7a620-3e77-4a94-b8c1-5661f69dcebc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.381614 Oct 12 22:56:30.146297 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2276/4415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:29 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:30.156274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-073de72e-d5b0-4248-b5be-0b603172c31c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44ffb83040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-665627147", "description": "tempest-description-909959683"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:30.159328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:30.159831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:30.189260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:30.189739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:30.190711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:30.190862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:30.191288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:30.191704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:30.296983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:56:30.552107 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-073de72e-d5b0-4248-b5be-0b603172c31c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.410720 Oct 12 22:56:30.617460 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2277/4416] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:56:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:30.630347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f701289-4dba-4782-802a-867498c7aaee tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fec53ca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:30.673744 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-406ef87c-eb66-4932-a895-0e48b6b116d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 204 len: 0 microversion: 2.1 time: 0.521927 Oct 12 22:56:30.674562 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2140/4417] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:56:30 2022] DELETE /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:56:30.692451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:30.693271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:30.711760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:30.712298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:30.712739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:30.713463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:30.713918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:30.714334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:31.061585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:31.071847 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-20833eb1-0dee-4ea4-beff-6315762e5f9d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1516 microversion: 2.1 time: 0.392951 Oct 12 22:56:31.072752 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2141/4418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:30 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1516 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:31.153829 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3f701289-4dba-4782-802a-867498c7aaee tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.530867 Oct 12 22:56:31.156119 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2278/4419] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:56:30 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:31.160195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:31.160994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:31.171057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:31.171544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:31.172006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:31.172699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:31.173204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:31.173571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:31.174076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00b1fec4-b75e-417a-b751-941ae6e791c6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fec599d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:31.387004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:31.390330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:31.401459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-db16ebf2-9a87-4f54-9d4c-0685cb728529 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.245129 Oct 12 22:56:31.402043 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2142/4420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:31 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:31.949869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00b1fec4-b75e-417a-b751-941ae6e791c6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8" status: 202 len: 0 microversion: 2.1 time: 0.783986 Oct 12 22:56:31.953466 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2279/4421] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:56:31 2022] DELETE /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8 => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:31.958584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85cada73-30fc-4eb3-bb83-a3daf399c531 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fe9695e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:31.983721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-85cada73-30fc-4eb3-bb83-a3daf399c531 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:56:31.984656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-85cada73-30fc-4eb3-bb83-a3daf399c531 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:56:31.985406 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-85cada73-30fc-4eb3-bb83-a3daf399c531 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:56:31.985406 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d49a7612-11d4-4d49-abe6-eea8d1af879d'] Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85cada73-30fc-4eb3-bb83-a3daf399c531 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8 HTTP/1.1 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d49a7612-11d4-4d49-abe6-eea8d1af879d'] Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'f1071ee7-eabd-4dc7-a5c5-325aad142fe8'} Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:56:31.987651 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d49a7612-11d4-4d49-abe6-eea8d1af879d'] Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d49a7612-11d4-4d49-abe6-eea8d1af879d'] Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d49a7612-11d4-4d49-abe6-eea8d1af879d'] Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d49a7612-11d4-4d49-abe6-eea8d1af879d'] Oct 12 22:56:31.992679 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.000483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85cada73-30fc-4eb3-bb83-a3daf399c531 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:56:32.000483 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-d49a7612-11d4-4d49-abe6-eea8d1af879d'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:32.001685 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-85cada73-30fc-4eb3-bb83-a3daf399c531 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8" status: 404 len: 194 microversion: 2.1 time: 0.046955 Oct 12 22:56:32.002806 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2143/4422] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:56:31 2022] GET /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:56:32.010774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27073a62-6e69-487d-80f3-7a29c1b512d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fec53310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:32.101321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:32.102388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:32.112215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:32.113000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:32.113687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:32.114614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:32.115290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:32.115994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:32.285429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:32.299319 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21f1c371-5862-43c6-94a0-c84e2bd3770a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1516 microversion: 2.1 time: 0.201728 Oct 12 22:56:32.300539 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2144/4423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:32 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:32.429563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:32.430638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:32.433570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:32.440124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:32.442757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:32.443632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:32.444650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:32.445473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:32.446288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:32.641901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:32.657618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3065cc20-b1e8-4298-9bf7-acd695df52f5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.233056 Oct 12 22:56:32.658721 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2145/4424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:32 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:32.791213 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27073a62-6e69-487d-80f3-7a29c1b512d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7" status: 202 len: 0 microversion: 2.1 time: 0.783914 Oct 12 22:56:32.795439 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2280/4425] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:56:32 2022] DELETE /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:32.802031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94e978c8-d722-4701-941d-973ac9f53288 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fe97d5e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:32.841760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-94e978c8-d722-4701-941d-973ac9f53288 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:56:32.843159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-94e978c8-d722-4701-941d-973ac9f53288 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:56:32.844523 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-94e978c8-d722-4701-941d-973ac9f53288 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:56:32.844523 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-3aeb4fdc-57ca-4e7f-bd8b-649d8d3641d2'] Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94e978c8-d722-4701-941d-973ac9f53288 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 HTTP/1.1 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-3aeb4fdc-57ca-4e7f-bd8b-649d8d3641d2'] Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '9ef7b430-2c0c-43f0-a075-fa1fef5eeda7'} Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:56:32.846532 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3aeb4fdc-57ca-4e7f-bd8b-649d8d3641d2'] Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3aeb4fdc-57ca-4e7f-bd8b-649d8d3641d2'] Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3aeb4fdc-57ca-4e7f-bd8b-649d8d3641d2'] Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3aeb4fdc-57ca-4e7f-bd8b-649d8d3641d2'] Oct 12 22:56:32.852433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:32.855569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94e978c8-d722-4701-941d-973ac9f53288 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:56:32.855569 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-3aeb4fdc-57ca-4e7f-bd8b-649d8d3641d2'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:32.860180 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94e978c8-d722-4701-941d-973ac9f53288 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7" status: 404 len: 194 microversion: 2.1 time: 0.060597 Oct 12 22:56:32.862021 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2146/4426] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:56:32 2022] GET /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:56:32.870550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a917d237-7e10-4f5d-a839-dbaba43360de tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44feca9700>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:33.327388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:33.328022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:33.344832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:33.345755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:33.346419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:33.347360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:33.348055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:33.348692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:33.511997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:33.529636 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b365e993-a03b-4d0d-8f09-aeea93865b7b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 200 len: 1474 microversion: 2.1 time: 0.207212 Oct 12 22:56:33.548462 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2147/4427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:33 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 1474 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:33.559808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6003065b-7584-491c-885d-fc7263a7fc2e req-041fdb90-0563-47a3-b57d-4f8c1bb23e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adaacc3-adb1-4645-9e7a-047616d8a877", "name": "network-vif-deleted", "tag": "557ddd41-7aa2-4934-a6b6-adae690a8ddf"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:33.577838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a917d237-7e10-4f5d-a839-dbaba43360de tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d" status: 202 len: 0 microversion: 2.1 time: 0.709955 Oct 12 22:56:33.579122 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2281/4428] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:56:32 2022] DELETE /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:33.583826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6003065b-7584-491c-885d-fc7263a7fc2e req-041fdb90-0563-47a3-b57d-4f8c1bb23e7a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:33.586926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6003065b-7584-491c-885d-fc7263a7fc2e req-041fdb90-0563-47a3-b57d-4f8c1bb23e7a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:33.587541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6003065b-7584-491c-885d-fc7263a7fc2e req-041fdb90-0563-47a3-b57d-4f8c1bb23e7a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:33.605694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6009fadb-c324-4f1c-8d1c-448b3330d931 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44feca91f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:33.616984 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6003065b-7584-491c-885d-fc7263a7fc2e req-041fdb90-0563-47a3-b57d-4f8c1bb23e7a service nova] Creating event network-vif-deleted:557ddd41-7aa2-4934-a6b6-adae690a8ddf for instance 7adaacc3-adb1-4645-9e7a-047616d8a877 on n-h2-860864-8 Oct 12 22:56:33.642018 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6003065b-7584-491c-885d-fc7263a7fc2e req-041fdb90-0563-47a3-b57d-4f8c1bb23e7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086065 Oct 12 22:56:33.642809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2148/4429] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:33.688628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:33.691353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:33.713904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:33.716634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:33.717099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:33.718421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:33.718890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:33.724561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:33.816510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-6009fadb-c324-4f1c-8d1c-448b3330d931 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:56:33.817349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-6009fadb-c324-4f1c-8d1c-448b3330d931 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group 0acae008-4d53-45cf-b03e-00b07dbef09d not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:56:33.817891 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6009fadb-c324-4f1c-8d1c-448b3330d931 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:56:33.817891 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-2824a5b0-87da-46a8-a5f4-d1196d24a1d5'] Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6009fadb-c324-4f1c-8d1c-448b3330d931 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d HTTP/1.1 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-2824a5b0-87da-46a8-a5f4-d1196d24a1d5'] Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '0acae008-4d53-45cf-b03e-00b07dbef09d'} Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:56:33.820098 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2824a5b0-87da-46a8-a5f4-d1196d24a1d5'] Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2824a5b0-87da-46a8-a5f4-d1196d24a1d5'] Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2824a5b0-87da-46a8-a5f4-d1196d24a1d5'] Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2824a5b0-87da-46a8-a5f4-d1196d24a1d5'] Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6009fadb-c324-4f1c-8d1c-448b3330d931 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-2824a5b0-87da-46a8-a5f4-d1196d24a1d5'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6009fadb-c324-4f1c-8d1c-448b3330d931 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d" status: 404 len: 194 microversion: 2.1 time: 0.227139 Oct 12 22:56:33.824705 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2282/4430] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:56:33 2022] GET /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d => generated 194 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:56:33.844024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-672035ec-6191-4d34-aa23-d3f3513067b1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fec53550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:34.109211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:34.119116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12b16c29-ec57-4b44-ad01-84aa0f49f373 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.438173 Oct 12 22:56:34.120042 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2149/4431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:33 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:34.556289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:34.556998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:34.575276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:34.577769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:34.578445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:34.580607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:34.597534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:34.601491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:34.659577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 HTTP/1.1 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7adaacc3-adb1-4645-9e7a-047616d8a877'} Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:34.664174 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:34.671068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:34.671068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:34.671068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:34.671068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:34.671068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:34.671068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:56:34.671068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:56:34.677628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:34.680356 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-062e0200-4fef-4245-8b60-b1f80d31f27f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 404 len: 111 microversion: 2.1 time: 0.129660 Oct 12 22:56:34.683021 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2150/4432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:34 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:56:34.735735 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-672035ec-6191-4d34-aa23-d3f3513067b1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.906452 Oct 12 22:56:34.749916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2283/4433] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 22:56:33 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:34.759185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2e226ba-a0f8-45c9-a268-27d7b951f3f1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44ff7460d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-195216580", "description": "tempest-description-1833593431"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:34.797390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-823020103", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d66ee827-cdbf-47c7-bea5-6c5ad2e47941"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:34.938128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] validate_networks() for [('d66ee827-cdbf-47c7-bea5-6c5ad2e47941', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:56:35.474248 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2e226ba-a0f8-45c9-a268-27d7b951f3f1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.719862 Oct 12 22:56:35.475239 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2151/4434] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:56:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:35.487753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:35.488916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:35.498081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:35.499608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:35.500293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:35.501202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:35.501969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:35.502670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:35.746390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:35.763011 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d12f0af-8d4a-4e3a-8fa4-876c687ca785 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.284855 Oct 12 22:56:35.763874 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2152/4435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:35 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:35.769396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb8989e9-b00c-43f8-8f2a-3033611b3dcc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44ff64bca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1648145849", "description": "tempest-description-1260720339"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:35.848617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:56:35.850263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:56:35.850263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:56:35.850263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:56:35.850563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:56:35.884514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:35.885108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:35.887171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:35.890141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:35.890141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:35.890141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:35.976086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:56:35.997747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Getting quotas for user d6c5b1061fe74546a69f5eadba4dc397 and project abad96e4285d4dd4af35ec5eab9a19be. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:56:36.056936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:56:36.060988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:56:36.195823 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e162a260-2f03-4be6-934e-08fd490312f9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402869 Oct 12 22:56:36.196516 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2284/4436] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:56:36.207635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5851b0a7-6dbd-4a0f-a586-3d164b092358 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:36.210170 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb8989e9-b00c-43f8-8f2a-3033611b3dcc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.444632 Oct 12 22:56:36.211475 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2153/4437] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:56:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:36.216839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5851b0a7-6dbd-4a0f-a586-3d164b092358 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:36.307739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-379942840", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "256ffb36-1fa7-48a5-ad9d-4bb8c741bcb8"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:36.323536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5851b0a7-6dbd-4a0f-a586-3d164b092358 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:36.338694 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5851b0a7-6dbd-4a0f-a586-3d164b092358 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1208 microversion: 2.1 time: 0.134816 Oct 12 22:56:36.340851 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2285/4438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:36 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1208 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:36.405748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] validate_networks() for [('256ffb36-1fa7-48a5-ad9d-4bb8c741bcb8', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:56:36.806908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:36.812072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:36.825381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:36.828111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:36.828986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:36.829607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:36.830070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:36.830498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:37.180410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:56:37.181032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:56:37.181346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:56:37.181760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:56:37.182177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:56:37.225215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:37.226051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:37.226663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:37.227613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:37.228362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:37.229194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:37.290517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Getting quotas for project 8f26c248bd284a3c86930342bee327a3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:56:37.298655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Getting quotas for user cb0b3f174f9e482985ca9e2f6ab1d07d and project 8f26c248bd284a3c86930342bee327a3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:56:37.330152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:56:37.332661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:56:37.406710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a62ccfc-a97a-4d79-8250-7fdf9cc6582a tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106130 Oct 12 22:56:37.408434 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2154/4439] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:56:37.413604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:37.414433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:37.442816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:37.443585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:37.444964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:37.446190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:37.446993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:37.447915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:37.544023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:37.559784 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea37b9de-e019-4a27-a55d-5fd0fc10f1a0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1212 microversion: 2.1 time: 0.150074 Oct 12 22:56:37.562681 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2155/4440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:37 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:37.563804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:37.576128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d450ac73-b77b-4494-8187-f1e88042f76e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:37.576844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d450ac73-b77b-4494-8187-f1e88042f76e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:37.577731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d263d43-cd8d-4bb3-9ee0-2b78f9ffd30f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.788461 Oct 12 22:56:37.597424 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2286/4441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:36 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:37.703658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d450ac73-b77b-4494-8187-f1e88042f76e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:37.712345 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d450ac73-b77b-4494-8187-f1e88042f76e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1215 microversion: 2.1 time: 0.148306 Oct 12 22:56:37.726039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2156/4442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:37 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:38.248732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:38.249356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:38.257967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.258521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.258961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.259938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.260517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.261132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.447300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:38.473076 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebdac610-4e85-41b6-baf1-d45fbd54ba00 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.230359 Oct 12 22:56:38.474934 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2287/4443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:38 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:38.588079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:38.588873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:38.608408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.608826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.613271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:38.614041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:38.624668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.625311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.625510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.626164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.626337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.626771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.627372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.631043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.632749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.633474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.791002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:38.803029 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-612326f3-0362-4cd7-9c00-48f5f0af22c6 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1268 microversion: 2.1 time: 0.219589 Oct 12 22:56:38.807224 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2157/4444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:38 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:38.823966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:38.824600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:38.847860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.848477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.848850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.849533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:38.850090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:38.850490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:38.975826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:38.984036 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-11cc89cd-abc4-4c41-827a-739544e78101 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1267 microversion: 2.1 time: 0.175488 Oct 12 22:56:38.984617 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2158/4445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:38 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:39.056368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:39.065927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-201dc950-a262-44a9-beb7-9712a387aeef tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1165 microversion: 2.1 time: 0.461513 Oct 12 22:56:39.067226 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2288/4446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:38 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1165 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:39.498633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:39.499605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:39.507228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:39.507719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:39.508184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:39.509189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:39.509809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:39.510419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:39.837965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:39.839133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:39.847538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:39.848067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:39.849269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:39.850333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:39.851049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:39.851597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:39.972266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:39.983445 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5eeaf2fa-6302-4a5f-859f-1b4f597e0365 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1266 microversion: 2.1 time: 0.149671 Oct 12 22:56:39.984693 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2289/4447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:39 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:40.017477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:40.027986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:40.028624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:40.029211 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a71691bb-d9a9-4141-abe3-38d103f7ef3e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.534219 Oct 12 22:56:40.043714 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2159/4448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:39 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:40.054020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.054802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.055442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.056367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.056981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.057574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.063219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1031927158"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:40.067050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:40.075732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.077198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.078411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.079678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.080240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.080747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.293232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:40.306262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2330cb1f-cfa9-4997-a62f-bf85f7f992eb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1273 microversion: 2.1 time: 0.302149 Oct 12 22:56:40.306850 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2290/4449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:40 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:40.313918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:40.321836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:40.341442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.342258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.342903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.343817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.344878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.345549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.393117 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77848f50-ea99-44a2-a878-c0fc6a155623 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.336005 Oct 12 22:56:40.394551 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2160/4450] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:40 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 22:56:40.405980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:40.406928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:40.414981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.415970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.416785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.417878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:40.418795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:40.419594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:40.792716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:40.812304 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5032eb7d-e148-4aad-b663-b3aa13d70efc tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.503993 Oct 12 22:56:40.813145 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2291/4451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:40 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:40.815799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:40.823997 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19949a95-d492-4433-be2b-2d51b12fbdbe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.424416 Oct 12 22:56:40.830867 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2161/4452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:40 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:41.008869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:41.009495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:41.017422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.017839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.018280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.018992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.019446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.019867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.332087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:41.333839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:41.344096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.356665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.358027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.359346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.359839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.360299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.483990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:41.493053 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b9fa747-5b37-4449-8337-6c52d503e43c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1308 microversion: 2.1 time: 0.488660 Oct 12 22:56:41.493777 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2292/4453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:41 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:41.684959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:41.695971 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ed45023-629e-44c4-97d2-971e03dddcf8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.369285 Oct 12 22:56:41.696570 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2162/4454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:41 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:41.834802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:41.835934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:41.857242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:41.858872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:41.861357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.862327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.863596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.864729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.865430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.866480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.867557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.868113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.868761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:41.869589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:41.870309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:41.870941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.037925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:42.050964 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d82b1b49-5463-485a-972e-b9974480a2b4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1684 microversion: 2.1 time: 0.199287 Oct 12 22:56:42.052038 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2163/4455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:41 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1684 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:42.273860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:42.308221 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e12c5f2-21c9-4a64-a5be-ee4fc53c5b39 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.476651 Oct 12 22:56:42.309544 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2293/4456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:41 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:42.354876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9f38a846-df2f-420e-a2f1-e3e1fb0fe8d6 req-3885b620-9811-4dbd-b611-8e56b01187d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-unplugged", "status": "completed", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:42.377761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9f38a846-df2f-420e-a2f1-e3e1fb0fe8d6 req-3885b620-9811-4dbd-b611-8e56b01187d8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.380464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9f38a846-df2f-420e-a2f1-e3e1fb0fe8d6 req-3885b620-9811-4dbd-b611-8e56b01187d8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.381146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9f38a846-df2f-420e-a2f1-e3e1fb0fe8d6 req-3885b620-9811-4dbd-b611-8e56b01187d8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.413069 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9f38a846-df2f-420e-a2f1-e3e1fb0fe8d6 req-3885b620-9811-4dbd-b611-8e56b01187d8 service nova] Creating event network-vif-unplugged:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:56:42.422909 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9f38a846-df2f-420e-a2f1-e3e1fb0fe8d6 req-3885b620-9811-4dbd-b611-8e56b01187d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072318 Oct 12 22:56:42.428030 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2164/4457] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:42.489026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9b239898-0848-474d-bd06-9283c6c8bf11 req-ce3ceade-2151-4325-a354-9d51a7084bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9", "tag": "d934155c-bc6b-4e3b-8861-b1486dc11c6e"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:42.500938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9b239898-0848-474d-bd06-9283c6c8bf11 req-ce3ceade-2151-4325-a354-9d51a7084bb3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.501331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9b239898-0848-474d-bd06-9283c6c8bf11 req-ce3ceade-2151-4325-a354-9d51a7084bb3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.502632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9b239898-0848-474d-bd06-9283c6c8bf11 req-ce3ceade-2151-4325-a354-9d51a7084bb3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.522957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:42.523667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:42.537189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.538064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.538610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.539426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.539852 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9b239898-0848-474d-bd06-9283c6c8bf11 req-ce3ceade-2151-4325-a354-9d51a7084bb3 service nova] Creating event network-changed:d934155c-bc6b-4e3b-8861-b1486dc11c6e for instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 on n-h2-860864-8 Oct 12 22:56:42.540212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.540802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.547385 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9b239898-0848-474d-bd06-9283c6c8bf11 req-ce3ceade-2151-4325-a354-9d51a7084bb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062868 Oct 12 22:56:42.550218 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2294/4458] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:56:42.722620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:42.723942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:42.729733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:42.731282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.732396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.733625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.734800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:42.735248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:42.736273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:42.737052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:42.744480 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03b9af48-087a-46e3-924d-5cbe46b72897 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1308 microversion: 2.1 time: 0.227349 Oct 12 22:56:42.745226 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2165/4459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:42 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:43.075832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:43.077236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:43.084748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.085399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.086111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:43.087070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.087626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.088324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:43.234815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:43.244840 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-28fb789f-0c3c-4380-8b50-f564340b3f99 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1684 microversion: 2.1 time: 0.172756 Oct 12 22:56:43.245829 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2166/4460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:43 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:43.331880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:43.332519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:43.338990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.340032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.340477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:43.341242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.341737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.342163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:43.355871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:43.378504 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d70be1db-a588-4184-a2bd-029706bf075c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.661287 Oct 12 22:56:43.378883 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2295/4461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:42 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:43.507347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:43.516244 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8b2a76a-7f67-4c45-b106-4831583b2870 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.188069 Oct 12 22:56:43.517095 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2167/4462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:43 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:43.772759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:43.773403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:43.780843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.781328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.781765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:43.782461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:43.782914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:43.783336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:43.925048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:43.932720 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b522e6a2-9992-4e8d-a70f-a169cf5562ea tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1308 microversion: 2.1 time: 0.164116 Oct 12 22:56:43.933288 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2296/4463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:43 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:44.272808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:44.273636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:44.280674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.281163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.281603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.282298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.282947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.283613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.403974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:44.405680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:44.414315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.415486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.416172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.417184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.418535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.419410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.452774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:44.463375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-768a7754-2d70-40be-96f5-a8f7679efa05 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1684 microversion: 2.1 time: 0.194675 Oct 12 22:56:44.467711 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2168/4464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:44 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1684 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:44.540350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:44.541010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:44.547310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.548051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.548658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.549548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.557989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.558704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.674973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:44.685201 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52b22136-0e79-426c-849f-e49ebd108357 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.287817 Oct 12 22:56:44.689114 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2297/4465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:44 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:44.700832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-52ace2e6-b20c-4f18-8a79-1d53842b6037 req-783ddbc0-6de3-481a-a9a1-ae6825e99782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d4032b-82b7-4dc2-8e90-9ce90e28d0a4", "tag": "bb707121-cc3d-4779-ae9b-1a2b4eefff8a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:44.718813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-52ace2e6-b20c-4f18-8a79-1d53842b6037 req-783ddbc0-6de3-481a-a9a1-ae6825e99782 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.719556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-52ace2e6-b20c-4f18-8a79-1d53842b6037 req-783ddbc0-6de3-481a-a9a1-ae6825e99782 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.720398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-52ace2e6-b20c-4f18-8a79-1d53842b6037 req-783ddbc0-6de3-481a-a9a1-ae6825e99782 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.739652 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-52ace2e6-b20c-4f18-8a79-1d53842b6037 req-783ddbc0-6de3-481a-a9a1-ae6825e99782 service nova] Creating event network-changed:bb707121-cc3d-4779-ae9b-1a2b4eefff8a for instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 on n-h2-860864-8 Oct 12 22:56:44.755978 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-52ace2e6-b20c-4f18-8a79-1d53842b6037 req-783ddbc0-6de3-481a-a9a1-ae6825e99782 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058624 Oct 12 22:56:44.757120 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2298/4466] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:44.867387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:44.877582 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7737c6b-3a40-4520-a9f3-276a3b057399 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.340962 Oct 12 22:56:44.884712 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2169/4467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:44 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:44.955097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:44.955814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:44.962714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.963178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.963838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:44.967978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:44.968698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:44.969330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.167678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:45.174890 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f9e3212-2df9-46ff-84fe-8452f34fb4e0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1308 microversion: 2.1 time: 0.224009 Oct 12 22:56:45.175486 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2299/4468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:44 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:45.493484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:45.494434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:45.512551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.513300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.514291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.515197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.515655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.516130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.709698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:45.710326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:45.721978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.724337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.725028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.729477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.730001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.730430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.806722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:45.833236 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae3dcbfd-6884-43a6-bc18-d4ee260c55c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.339512 Oct 12 22:56:45.867834 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2170/4469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:45 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:45.901931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:45.903320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:45.919655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.920252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.920872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.921757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:45.922382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:45.922996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:45.930157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:46.037402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:46.048915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e285988-e43d-476f-81df-47e007e8db77 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.343087 Oct 12 22:56:46.051035 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2300/4470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:45 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:46.173431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:46.181853 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9847ba0f-ff43-418e-8fd9-184ecc067018 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.283800 Oct 12 22:56:46.182670 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2171/4471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:45 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:46.203843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:46.204746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:46.211066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:46.211549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:46.212144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:46.213272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:46.213923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:46.214239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:46.330428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:46.476356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1181dbcf-3420-4d12-9612-9db2c6fc1f33 req-bd3b812e-3f9f-4005-8db9-c103e0c9d188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-plugged", "status": "completed", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:46.507481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1181dbcf-3420-4d12-9612-9db2c6fc1f33 req-bd3b812e-3f9f-4005-8db9-c103e0c9d188 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:46.508331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1181dbcf-3420-4d12-9612-9db2c6fc1f33 req-bd3b812e-3f9f-4005-8db9-c103e0c9d188 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:46.508929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1181dbcf-3420-4d12-9612-9db2c6fc1f33 req-bd3b812e-3f9f-4005-8db9-c103e0c9d188 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:46.523222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1181dbcf-3420-4d12-9612-9db2c6fc1f33 req-bd3b812e-3f9f-4005-8db9-c103e0c9d188 service nova] Creating event network-vif-plugged:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:56:46.529694 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1181dbcf-3420-4d12-9612-9db2c6fc1f33 req-bd3b812e-3f9f-4005-8db9-c103e0c9d188 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057093 Oct 12 22:56:46.530780 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2172/4472] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:46.640021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:46.657329 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09fb2d2c-18b0-4ed6-820a-85a45879e0f4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1308 microversion: 2.1 time: 0.463174 Oct 12 22:56:46.681847 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2301/4473] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:46 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:46.864462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:46.866260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:46.880843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:46.881529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:46.882061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:46.882993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:46.883877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:46.884834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.074149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:47.074778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:47.085692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.086190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.086631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.087344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.098865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.099738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.110396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:47.270323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:47.378366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:47.390925 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a6d9578-8499-4e2b-9ea2-0204b5dc059e tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.320398 Oct 12 22:56:47.392163 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2302/4474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:47 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:47.397513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:47.398541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:47.405693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.406411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.407200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.408318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.408941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.409642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.638226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:47.647920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:47.649357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2280742f-97b0-4d14-a1a3-09797150affb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.789677 Oct 12 22:56:47.651723 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2173/4475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:46 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:47.663301 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-574918ca-ca6a-4373-befa-91230ef70ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.269839 Oct 12 22:56:47.668751 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2303/4476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:47 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:47.690158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:47.690776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:47.698869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.699559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.700200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.701585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:47.702180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:47.702744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:47.990718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:48.308958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:48.331725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e15b4e6-ff76-4bbc-b17a-f0bf25b00e40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1308 microversion: 2.1 time: 0.648791 Oct 12 22:56:48.372917 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2174/4477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:47 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:48.418973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:48.420293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:48.430400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.436098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.436788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.437723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.438495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.439138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.597267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-31808b39-b114-4cd6-bc4e-9b8e5b379cab req-a705317c-a284-40d7-bf93-6a5dfef2b658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9", "name": "network-vif-plugged", "status": "completed", "tag": "d934155c-bc6b-4e3b-8861-b1486dc11c6e"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:48.616815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-31808b39-b114-4cd6-bc4e-9b8e5b379cab req-a705317c-a284-40d7-bf93-6a5dfef2b658 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.617296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-31808b39-b114-4cd6-bc4e-9b8e5b379cab req-a705317c-a284-40d7-bf93-6a5dfef2b658 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.617734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-31808b39-b114-4cd6-bc4e-9b8e5b379cab req-a705317c-a284-40d7-bf93-6a5dfef2b658 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.646655 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-31808b39-b114-4cd6-bc4e-9b8e5b379cab req-a705317c-a284-40d7-bf93-6a5dfef2b658 service nova] Creating event network-vif-plugged:d934155c-bc6b-4e3b-8861-b1486dc11c6e for instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 on n-h2-860864-8 Oct 12 22:56:48.653918 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-31808b39-b114-4cd6-bc4e-9b8e5b379cab req-a705317c-a284-40d7-bf93-6a5dfef2b658 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059855 Oct 12 22:56:48.658855 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2175/4478] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:48.678203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:48.678911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:48.694450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.695136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.697588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.698161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.703369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.704017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.854943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:48.882156 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebe4efac-e242-4fc9-bdd6-a00ba00c7aea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.467214 Oct 12 22:56:48.890313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2304/4479] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:48 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:48.905239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:48.905865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:48.913303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.913730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.914175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:48.914889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:48.915355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:48.917192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:49.150536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:49.156687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:49.161959 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f422072-30ad-4860-a02d-2436a7132197 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.268254 Oct 12 22:56:49.166437 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-abe3086a-9ece-44c0-bd08-321115ffdbcc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.492750 Oct 12 22:56:49.184213 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2305/4480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:48 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:49.186174 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2176/4481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:48 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:49.361412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:49.362046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:49.368468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:49.368974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:49.369418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:49.370208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:49.370669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:49.371094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:49.542040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:49.552869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f20f97eb-64ec-40b9-9759-a6b6517f8ce2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1308 microversion: 2.1 time: 0.195771 Oct 12 22:56:49.555691 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2306/4482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:49 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:49.912723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:49.913344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:49.920644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:49.921135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:49.921573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:49.922287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:49.922899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:49.923322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.122319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:50.132094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1da1b59b-1b9f-4379-b066-a62a3181a261 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.224634 Oct 12 22:56:50.144257 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2177/4483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:49 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:50.190778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:50.191404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:50.203067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:50.203686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:50.205750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.206248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.206678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.207378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.207841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.211258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.225686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.226183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.226621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.227336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.227801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.228244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.447987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:50.467749 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-df9adfd2-8688-4cf1-b779-6b39851cf67e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.271296 Oct 12 22:56:50.480394 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2178/4484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:50 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:50.504935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:50.517678 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-569d1e64-451d-4cde-9c8e-5f472dc9d85b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.332309 Oct 12 22:56:50.518843 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2307/4485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:50 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:50.579066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:50.580719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:50.592748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.593460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.594534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.595256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.595994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.596581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.777660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:50.787988 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4617901c-8796-4409-94f0-6f4ade165151 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1490 microversion: 2.1 time: 0.213491 Oct 12 22:56:50.791508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2179/4486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:50 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1490 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:50.815061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1646508524"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:50.816585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:50.826845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.829422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.830532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.833023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.833911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.835234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.923670 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-76648160-b730-4eab-85bb-1df6eba84a56 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "PUT /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1076 microversion: 2.1 time: 0.113806 Oct 12 22:56:50.924946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2308/4487] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:56:50 2022] PUT /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1076 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:50.943801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:50.944888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:50.953153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.953876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.954591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:50.955503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:50.956178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:50.956778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.117507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-090b6d30-819c-49e4-b94d-c75c392e37f7 req-2ce7e88f-b2b3-4021-ae61-575259e07507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d4032b-82b7-4dc2-8e90-9ce90e28d0a4", "name": "network-vif-plugged", "status": "completed", "tag": "bb707121-cc3d-4779-ae9b-1a2b4eefff8a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:51.138552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-090b6d30-819c-49e4-b94d-c75c392e37f7 req-2ce7e88f-b2b3-4021-ae61-575259e07507 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.139324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-090b6d30-819c-49e4-b94d-c75c392e37f7 req-2ce7e88f-b2b3-4021-ae61-575259e07507 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.140892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-090b6d30-819c-49e4-b94d-c75c392e37f7 req-2ce7e88f-b2b3-4021-ae61-575259e07507 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.176347 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-090b6d30-819c-49e4-b94d-c75c392e37f7 req-2ce7e88f-b2b3-4021-ae61-575259e07507 service nova] Creating event network-vif-plugged:bb707121-cc3d-4779-ae9b-1a2b4eefff8a for instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 on n-h2-860864-8 Oct 12 22:56:51.184389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:51.189618 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-090b6d30-819c-49e4-b94d-c75c392e37f7 req-2ce7e88f-b2b3-4021-ae61-575259e07507 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076735 Oct 12 22:56:51.192258 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2309/4488] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:56:51.193229 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-411691a0-7452-47ef-a8af-a4dde4df2c67 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1502 microversion: 2.1 time: 0.253424 Oct 12 22:56:51.209362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:51.210422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:51.212720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2180/4489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:50 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:51.220951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:51.221730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:51.229066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.229750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.230583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.231208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.232498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.233151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.239525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.243342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.243936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.244769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.247011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.248087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.385956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:51.395152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-96858768-e203-455c-a873-0e4bf70ee6a9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1502 microversion: 2.1 time: 0.179499 Oct 12 22:56:51.397590 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2181/4490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:51 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:51.427275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f2b6b27-37e0-4f46-9954-2005affc9e59 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:51.437979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2b6b27-37e0-4f46-9954-2005affc9e59 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.440003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2b6b27-37e0-4f46-9954-2005affc9e59 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.440544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2b6b27-37e0-4f46-9954-2005affc9e59 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.560399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f2b6b27-37e0-4f46-9954-2005affc9e59 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Going to try to stop instance {{(pid=120543) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:56:51.614280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:51.642991 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f2b6b27-37e0-4f46-9954-2005affc9e59 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "POST /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9/action" status: 202 len: 0 microversion: 2.1 time: 0.215827 Oct 12 22:56:51.648508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2182/4491] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:51 2022] POST /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:51.649759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:51.667504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:51.671258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b43cdead-6071-4a26-a925-be97a07c8fe0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1315 microversion: 2.1 time: 0.477500 Oct 12 22:56:51.671715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:51.672062 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2310/4492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:51 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:51.677575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:51.678426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:51.686458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.687298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.687962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.688975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.689311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.689695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.689928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.690224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.690632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.691427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:51.692050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:51.692554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:51.960647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:51.978927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:51.983641 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-deebfbd7-25b0-42bb-8c62-b1c6eacced57 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.298977 Oct 12 22:56:51.988163 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2311/4493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:51 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:51.989485 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d6ea76d-fcc4-4c97-90a3-b16eb6ecf971 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.341474 Oct 12 22:56:52.000372 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2183/4494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:51 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:52.008475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:52.008475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:52.016045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.016730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.018394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.020016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.021488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.022074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.201676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:52.216947 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0392b87-0b50-429b-b08e-cf7ef96c367a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.226054 Oct 12 22:56:52.218133 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2312/4495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:51 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:52.699836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:52.700642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:52.709506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.712678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.713259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.715921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:52.717374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:52.717922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:52.957944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:52.971504 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f252be18-0a95-4de5-995f-0b4dcd1237e0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1503 microversion: 2.1 time: 0.275927 Oct 12 22:56:52.989406 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2184/4496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:52 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1503 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:52.996745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-195216580"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:52.997838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:53.016223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:53.019999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:53.022488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.026848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.027416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.027935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.028226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.029233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.029978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.030436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.030538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.030887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.031200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.031780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.281279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:53.281454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.network.security_group_api [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Adding security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 to port bb707121-cc3d-4779-ae9b-1a2b4eefff8a Oct 12 22:56:53.289832 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9e2f163-b0dc-48b9-90fe-d73a7bbe84b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.281080 Oct 12 22:56:53.309087 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2185/4497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:53 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:53.316977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:53.317616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:53.324899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.326094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.326625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.327444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.328088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.328666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.488198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:53.498582 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78d79ab7-1425-4694-83ea-6b74759ff680 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.187423 Oct 12 22:56:53.499620 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2186/4498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:53 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:53.504419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:53.505175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:53.511768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.512457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.514748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.514748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.516254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.516254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.736683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:53.746588 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ab51ac45-61a7-41e0-9cf1-2a7b8842ce72 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.245734 Oct 12 22:56:53.748017 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2187/4499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:53 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:53.770466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-85c0389d-8bb9-422e-ac4e-991ab696be0f req-7bb1ad05-cf3c-49a9-83a0-7437584991ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984f1775-6842-4f0a-b001-2d6cfc44a8e1", "name": "network-vif-plugged", "status": "completed", "tag": "eaf8c85a-91ec-4b43-ae2f-c944803ad7d9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:53.775150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:53.794690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-85c0389d-8bb9-422e-ac4e-991ab696be0f req-7bb1ad05-cf3c-49a9-83a0-7437584991ca service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.795852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-85c0389d-8bb9-422e-ac4e-991ab696be0f req-7bb1ad05-cf3c-49a9-83a0-7437584991ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.796472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-85c0389d-8bb9-422e-ac4e-991ab696be0f req-7bb1ad05-cf3c-49a9-83a0-7437584991ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.802067 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dcb7ed9b-5985-4a23-b8d6-a2742214ec8b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4/action" status: 202 len: 0 microversion: 2.1 time: 0.809295 Oct 12 22:56:53.805822 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2313/4500] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:52 2022] POST /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:53.812830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8b6a624-4922-40c8-96e2-39a14b4803b0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fe6e6160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:53.819837 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-85c0389d-8bb9-422e-ac4e-991ab696be0f req-7bb1ad05-cf3c-49a9-83a0-7437584991ca service nova] Creating event network-vif-plugged:eaf8c85a-91ec-4b43-ae2f-c944803ad7d9 for instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 on n-h2-860864-8 Oct 12 22:56:53.827402 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-85c0389d-8bb9-422e-ac4e-991ab696be0f req-7bb1ad05-cf3c-49a9-83a0-7437584991ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077929 Oct 12 22:56:53.829037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2188/4501] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:53.835236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4caadf41-e8b6-47e2-83df-93d21ea3731b req-69d6b65a-7f0f-4831-a3ce-e8d575e9d682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d4032b-82b7-4dc2-8e90-9ce90e28d0a4", "tag": "bb707121-cc3d-4779-ae9b-1a2b4eefff8a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:53.848529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4caadf41-e8b6-47e2-83df-93d21ea3731b req-69d6b65a-7f0f-4831-a3ce-e8d575e9d682 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:53.849511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4caadf41-e8b6-47e2-83df-93d21ea3731b req-69d6b65a-7f0f-4831-a3ce-e8d575e9d682 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:53.850931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4caadf41-e8b6-47e2-83df-93d21ea3731b req-69d6b65a-7f0f-4831-a3ce-e8d575e9d682 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:53.883648 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4caadf41-e8b6-47e2-83df-93d21ea3731b req-69d6b65a-7f0f-4831-a3ce-e8d575e9d682 service nova] Creating event network-changed:bb707121-cc3d-4779-ae9b-1a2b4eefff8a for instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 on n-h2-860864-8 Oct 12 22:56:53.890420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4caadf41-e8b6-47e2-83df-93d21ea3731b req-69d6b65a-7f0f-4831-a3ce-e8d575e9d682 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059866 Oct 12 22:56:53.891413 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2189/4502] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:54.318590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:54.320081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:54.333173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.336974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.338762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.339629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.341670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.342216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.468778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-f8b6a624-4922-40c8-96e2-39a14b4803b0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use.", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:56:54.470097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f8b6a624-4922-40c8-96e2-39a14b4803b0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use. Oct 12 22:56:54.470097 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-a1e4f8d1-2f3b-44da-8ec9-de5f2f82206a'] Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8b6a624-4922-40c8-96e2-39a14b4803b0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 HTTP/1.1 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: exception: Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use. Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-a1e4f8d1-2f3b-44da-8ec9-de5f2f82206a'] Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4'} Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:56:54.472412 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use. Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4f8d1-2f3b-44da-8ec9-de5f2f82206a'] Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use. Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4f8d1-2f3b-44da-8ec9-de5f2f82206a'] Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use. Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4f8d1-2f3b-44da-8ec9-de5f2f82206a'] Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use. Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e4f8d1-2f3b-44da-8ec9-de5f2f82206a'] Oct 12 22:56:54.475729 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:54.479979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8b6a624-4922-40c8-96e2-39a14b4803b0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 400 to user: Security Group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 in use. Oct 12 22:56:54.479979 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-a1e4f8d1-2f3b-44da-8ec9-de5f2f82206a'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:54.482308 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f8b6a624-4922-40c8-96e2-39a14b4803b0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4" status: 400 len: 185 microversion: 2.1 time: 0.673932 Oct 12 22:56:54.483874 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2314/4503] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:56:53 2022] DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 => generated 185 bytes in 677 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:56:54.492218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:54.496560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:54.503150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:54.505327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.506228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.506903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.507954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.508598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.509209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.600638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:54.618423 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e6a54f2-c0fe-4f99-813e-7065acbd2d30 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.303779 Oct 12 22:56:54.631924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2190/4504] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:54 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:54.638524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:54.638524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:54.649954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.650487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.651096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.652212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.652670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.653179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.668011 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54be4c54-9cbc-42d0-979d-768dd56f150b tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4/action" status: 202 len: 0 microversion: 2.1 time: 0.179595 Oct 12 22:56:54.670224 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2315/4505] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:54 2022] POST /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:56:54.688036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:54.689185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:54.697759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.698702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.699457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.703920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.705044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.705830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.935510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:54.948178 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6af8396-a4ac-487c-8afc-b2dcd0af9cf3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.324293 Oct 12 22:56:54.949395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2191/4506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:54 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:54.973701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:54.974330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:54.982225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.982710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.983142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:54.983844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:54.984336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:54.984754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:55.048496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:55.067786 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2913d43-3747-4173-8295-87605024d6dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1573 microversion: 2.1 time: 0.384892 Oct 12 22:56:55.070268 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2316/4507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:54 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1573 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:55.142162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:55.152511 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0be47f2c-67da-4263-829b-763c9e07e819 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.190800 Oct 12 22:56:55.154793 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2192/4508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:54 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:55.652555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:55.653389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:55.674813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:55.674813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:55.674813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:55.674813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:55.674813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:55.674813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:55.961359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:55.971914 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f73f9f8-cf45-4419-9745-b38afac700f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1199 microversion: 2.1 time: 0.329217 Oct 12 22:56:55.984792 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2317/4509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:55 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1199 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:55.993605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:55.994294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:56.009256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.009751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.010180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.016651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.018356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.018982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.094336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:56.095346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:56.105355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.107708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.110495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.111395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.112012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.120986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.266425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:56.276988 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b23750b-1ae9-4160-896a-8417f52bac9b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.305840 Oct 12 22:56:56.279049 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2193/4510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:55 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:56.288489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:56.289522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:56.300935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.301854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.302646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.303906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:56.304593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:56.305224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:56.542171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:56.554080 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d8c44ee-d5e9-4ce6-9ece-23f2064d2ff4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.273644 Oct 12 22:56:56.571315 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2194/4511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:56 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:56.654006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:56.665522 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-edd4fa90-de4d-4686-b7d4-180cac670663 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1573 microversion: 2.1 time: 0.574801 Oct 12 22:56:56.666598 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2318/4512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:56 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1573 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:57.001054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.001803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.009733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.010321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.010853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.011565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.012063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.012494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.168718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:57.187751 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52217efe-45e2-449b-84ce-a36f53034fbb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1385 microversion: 2.1 time: 0.190583 Oct 12 22:56:57.189053 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2195/4513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:56 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:57.211579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.212262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.221351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.221789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.224419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.225166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.225620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.226047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.233180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:57.306414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.307440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.315219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.316011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.316636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.317543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.318180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.318790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.390630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:57.399806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1114477f-e69c-4de8-871b-9918ce590562 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1385 microversion: 2.1 time: 0.192079 Oct 12 22:56:57.400770 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2319/4514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:57 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:57.426631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.427261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.438344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.438840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.439287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.440925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.441899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.442515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.507853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:57.519178 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18ada71a-1963-4437-b58a-3dc8ca349493 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.215398 Oct 12 22:56:57.535977 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2196/4515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:57 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:57.583791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.584454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.596884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.597436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.598606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.599398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.600238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.600366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.656849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:57.665970 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b46c9a6-3572-4d68-a90c-259e4eff4ea5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1385 microversion: 2.1 time: 0.244075 Oct 12 22:56:57.676173 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2320/4516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:57 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:57.691738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.693120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.702117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.703113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.703833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.705065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.706055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.706775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.814016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:57.823363 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-648daacc-e2b9-4f33-aa7a-b283cbb02698 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.242889 Oct 12 22:56:57.825875 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2197/4517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:57 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:57.831988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:57.832390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.840391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.857369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.857918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.858654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.859129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.859595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.917675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:56:57.930393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:57.939737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-014529fd-b945-480e-aebf-7f91732dc226 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1571 microversion: 2.1 time: 0.252812 Oct 12 22:56:57.941322 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2321/4518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:57 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1571 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:57.967123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1648145849"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:57.968229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:57.987877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.990543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.991822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:57.994421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:57.996691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:57.999579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.112572 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-850012a3-4026-48de-a781-f52828d11bc9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 204 len: 0 microversion: 2.1 time: 0.285384 Oct 12 22:56:58.113993 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2198/4519] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:56:57 2022] DELETE /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:56:58.124681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:58.127038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:58.141119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.141616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.142059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.143291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.144535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.144975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.150149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:56:58.244036 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.network.security_group_api [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Adding security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 to port bb707121-cc3d-4779-ae9b-1a2b4eefff8a Oct 12 22:56:58.345282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:58.353989 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b12d173-ac64-4e9b-95be-6388e40d1661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1391 microversion: 2.1 time: 0.235449 Oct 12 22:56:58.363956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2199/4520] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:58 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:56:58.543183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:58.544599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:58.551342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.552259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.552869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.553752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.554403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.554971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.739544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-01c941c8-c3ee-4b12-97c6-28f3b84018f7 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4/action" status: 202 len: 0 microversion: 2.1 time: 0.777582 Oct 12 22:56:58.744442 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2322/4521] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:56:57 2022] POST /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:56:58.749903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21c18c12-da45-41a1-81c3-1e55fcfa4e08 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fe6e6c10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:58.789646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:58.805978 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6be1eea0-2006-45cf-9b32-9a89d8621290 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.265747 Oct 12 22:56:58.805978 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2200/4522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:58 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:58.811599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e9ea69df-ab0a-4048-b6fc-f86f384971bf req-c46281ae-4d3e-49e0-b591-2efb5e58504a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d4032b-82b7-4dc2-8e90-9ce90e28d0a4", "tag": "bb707121-cc3d-4779-ae9b-1a2b4eefff8a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:56:58.842532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9ea69df-ab0a-4048-b6fc-f86f384971bf req-c46281ae-4d3e-49e0-b591-2efb5e58504a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.843170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9ea69df-ab0a-4048-b6fc-f86f384971bf req-c46281ae-4d3e-49e0-b591-2efb5e58504a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.843644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9ea69df-ab0a-4048-b6fc-f86f384971bf req-c46281ae-4d3e-49e0-b591-2efb5e58504a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.871935 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e9ea69df-ab0a-4048-b6fc-f86f384971bf req-c46281ae-4d3e-49e0-b591-2efb5e58504a service nova] Creating event network-changed:bb707121-cc3d-4779-ae9b-1a2b4eefff8a for instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 on n-h2-860864-8 Oct 12 22:56:58.882271 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e9ea69df-ab0a-4048-b6fc-f86f384971bf req-c46281ae-4d3e-49e0-b591-2efb5e58504a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075596 Oct 12 22:56:58.889683 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2201/4523] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:56:58.898100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:58.899018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:58.910176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.910885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.911408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:58.912246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:58.912778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:58.913302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.003129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-21c18c12-da45-41a1-81c3-1e55fcfa4e08 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use.", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:56:59.004162 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-21c18c12-da45-41a1-81c3-1e55fcfa4e08 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use. Oct 12 22:56:59.004162 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-0de4f679-98cb-4d49-bcc0-c12e387abfec'] Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21c18c12-da45-41a1-81c3-1e55fcfa4e08 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68 HTTP/1.1 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: exception: Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use. Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-0de4f679-98cb-4d49-bcc0-c12e387abfec'] Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '298bf4aa-5b89-495d-99b3-ff442e3a2b68'} Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:56:59.009464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use. Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de4f679-98cb-4d49-bcc0-c12e387abfec'] Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use. Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de4f679-98cb-4d49-bcc0-c12e387abfec'] Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use. Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de4f679-98cb-4d49-bcc0-c12e387abfec'] Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use. Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de4f679-98cb-4d49-bcc0-c12e387abfec'] Oct 12 22:56:59.013916 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:56:59.017459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21c18c12-da45-41a1-81c3-1e55fcfa4e08 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 400 to user: Security Group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 in use. Oct 12 22:56:59.017459 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-0de4f679-98cb-4d49-bcc0-c12e387abfec'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:56:59.018631 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21c18c12-da45-41a1-81c3-1e55fcfa4e08 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68" status: 400 len: 185 microversion: 2.1 time: 0.272932 Oct 12 22:56:59.019371 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2323/4524] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:56:58 2022] DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68 => generated 185 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:56:59.030166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:59.030954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:59.040445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.041398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.041997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.042930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.043565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.044240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.084328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:56:59.232292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:59.250055 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c10cff1a-b77b-4614-a345-18d59fef014a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.357843 Oct 12 22:56:59.252246 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2202/4525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:58 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:59.301676 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b06899bd-70ab-4e73-851a-67688d8de104 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 204 len: 0 microversion: 2.1 time: 0.277227 Oct 12 22:56:59.305519 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2324/4526] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:56:59 2022] DELETE /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:56:59.314064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:59.314699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:59.321408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.321902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.322342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.323043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.323495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.323932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.379315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:59.380087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:59.392554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.393032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.393472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.394204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.396255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.396690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.512234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:59.521459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-313afc90-1740-4d6b-a727-faca4c506729 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1646 microversion: 2.1 time: 0.213532 Oct 12 22:56:59.522785 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2203/4527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:59 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1646 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:59.583454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:56:59.591359 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b383e5cd-4649-4a13-bdd8-e4a1a6f92b01 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1391 microversion: 2.1 time: 0.217146 Oct 12 22:56:59.604349 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2325/4528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:59 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:56:59.831838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:56:59.832475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:56:59.839523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.840042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.840481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:56:59.841220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:56:59.841668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:56:59.842092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.018365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:00.029553 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-df4430a3-d8d6-4bea-9cfd-926dedc28983 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.201412 Oct 12 22:57:00.031528 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2204/4529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:56:59 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:00.292733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:00.294068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:00.305050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.305645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.306294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.307680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.308263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.308772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.472590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:00.480865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3593850-81a0-44b8-aea1-97b2914491e8 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.198831 Oct 12 22:57:00.483324 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2326/4530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:00 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:00.547619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:00.548470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:00.555831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.556474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.556943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.564330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.564330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.564330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.614998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:00.616717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:00.632244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.633266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.633714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.634604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:00.635165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:00.636110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:00.843923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:00.858414 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b47ebbad-afd1-4c9d-9d56-a12f739952d9 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1646 microversion: 2.1 time: 0.312555 Oct 12 22:57:00.871560 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2205/4531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:00 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1646 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:01.055343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:01.056252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:01.064593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:01.065453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:01.066151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:01.067392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:01.068759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:01.069358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:01.295416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:01.306520 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9857e4f-1f77-4a81-975f-412fa5fcd695 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1679 microversion: 2.1 time: 0.255574 Oct 12 22:57:01.311103 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2206/4532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:01 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:01.500912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:01.508666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:01.509543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:01.521646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:01.524425 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80fc60e3-f737-45b2-a6d4-501bb057a5dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1391 microversion: 2.1 time: 0.913323 Oct 12 22:57:01.526636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2327/4533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:00 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1391 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:01.538036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:01.538641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:01.539417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:01.539921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:01.553633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:01.651646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a0f4538a-c5bb-4923-b7bb-deecf19186e0 req-316f03de-e253-4810-8094-2997269b0540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d4032b-82b7-4dc2-8e90-9ce90e28d0a4", "name": "network-vif-deleted", "tag": "bb707121-cc3d-4779-ae9b-1a2b4eefff8a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:01.726960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a0f4538a-c5bb-4923-b7bb-deecf19186e0 req-316f03de-e253-4810-8094-2997269b0540 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:01.727460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a0f4538a-c5bb-4923-b7bb-deecf19186e0 req-316f03de-e253-4810-8094-2997269b0540 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:01.727925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a0f4538a-c5bb-4923-b7bb-deecf19186e0 req-316f03de-e253-4810-8094-2997269b0540 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:01.784317 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a0f4538a-c5bb-4923-b7bb-deecf19186e0 req-316f03de-e253-4810-8094-2997269b0540 service nova] Creating event network-vif-deleted:bb707121-cc3d-4779-ae9b-1a2b4eefff8a for instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 on n-h2-860864-8 Oct 12 22:57:01.799197 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a0f4538a-c5bb-4923-b7bb-deecf19186e0 req-316f03de-e253-4810-8094-2997269b0540 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162229 Oct 12 22:57:01.824372 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2328/4534] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:01.892643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:01.893797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:01.927315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:01.928357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:01.932425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:01.935773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:01.936895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:01.937625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.005612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:02.034386 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6fcc5ea2-ac81-401f-ac48-10f3d6f76ecb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.533080 Oct 12 22:57:02.049489 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2207/4535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:01 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:02.062607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.067132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.067666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.068324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lazy-loading 'fault' on Instance uuid 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:57:02.130088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:02.139113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93db1885-fe86-4f8f-afb8-7c236c0b73dd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 200 len: 1305 microversion: 2.1 time: 0.256055 Oct 12 22:57:02.140081 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2329/4536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:01 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 1305 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:02.232370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2e7b1ba8-cd4e-47cb-8445-c393c156f733 req-611c66ce-bf4b-4522-b0d7-75e25c6b2fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984f1775-6842-4f0a-b001-2d6cfc44a8e1", "name": "network-vif-deleted", "tag": "eaf8c85a-91ec-4b43-ae2f-c944803ad7d9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:02.243085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2e7b1ba8-cd4e-47cb-8445-c393c156f733 req-611c66ce-bf4b-4522-b0d7-75e25c6b2fc9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.243567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2e7b1ba8-cd4e-47cb-8445-c393c156f733 req-611c66ce-bf4b-4522-b0d7-75e25c6b2fc9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.244027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2e7b1ba8-cd4e-47cb-8445-c393c156f733 req-611c66ce-bf4b-4522-b0d7-75e25c6b2fc9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.255735 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2e7b1ba8-cd4e-47cb-8445-c393c156f733 req-611c66ce-bf4b-4522-b0d7-75e25c6b2fc9 service nova] Creating event network-vif-deleted:eaf8c85a-91ec-4b43-ae2f-c944803ad7d9 for instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 on n-h2-860864-8 Oct 12 22:57:02.260753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2e7b1ba8-cd4e-47cb-8445-c393c156f733 req-611c66ce-bf4b-4522-b0d7-75e25c6b2fc9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Oct 12 22:57:02.261361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2208/4537] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:02.330350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:02.330894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:02.339219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.339928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.340381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.341773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.342234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.342662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.492727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:02.501278 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f45a0f81-218f-4b38-a577-880087a0d557 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.174898 Oct 12 22:57:02.502781 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2330/4538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:02 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:02.552945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:02.553934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:02.560373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.560860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.561297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.561991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.562442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.562996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.617221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:02.617909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:02.624780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.625334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.625838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.626611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:02.627126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:02.627610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:02.632976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:02.641814 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd0eb796-ee85-4206-92b3-5e40f4636151 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1184 microversion: 2.1 time: 0.093432 Oct 12 22:57:02.642400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2209/4539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:02 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1184 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:02.774074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:02.782460 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-73a0e520-d448-4149-8f26-e1b01f1f895e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.169017 Oct 12 22:57:02.783029 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2331/4540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:02 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:03.058452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.059081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:03.067678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.072929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.073551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.074962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.076752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.077374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.162920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.164253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:03.173786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.174405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.175381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.176230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.176820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.177830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.208940 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 HTTP/1.1 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '89d4032b-82b7-4dc2-8e90-9ce90e28d0a4'} Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:03.215070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:03.218969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:03.218969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:03.218969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:03.218969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:03.218969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:03.218969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:03.218969 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:03.221450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:03.228424 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d74192ea-fd25-46d4-bab4-77169cc916cd tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 404 len: 111 microversion: 2.1 time: 0.069630 Oct 12 22:57:03.229164 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2332/4541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:03 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:03.240538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26c9e0bf-cf02-4574-aefd-137c32eb3cd8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fe6e6430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.305042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:03.340166 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0424cc3a-1f95-473f-a855-b90f34cf5129 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.283054 Oct 12 22:57:03.342906 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2210/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:03 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:03.470435 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26c9e0bf-cf02-4574-aefd-137c32eb3cd8 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4" status: 202 len: 0 microversion: 2.1 time: 0.235310 Oct 12 22:57:03.472159 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2333/4543] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:03 2022] DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:57:03.483922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e87c096a-48a7-443a-8564-57a703999512 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fe914c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.665787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.666899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:03.675533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.676362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.676939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.677775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.678642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.679205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.714435 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e87c096a-48a7-443a-8564-57a703999512 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68" status: 202 len: 0 microversion: 2.1 time: 0.238377 Oct 12 22:57:03.715335 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2211/4544] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:03 2022] DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:57:03.733136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4955a43-806a-4160-8281-0edf8bf9ccf0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'create', calling method: .version_select at 0x7f44ff7c7430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-62871296", "description": "tempest-description-605705197"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:03.787462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:03.800220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f66c5f7-cb69-4e9e-84ff-85f6836d5ff9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1184 microversion: 2.1 time: 0.138295 Oct 12 22:57:03.801133 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2334/4545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:03 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1184 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:03.884074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:03.884714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:03.891049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.891542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.892019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.892727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:03.893181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:03.893804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:03.927864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4955a43-806a-4160-8281-0edf8bf9ccf0 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.199567 Oct 12 22:57:03.928781 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2212/4546] 10.222.0.20 () {60 vars in 1180 bytes} [Wed Oct 12 22:57:03 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:03.944798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7f5adcf-44d6-472c-88b4-7948e8114e4c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Action: 'update', calling method: .version_select at 0x7f44ff684ca0>, body: {"security_group": {"name": "tempest-sg-hth-148382522", "description": "tempest-description-hth-1249534159"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:04.041103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:04.050233 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b803a28-b168-42fd-a904-0bdd7b560d8c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.170405 Oct 12 22:57:04.051972 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2335/4547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:03 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:04.072693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.073311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.079586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.080110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.080552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.081250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.081706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.082131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.111411 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7f5adcf-44d6-472c-88b4-7948e8114e4c tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/5a141037-83cf-4b71-af8a-f2966b409fe3" status: 200 len: 217 microversion: 2.1 time: 0.172530 Oct 12 22:57:04.120660 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2213/4548] 10.222.0.20 () {60 vars in 1290 bytes} [Wed Oct 12 22:57:03 2022] PUT /compute/v2.1/os-security-groups/5a141037-83cf-4b71-af8a-f2966b409fe3 => generated 217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:04.125724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb25a736-3cbb-45cd-931d-83fa0f110f62 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44ff684430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.188247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb25a736-3cbb-45cd-931d-83fa0f110f62 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/5a141037-83cf-4b71-af8a-f2966b409fe3" status: 200 len: 217 microversion: 2.1 time: 0.066284 Oct 12 22:57:04.188887 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2214/4549] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:57:04 2022] GET /compute/v2.1/os-security-groups/5a141037-83cf-4b71-af8a-f2966b409fe3 => generated 217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:04.205022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85a7ac00-15e4-4421-bba7-d641f6770aeb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f4507a7d4c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.238501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:04.249891 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d652c12e-d456-49e5-ac52-e7d8ec23290c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.180907 Oct 12 22:57:04.250751 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2336/4550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:04 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:04.274654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.275609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.284412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.285299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.286255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.287602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.288356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.289097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.315574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:04.442161 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-85a7ac00-15e4-4421-bba7-d641f6770aeb tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5a141037-83cf-4b71-af8a-f2966b409fe3" status: 202 len: 0 microversion: 2.1 time: 0.242288 Oct 12 22:57:04.443170 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2215/4551] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:04 2022] DELETE /compute/v2.1/os-security-groups/5a141037-83cf-4b71-af8a-f2966b409fe3 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:57:04.452201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.453941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.461330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:04.468224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.468968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.471085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.472199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.473823 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b84d267c-5cbc-4e28-b2ad-5f35a85da224 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.204277 Oct 12 22:57:04.474150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.475198 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2337/4552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:04 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:04.475922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.482374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.488425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.497462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.498142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.498734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.499592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.501050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.501627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.522790 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 HTTP/1.1 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '89d4032b-82b7-4dc2-8e90-9ce90e28d0a4'} Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:04.524955 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.529237 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.530528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:04.531330 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2b4701a-8fa5-4873-b92f-8089c7c4aba1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 404 len: 111 microversion: 2.1 time: 0.054191 Oct 12 22:57:04.532311 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2338/4553] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:04 2022] DELETE /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:04.538316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:04.541811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.572017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.572520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.572965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.573673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.578071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.580928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.669797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:04.678931 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59b35441-a83c-47cd-8739-d1b3b5077bbb tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.231421 Oct 12 22:57:04.679808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2216/4554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:04 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:04.686760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.687932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.695797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.696610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.697358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.698366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.699119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.699715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.715538 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ceb6db4-b168-49dd-84bf-90a60bef012d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.181774 Oct 12 22:57:04.716201 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2339/4555] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:57:04 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:57:04.721009 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.723717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c56290a8-6d4d-46c8-b8bd-f3617358ac3c req-695c1a16-f601-4c90-bc6f-f7e421f11c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-unplugged", "status": "completed", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 HTTP/1.1 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '89d4032b-82b7-4dc2-8e90-9ce90e28d0a4'} Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.724060 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Instance 89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4cb1f964-a655-4013-bc7b-1962cc0b12fa tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4" status: 404 len: 111 microversion: 2.1 time: 0.044529 Oct 12 22:57:04.728601 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2217/4556] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:04 2022] GET /compute/v2.1/servers/89d4032b-82b7-4dc2-8e90-9ce90e28d0a4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:04.731642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.742689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.754583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.762354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.763485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.764282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.766134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c56290a8-6d4d-46c8-b8bd-f3617358ac3c req-695c1a16-f601-4c90-bc6f-f7e421f11c4b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.766859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c56290a8-6d4d-46c8-b8bd-f3617358ac3c req-695c1a16-f601-4c90-bc6f-f7e421f11c4b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.767421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c56290a8-6d4d-46c8-b8bd-f3617358ac3c req-695c1a16-f601-4c90-bc6f-f7e421f11c4b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.772307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.772970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.785257 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c56290a8-6d4d-46c8-b8bd-f3617358ac3c req-695c1a16-f601-4c90-bc6f-f7e421f11c4b service nova] Creating event network-vif-unplugged:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 22:57:04.791142 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c56290a8-6d4d-46c8-b8bd-f3617358ac3c req-695c1a16-f601-4c90-bc6f-f7e421f11c4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072771 Oct 12 22:57:04.792689 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2340/4557] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:04.799674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aea47ee1-1aa5-4068-b5f5-05c678b4d9c3 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44feb5fa60>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.832278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-aea47ee1-1aa5-4068-b5f5-05c678b4d9c3 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:57:04.833121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-aea47ee1-1aa5-4068-b5f5-05c678b4d9c3 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:57:04.834756 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-aea47ee1-1aa5-4068-b5f5-05c678b4d9c3 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist Oct 12 22:57:04.834756 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-820c1e63-cf36-41f0-b000-151b9158a689'] Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aea47ee1-1aa5-4068-b5f5-05c678b4d9c3 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68 HTTP/1.1 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-820c1e63-cf36-41f0-b000-151b9158a689'] Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '298bf4aa-5b89-495d-99b3-ff442e3a2b68'} Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:57:04.837013 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-820c1e63-cf36-41f0-b000-151b9158a689'] Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-820c1e63-cf36-41f0-b000-151b9158a689'] Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-820c1e63-cf36-41f0-b000-151b9158a689'] Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-820c1e63-cf36-41f0-b000-151b9158a689'] Oct 12 22:57:04.840034 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.843833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aea47ee1-1aa5-4068-b5f5-05c678b4d9c3 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group 298bf4aa-5b89-495d-99b3-ff442e3a2b68 does not exist Oct 12 22:57:04.843833 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-820c1e63-cf36-41f0-b000-151b9158a689'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:04.845013 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aea47ee1-1aa5-4068-b5f5-05c678b4d9c3 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68" status: 404 len: 194 microversion: 2.1 time: 0.051068 Oct 12 22:57:04.845945 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2341/4558] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:04 2022] DELETE /compute/v2.1/os-security-groups/298bf4aa-5b89-495d-99b3-ff442e3a2b68 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:04.851694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.852919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:04.862401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.863291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.864586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.865743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:04.866407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:04.867038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:04.939717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:04.948814 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b8d6e11-c164-499c-9ead-937948b2dd7b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1184 microversion: 2.1 time: 0.101349 Oct 12 22:57:04.949716 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2342/4559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:04 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:04.955002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f1bc82a-fcfc-4154-9c58-375a88150519 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44ffe19f70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:04.978456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-9f1bc82a-fcfc-4154-9c58-375a88150519 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:57:04.979139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-9f1bc82a-fcfc-4154-9c58-375a88150519 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:57:04.979744 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9f1bc82a-fcfc-4154-9c58-375a88150519 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist Oct 12 22:57:04.979744 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-ed39cf8d-603c-48e2-b666-45e540d4c35d'] Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f1bc82a-fcfc-4154-9c58-375a88150519 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 HTTP/1.1 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-ed39cf8d-603c-48e2-b666-45e540d4c35d'] Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4'} Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:57:04.982891 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed39cf8d-603c-48e2-b666-45e540d4c35d'] Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed39cf8d-603c-48e2-b666-45e540d4c35d'] Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed39cf8d-603c-48e2-b666-45e540d4c35d'] Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed39cf8d-603c-48e2-b666-45e540d4c35d'] Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f1bc82a-fcfc-4154-9c58-375a88150519 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 does not exist Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-ed39cf8d-603c-48e2-b666-45e540d4c35d'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f1bc82a-fcfc-4154-9c58-375a88150519 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4" status: 404 len: 194 microversion: 2.1 time: 0.034310 Oct 12 22:57:04.985879 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2343/4560] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:04 2022] DELETE /compute/v2.1/os-security-groups/f7ae414f-5ef4-450c-b4f6-7e8d3bc8efe4 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:04.994071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f63a87e-3aff-4e8f-a807-7eea9679adea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44feb5f670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.019045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-3f63a87e-3aff-4e8f-a807-7eea9679adea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:57:05.019795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-3f63a87e-3aff-4e8f-a807-7eea9679adea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group 0acae008-4d53-45cf-b03e-00b07dbef09d not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:57:05.020512 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-3f63a87e-3aff-4e8f-a807-7eea9679adea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:57:05.020512 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-a0493693-2fdc-487f-b53c-04cf8958ae0e'] Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f63a87e-3aff-4e8f-a807-7eea9679adea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d HTTP/1.1 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-a0493693-2fdc-487f-b53c-04cf8958ae0e'] Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '0acae008-4d53-45cf-b03e-00b07dbef09d'} Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:57:05.024160 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0493693-2fdc-487f-b53c-04cf8958ae0e'] Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0493693-2fdc-487f-b53c-04cf8958ae0e'] Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0493693-2fdc-487f-b53c-04cf8958ae0e'] Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0493693-2fdc-487f-b53c-04cf8958ae0e'] Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f63a87e-3aff-4e8f-a807-7eea9679adea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group 0acae008-4d53-45cf-b03e-00b07dbef09d does not exist Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-a0493693-2fdc-487f-b53c-04cf8958ae0e'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:05.027162 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3f63a87e-3aff-4e8f-a807-7eea9679adea tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d" status: 404 len: 194 microversion: 2.1 time: 0.035539 Oct 12 22:57:05.031494 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2344/4561] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:04 2022] DELETE /compute/v2.1/os-security-groups/0acae008-4d53-45cf-b03e-00b07dbef09d => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:05.036709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ee6d09f-e7b6-49f3-881e-d4919d9bd8a2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44feb5fe50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.063876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:05.068645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-7ee6d09f-e7b6-49f3-881e-d4919d9bd8a2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:57:05.069251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-7ee6d09f-e7b6-49f3-881e-d4919d9bd8a2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:57:05.069783 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7ee6d09f-e7b6-49f3-881e-d4919d9bd8a2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:57:05.069783 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-59f2bead-737e-4bfa-8a64-18c962e1f128'] Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ee6d09f-e7b6-49f3-881e-d4919d9bd8a2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 HTTP/1.1 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-59f2bead-737e-4bfa-8a64-18c962e1f128'] Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '9ef7b430-2c0c-43f0-a075-fa1fef5eeda7'} Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:57:05.071723 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59f2bead-737e-4bfa-8a64-18c962e1f128'] Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59f2bead-737e-4bfa-8a64-18c962e1f128'] Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59f2bead-737e-4bfa-8a64-18c962e1f128'] Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59f2bead-737e-4bfa-8a64-18c962e1f128'] Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ee6d09f-e7b6-49f3-881e-d4919d9bd8a2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group 9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 does not exist Oct 12 22:57:05.074732 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-59f2bead-737e-4bfa-8a64-18c962e1f128'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:05.077536 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e3eeb08-0398-4959-8c86-8446a446e81f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1668 microversion: 2.1 time: 0.344848 Oct 12 22:57:05.077536 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2218/4562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:04 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1668 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:05.077657 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ee6d09f-e7b6-49f3-881e-d4919d9bd8a2 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7" status: 404 len: 194 microversion: 2.1 time: 0.040600 Oct 12 22:57:05.081515 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2345/4563] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:05 2022] DELETE /compute/v2.1/os-security-groups/9ef7b430-2c0c-43f0-a075-fa1fef5eeda7 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:05.087977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dd7b69a-3045-4f2d-b9c0-a8e165da7f09 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f45050ea9d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.136437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG neutronclient.v2_0.client [None req-5dd7b69a-3045-4f2d-b9c0-a8e165da7f09 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist", "detail": ""}} {{(pid=120543) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:57:05.137048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.security_group_api [None req-5dd7b69a-3045-4f2d-b9c0-a8e165da7f09 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 not found {{(pid=120543) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:57:05.137681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5dd7b69a-3045-4f2d-b9c0-a8e165da7f09 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:57:05.137681 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-68aecff3-e098-4dd4-b27c-771d4f5a3075'] Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dd7b69a-3045-4f2d-b9c0-a8e165da7f09 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8 HTTP/1.1 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: exception: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-68aecff3-e098-4dd4-b27c-771d4f5a3075'] Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'f1071ee7-eabd-4dc7-a5c5-325aad142fe8'} Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:57:05.139660 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aecff3-e098-4dd4-b27c-771d4f5a3075'] Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aecff3-e098-4dd4-b27c-771d4f5a3075'] Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aecff3-e098-4dd4-b27c-771d4f5a3075'] Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aecff3-e098-4dd4-b27c-771d4f5a3075'] Oct 12 22:57:05.143685 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.147493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dd7b69a-3045-4f2d-b9c0-a8e165da7f09 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group f1071ee7-eabd-4dc7-a5c5-325aad142fe8 does not exist Oct 12 22:57:05.147493 n-d-860864-8 devstack@n-api.service[120543]: Neutron server returns request_ids: ['req-68aecff3-e098-4dd4-b27c-771d4f5a3075'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:05.148424 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dd7b69a-3045-4f2d-b9c0-a8e165da7f09 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8" status: 404 len: 194 microversion: 2.1 time: 0.064405 Oct 12 22:57:05.148987 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2219/4564] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:05 2022] DELETE /compute/v2.1/os-security-groups/f1071ee7-eabd-4dc7-a5c5-325aad142fe8 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:05.157162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b536d0b-7706-4a87-8e9e-6ef6dbb625dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f4505195f70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.180389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG neutronclient.v2_0.client [None req-4b536d0b-7706-4a87-8e9e-6ef6dbb625dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist", "detail": ""}} {{(pid=120542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 22:57:05.181657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-4b536d0b-7706-4a87-8e9e-6ef6dbb625dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Neutron security group a55de4f1-1904-46a8-b93b-46b04fd738fa not found {{(pid=120542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 22:57:05.182360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-4b536d0b-7706-4a87-8e9e-6ef6dbb625dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:57:05.182360 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-3c389c11-fca9-44d1-9f97-66b3f660c0e3'] Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b536d0b-7706-4a87-8e9e-6ef6dbb625dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa HTTP/1.1 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: exception: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-3c389c11-fca9-44d1-9f97-66b3f660c0e3'] Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a55de4f1-1904-46a8-b93b-46b04fd738fa'} Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 22:57:05.185110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c389c11-fca9-44d1-9f97-66b3f660c0e3'] Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c389c11-fca9-44d1-9f97-66b3f660c0e3'] Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c389c11-fca9-44d1-9f97-66b3f660c0e3'] Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c389c11-fca9-44d1-9f97-66b3f660c0e3'] Oct 12 22:57:05.188542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:05.191800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b536d0b-7706-4a87-8e9e-6ef6dbb625dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Security group a55de4f1-1904-46a8-b93b-46b04fd738fa does not exist Oct 12 22:57:05.191800 n-d-860864-8 devstack@n-api.service[120542]: Neutron server returns request_ids: ['req-3c389c11-fca9-44d1-9f97-66b3f660c0e3'] {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:05.192785 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b536d0b-7706-4a87-8e9e-6ef6dbb625dc tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa" status: 404 len: 194 microversion: 2.1 time: 0.039465 Oct 12 22:57:05.193370 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2346/4565] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:05 2022] DELETE /compute/v2.1/os-security-groups/a55de4f1-1904-46a8-b93b-46b04fd738fa => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:05.202146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.202657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:05.212262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.212972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.213413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.214132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.214585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.215009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.249773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:57:05.336975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0a83d23-b778-4cd9-8850-6f84805ca493 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 204 len: 0 microversion: 2.1 time: 0.138926 Oct 12 22:57:05.339992 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2220/4566] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:05 2022] DELETE /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:57:05.345890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.346508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:05.353525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.354009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.354450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.355148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.355601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.356085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.507611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:05.516537 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c7c28f52-f2ac-43ef-9cdd-52e80166feba tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1646 microversion: 2.1 time: 0.174535 Oct 12 22:57:05.517108 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2347/4567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:05 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1646 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:05.703449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.704186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:05.710276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.710700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.711133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.711814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.712288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.712710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.862938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:05.871432 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5669cfef-9850-43ea-93a7-0a2b726ebfe2 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.172193 Oct 12 22:57:05.884339 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2221/4568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:05 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:05.971375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:05.972341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:05.979550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.980231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.980764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:05.982394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:05.983219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:05.983801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.052506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:06.060779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bf5c249a-d67b-4620-9f17-823f92273bb1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1184 microversion: 2.1 time: 0.093287 Oct 12 22:57:06.062699 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2348/4569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:05 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1184 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:06.098764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:06.099393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:06.107133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.107745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.108320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.109153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.109714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.110229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.115119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:06.254676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:06.263147 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78a2fc40-e5e4-4d2d-8ea8-7c2f88c1c2c7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1668 microversion: 2.1 time: 0.168370 Oct 12 22:57:06.264162 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2222/4570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:06 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:06.539774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:06.540634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:06.547998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.548765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.549405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.550307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.550960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.551589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.716846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:06.725549 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ad6504f-9734-4be2-86a2-23440cb7d4f6 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1646 microversion: 2.1 time: 0.189682 Oct 12 22:57:06.740441 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2349/4571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:06 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1646 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:06.895259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:06.896900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:06.904287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.904949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.905649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:06.906500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:06.907096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:06.907664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.085108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:07.085883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:07.093755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.098270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.099769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.105255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.106861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.107519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.187375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:07.197540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:07.197740 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-983e9a25-af4b-416d-96a2-2437b8d16d25 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 200 len: 1184 microversion: 2.1 time: 0.115736 Oct 12 22:57:07.204616 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2350/4572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:07 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 1184 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:07.212609 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d0643ec-f6fa-4c24-b4cc-00be2d638415 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.319978 Oct 12 22:57:07.213592 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2223/4573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:06 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:07.289706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:07.290253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:07.300103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.300594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.301038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.308308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.308794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.309977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.425133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8faaa2c1-b367-490a-b706-51b56d57f339 req-a8b5abde-1878-43a8-9141-8df2b5215743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b803444-451e-4840-81a0-8b207b378222", "name": "network-vif-deleted", "tag": "f8c7b006-7a37-4818-8fa0-1873e27f6eb5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:07.455651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8faaa2c1-b367-490a-b706-51b56d57f339 req-a8b5abde-1878-43a8-9141-8df2b5215743 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.456184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8faaa2c1-b367-490a-b706-51b56d57f339 req-a8b5abde-1878-43a8-9141-8df2b5215743 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.456664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8faaa2c1-b367-490a-b706-51b56d57f339 req-a8b5abde-1878-43a8-9141-8df2b5215743 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.482094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8faaa2c1-b367-490a-b706-51b56d57f339 req-a8b5abde-1878-43a8-9141-8df2b5215743 service nova] Creating event network-vif-deleted:f8c7b006-7a37-4818-8fa0-1873e27f6eb5 for instance 8b803444-451e-4840-81a0-8b207b378222 on n-h1-860864-8 Oct 12 22:57:07.489485 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8faaa2c1-b367-490a-b706-51b56d57f339 req-a8b5abde-1878-43a8-9141-8df2b5215743 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071236 Oct 12 22:57:07.491349 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2224/4574] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:07.565399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:07.574300 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d73ff332-02de-407c-bf0d-ffaa7777ad35 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.288821 Oct 12 22:57:07.588085 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2351/4575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:07 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:07.599754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:07.602194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:07.608698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.609190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.609634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.610352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.610807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.611233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.671147 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6574de85-27c7-445c-9c00-5641732b810d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 200 len: 321 microversion: 2.1 time: 0.075682 Oct 12 22:57:07.671924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2225/4576] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:57:07 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 321 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:07.681733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:07.682479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:07.695813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.696402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.697691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.698701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.700407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.701032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.752274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:07.753750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:07.768978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.769844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.771763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.775522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.776278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.777427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.855447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.856738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.860242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.860731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lazy-loading 'fault' on Instance uuid 8b803444-451e-4840-81a0-8b207b378222 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:57:07.920147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:07.929455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d248ac0e-f923-4974-be42-5b213ad20756 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.251531 Oct 12 22:57:07.944612 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2352/4577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:07 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:07.959097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0b3f174f9e482985ca9e2f6ab1d07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f26c248bd284a3c86930342bee327a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:07.960358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:07.960971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:07.968374 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2eb4adf-96fb-4d3c-91d1-280152d27249 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 200 len: 1305 microversion: 2.1 time: 0.222201 Oct 12 22:57:07.968962 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2226/4578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:07 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:07.977494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.978026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.978630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:07.979581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:07.980193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:07.980826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.168690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:08.180384 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24d880c4-5744-4492-a242-36a85fa5813c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.223641 Oct 12 22:57:08.181594 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2353/4579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:07 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:08.205021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:08.205846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:08.218241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.218955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.219726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.220607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.221284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.221659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:08.222090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.222271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:08.228426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.229155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.229791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.230660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.231313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.233667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.251161 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 HTTP/1.1 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '984f1775-6842-4f0a-b001-2d6cfc44a8e1'} Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:08.253015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.256259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:08.256259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:08.256259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:08.256259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:08.256259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:08.256259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:08.256259 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:08.258139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:08.259318 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f416c23-ca0e-462e-b230-9738eb4e670a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 404 len: 111 microversion: 2.1 time: 0.041544 Oct 12 22:57:08.260394 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2354/4580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:08 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:08.267849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:08.268829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:08.278945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.279629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.280272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.281161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.281783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.282378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.438838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:08.450687 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-127bd6ad-a24f-4b48-837e-3fd118e17008 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.249727 Oct 12 22:57:08.467203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:08.468039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2227/4581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:08 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:08.477328 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7fd9304b-64a6-4089-90a5-b8726e25fd7a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.215745 Oct 12 22:57:08.478081 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2355/4582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:08 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:08.479623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:08.480240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:08.488191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.488698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.489274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.489987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:08.490443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:08.491055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:08.648205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:08.655560 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2123d5b6-f1e5-4e61-a361-e44c50385292 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.185442 Oct 12 22:57:08.656157 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2228/4583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:08 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:08.776521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2015783290", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "41c00e0a-6171-41b3-913b-03da316da8e7"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:08.840948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] validate_networks() for [('41c00e0a-6171-41b3-913b-03da316da8e7', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:57:08.993001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:08.993724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] [instance: 8b803444-451e-4840-81a0-8b207b378222] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:09.001027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.001504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.002118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.002823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.003277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.003697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.018723 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] HTTP exception thrown: Instance 8b803444-451e-4840-81a0-8b207b378222 could not be found. Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Request method failure captured: Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 HTTP/1.1 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0X8C54DPtGu9OvG9vUW4Vpdh7a6U-W4ddIXlh2yoE-s9v4Y2S2CZ7GWfwgVpT_VgV1kCAo8jCXIWgN4ir1QoDZBKgATntpqJ40l8p4QsuSlh5sTPbE2tVYIlcVEWSnFyQNOgdaTaTT5y1jb3a5Kt3Jp9UzrVapKS0resDwhgcYGYTU Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f26c248bd284a3c86930342bee327a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f26c248bd284a3c86930342bee327a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f26c248bd284a3c86930342bee327a3"}]}] Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8f26c248bd284a3c86930342bee327a3 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1022612190 Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cb0b3f174f9e482985ca9e2f6ab1d07d Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-SecurityGroupsTestJSON-1022612190-project Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 8b803444-451e-4840-81a0-8b207b378222 could not be found. Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '8b803444-451e-4840-81a0-8b207b378222'} Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b803444-451e-4840-81a0-8b207b378222 could not be found. Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b803444-451e-4840-81a0-8b207b378222 could not be found. Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:09.021274 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b803444-451e-4840-81a0-8b207b378222 could not be found. Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Returning 404 to user: Instance 8b803444-451e-4840-81a0-8b207b378222 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-498603f1-b77c-44c4-abd8-fd9e3fd5e341 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222" status: 404 len: 111 microversion: 2.1 time: 0.033092 Oct 12 22:57:09.025961 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2229/4584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:08 2022] GET /compute/v2.1/servers/8b803444-451e-4840-81a0-8b207b378222 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:09.031473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b9c5cc7-dc34-4bd2-86cb-6f2aac3387f1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44fe92df70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:09.255770 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b9c5cc7-dc34-4bd2-86cb-6f2aac3387f1 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a33fd96c-fe55-4ede-a465-b32347845bbb" status: 202 len: 0 microversion: 2.1 time: 0.227908 Oct 12 22:57:09.256864 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2230/4585] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:09 2022] DELETE /compute/v2.1/os-security-groups/a33fd96c-fe55-4ede-a465-b32347845bbb => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:57:09.265960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b7eff9a-45b5-4558-9617-d307f40dd564 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] Calling method '.version_select at 0x7f44ff87fc10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:09.284279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:57:09.291109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:57:09.298036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:57:09.298464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:57:09.298874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:57:09.327984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.328664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.329240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.331217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.331819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.332522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.358030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:09.366073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for user b103c953780a4dce8d8872ee8b47d186 and project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:09.387826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:57:09.391830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:57:09.474699 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37c4b8bc-8094-42e5-96dd-a04d4e6e5263 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702578 Oct 12 22:57:09.475825 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2356/4586] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:57:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:57:09.487806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08f1cf40-560d-47d8-b7c3-b4deaafbc3cb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:09.488544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08f1cf40-560d-47d8-b7c3-b4deaafbc3cb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:09.556390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-08f1cf40-560d-47d8-b7c3-b4deaafbc3cb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:09.566867 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08f1cf40-560d-47d8-b7c3-b4deaafbc3cb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1215 microversion: 2.1 time: 0.083311 Oct 12 22:57:09.573313 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b7eff9a-45b5-4558-9617-d307f40dd564 tempest-SecurityGroupsTestJSON-1022612190 tempest-SecurityGroupsTestJSON-1022612190-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e4efeb58-249c-4bf7-939f-ca7ed02fc366" status: 202 len: 0 microversion: 2.1 time: 0.312592 Oct 12 22:57:09.580015 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2231/4587] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 22:57:09 2022] DELETE /compute/v2.1/os-security-groups/e4efeb58-249c-4bf7-939f-ca7ed02fc366 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:57:09.581106 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2357/4588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:09 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:09.588563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:09.592442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:09.625454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.625954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.634210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.636619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:09.637413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:09.637855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:09.853352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:09.862445 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4020d5f-d10a-4eb9-b9c4-efe1fa260191 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.281066 Oct 12 22:57:09.863045 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2232/4589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:09 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:10.594066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:10.594676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:10.620058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:10.622151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:10.624418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:10.626352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:10.628243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:10.628869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:10.816667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:10.826090 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4682aea5-ab0b-4b22-a01f-ef70432dac34 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1211 microversion: 2.1 time: 0.236278 Oct 12 22:57:10.828997 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2358/4590] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:10 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1211 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:10.889974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:10.890622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:10.902376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:10.902903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:10.903347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:10.904086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:10.904707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:10.905350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:11.102254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:11.112787 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e3e71c1-def6-4b9c-ba8c-e500e91390d9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.226880 Oct 12 22:57:11.113982 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2233/4591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:10 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:11.618483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:11.619206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:11.631837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.640656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.641120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:11.641892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.642354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.642791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:11.691179 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 HTTP/1.1 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '984f1775-6842-4f0a-b001-2d6cfc44a8e1'} Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:11.702304 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:11.710403 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dd93c662-57ad-46d7-a08a-aafd9f1f729e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 404 len: 111 microversion: 2.1 time: 0.090167 Oct 12 22:57:11.713014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:11.713631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 984f1775-6842-4f0a-b001-2d6cfc44a8e1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:11.722535 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2359/4592] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:11 2022] DELETE /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:11.726102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.728137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.729682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:11.737478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.740030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.740672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:11.791798 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 HTTP/1.1 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '984f1775-6842-4f0a-b001-2d6cfc44a8e1'} Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:11.798894 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:11.802800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 984f1775-6842-4f0a-b001-2d6cfc44a8e1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:11.803481 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f724fae-6a32-457d-9cfa-350b09b387b2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1" status: 404 len: 111 microversion: 2.1 time: 0.094393 Oct 12 22:57:11.805585 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2234/4593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:11 2022] GET /compute/v2.1/servers/984f1775-6842-4f0a-b001-2d6cfc44a8e1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:11.854065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:11.855038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:11.868286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:11.872623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.874901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.876084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:11.880032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:11.884308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:11.888493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:12.142019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:12.142701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:12.161676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:12.167343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:12.167735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:12.173180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:12.173685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:12.176439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:12.201973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:12.217294 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9145a6d-bd04-4c4f-b958-8bafd1f82288 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1273 microversion: 2.1 time: 0.367864 Oct 12 22:57:12.217909 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2360/4594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:11 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:13.244904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:13.245521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:13.269089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:13.269607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:13.270055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:13.271050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:13.271537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:13.271993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:13.802113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:13.820073 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1e454c47-80f8-4b28-a58d-763561b43fc5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 1.682668 Oct 12 22:57:13.822420 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2235/4595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:12 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:14.250829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:14.259585 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf12a4cd-80b8-4b33-934c-e332eb4931e3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1315 microversion: 2.1 time: 1.018544 Oct 12 22:57:14.279971 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2361/4596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:13 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:14.849021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:14.849938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:14.862995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:14.865119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:14.866032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:14.870695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:14.876719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:14.877508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:14.897618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-21217cc4-ad0a-4028-929f-a10d4c525bc6 req-1da27fe7-8902-42e1-9c86-797bbf4201bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97dc7de-4628-4c6d-9f78-53941bd984f9", "tag": "5afe1bc2-e0a9-41de-b206-5b439f6fe890"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:14.924912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-21217cc4-ad0a-4028-929f-a10d4c525bc6 req-1da27fe7-8902-42e1-9c86-797bbf4201bf service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:14.925601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-21217cc4-ad0a-4028-929f-a10d4c525bc6 req-1da27fe7-8902-42e1-9c86-797bbf4201bf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:14.933111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-21217cc4-ad0a-4028-929f-a10d4c525bc6 req-1da27fe7-8902-42e1-9c86-797bbf4201bf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:14.952987 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-21217cc4-ad0a-4028-929f-a10d4c525bc6 req-1da27fe7-8902-42e1-9c86-797bbf4201bf service nova] Creating event network-changed:5afe1bc2-e0a9-41de-b206-5b439f6fe890 for instance c97dc7de-4628-4c6d-9f78-53941bd984f9 on n-h1-860864-8 Oct 12 22:57:14.962749 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-21217cc4-ad0a-4028-929f-a10d4c525bc6 req-1da27fe7-8902-42e1-9c86-797bbf4201bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069229 Oct 12 22:57:14.963609 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2362/4597] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:15.274411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:15.300697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:15.301731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:15.312764 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d43df2d-33a2-4008-a337-7bed3b0cdef4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.468385 Oct 12 22:57:15.360459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:15.360850 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2236/4598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:14 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:15.364549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:15.365945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:15.366925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:15.368521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:15.369168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:15.381610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:15.622680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:15.634557 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f5de53e3-4842-47c9-ab06-2069bd965b87 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1315 microversion: 2.1 time: 0.340070 Oct 12 22:57:15.635807 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2363/4599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:15 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:16.345222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:16.346435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:16.354750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:16.360265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:16.360945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:16.362474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:16.363189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:16.364582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:16.560687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:16.570140 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-506645bb-7eb5-4b32-ab88-a437965e1c40 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1512 microversion: 2.1 time: 0.228665 Oct 12 22:57:16.571600 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2237/4600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:16 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:16.658741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:16.659466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:16.667109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:16.667951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:16.669104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:16.670053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:16.670712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:16.671345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:16.889998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:16.899517 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d12a3337-8fbc-4c5d-b9a4-395d6fe4f0a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1315 microversion: 2.1 time: 0.244513 Oct 12 22:57:16.915208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2364/4601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:16 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:17.595263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:17.596515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:17.607636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.608633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.609283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.610193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.610813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.611379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.795799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:17.804657 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-67aca928-923a-449b-9112-94260abeeb44 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1489 microversion: 2.1 time: 0.213275 Oct 12 22:57:17.805415 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2238/4602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:17 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1489 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:17.837698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-318589371"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:17.840869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:17.847906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.848578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.849178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.850235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.850836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.851567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.924316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:17.924862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:17.926823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:17.930719 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4adcf62-61d7-434f-8c45-c987ce536cc9 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "PUT /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1061 microversion: 2.1 time: 0.096718 Oct 12 22:57:17.931970 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2365/4603] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 22:57:17 2022] PUT /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1061 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:17.941778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.942135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.942755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.943722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.944481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.945052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.956168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:17.957049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:17.963962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.964655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.966071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:17.967083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:17.967836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:17.968553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.163640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:18.173802 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c501d44a-111f-4577-8281-d9b115567b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1315 microversion: 2.1 time: 0.254091 Oct 12 22:57:18.175679 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2239/4604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:17 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:18.204481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:18.213419 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-577b22c5-365b-4acd-a0aa-ae9d8c27e088 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1488 microversion: 2.1 time: 0.261731 Oct 12 22:57:18.215861 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2366/4605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:17 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1488 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:18.240206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:18.240821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:18.246889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:18.247372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:18.247804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.248554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:18.249002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:18.249423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.491935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:18.517076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d324403d-8bbe-4329-8e3e-f283cf002f88 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1488 microversion: 2.1 time: 0.281095 Oct 12 22:57:18.531398 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2240/4606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:18 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1488 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:18.563540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:18.567734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:18.591521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:18.593884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:18.595068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.596885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:18.600764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:18.604522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.709013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:57:18.907051 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-773f4851-d9b1-4088-b91f-a5b45e64c32a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 204 len: 0 microversion: 2.1 time: 0.351766 Oct 12 22:57:18.910047 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2367/4607] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:18 2022] DELETE /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:18.919328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:18.919977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:18.935660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:18.936455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:18.938013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:18.938907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:18.939536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:18.940157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:19.116203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:19.127103 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54163464-89c5-4191-847c-fd0748a66450 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1494 microversion: 2.1 time: 0.212573 Oct 12 22:57:19.128069 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2241/4608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:18 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1494 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:19.204484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:19.205680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:19.223496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:19.225237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:19.226559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:19.229540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:19.231288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:19.232714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:19.348812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:19.481114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:19.500624 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f182c5a1-29df-444d-adce-d5b8ad1c54e4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1315 microversion: 2.1 time: 0.305390 Oct 12 22:57:19.502396 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2368/4609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:19 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:20.155116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:20.157167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:20.172794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.173326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.174450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.177010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.178769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.179159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.529788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:20.531494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:20.546657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:20.554445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.555008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.555464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.556226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:20.556679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:20.564348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:20.631706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:20.634076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:20.645854 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-82425400-fd47-40b0-8e52-18c9f2214065 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1494 microversion: 2.1 time: 0.496255 Oct 12 22:57:20.647391 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2242/4610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:20 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1494 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:20.957051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:20.967642 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eab372d2-f02b-45b7-b8d4-1462f197f830 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1315 microversion: 2.1 time: 0.441059 Oct 12 22:57:20.969081 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2369/4611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:20 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:21.020947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-509613a1-a488-4e30-b2e9-1b2fd5ff3795 req-d48547c6-e9e8-4e2c-bd8a-bf7b1b9873de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97dc7de-4628-4c6d-9f78-53941bd984f9", "name": "network-vif-plugged", "status": "completed", "tag": "5afe1bc2-e0a9-41de-b206-5b439f6fe890"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:21.048443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-509613a1-a488-4e30-b2e9-1b2fd5ff3795 req-d48547c6-e9e8-4e2c-bd8a-bf7b1b9873de service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:21.049054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-509613a1-a488-4e30-b2e9-1b2fd5ff3795 req-d48547c6-e9e8-4e2c-bd8a-bf7b1b9873de service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:21.049727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-509613a1-a488-4e30-b2e9-1b2fd5ff3795 req-d48547c6-e9e8-4e2c-bd8a-bf7b1b9873de service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:21.080828 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-509613a1-a488-4e30-b2e9-1b2fd5ff3795 req-d48547c6-e9e8-4e2c-bd8a-bf7b1b9873de service nova] Creating event network-vif-plugged:5afe1bc2-e0a9-41de-b206-5b439f6fe890 for instance c97dc7de-4628-4c6d-9f78-53941bd984f9 on n-h1-860864-8 Oct 12 22:57:21.092925 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-509613a1-a488-4e30-b2e9-1b2fd5ff3795 req-d48547c6-e9e8-4e2c-bd8a-bf7b1b9873de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368747 Oct 12 22:57:21.095844 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2243/4612] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:21.207766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8490e7a8-268e-4de6-bee6-7b950246d079 req-ef94fa55-2d1e-47c8-8279-a87de26530ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9", "name": "network-vif-deleted", "tag": "d934155c-bc6b-4e3b-8861-b1486dc11c6e"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:21.240583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8490e7a8-268e-4de6-bee6-7b950246d079 req-ef94fa55-2d1e-47c8-8279-a87de26530ca service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:21.242142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8490e7a8-268e-4de6-bee6-7b950246d079 req-ef94fa55-2d1e-47c8-8279-a87de26530ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:21.242762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8490e7a8-268e-4de6-bee6-7b950246d079 req-ef94fa55-2d1e-47c8-8279-a87de26530ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:21.299808 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8490e7a8-268e-4de6-bee6-7b950246d079 req-ef94fa55-2d1e-47c8-8279-a87de26530ca service nova] Creating event network-vif-deleted:d934155c-bc6b-4e3b-8861-b1486dc11c6e for instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 on n-h2-860864-8 Oct 12 22:57:21.318249 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8490e7a8-268e-4de6-bee6-7b950246d079 req-ef94fa55-2d1e-47c8-8279-a87de26530ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118959 Oct 12 22:57:21.324964 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2370/4613] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:21.672729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:21.674024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:21.698111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:21.698609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:21.699088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:21.699795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:21.700272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:21.700699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:21.757627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:21.758345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:21.758923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:21.759553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lazy-loading 'fault' on Instance uuid 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:57:21.993049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:21.994414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:22.006779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:22.014734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:22.015730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:22.017544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:22.028334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:22.028982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:22.095394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:22.107283 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-22a53bfc-9ac9-4ea1-864a-bc8fa75e1a2f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 200 len: 1309 microversion: 2.1 time: 0.439708 Oct 12 22:57:22.108257 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2244/4614] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:21 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 1309 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:22.379236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:22.392245 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b37b19d-b4f6-4ce2-b533-0cbea5e5cfe1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1315 microversion: 2.1 time: 0.401560 Oct 12 22:57:22.392870 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2371/4615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:21 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:23.133158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.134653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.148083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.148628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.149084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.149829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.150291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.150722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.188894 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 HTTP/1.1 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9'} Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.190544 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd2432f9-e68c-4f45-b559-502dc672ec32 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 404 len: 111 microversion: 2.1 time: 0.062988 Oct 12 22:57:23.194842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2245/4616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.207379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.207936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.217004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.217501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.217941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.218650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.219104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.219526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.239712 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 HTTP/1.1 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9'} Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.241816 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.245838 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.250993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.252477 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f425f9c-58ee-4d29-af80-ed93af3e0626 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 404 len: 111 microversion: 2.1 time: 0.050689 Oct 12 22:57:23.255598 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2372/4617] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:23.262097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.262978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.270665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.271544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.272320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.272964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.273459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.273874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.296140 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 HTTP/1.1 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9'} Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.298002 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34ad2c01-6fb9-480d-974f-c3926eccffc7 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9" status: 404 len: 111 microversion: 2.1 time: 0.041989 Oct 12 22:57:23.301245 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2246/4618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/928d6cdd-2398-46dd-9a8e-cb6bdf9a25f9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.308413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.309781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.315496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.316022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.316915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.318048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.319029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.319612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.334787 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 HTTP/1.1 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '7adaacc3-adb1-4645-9e7a-047616d8a877'} Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.336703 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef5f4586-12fb-4d94-ae98-55bb97e97317 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 404 len: 111 microversion: 2.1 time: 0.033715 Oct 12 22:57:23.342998 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2373/4619] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.351266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.351906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 7adaacc3-adb1-4645-9e7a-047616d8a877] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.362299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.362802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.363234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.364205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.364638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.365605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.392453 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 HTTP/1.1 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7adaacc3-adb1-4645-9e7a-047616d8a877'} Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.394021 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 7adaacc3-adb1-4645-9e7a-047616d8a877 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.397689 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18d73ac0-c318-4bab-911e-5b18baae4316 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877" status: 404 len: 111 microversion: 2.1 time: 0.051408 Oct 12 22:57:23.400658 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2247/4620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/7adaacc3-adb1-4645-9e7a-047616d8a877 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.411072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.412124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.420710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.422541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.423259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.424033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.424545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.426748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.427421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.429498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.432228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.432889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.433874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.434787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.435431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.436240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.467704 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 HTTP/1.1 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'bfb8f9f4-0bea-47e2-8d9b-60150b994572'} Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.474903 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a02710a1-00b0-4169-ab6f-68f3c2087b1d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 404 len: 111 microversion: 2.1 time: 0.072512 Oct 12 22:57:23.478352 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2374/4621] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.489181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.490071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: bfb8f9f4-0bea-47e2-8d9b-60150b994572] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.496862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.497879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.498815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.500017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.500681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.501110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.519875 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 HTTP/1.1 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'bfb8f9f4-0bea-47e2-8d9b-60150b994572'} Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.522078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.526312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.526312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.526312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.526312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.526312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.526312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. Oct 12 22:57:23.526312 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.528311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance bfb8f9f4-0bea-47e2-8d9b-60150b994572 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.529220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef5f38ac-33da-4c54-9909-f9ce7926d3c4 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572" status: 404 len: 111 microversion: 2.1 time: 0.044103 Oct 12 22:57:23.529982 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2375/4622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/bfb8f9f4-0bea-47e2-8d9b-60150b994572 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.538520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.539471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.546355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.546872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.547387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.548314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.548963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.550524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.568318 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 HTTP/1.1 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1abe2aa3-5fb8-4c1c-855a-3de4a40b1997'} Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.570267 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8fcab173-4e1e-4446-8373-cd87c1a0761a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 404 len: 111 microversion: 2.1 time: 0.038707 Oct 12 22:57:23.574365 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2376/4623] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:23.582277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.582975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.591231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.591820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.592351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.593278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.593671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.594162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.611345 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 HTTP/1.1 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '1abe2aa3-5fb8-4c1c-855a-3de4a40b1997'} Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.613025 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.617718 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0396f316-5b06-4de0-88ac-1c4cd4e01e5d tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997" status: 404 len: 111 microversion: 2.1 time: 0.037543 Oct 12 22:57:23.618860 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2377/4624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/1abe2aa3-5fb8-4c1c-855a-3de4a40b1997 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.623603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.624133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.630432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.630927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.631364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.632091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.632562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.632965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.648545 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f HTTP/1.1 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '90e16df0-d29d-42ba-83cb-dc2a75472b2f'} Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.650110 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bfe0598e-f91c-4cc7-8d9e-edbac73136f0 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 404 len: 111 microversion: 2.1 time: 0.031696 Oct 12 22:57:23.656369 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2378/4625] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.664120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.664852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 90e16df0-d29d-42ba-83cb-dc2a75472b2f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.671289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.671923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.672475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.673274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.673827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.674475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.690196 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f HTTP/1.1 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '90e16df0-d29d-42ba-83cb-dc2a75472b2f'} Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.692361 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.695658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.695658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.695658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.695658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.695658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.695658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. Oct 12 22:57:23.695658 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.696736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 90e16df0-d29d-42ba-83cb-dc2a75472b2f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.701288 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d68b80ae-a0e2-42af-9e3c-04d031bf89dd tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f" status: 404 len: 111 microversion: 2.1 time: 0.040536 Oct 12 22:57:23.703411 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2379/4626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/90e16df0-d29d-42ba-83cb-dc2a75472b2f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.711830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.712512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.719325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.720325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.720872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.721675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.722310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.722835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.737346 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 HTTP/1.1 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd3b53753-ede7-453a-94fd-b6c571d367f8'} Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.739005 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.743041 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.744068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.745049 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b89a6775-c56a-4139-b4bd-1e9c33f914d1 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 404 len: 111 microversion: 2.1 time: 0.038143 Oct 12 22:57:23.749033 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2380/4627] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:23.754072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.754758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: d3b53753-ede7-453a-94fd-b6c571d367f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.762300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.763038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.763674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.764576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.765207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.765820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.783636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 HTTP/1.1 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd3b53753-ede7-453a-94fd-b6c571d367f8'} Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.786653 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.789934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.789934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.789934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.789934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.789934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.789934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. Oct 12 22:57:23.789934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.794770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance d3b53753-ede7-453a-94fd-b6c571d367f8 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.796840 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-945c62d9-0152-43bd-a9df-c0e7fb0a636c tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8" status: 404 len: 111 microversion: 2.1 time: 0.046694 Oct 12 22:57:23.801162 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2381/4628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/d3b53753-ede7-453a-94fd-b6c571d367f8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.808961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7aa0f306-6dca-4073-b47e-b0f7e718ddba tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.809456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7aa0f306-6dca-4073-b47e-b0f7e718ddba tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 400a9894-2ede-4cfd-8920-54548cd92a46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.813230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:23.816335 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7aa0f306-6dca-4073-b47e-b0f7e718ddba tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7aa0f306-6dca-4073-b47e-b0f7e718ddba tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46 HTTP/1.1 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '400a9894-2ede-4cfd-8920-54548cd92a46'} Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.817900 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.822021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.822021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.822021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.822021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.822021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.822021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.822021 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.822444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac72ecf1-8ba2-493f-97a4-bf9857d4e9c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1502 microversion: 2.1 time: 0.406081 Oct 12 22:57:23.822444 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2248/4629] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:23.824496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7aa0f306-6dca-4073-b47e-b0f7e718ddba tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.826138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7aa0f306-6dca-4073-b47e-b0f7e718ddba tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46" status: 404 len: 111 microversion: 2.1 time: 0.023300 Oct 12 22:57:23.827086 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2382/4630] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.850541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f62935dc-57d7-4645-8a83-df08491d6f5f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.851173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f62935dc-57d7-4645-8a83-df08491d6f5f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 400a9894-2ede-4cfd-8920-54548cd92a46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.861716 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f62935dc-57d7-4645-8a83-df08491d6f5f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f62935dc-57d7-4645-8a83-df08491d6f5f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46 HTTP/1.1 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '400a9894-2ede-4cfd-8920-54548cd92a46'} Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:23.863593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:23.868781 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:23.868781 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:23.868781 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:23.868781 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. Oct 12 22:57:23.868781 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:23.868781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f62935dc-57d7-4645-8a83-df08491d6f5f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 400a9894-2ede-4cfd-8920-54548cd92a46 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:23.868781 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f62935dc-57d7-4645-8a83-df08491d6f5f tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46" status: 404 len: 111 microversion: 2.1 time: 0.018624 Oct 12 22:57:23.869328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84ee38df-8ba0-4b50-8b0c-5e18889061cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:23.869457 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2249/4631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:23 2022] GET /compute/v2.1/servers/400a9894-2ede-4cfd-8920-54548cd92a46 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:23.879292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:23.880950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:23.884276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84ee38df-8ba0-4b50-8b0c-5e18889061cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.884974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84ee38df-8ba0-4b50-8b0c-5e18889061cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.885579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84ee38df-8ba0-4b50-8b0c-5e18889061cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.892735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.893225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.899628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.902727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:23.903211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:23.903650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:23.935617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84ee38df-8ba0-4b50-8b0c-5e18889061cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:57:23.967247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:57:24.026191 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84ee38df-8ba0-4b50-8b0c-5e18889061cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9/action" status: 202 len: 0 microversion: 2.1 time: 0.169196 Oct 12 22:57:24.027076 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2383/4632] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:57:23 2022] POST /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:57:24.037595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:24.042872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:24.053864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:24.054534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:24.055223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:24.055957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:24.056736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:24.057308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:24.138939 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3c5d8c6a-3db0-4ae4-abf6-338ae9d5f42e tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 204 len: 0 microversion: 2.1 time: 0.267468 Oct 12 22:57:24.140861 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2250/4633] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:23 2022] DELETE /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:24.154113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:24.155380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:24.165755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:24.166643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:24.167273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:24.168678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:24.169522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:24.170108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:24.300686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:24.305372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:24.313492 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52183bce-3483-48ef-a3dc-37e65bcbf286 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.281430 Oct 12 22:57:24.315031 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2384/4634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:24 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:24.507627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:24.517150 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25b9d94b-c3f5-4223-b9c9-590bd2e9ab64 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1479 microversion: 2.1 time: 0.371306 Oct 12 22:57:24.518280 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2251/4635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:24 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1479 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:25.341153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:25.342324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:25.358617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:25.359183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:25.368774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:25.369777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:25.370402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:25.371033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:25.546574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:25.548517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:25.587201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:25.590100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:25.592043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:25.593246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:25.596171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:25.596957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:25.827418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:25.841976 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-834353e4-3d02-4550-88bd-3476269038d5 tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1479 microversion: 2.1 time: 0.298742 Oct 12 22:57:25.843278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:25.843513 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2252/4636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:25 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1479 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:25.862510 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-012abd57-3353-4799-92c9-30305629c9cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.527791 Oct 12 22:57:25.863423 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2385/4637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:25 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:25.969069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d7fa829-987a-4130-9ddd-92748e153946 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Action: 'create', calling method: .version_select at 0x7f44fe92dca0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-448938365", "policies": ["affinity"]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:25.988757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d7fa829-987a-4130-9ddd-92748e153946 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:25.994150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d7fa829-987a-4130-9ddd-92748e153946 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.062662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d7fa829-987a-4130-9ddd-92748e153946 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.069037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d7fa829-987a-4130-9ddd-92748e153946 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.090942 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d7fa829-987a-4130-9ddd-92748e153946 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.246118 Oct 12 22:57:26.092042 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2253/4638] 10.222.0.20 () {60 vars in 1174 bytes} [Wed Oct 12 22:57:25 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:26.103178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79ddf405-e414-4ed9-9ef3-cf7b9c0a2efe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Action: 'create', calling method: .version_select at 0x7f4507a39d30>, body: {"server_group": {"name": "tempest-server-group-211376601", "policies": ["affinity"]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:26.121239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79ddf405-e414-4ed9-9ef3-cf7b9c0a2efe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.127229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79ddf405-e414-4ed9-9ef3-cf7b9c0a2efe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.184400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79ddf405-e414-4ed9-9ef3-cf7b9c0a2efe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.190921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79ddf405-e414-4ed9-9ef3-cf7b9c0a2efe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.206585 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79ddf405-e414-4ed9-9ef3-cf7b9c0a2efe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.107291 Oct 12 22:57:26.207527 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2386/4639] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Oct 12 22:57:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:26.220295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d669001-7298-44df-a730-283944ba3d77 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Action: 'create', calling method: .version_select at 0x7f44ff5adee0>, body: {"server_group": {"name": "tempest-server-group-211376601", "policies": ["affinity"]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:26.250781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d669001-7298-44df-a730-283944ba3d77 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.262657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d669001-7298-44df-a730-283944ba3d77 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.291016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9edd9973-d2b2-42a1-af1b-c2e2eefc5d2f req-cc9390d7-2995-4356-b5ed-8e0a156a71c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d", "name": "network-vif-deleted", "tag": "e2e0ac2e-05a8-40ac-a187-195df3e0e09c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:26.322965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9edd9973-d2b2-42a1-af1b-c2e2eefc5d2f req-cc9390d7-2995-4356-b5ed-8e0a156a71c1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:26.325135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9edd9973-d2b2-42a1-af1b-c2e2eefc5d2f req-cc9390d7-2995-4356-b5ed-8e0a156a71c1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:26.325684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9edd9973-d2b2-42a1-af1b-c2e2eefc5d2f req-cc9390d7-2995-4356-b5ed-8e0a156a71c1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:26.340044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d669001-7298-44df-a730-283944ba3d77 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.343477 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9edd9973-d2b2-42a1-af1b-c2e2eefc5d2f req-cc9390d7-2995-4356-b5ed-8e0a156a71c1 service nova] Creating event network-vif-deleted:e2e0ac2e-05a8-40ac-a187-195df3e0e09c for instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d on n-h2-860864-8 Oct 12 22:57:26.349665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5d669001-7298-44df-a730-283944ba3d77 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.361885 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9edd9973-d2b2-42a1-af1b-c2e2eefc5d2f req-cc9390d7-2995-4356-b5ed-8e0a156a71c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075201 Oct 12 22:57:26.364355 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2387/4640] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:26.365963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d669001-7298-44df-a730-283944ba3d77 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.151399 Oct 12 22:57:26.367400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2254/4641] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Oct 12 22:57:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:26.384531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80052bbb-1624-4a4f-b6d5-fd59153adebe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.424497 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80052bbb-1624-4a4f-b6d5-fd59153adebe tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/18aeddd6-ac5b-4513-a79e-28bb21260cff" status: 204 len: 0 microversion: 2.1 time: 0.047219 Oct 12 22:57:26.425464 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2388/4642] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:26 2022] DELETE /compute/v2.1/os-server-groups/18aeddd6-ac5b-4513-a79e-28bb21260cff => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:26.434421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae76490b-641e-4630-af2c-a4e5ac831de8 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.449505 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae76490b-641e-4630-af2c-a4e5ac831de8 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.018659 Oct 12 22:57:26.450269 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2255/4643] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:57:26 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:26.461752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa934268-8087-4c20-b943-25592ee62c3a tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.481131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:26.493428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa934268-8087-4c20-b943-25592ee62c3a tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1" status: 204 len: 0 microversion: 2.1 time: 0.035848 Oct 12 22:57:26.494113 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2389/4644] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:26 2022] DELETE /compute/v2.1/os-server-groups/3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:57:26.506136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a919eda4-61de-46fc-9046-e660cea7c6cf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.529225 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a919eda4-61de-46fc-9046-e660cea7c6cf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029015 Oct 12 22:57:26.530178 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2256/4645] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:57:26 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:26.544744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81912df5-daef-4e4b-9238-90b09b4324f2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Action: 'create', calling method: .version_select at 0x7f44fee32160>, body: {"server_group": {"name": "tempest-server-group-1668660065", "policies": ["affinity"]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:26.570409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-81912df5-daef-4e4b-9238-90b09b4324f2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.577872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-81912df5-daef-4e4b-9238-90b09b4324f2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.627354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-81912df5-daef-4e4b-9238-90b09b4324f2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.633807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-81912df5-daef-4e4b-9238-90b09b4324f2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.648478 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81912df5-daef-4e4b-9238-90b09b4324f2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.107720 Oct 12 22:57:26.655488 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2390/4646] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Oct 12 22:57:26 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:26.660688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80c9bb2a-dcfc-4a2b-9108-cf1069727504 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.689554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:26.716061 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80c9bb2a-dcfc-4a2b-9108-cf1069727504 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/f27b8ca7-e836-4ce4-af30-6549bcaed2cb" status: 204 len: 0 microversion: 2.1 time: 0.059069 Oct 12 22:57:26.724081 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2257/4647] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:26 2022] DELETE /compute/v2.1/os-server-groups/f27b8ca7-e836-4ce4-af30-6549bcaed2cb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:26.725274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3aecbcf3-0cfd-4d9d-b316-7ef170224db2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.752350 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3aecbcf3-0cfd-4d9d-b316-7ef170224db2 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.030874 Oct 12 22:57:26.753242 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2391/4648] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:57:26 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:26.766242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1a0b851-6400-4437-ab89-da8c5d49392e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Action: 'create', calling method: .version_select at 0x7f44ff547ca0>, body: {"server_group": {"name": "tempest-server-group-1891781930", "policies": ["anti-affinity"]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:26.811529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b1a0b851-6400-4437-ab89-da8c5d49392e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.819870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b1a0b851-6400-4437-ab89-da8c5d49392e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.868580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.869490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:26.891357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:26.893330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:26.893862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:26.900988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:26.902271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:26.903782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:26.914312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b1a0b851-6400-4437-ab89-da8c5d49392e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:26.920884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b1a0b851-6400-4437-ab89-da8c5d49392e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_groups'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:26.974452 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1a0b851-6400-4437-ab89-da8c5d49392e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.213062 Oct 12 22:57:26.981672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2258/4649] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Oct 12 22:57:26 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:26.984940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:26.986016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:26.994018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:26.994373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:26.994811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:26.995570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:26.996047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:26.996471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:27.007694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:27.008592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:27.009349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:27.010186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lazy-loading 'fault' on Instance uuid 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:57:27.091595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c5b1061fe74546a69f5eadba4dc397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abad96e4285d4dd4af35ec5eab9a19be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:27.104379 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a970c86-d8bd-4ad4-93f4-16741420c30b tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 200 len: 1282 microversion: 2.1 time: 0.241203 Oct 12 22:57:27.120006 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2392/4650] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:26 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 1282 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:27.120006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54624028-86ea-495a-810e-fd4fef7ea57c tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:27.188571 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54624028-86ea-495a-810e-fd4fef7ea57c tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/acb34fde-24e0-47f9-9f91-7214be41501e" status: 204 len: 0 microversion: 2.1 time: 0.079241 Oct 12 22:57:27.190000 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2393/4651] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:27 2022] DELETE /compute/v2.1/os-server-groups/acb34fde-24e0-47f9-9f91-7214be41501e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:27.199629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a130efc9-7daa-48f2-8f5c-a9fbdf61563b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:27.215439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:27.224099 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a130efc9-7daa-48f2-8f5c-a9fbdf61563b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029645 Oct 12 22:57:27.236125 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2394/4652] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:57:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:27.236410 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a46c990-2ee4-4b5b-b7c6-ecc0796b0654 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.249435 Oct 12 22:57:27.236410 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2259/4653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:26 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:27.286003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1872835242", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "8d8c853a-44e4-4f21-a786-6271932b88bc"}]}, "os:scheduler_hints": {"group": "2d78c6f0-5f75-4baa-9913-f4fa9f34afda"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:27.377834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] validate_networks() for [('8d8c853a-44e4-4f21-a786-6271932b88bc', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:57:27.910667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:57:27.911012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:57:27.911480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:57:27.912179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:57:27.912631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:57:27.930009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:27.930490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:27.930920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:27.931698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:27.932289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:27.932724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:27.954638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:27.960853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:27.975500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:57:27.977990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:57:28.052430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:28.061655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:28.142207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:28.149619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Getting quotas for user fa6abac3662a4491a682e17a69243dfa and project d5f6f211d60648d29425e8150e5703bb. Resources: {'server_group_members'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:28.150600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:28.152420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] [instance: 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:28.167121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:28.168662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:28.169592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:28.170478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:28.171279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:28.172050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:28.201479 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] HTTP exception thrown: Instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d could not be found. Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Request method failure captured: Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d HTTP/1.1 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0WXQM3rICS7hdxuha-lXvE1de6jZy-ZOpEsLCfYPIQrq2r66CzPAIYARyHFfkoWWc9V6jPpO8j4Vm69Yi6oGmX4Joy37OP4n1fR1UKIqf48UJUHu5XZoiawel7HdumMyj4eqjIIICu8fhIcaOTSSnxFxjFw4spkNWwy_eQD1Bn6vcI Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abad96e4285d4dd4af35ec5eab9a19be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abad96e4285d4dd4af35ec5eab9a19be"}]}] Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersTestJSON-1170997256 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: abad96e4285d4dd4af35ec5eab9a19be Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersTestJSON-1170997256 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: d6c5b1061fe74546a69f5eadba4dc397 Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersTestJSON-1170997256-project Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d could not be found. Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d'} Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d could not be found. Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d could not be found. Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:28.209127 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d could not be found. Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] Returning 404 to user: Instance 0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:28.213666 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-28f610d7-d450-456e-a08d-c5796302567a tempest-ServersTestJSON-1170997256 tempest-ServersTestJSON-1170997256-project] 10.222.0.20 "GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d" status: 404 len: 111 microversion: 2.1 time: 0.082202 Oct 12 22:57:28.223216 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2260/4654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:28 2022] GET /compute/v2.1/servers/0fb22aa5-49a3-4c28-b2fa-a019c6c87a8d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:28.237491 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d895e1b-7954-40f2-859f-6195fe47658b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956483 Oct 12 22:57:28.237930 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2395/4655] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:57:28.252117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:28.252935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1a093a8-24ab-45c2-91bd-e5383bc3024a tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:28.252935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b1a093a8-24ab-45c2-91bd-e5383bc3024a tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:28.253114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:28.266113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:28.266610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:28.267046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:28.268064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:28.268522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:28.272510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:28.420402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1a093a8-24ab-45c2-91bd-e5383bc3024a tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:28.430539 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1a093a8-24ab-45c2-91bd-e5383bc3024a tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1213 microversion: 2.1 time: 0.181860 Oct 12 22:57:28.433931 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2261/4656] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:28 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:28.614458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:28.625261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-803e6115-be67-4980-a1cd-107ed4d155a7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.378036 Oct 12 22:57:28.640548 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2396/4657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:28 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:29.455978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:29.456693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:29.477858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:29.482014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:29.482641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:29.490473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:29.491099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:29.492384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:29.651624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:29.652857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:29.673800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:29.674391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:29.675028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:29.675964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:29.676603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:29.678020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:29.851930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:29.865505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-281378b4-9bc2-4d01-be40-423156191ec9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.218296 Oct 12 22:57:29.867401 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2397/4658] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:29 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:29.971431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:29.989114 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3bc6771e-2e25-43cc-b598-ec6a685b5004 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1265 microversion: 2.1 time: 0.537017 Oct 12 22:57:29.990580 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2262/4659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:29 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1265 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:30.892049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:30.892726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:30.918078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:30.919835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:30.921165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:30.923150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:30.924750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:30.926059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:31.016036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:31.016869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:31.038017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:31.038537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:31.038990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:31.039719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:31.040206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:31.040644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:31.268230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:31.283534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd8a1f93-578a-47aa-9a73-4ca4f44f4b2b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1271 microversion: 2.1 time: 0.272398 Oct 12 22:57:31.286442 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2263/4660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:31 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:31.409982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:31.421207 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6cf67dc9-2902-4bcc-a3fe-48949b4a98f3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.532407 Oct 12 22:57:31.422612 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2398/4661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:30 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:32.310801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:32.311379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:32.329422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:32.329919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:32.330357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:32.331107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:32.331563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:32.332017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:32.451248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:32.452528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:32.474413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:32.475478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:32.478203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:32.488050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:32.488050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:32.490753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:32.783359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:32.800596 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4448d1d9-ab3a-4704-9159-f1e609fc5f59 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1313 microversion: 2.1 time: 0.494591 Oct 12 22:57:32.802453 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2264/4662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:32 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:32.820744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:32.832135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79f1fa02-68a6-49a4-96b7-8a37a085b63a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.388672 Oct 12 22:57:32.833556 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2399/4663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:32 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:33.059750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1209ff30-3f08-4de1-9990-4ddac4dc3ef1 req-b5a3c0c3-f8d5-4167-803b-9e18b2b8075a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04db50c0-5d8f-48fd-b4ab-082de581513f", "tag": "2acdadd8-953c-4061-b8a8-ac8cb2f8229b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:33.082061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1209ff30-3f08-4de1-9990-4ddac4dc3ef1 req-b5a3c0c3-f8d5-4167-803b-9e18b2b8075a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:33.083397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1209ff30-3f08-4de1-9990-4ddac4dc3ef1 req-b5a3c0c3-f8d5-4167-803b-9e18b2b8075a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:33.084120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1209ff30-3f08-4de1-9990-4ddac4dc3ef1 req-b5a3c0c3-f8d5-4167-803b-9e18b2b8075a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:33.097821 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1209ff30-3f08-4de1-9990-4ddac4dc3ef1 req-b5a3c0c3-f8d5-4167-803b-9e18b2b8075a service nova] Creating event network-changed:2acdadd8-953c-4061-b8a8-ac8cb2f8229b for instance 04db50c0-5d8f-48fd-b4ab-082de581513f on n-h2-860864-8 Oct 12 22:57:33.104708 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1209ff30-3f08-4de1-9990-4ddac4dc3ef1 req-b5a3c0c3-f8d5-4167-803b-9e18b2b8075a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048845 Oct 12 22:57:33.105572 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2265/4664] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:33.822543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:33.823160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:33.831723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:33.832285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:33.832726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:33.833438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:33.833869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:33.834288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:33.862863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:33.864686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:33.900069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:33.901233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:33.909681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:33.910464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:33.911422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:33.911792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:34.039766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:34.051679 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd070e80-4f88-4517-918f-a9f3737d675f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1313 microversion: 2.1 time: 0.232898 Oct 12 22:57:34.052293 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2400/4665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:33 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:34.219759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:34.229103 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dad3274e-29a7-4a11-88ab-fd730df67a02 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.374005 Oct 12 22:57:34.230045 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2266/4666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:33 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:35.078257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:35.078874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:35.090223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:35.090709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:35.091309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:35.092223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:35.092822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:35.093392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:35.262273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:35.262962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:35.281564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:35.288878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:35.290838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:35.293445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:35.293891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:35.296740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:35.392651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:35.405118 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9dbc55ad-10b3-41f8-b7c4-2ac6552fafaf tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1313 microversion: 2.1 time: 0.330656 Oct 12 22:57:35.407641 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2401/4667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:35 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:35.543604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:35.552588 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e51defbc-4026-4567-886d-fcbae4886d3f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.304075 Oct 12 22:57:35.553182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2267/4668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:35 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:36.070716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-380588511", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": "none"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:36.082090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:36.137754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:57:36.138294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:57:36.139061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:57:36.139608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:57:36.140211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:57:36.150737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:36.152105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:36.152767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:36.153485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:36.154077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:36.154643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:36.173913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Getting quotas for project 68f73a3edf3a4c168a85f7435aee5ead. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:36.179646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Getting quotas for user c81543babf8d4ee0866efbf920bc87f5 and project 68f73a3edf3a4c168a85f7435aee5ead. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:36.194844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:57:36.197152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:57:36.248434 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-66807197-b16a-4ec4-9a29-97b50e41c3c1 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.319982 Oct 12 22:57:36.249700 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2402/4669] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:57:36.260414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3c11f759-3478-4bf6-9e41-a32bb17d625b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:36.261318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3c11f759-3478-4bf6-9e41-a32bb17d625b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:36.335938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3c11f759-3478-4bf6-9e41-a32bb17d625b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:36.346889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3c11f759-3478-4bf6-9e41-a32bb17d625b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:36.348841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3c11f759-3478-4bf6-9e41-a32bb17d625b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:36.349988 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3c11f759-3478-4bf6-9e41-a32bb17d625b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1277 microversion: 2.57 time: 0.093442 Oct 12 22:57:36.350549 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2268/4670] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:36 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:57:36.433327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:36.434843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:36.446583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:36.447153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:36.447709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:36.449203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:36.449977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:36.450971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:36.577910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:36.578613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:36.585123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:36.588980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:36.590644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:36.592500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:36.595259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:36.595973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:36.616559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:36.630370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab6180bd-766d-4785-a8a2-281c37f87d4e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1313 microversion: 2.1 time: 0.201633 Oct 12 22:57:36.630985 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2403/4671] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:36 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:36.790503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:36.800900 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25f90361-89a8-49a3-9447-548c07c3aba7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.227815 Oct 12 22:57:36.802716 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2269/4672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:36 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:37.353921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-677b42ad-0e53-4131-96fb-12b414b78b4d req-22f6ad35-e432-4b02-b289-eefa0ac459bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db50c0-5d8f-48fd-b4ab-082de581513f", "name": "network-vif-plugged", "status": "completed", "tag": "2acdadd8-953c-4061-b8a8-ac8cb2f8229b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:37.374585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-677b42ad-0e53-4131-96fb-12b414b78b4d req-22f6ad35-e432-4b02-b289-eefa0ac459bc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:37.375535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-677b42ad-0e53-4131-96fb-12b414b78b4d req-22f6ad35-e432-4b02-b289-eefa0ac459bc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:37.376215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-677b42ad-0e53-4131-96fb-12b414b78b4d req-22f6ad35-e432-4b02-b289-eefa0ac459bc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:37.378140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:37.378901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:37.389883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:37.390617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:37.391060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:37.392552 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-677b42ad-0e53-4131-96fb-12b414b78b4d req-22f6ad35-e432-4b02-b289-eefa0ac459bc service nova] Creating event network-vif-plugged:2acdadd8-953c-4061-b8a8-ac8cb2f8229b for instance 04db50c0-5d8f-48fd-b4ab-082de581513f on n-h2-860864-8 Oct 12 22:57:37.392686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:37.393046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:37.393469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:37.400146 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-677b42ad-0e53-4131-96fb-12b414b78b4d req-22f6ad35-e432-4b02-b289-eefa0ac459bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051427 Oct 12 22:57:37.401920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2404/4673] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:37.422872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:37.539100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:37.566236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:37.569008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:37.570377 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b496fd89-42dc-4dcd-9edd-83f60814993d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1329 microversion: 2.57 time: 0.197500 Oct 12 22:57:37.574545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2270/4674] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:37 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1329 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:37.658533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:37.660750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:37.667478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:37.668145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:37.668698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:37.669667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:37.670358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:37.671001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:37.826570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:37.827426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:37.834779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:37.835553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:37.836208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:37.837086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:37.837767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:37.838355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:37.839323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:37.861690 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-610c44f2-081c-4dab-82a7-bf2cc90f1e71 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1313 microversion: 2.1 time: 0.206928 Oct 12 22:57:37.863990 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2405/4675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:37 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:38.038843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:38.047453 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-31df3653-3e6c-4646-bb58-e728f074a592 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.225541 Oct 12 22:57:38.048066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2271/4676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:37 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:38.601499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:38.602039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:38.609937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:38.610440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:38.610865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:38.611572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:38.612057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:38.612487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:38.680097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:38.689453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:38.692434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:38.693573 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8968b1cb-1d19-4b1d-8842-34651631cb0b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1335 microversion: 2.57 time: 0.096279 Oct 12 22:57:38.694136 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2406/4677] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:38 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:38.887364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:38.888775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:38.896641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:38.897139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:38.897584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:38.898569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:38.899031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:38.899460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:39.074753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:39.075395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:39.084999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:39.085535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:39.085985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:39.087001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:39.087472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:39.088626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:39.102556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:39.129085 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ab20f1fd-9627-4f57-ab9a-aa870924bc89 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1313 microversion: 2.1 time: 0.237709 Oct 12 22:57:39.130402 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2272/4678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:38 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:39.316628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:39.327651 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b698e04-0b23-44f9-9a66-96c697614f47 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.259391 Oct 12 22:57:39.328706 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2407/4679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:39 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:39.721870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:39.722832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:39.732441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:39.733261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:39.734448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:39.735415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:39.736241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:39.737137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:39.833991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:39.847928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:39.849381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:39.850709 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6ac1682-a59f-422b-a9b4-891e2db63181 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1335 microversion: 2.57 time: 0.133630 Oct 12 22:57:39.851700 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2273/4680] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:39 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:40.156763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:40.157383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:40.169746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.171414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.172223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.172947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.173415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.173842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.359176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:40.359818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:40.375958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.376467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.377100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.377665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.379244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.381855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.382432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:40.390648 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3712c49c-af36-4edb-8c16-ef722234e627 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1498 microversion: 2.1 time: 0.237741 Oct 12 22:57:40.391617 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2408/4681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:40 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1498 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:40.420157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-793bee00-8eb1-4cb5-9d41-5ed534594355 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:40.436660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.compute.server_groups [None req-793bee00-8eb1-4cb5-9d41-5ed534594355 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Querying cell 868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) for 1 instances {{(pid=120542) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:57:40.437366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-793bee00-8eb1-4cb5-9d41-5ed534594355 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.437841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-793bee00-8eb1-4cb5-9d41-5ed534594355 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.438268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-793bee00-8eb1-4cb5-9d41-5ed534594355 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.457416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-793bee00-8eb1-4cb5-9d41-5ed534594355 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/2d78c6f0-5f75-4baa-9913-f4fa9f34afda" status: 200 len: 221 microversion: 2.1 time: 0.043498 Oct 12 22:57:40.458224 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2409/4682] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:57:40 2022] GET /compute/v2.1/os-server-groups/2d78c6f0-5f75-4baa-9913-f4fa9f34afda => generated 221 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:40.470899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:40.471504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:40.478190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.478776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.479948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.480726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.481255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.481746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.513941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:57:40.542867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:40.600068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:40.612710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c02db3bd-d6b5-4ddc-b07b-0faca7cee18d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.262818 Oct 12 22:57:40.613535 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2274/4683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:40 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:40.613697 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9a131e98-efa2-47d0-8744-db082b302e38 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 204 len: 0 microversion: 2.1 time: 0.146039 Oct 12 22:57:40.614596 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2410/4684] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:40 2022] DELETE /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:40.624778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:40.625388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:40.633079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.633569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.634006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.634698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.635147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.635604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.802640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:40.812490 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a672e938-56de-4f27-929f-49f5d922a56b tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1504 microversion: 2.1 time: 0.191762 Oct 12 22:57:40.813213 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2275/4685] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:40 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:40.878520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:40.879363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:40.885874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.886366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.886803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.887495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:40.887974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:40.888412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:40.960902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:40.970522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:40.972118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:40.973370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44672e88-2822-4905-b3e8-3ef31059ee3b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1356 microversion: 2.57 time: 0.099568 Oct 12 22:57:40.974333 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2411/4686] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:40 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:40.999078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:41.002113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:41.008295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.008788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.009223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.009914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.010903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.011321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.096858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:57:41.097382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:57:41.097950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:57:41.098441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:57:41.098925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:57:41.185879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:41.194687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.195633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.196111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.196822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.197274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.197715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.234289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7e400189-6bc7-472d-9e44-df6f56440638 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "POST /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017/action" status: 202 len: 1137 microversion: 2.57 time: 0.238996 Oct 12 22:57:41.235285 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2276/4687] 10.222.0.20 () {62 vars in 1320 bytes} [Wed Oct 12 22:57:40 2022] POST /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017/action => generated 1137 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 22:57:41.260071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:41.261467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:41.273779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.274420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.275104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.276106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.276845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.277478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.351949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:41.361039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:41.362537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:41.363726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e4235c0-186d-49ae-bfd0-8d7b1210a641 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.108398 Oct 12 22:57:41.364530 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2412/4688] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:41 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:41.638030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:41.638793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:41.646467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.647080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.647591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.648399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.648930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.649366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.838324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:41.843789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:41.844713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:41.852910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.857256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.858189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:41.859351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:41.860508 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d3b79fd-b81c-45c1-97c3-b4195152f574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.227141 Oct 12 22:57:41.861995 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2277/4689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:41 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:41.862457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:41.864424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:42.132718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:42.142776 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a891af30-6097-468e-b8ba-307ed5d269d9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1504 microversion: 2.1 time: 0.310234 Oct 12 22:57:42.143858 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2413/4690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:41 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:42.397644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:42.398251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:42.409291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:42.410756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:42.412201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:42.415714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:42.419280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:42.420098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:42.540425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:42.558112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:42.561198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:42.565680 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f73d5534-3974-4023-bf72-e53012945eb7 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.174656 Oct 12 22:57:42.567365 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2278/4691] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:42 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:42.857859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7b1e2abb-7f9c-4ef9-adf3-3d13ab6021ae req-d621e18f-23f2-4ddf-9585-baeb99e9558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db50c0-5d8f-48fd-b4ab-082de581513f", "name": "network-vif-deleted", "tag": "2acdadd8-953c-4061-b8a8-ac8cb2f8229b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:42.879826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7b1e2abb-7f9c-4ef9-adf3-3d13ab6021ae req-d621e18f-23f2-4ddf-9585-baeb99e9558d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:42.880938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7b1e2abb-7f9c-4ef9-adf3-3d13ab6021ae req-d621e18f-23f2-4ddf-9585-baeb99e9558d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:42.881392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7b1e2abb-7f9c-4ef9-adf3-3d13ab6021ae req-d621e18f-23f2-4ddf-9585-baeb99e9558d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:42.891254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:42.901953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:42.902320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7b1e2abb-7f9c-4ef9-adf3-3d13ab6021ae req-d621e18f-23f2-4ddf-9585-baeb99e9558d service nova] Creating event network-vif-deleted:2acdadd8-953c-4061-b8a8-ac8cb2f8229b for instance 04db50c0-5d8f-48fd-b4ab-082de581513f on n-h2-860864-8 Oct 12 22:57:42.909382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7b1e2abb-7f9c-4ef9-adf3-3d13ab6021ae req-d621e18f-23f2-4ddf-9585-baeb99e9558d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308101 Oct 12 22:57:42.910540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2414/4692] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:42.919266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:42.920300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:42.920901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:42.921716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:42.922177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:42.922774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:43.094554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:43.106167 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f322495c-acb2-437d-afba-4eafdfe117c2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.221843 Oct 12 22:57:43.107103 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2279/4693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:42 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:43.167744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:43.168969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:43.177278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:43.177955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:43.178537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:43.179465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:43.180098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:43.180779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:43.221174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:43.223849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:43.224687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:43.225357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lazy-loading 'fault' on Instance uuid 04db50c0-5d8f-48fd-b4ab-082de581513f {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:57:43.292643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6abac3662a4491a682e17a69243dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f6f211d60648d29425e8150e5703bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:43.301296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08fb71c7-3b51-488e-b173-d19ba5a350a9 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 200 len: 1303 microversion: 2.1 time: 0.139323 Oct 12 22:57:43.303745 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2415/4694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:43 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:43.593428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:43.594299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:43.601005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:43.601685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:43.602189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:43.603047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:43.603506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:43.604498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:43.682222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:43.692552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:43.693922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:43.695110 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a07aec21-6be7-47eb-bf10-1fae1df20b3a tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.105683 Oct 12 22:57:43.695674 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2280/4695] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:43 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:44.133602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.134252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:44.141099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.141576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.142005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.142688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.143127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.143543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.327438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.328163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:44.335296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.335789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.336329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.337071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.337529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.337987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.352955 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] HTTP exception thrown: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Request method failure captured: Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f HTTP/1.1 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ZV-UX_eHfneSB03LICsA-HaOwHG2-TuBnoJ44QKnSQMKXuuAhZA3frFt0o4_hs4JOjU1by2bBc32-tdEqEpqMtVoM7WshMqYdJzdcKGjbCcX7KLYWIHD_Qa9PmHbDQsRmT74dvQCkmP_zeyV0hGOqQshp7Yw6HeaBjSGaNY-nosl0 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}] Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fa6abac3662a4491a682e17a69243dfa Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04db50c0-5d8f-48fd-b4ab-082de581513f'} Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.354648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Returning 404 to user: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c91f448c-f918-4d7e-aa37-a5372a25800e tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 404 len: 111 microversion: 2.1 time: 0.033387 Oct 12 22:57:44.363507 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2281/4696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:44 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:44.368633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d9cd6f3-cfbd-4e2d-8313-63ad95619080 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.384933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.server_groups [None req-7d9cd6f3-cfbd-4e2d-8313-63ad95619080 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Querying cell 868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) for 1 instances {{(pid=120543) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:57:44.386383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9cd6f3-cfbd-4e2d-8313-63ad95619080 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.386872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9cd6f3-cfbd-4e2d-8313-63ad95619080 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.387310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d9cd6f3-cfbd-4e2d-8313-63ad95619080 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.399251 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d9cd6f3-cfbd-4e2d-8313-63ad95619080 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034446 Oct 12 22:57:44.406452 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2282/4697] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 22:57:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:44.414723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-875be9f8-f082-4c56-9822-06d3a9e89417 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.428798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.server_groups [None req-875be9f8-f082-4c56-9822-06d3a9e89417 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Querying cell 868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) for 1 instances {{(pid=120543) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 22:57:44.429616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875be9f8-f082-4c56-9822-06d3a9e89417 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.430206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875be9f8-f082-4c56-9822-06d3a9e89417 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.430709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875be9f8-f082-4c56-9822-06d3a9e89417 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.441889 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-875be9f8-f082-4c56-9822-06d3a9e89417 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/2d78c6f0-5f75-4baa-9913-f4fa9f34afda" status: 200 len: 183 microversion: 2.1 time: 0.031239 Oct 12 22:57:44.442561 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2283/4698] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 22:57:44 2022] GET /compute/v2.1/os-server-groups/2d78c6f0-5f75-4baa-9913-f4fa9f34afda => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:44.455729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.456262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:44.462567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.463129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.463610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.466307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.466307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.466307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.479486 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] HTTP exception thrown: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Request method failure captured: Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f HTTP/1.1 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ZV-UX_eHfneSB03LICsA-HaOwHG2-TuBnoJ44QKnSQMKXuuAhZA3frFt0o4_hs4JOjU1by2bBc32-tdEqEpqMtVoM7WshMqYdJzdcKGjbCcX7KLYWIHD_Qa9PmHbDQsRmT74dvQCkmP_zeyV0hGOqQshp7Yw6HeaBjSGaNY-nosl0 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}] Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fa6abac3662a4491a682e17a69243dfa Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04db50c0-5d8f-48fd-b4ab-082de581513f'} Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:44.481115 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Returning 404 to user: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:44.485346 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bac3744a-902d-4239-8eed-c13725e211db tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 404 len: 111 microversion: 2.1 time: 0.030754 Oct 12 22:57:44.486251 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2284/4699] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:44 2022] DELETE /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:44.490996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.491613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] [instance: 04db50c0-5d8f-48fd-b4ab-082de581513f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:44.499780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.500352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.500795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.501497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.501949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.502380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.517567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] HTTP exception thrown: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Request method failure captured: Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f HTTP/1.1 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ZV-UX_eHfneSB03LICsA-HaOwHG2-TuBnoJ44QKnSQMKXuuAhZA3frFt0o4_hs4JOjU1by2bBc32-tdEqEpqMtVoM7WshMqYdJzdcKGjbCcX7KLYWIHD_Qa9PmHbDQsRmT74dvQCkmP_zeyV0hGOqQshp7Yw6HeaBjSGaNY-nosl0 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}] Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fa6abac3662a4491a682e17a69243dfa Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04db50c0-5d8f-48fd-b4ab-082de581513f'} Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.519243 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Returning 404 to user: Instance 04db50c0-5d8f-48fd-b4ab-082de581513f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f016fde1-9266-4de6-954d-fbdb4574e73f tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f" status: 404 len: 111 microversion: 2.1 time: 0.033655 Oct 12 22:57:44.523388 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2285/4700] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:44 2022] GET /compute/v2.1/servers/04db50c0-5d8f-48fd-b4ab-082de581513f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:44.533532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1baa007d-065f-4f38-bacc-d868f5b830cb tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.541617 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1baa007d-065f-4f38-bacc-d868f5b830cb tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] HTTP exception thrown: Instance group acb34fde-24e0-47f9-9f91-7214be41501e could not be found. Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1baa007d-065f-4f38-bacc-d868f5b830cb tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Request method failure captured: Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-server-groups/acb34fde-24e0-47f9-9f91-7214be41501e HTTP/1.1 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ZV-UX_eHfneSB03LICsA-HaOwHG2-TuBnoJ44QKnSQMKXuuAhZA3frFt0o4_hs4JOjU1by2bBc32-tdEqEpqMtVoM7WshMqYdJzdcKGjbCcX7KLYWIHD_Qa9PmHbDQsRmT74dvQCkmP_zeyV0hGOqQshp7Yw6HeaBjSGaNY-nosl0 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}] Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fa6abac3662a4491a682e17a69243dfa Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance group acb34fde-24e0-47f9-9f91-7214be41501e could not be found. Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'acb34fde-24e0-47f9-9f91-7214be41501e'} Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group acb34fde-24e0-47f9-9f91-7214be41501e could not be found. Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group acb34fde-24e0-47f9-9f91-7214be41501e could not be found. Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.543202 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group acb34fde-24e0-47f9-9f91-7214be41501e could not be found. Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1baa007d-065f-4f38-bacc-d868f5b830cb tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Returning 404 to user: Instance group acb34fde-24e0-47f9-9f91-7214be41501e could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1baa007d-065f-4f38-bacc-d868f5b830cb tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/acb34fde-24e0-47f9-9f91-7214be41501e" status: 404 len: 117 microversion: 2.1 time: 0.016572 Oct 12 22:57:44.550455 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2286/4701] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:44 2022] DELETE /compute/v2.1/os-server-groups/acb34fde-24e0-47f9-9f91-7214be41501e => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:44.560888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d17e1738-fecf-4183-abfa-6035d36c1d0d tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.568162 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d17e1738-fecf-4183-abfa-6035d36c1d0d tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] HTTP exception thrown: Instance group f27b8ca7-e836-4ce4-af30-6549bcaed2cb could not be found. Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d17e1738-fecf-4183-abfa-6035d36c1d0d tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Request method failure captured: Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-server-groups/f27b8ca7-e836-4ce4-af30-6549bcaed2cb HTTP/1.1 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ZV-UX_eHfneSB03LICsA-HaOwHG2-TuBnoJ44QKnSQMKXuuAhZA3frFt0o4_hs4JOjU1by2bBc32-tdEqEpqMtVoM7WshMqYdJzdcKGjbCcX7KLYWIHD_Qa9PmHbDQsRmT74dvQCkmP_zeyV0hGOqQshp7Yw6HeaBjSGaNY-nosl0 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}] Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fa6abac3662a4491a682e17a69243dfa Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance group f27b8ca7-e836-4ce4-af30-6549bcaed2cb could not be found. Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'f27b8ca7-e836-4ce4-af30-6549bcaed2cb'} Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f27b8ca7-e836-4ce4-af30-6549bcaed2cb could not be found. Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f27b8ca7-e836-4ce4-af30-6549bcaed2cb could not be found. Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.570015 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f27b8ca7-e836-4ce4-af30-6549bcaed2cb could not be found. Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d17e1738-fecf-4183-abfa-6035d36c1d0d tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Returning 404 to user: Instance group f27b8ca7-e836-4ce4-af30-6549bcaed2cb could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d17e1738-fecf-4183-abfa-6035d36c1d0d tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/f27b8ca7-e836-4ce4-af30-6549bcaed2cb" status: 404 len: 117 microversion: 2.1 time: 0.016540 Oct 12 22:57:44.574982 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2287/4702] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:44 2022] DELETE /compute/v2.1/os-server-groups/f27b8ca7-e836-4ce4-af30-6549bcaed2cb => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:44.578563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-861579214", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d116f680-d9f9-4f96-9a80-0572028c0240", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:44.590276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:44.622053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:44.634915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50ab00d1-1a88-477f-9ad1-b4066a85417d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.504716 Oct 12 22:57:44.653252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:57:44.655342 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2416/4703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:44 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:44.664958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96b4a17d-b9ce-4fc0-b5b8-6fc6251c7163 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.672998 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-96b4a17d-b9ce-4fc0-b5b8-6fc6251c7163 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] HTTP exception thrown: Instance group 3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 could not be found. Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96b4a17d-b9ce-4fc0-b5b8-6fc6251c7163 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Request method failure captured: Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-server-groups/3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 HTTP/1.1 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ZV-UX_eHfneSB03LICsA-HaOwHG2-TuBnoJ44QKnSQMKXuuAhZA3frFt0o4_hs4JOjU1by2bBc32-tdEqEpqMtVoM7WshMqYdJzdcKGjbCcX7KLYWIHD_Qa9PmHbDQsRmT74dvQCkmP_zeyV0hGOqQshp7Yw6HeaBjSGaNY-nosl0 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}] Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: fa6abac3662a4491a682e17a69243dfa Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance group 3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 could not be found. Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1'} Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 could not be found. Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 could not be found. Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.675491 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.679438 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.679438 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.679438 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:44.679438 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:44.679438 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 could not be found. Oct 12 22:57:44.679438 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.680669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96b4a17d-b9ce-4fc0-b5b8-6fc6251c7163 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Returning 404 to user: Instance group 3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:44.681521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96b4a17d-b9ce-4fc0-b5b8-6fc6251c7163 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1" status: 404 len: 117 microversion: 2.1 time: 0.025100 Oct 12 22:57:44.682684 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2417/4704] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:44 2022] DELETE /compute/v2.1/os-server-groups/3ae3dc05-96b3-4f49-95f7-300b8b8a6bd1 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:57:44.691050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e2d94df-99fc-4de9-98ec-407c1c49aebc tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.700086 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6e2d94df-99fc-4de9-98ec-407c1c49aebc tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] HTTP exception thrown: Instance group 18aeddd6-ac5b-4513-a79e-28bb21260cff could not be found. Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e2d94df-99fc-4de9-98ec-407c1c49aebc tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Request method failure captured: Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-server-groups/18aeddd6-ac5b-4513-a79e-28bb21260cff HTTP/1.1 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ZV-UX_eHfneSB03LICsA-HaOwHG2-TuBnoJ44QKnSQMKXuuAhZA3frFt0o4_hs4JOjU1by2bBc32-tdEqEpqMtVoM7WshMqYdJzdcKGjbCcX7KLYWIHD_Qa9PmHbDQsRmT74dvQCkmP_zeyV0hGOqQshp7Yw6HeaBjSGaNY-nosl0 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d5f6f211d60648d29425e8150e5703bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d5f6f211d60648d29425e8150e5703bb"}]}] Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d5f6f211d60648d29425e8150e5703bb Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerGroupTestJSON-1537090332 Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: fa6abac3662a4491a682e17a69243dfa Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerGroupTestJSON-1537090332-project Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance group 18aeddd6-ac5b-4513-a79e-28bb21260cff could not be found. Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '18aeddd6-ac5b-4513-a79e-28bb21260cff'} Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 18aeddd6-ac5b-4513-a79e-28bb21260cff could not be found. Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 18aeddd6-ac5b-4513-a79e-28bb21260cff could not be found. Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.701765 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 18aeddd6-ac5b-4513-a79e-28bb21260cff could not be found. Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e2d94df-99fc-4de9-98ec-407c1c49aebc tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Returning 404 to user: Instance group 18aeddd6-ac5b-4513-a79e-28bb21260cff could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e2d94df-99fc-4de9-98ec-407c1c49aebc tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/18aeddd6-ac5b-4513-a79e-28bb21260cff" status: 404 len: 117 microversion: 2.1 time: 0.016400 Oct 12 22:57:44.705462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2418/4705] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:44 2022] DELETE /compute/v2.1/os-server-groups/18aeddd6-ac5b-4513-a79e-28bb21260cff => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:44.711452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-43dcf13d-e74b-4783-ad28-60ceafde8aa0 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.737959 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-43dcf13d-e74b-4783-ad28-60ceafde8aa0 tempest-ServerGroupTestJSON-1537090332 tempest-ServerGroupTestJSON-1537090332-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/2d78c6f0-5f75-4baa-9913-f4fa9f34afda" status: 204 len: 0 microversion: 2.1 time: 0.030113 Oct 12 22:57:44.738603 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2419/4706] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 22:57:44 2022] DELETE /compute/v2.1/os-server-groups/2d78c6f0-5f75-4baa-9913-f4fa9f34afda => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:57:44.743551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:44.744381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:44.751423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.751885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.753724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.754444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:44.754902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:44.756080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:44.855478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:44.873734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:44.875646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:44.877125 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fe00cd3-387f-4d2f-8498-57c4e85865ad tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.137410 Oct 12 22:57:44.878210 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2420/4707] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:44 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:45.072031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:57:45.072534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:57:45.073085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:57:45.073504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:57:45.073922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:57:45.082920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.083403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.083836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.084601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.085053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.085475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.103059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:45.109338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:45.175061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:57:45.177373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d116f680-d9f9-4f96-9a80-0572028c0240',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:57:45.322420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-348b27ee-1521-4746-b74f-a365cb827afd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747740 Oct 12 22:57:45.323118 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2288/4708] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 22:57:45.334582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa0122dc-a173-4338-b33f-f669e699df0f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:45.335212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa0122dc-a173-4338-b33f-f669e699df0f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:45.443159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fa0122dc-a173-4338-b33f-f669e699df0f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:45.491864 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa0122dc-a173-4338-b33f-f669e699df0f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1070 microversion: 2.1 time: 0.159945 Oct 12 22:57:45.495511 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2421/4709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:45 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1070 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:45.664458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:45.665641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:45.677475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.679139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.679798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.680971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.681589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.682813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.899616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:45.900975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:45.911348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.911828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.912313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.913034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.914003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.914584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.935616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:45.944721 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-63729bc9-9e51-469b-b17a-52468d35ad53 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.285879 Oct 12 22:57:45.946404 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2422/4710] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:45 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:45.951809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:45.952455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:45.959770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.960499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.961157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.962037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:45.962647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:45.963332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:45.970358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:57:46.035445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:46.080822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:46.094575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:46.096543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:46.098113 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-acf9ff9b-1b64-4e76-a16f-3ffdd25cf748 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.150529 Oct 12 22:57:46.099378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2423/4711] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:45 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:46.104371 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d6e3c86-ca1e-485b-b701-702e90526bb4 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 204 len: 0 microversion: 2.1 time: 0.610274 Oct 12 22:57:46.107868 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2289/4712] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:45 2022] DELETE /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:57:46.128763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:46.129384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:46.143927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:46.146309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:46.147002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:46.147944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:46.152006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:46.152650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:46.190595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:46.420556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:46.431411 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cbb5b72a-f238-4268-a459-3303670c67b3 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1731 microversion: 2.1 time: 0.318526 Oct 12 22:57:46.434071 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2424/4713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:46 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:46.520774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:46.521860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:46.531377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:46.532197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:46.532867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:46.533827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:46.534557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:46.535215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:46.614923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:46.623379 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7dcb844b-9c3a-49bc-afc7-cb7cc9019e6d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1168 microversion: 2.1 time: 0.108591 Oct 12 22:57:46.624501 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2290/4714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:46 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1168 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:46.972645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:46.973309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:46.983127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:46.985342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:46.985964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:46.986670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:46.987136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:46.991596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:47.127844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:47.128507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:47.143634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:47.146874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:47.147050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:47.153402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:47.154024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:47.154488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:47.259295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:47.278129 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-94accc04-6f2f-4f3c-bd36-2f110a580652 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.311632 Oct 12 22:57:47.300576 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2425/4715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:46 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:47.458928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:47.460289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:47.474664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:47.477776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:47.478605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:47.480225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:47.485987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:47.486691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:47.841951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:47.853292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:47.864125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:47.867398 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3ff335d-b53d-4b6d-8261-0975549cb452 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.744718 Oct 12 22:57:47.870304 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2291/4716] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:47 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:47.887757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:47.900597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:47.913686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:47.917188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:47.918855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:47.919701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:47.921253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:47.921990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:48.145946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:48.155751 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-736f74f0-a522-43e1-a833-b8f95b0f509e tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1731 microversion: 2.1 time: 0.702054 Oct 12 22:57:48.172109 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2426/4717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:47 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1731 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:48.330997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:48.331765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:48.357105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:48.358171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:48.361261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:48.364490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:48.365158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:48.366686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:48.569148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:48.578158 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30b1cda9-2693-4662-96d4-0f0361452906 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1228 microversion: 2.1 time: 0.706595 Oct 12 22:57:48.580467 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2292/4718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:47 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1228 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:48.902529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:48.903409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:48.918403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:48.920027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:48.920731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:48.924488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:48.929636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:48.930328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:49.129239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:49.140754 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38f8667e-7f06-43ea-8270-7458f53bfce7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1512 microversion: 2.1 time: 0.816875 Oct 12 22:57:49.143468 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2427/4719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:48 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1512 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:49.158909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:49.175323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:49.176795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:49.178248 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c21e6a92-47d9-40ef-9036-8c5c8481af15 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.282631 Oct 12 22:57:49.178955 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2293/4720] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:48 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:49.191263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:49.191880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:49.207952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:49.208418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:49.208856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:49.210203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:49.210670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:49.211105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:49.553836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:49.564084 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9dbf8ff-7194-4e7b-942a-e2ee1b616cef tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1731 microversion: 2.1 time: 0.377171 Oct 12 22:57:49.565325 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2428/4721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:49 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1731 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:49.606285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:49.606898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:49.614590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:49.615396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:49.616162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:49.617194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:49.617853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:49.618482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:49.763343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-11da6e5c-a500-42fe-aef7-ede5c437e02d req-00a592fd-573a-458c-8256-e34bb0ae9bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577ee858-4678-4353-a3f9-753f611ca870", "tag": "31ddb955-27a0-4ed6-85d9-97ece3f1189a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:49.778836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-11da6e5c-a500-42fe-aef7-ede5c437e02d req-00a592fd-573a-458c-8256-e34bb0ae9bab service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:49.779627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-11da6e5c-a500-42fe-aef7-ede5c437e02d req-00a592fd-573a-458c-8256-e34bb0ae9bab service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:49.780286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-11da6e5c-a500-42fe-aef7-ede5c437e02d req-00a592fd-573a-458c-8256-e34bb0ae9bab service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:49.794856 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-11da6e5c-a500-42fe-aef7-ede5c437e02d req-00a592fd-573a-458c-8256-e34bb0ae9bab service nova] Creating event network-changed:31ddb955-27a0-4ed6-85d9-97ece3f1189a for instance 577ee858-4678-4353-a3f9-753f611ca870 on n-h2-860864-8 Oct 12 22:57:49.800726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-11da6e5c-a500-42fe-aef7-ede5c437e02d req-00a592fd-573a-458c-8256-e34bb0ae9bab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041436 Oct 12 22:57:49.801952 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2429/4722] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:50.170005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:50.170937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:50.182043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.183158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.183606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.184459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.197921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.206433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:50.213753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.220783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cf7b9269-78c8-4900-8bcc-805379e93f8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1228 microversion: 2.1 time: 0.618949 Oct 12 22:57:50.224832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2294/4723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:49 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1228 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:50.245034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:50.245771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:50.255105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.255749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.257811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.258745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.259883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.261929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.452369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:50.470807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:50.473230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:50.479886 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-92e6943b-6efc-4eac-bbfd-3f1e0786fd26 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.253713 Oct 12 22:57:50.483253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2295/4724] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:50 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:50.589065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:50.589825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:50.613663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.615016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.615622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.616577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.617206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.620381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.700533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:50.721813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e96c8c5d-3492-4a11-8213-46f280b48189 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1489 microversion: 2.1 time: 0.557162 Oct 12 22:57:50.729053 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2430/4725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:50 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1489 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:50.755022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:50.757826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:50.775561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.776418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.777087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.778038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.778731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.779529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.784337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:50.855344 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92dfb584-ff65-4ee6-aed4-6b37d4f1c9e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 200 len: 150 microversion: 2.1 time: 0.106957 Oct 12 22:57:50.856636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2431/4726] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:57:50 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 150 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:57:50.867370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:50.867932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:50.880525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.881011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.881444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:50.882144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:50.882594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:50.883013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.159245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:51.172703 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3d36a5e-9578-4be6-b660-8952e2b6dee6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.310070 Oct 12 22:57:51.188534 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2432/4727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:50 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:51.206238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:51.209005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:51.228495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.232067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.233051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.236964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.237719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.238264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.285445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf02c31b918401f99a99b525da1c347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e4a59e36204b8d89834efe11217f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:51.305655 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9dca5e87-5552-4cbf-afaa-7aaf6a4d0404 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 200 len: 1664 microversion: 2.1 time: 0.716278 Oct 12 22:57:51.320968 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2296/4728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:50 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 1664 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:51.329474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:51.330094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:51.343783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.360782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.361256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.362018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.362492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.362938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.564371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:51.575739 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aba01d8b-9a69-4d14-bea2-4c9114ea6dfc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.374946 Oct 12 22:57:51.576363 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2433/4729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:51 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:51.593593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4e0d4b1f-ccff-4346-bf95-91f97bb11932 req-ad409e23-abbf-496d-a9bc-3b5792a3a660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ebc986-cced-4189-b659-8838d2f9747f", "name": "network-vif-deleted", "tag": "38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:51.616334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4e0d4b1f-ccff-4346-bf95-91f97bb11932 req-ad409e23-abbf-496d-a9bc-3b5792a3a660 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.616437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4e0d4b1f-ccff-4346-bf95-91f97bb11932 req-ad409e23-abbf-496d-a9bc-3b5792a3a660 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.616950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4e0d4b1f-ccff-4346-bf95-91f97bb11932 req-ad409e23-abbf-496d-a9bc-3b5792a3a660 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.638085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:51.667938 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4e0d4b1f-ccff-4346-bf95-91f97bb11932 req-ad409e23-abbf-496d-a9bc-3b5792a3a660 service nova] Creating event network-vif-deleted:38ffc7e3-b347-4e8d-a6f7-5ac3482d18f1 for instance 98ebc986-cced-4189-b659-8838d2f9747f on n-h1-860864-8 Oct 12 22:57:51.668941 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f361537-4966-4211-8995-6bec48aaa2e1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1228 microversion: 2.1 time: 0.353709 Oct 12 22:57:51.676381 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2297/4730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:51 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1228 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:51.687311 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4e0d4b1f-ccff-4346-bf95-91f97bb11932 req-ad409e23-abbf-496d-a9bc-3b5792a3a660 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109250 Oct 12 22:57:51.687969 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2434/4731] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:57:51.695526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:51.696597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:51.696860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:51.701973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:51.706556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.707679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.708379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.709301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.710076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.710890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.717879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.719718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.720208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.720930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:51.721398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:51.724073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:51.818732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:51.833093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:51.844895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:51.849311 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21a32335-b593-43ac-bf62-0a2701a8931e tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.171614 Oct 12 22:57:51.850672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2298/4732] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:51 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:52.234413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:52.243797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-342d7620-8712-424c-aa2c-9297bb3478dd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.554291 Oct 12 22:57:52.247957 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2435/4733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:51 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:52.275738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:52.276544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:52.286522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.288282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.288733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:52.289453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.289908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.290334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:52.332192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:52.332818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:52.341895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:52.348461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.348953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.349387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:52.350092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.350533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.371361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:52.450004 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] HTTP exception thrown: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Request method failure captured: Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f HTTP/1.1 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0UHuKJEUimT69w7Ty4S5Y0SSpIVfwEUXoa0eebKKuCSAeTnb8ZrX_URzzloRsltK5-g1wHwkdj2WWfYXKXqEuEQ2mxUu3Le6-YzpeXOdZ_5fK7onXsxKGpAKf0o5swVFBY8yl7DceJmShZlGsJOJuzPRLKF36fJMGfix-MsD83Wtxo Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: c9e4a59e36204b8d89834efe11217f36 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestServerBasicOps-135442168 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9e4a59e36204b8d89834efe11217f36"}]}] Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestServerBasicOps-135442168 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: c9e4a59e36204b8d89834efe11217f36 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestServerBasicOps-135442168 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestServerBasicOps-135442168-project Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: cbf02c31b918401f99a99b525da1c347 Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestServerBasicOps-135442168-project Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '98ebc986-cced-4189-b659-8838d2f9747f'} Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:52.459552 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Returning 404 to user: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:52.464591 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39acf6c9-c067-45c8-a3d8-0f64ec8bcf54 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 404 len: 111 microversion: 2.1 time: 0.133480 Oct 12 22:57:52.465759 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2436/4734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:52 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:52.695019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:52.695703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:52.707798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.709605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.710065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:52.713114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.713671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.714120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:52.897142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:52.926202 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41f33c41-7db7-4f5c-b2b6-2ba8e28810eb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.654294 Oct 12 22:57:52.928337 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2299/4735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:52 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:52.947254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:52.948126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:52.968160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.974375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.976738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:52.977599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:52.985903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:52.986532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:53.109261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:53.118917 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1e75d00-16e7-43ee-98f8-2cba3be4822c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1228 microversion: 2.1 time: 0.429349 Oct 12 22:57:53.119544 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2437/4736] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:52 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1228 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:53.174662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:53.188108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:53.195308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:53.197012 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-571d503f-2b1a-41d2-9ee3-6d264646c78d tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.263670 Oct 12 22:57:53.201621 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2300/4737] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:52 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:53.227683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1828020748", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "41c00e0a-6171-41b3-913b-03da316da8e7"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:57:53.472171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] validate_networks() for [('41c00e0a-6171-41b3-913b-03da316da8e7', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:57:53.631547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:53.632407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:53.643945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:53.644456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:53.645164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:53.647757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:53.648514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:53.649657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:53.686275 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] HTTP exception thrown: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Request method failure captured: Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f HTTP/1.1 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0UHuKJEUimT69w7Ty4S5Y0SSpIVfwEUXoa0eebKKuCSAeTnb8ZrX_URzzloRsltK5-g1wHwkdj2WWfYXKXqEuEQ2mxUu3Le6-YzpeXOdZ_5fK7onXsxKGpAKf0o5swVFBY8yl7DceJmShZlGsJOJuzPRLKF36fJMGfix-MsD83Wtxo Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c9e4a59e36204b8d89834efe11217f36 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestServerBasicOps-135442168 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9e4a59e36204b8d89834efe11217f36"}]}] Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestServerBasicOps-135442168 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c9e4a59e36204b8d89834efe11217f36 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestServerBasicOps-135442168 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestServerBasicOps-135442168-project Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cbf02c31b918401f99a99b525da1c347 Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestServerBasicOps-135442168-project Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '98ebc986-cced-4189-b659-8838d2f9747f'} Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:53.688205 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Returning 404 to user: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8757fdd8-fdec-4ea6-b09d-ed7b4f966a7d tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 404 len: 111 microversion: 2.1 time: 0.064390 Oct 12 22:57:53.692353 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2301/4738] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:57:53 2022] DELETE /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:53.698953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:53.699881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] [instance: 98ebc986-cced-4189-b659-8838d2f9747f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:53.708480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:53.708997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:53.709444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:53.710232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:53.711607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:53.712185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:53.751221 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] HTTP exception thrown: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Request method failure captured: Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f HTTP/1.1 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0UHuKJEUimT69w7Ty4S5Y0SSpIVfwEUXoa0eebKKuCSAeTnb8ZrX_URzzloRsltK5-g1wHwkdj2WWfYXKXqEuEQ2mxUu3Le6-YzpeXOdZ_5fK7onXsxKGpAKf0o5swVFBY8yl7DceJmShZlGsJOJuzPRLKF36fJMGfix-MsD83Wtxo Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c9e4a59e36204b8d89834efe11217f36 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestServerBasicOps-135442168 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c9e4a59e36204b8d89834efe11217f36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c9e4a59e36204b8d89834efe11217f36"}]}] Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestServerBasicOps-135442168 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c9e4a59e36204b8d89834efe11217f36 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestServerBasicOps-135442168 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestServerBasicOps-135442168-project Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: cbf02c31b918401f99a99b525da1c347 Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestServerBasicOps-135442168-project Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '98ebc986-cced-4189-b659-8838d2f9747f'} Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:57:53.753433 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Returning 404 to user: Instance 98ebc986-cced-4189-b659-8838d2f9747f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f11498d-5224-4b79-8d16-fee4d83cefab tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f" status: 404 len: 111 microversion: 2.1 time: 0.060384 Oct 12 22:57:53.757930 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2302/4739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:53 2022] GET /compute/v2.1/servers/98ebc986-cced-4189-b659-8838d2f9747f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:57:54.106768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16549bc7-80ef-4d66-a0f1-6dd4a7bb6762 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] Calling method '.version_select at 0x7f44ff7c7790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:54.188653 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16549bc7-80ef-4d66-a0f1-6dd4a7bb6762 tempest-TestServerBasicOps-135442168 tempest-TestServerBasicOps-135442168-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-393713541" status: 202 len: 0 microversion: 2.1 time: 0.083536 Oct 12 22:57:54.189467 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2303/4740] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 22:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-393713541 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:57:54.208194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:54.210562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:54.245504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:54.246058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:54.251982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:54.253245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:54.253743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:54.255768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:54.572031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:57:54.573012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:57:54.573633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:57:54.574329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:57:54.574897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:57:54.587030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=39 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:54.596660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:54.598673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:54.599456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:54.607039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:54.617916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:54.620313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:54.621514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:54.627817 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f752af39-cc4f-4ac9-b059-6f9ced36d34c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1228 microversion: 2.1 time: 0.431014 Oct 12 22:57:54.630492 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2304/4741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:54 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1228 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:54.635180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:54.635802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:54.654570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:54.655456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:54.656992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:54.659217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:54.660275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:54.660921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:54.687329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:57:54.699082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for user b103c953780a4dce8d8872ee8b47d186 and project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:57:54.732382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:57:54.738406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:57:54.841574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3edc2e35-0293-4537-90c6-1afbbd4047c1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.617672 Oct 12 22:57:54.842780 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2438/4742] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:57:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:57:54.854552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0679c6f7-ac62-468d-913d-b3ee15cc0146 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:54.855185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0679c6f7-ac62-468d-913d-b3ee15cc0146 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:54.972513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0679c6f7-ac62-468d-913d-b3ee15cc0146 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:54.982174 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0679c6f7-ac62-468d-913d-b3ee15cc0146 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1215 microversion: 2.1 time: 0.132021 Oct 12 22:57:54.983737 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2439/4743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:54 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:55.042699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:55.056983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:55.058543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:55.059725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8caee51-0e7d-4d39-895f-555bf3d71dff tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.428481 Oct 12 22:57:55.068102 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2305/4744] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:54 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:55.654415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:55.655328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:55.665698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:55.666553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:55.667203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:55.668202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:55.668873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:55.669595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:55.944471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:55.959092 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85af4baf-d480-4111-b394-68e84b2de7b6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.311558 Oct 12 22:57:55.960216 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2440/4745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:55 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:56.010461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:56.011689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:56.019929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:56.021969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=34 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:56.029678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.030395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.030911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.031718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.032308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.032802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.096119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:56.097545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:56.112695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.115460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.116479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.117222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.120050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.123553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.245730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:56.253208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:56.258675 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ceeb9fee-eff7-45de-a3a9-f0cd1c221e64 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1267 microversion: 2.1 time: 0.252944 Oct 12 22:57:56.262355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:56.267257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:56.270286 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6184e272-136d-4def-b5bd-deb4644a362b tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.179137 Oct 12 22:57:56.278277 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2441/4746] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:56 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:56.279446 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2306/4747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:56 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:56.632731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:56.633478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:56.643452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.646956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.647640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.648586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.651302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.651849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.719712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:57:56.848216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cc04f56-81dc-47d4-a21f-462c3b752021 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 204 len: 0 microversion: 2.32 time: 0.482221 Oct 12 22:57:56.870556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:56.871363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:56.877996 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2442/4748] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:57:56 2022] DELETE /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:57:56.888436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.889914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.890770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.891751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:56.892423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:56.893035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:56.985782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:56.986882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:57.001550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:57.002832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:57.004252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:57.006233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:57.007307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:57.008957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:57.303338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.318909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.320546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.327979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-807bd074-062d-4768-8ffe-9e90103c6b03 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2942 microversion: 2.32 time: 0.471198 Oct 12 22:57:57.333049 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2307/4749] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:56 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2942 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:57.348402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:57.349316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:57.360480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:57.366866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:57.367581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:57.368464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:57.369071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:57.369750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:57.407495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:57:57.514860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.529421 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c299e3b8-1275-4543-8075-1b31cd98d127 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1273 microversion: 2.1 time: 0.195128 Oct 12 22:57:57.531832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2308/4750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:57 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:57.539484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:57.540363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:57.548137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:57.548983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:57.550188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:57.553402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:57.554089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:57.554721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:57.688193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.699265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.700797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.702023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0afa8541-c188-4d85-962e-be4c9c875edf tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.168350 Oct 12 22:57:57.702775 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2309/4751] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:57 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:57.716598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:57.729349 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-180a3a02-a6bc-40bf-95be-51b495fd2332 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.749017 Oct 12 22:57:57.736780 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2443/4752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:56 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:58.366609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:58.367222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:58.381125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.384756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.388090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.389050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.389872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.390791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.556541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:58.557186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:58.567742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.569890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.570347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.571081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.571537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.572049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.705424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:58.720524 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a247a33-24ff-4341-b7b1-26fd7183295e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1273 microversion: 2.1 time: 0.168203 Oct 12 22:57:58.721110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2444/4753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:58 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:57:58.732904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:58.734202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:58.743297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.744369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.752196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.753131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.753753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.754192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.906355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:58.917319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:58.925429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:58.927297 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff8d4e8d-1225-4da8-9c8b-bd330dfcf118 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.197582 Oct 12 22:57:58.927911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2445/4754] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:58 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:57:58.941197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:58.941850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:58.953409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.953911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.954356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.955073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:58.955529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:58.956001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:58.971619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:58.986846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:58.990011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:58.996626 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3980a77-a23d-4f85-a121-4ee75ddc8b36 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2942 microversion: 2.32 time: 0.628681 Oct 12 22:57:58.997833 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2310/4755] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:58 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2942 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:57:59.355544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:57:59.370151 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42f7e105-9039-4146-87b8-f9c92d7baef6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.439892 Oct 12 22:57:59.371145 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2446/4756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:58 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:57:59.745030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:59.745651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:59.757331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:59.762777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:59.763296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:59.764078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:59.764548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:59.764981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:59.956404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:57:59.957176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:57:59.974191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:59.975098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:59.975702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:57:59.976818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:57:59.977558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:57:59.979286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:00.128913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:00.154967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:00.159156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:00.167549 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27ad8050-e949-4774-99f4-41d644825c02 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.215247 Oct 12 22:58:00.168171 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2447/4757] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:57:59 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:58:00.195461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:00.197704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:00.205012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:00.205900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:00.206601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:00.207886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:00.208942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:00.209598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:00.516551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:00.527165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b894e166-e132-402f-b867-c13ee69c26e5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.786767 Oct 12 22:58:00.527779 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2311/4758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:57:59 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:00.540993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:00.541634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:00.558511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:00.559015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:00.559757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:00.563640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:00.564152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:00.565868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:00.657565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:00.670834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:00.673239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:00.677900 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82830cea-06b4-4f78-b0fd-30c389aa5e5f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2942 microversion: 2.32 time: 0.492210 Oct 12 22:58:00.679059 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2448/4759] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:00 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2942 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:01.061797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:01.081849 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6423dd82-e220-4400-9f25-fa32dfbd4d51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.552817 Oct 12 22:58:01.092608 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2312/4760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:00 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:01.200288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:01.200913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:01.218355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:01.218849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:01.219291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:01.220028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:01.220480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:01.220914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:01.241193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:01.551352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:01.552199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:01.560904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:01.561776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:01.562499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:01.563382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:01.564086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:01.564668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:01.814774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:01.829957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:01.833530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:01.837315 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6d90322-f516-40e2-b36a-6e4ab46072ea tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.638952 Oct 12 22:58:01.860003 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2449/4761] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:01 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:01.870472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:01.871095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:01.881302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:01.881789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:01.890183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:01.891201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:01.897512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:01.899267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:01.985556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:02.027157 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2924a63b-01de-4801-80fa-f7ab1d157147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.477535 Oct 12 22:58:02.033767 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2313/4762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:01 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:02.128836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:02.129298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:02.142936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:02.143606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:02.144126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:02.146190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:02.146827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:02.147611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:02.388420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:02.405618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:02.411448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:02.412771 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23e6a434-954d-45ad-a6ac-c7f07297dff8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2942 microversion: 2.32 time: 0.551685 Oct 12 22:58:02.416360 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2450/4763] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:01 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2942 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:02.558010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:02.570178 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-323f6918-8003-4c1b-8a9d-5732e3432177 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.456844 Oct 12 22:58:02.577038 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2314/4764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:02 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:02.866321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:02.868549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:02.876970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:02.878135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:02.879409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:02.880761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:02.881680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:02.882249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:02.984990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:02.998027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:03.002978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:03.008421 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b102df9-da01-400b-b020-5e70f56e3efa tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.145432 Oct 12 22:58:03.010089 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2451/4765] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:02 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:03.061751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:03.062732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:03.073303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:03.079946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:03.083244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:03.084777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:03.085453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:03.086763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:03.446361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:03.447140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:03.475524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:03.476064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:03.476503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:03.480687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:03.483190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:03.483885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:03.958060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:03.975039 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c2934d51-167c-4089-a21d-491a89328bc6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.918769 Oct 12 22:58:03.977081 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2315/4766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:03 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:03.998870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:03.999814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:04.010262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:04.011258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:04.013302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:04.014538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:04.015625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:04.016275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:04.021183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:04.036759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:04.038323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:04.042362 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1db9e7f-93e6-416a-8eb8-eab40bee9551 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2921 microversion: 2.32 time: 0.598588 Oct 12 22:58:04.042962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2452/4767] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:03 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2921 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:04.065193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:04.072802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:04.079373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:04.080230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:04.080837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:04.082787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:04.087011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:04.088425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:04.209622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:04.233322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:04.236904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:04.240105 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-937dc65a-6151-4754-9f45-3d4de079fbe2 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.194174 Oct 12 22:58:04.252528 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2453/4768] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:04 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:04.380412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-dfdc9c55-56df-4ac9-aef3-825a09297a9e req-2f80b1fd-8c53-4ef0-9d0b-646472f03bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd6b413-daee-497e-8632-2be5e151c376", "tag": "671f02d8-28a9-40ae-b26d-134fce8b120d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:04.393995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dfdc9c55-56df-4ac9-aef3-825a09297a9e req-2f80b1fd-8c53-4ef0-9d0b-646472f03bd2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:04.413536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dfdc9c55-56df-4ac9-aef3-825a09297a9e req-2f80b1fd-8c53-4ef0-9d0b-646472f03bd2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:04.414328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dfdc9c55-56df-4ac9-aef3-825a09297a9e req-2f80b1fd-8c53-4ef0-9d0b-646472f03bd2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:04.443544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-dfdc9c55-56df-4ac9-aef3-825a09297a9e req-2f80b1fd-8c53-4ef0-9d0b-646472f03bd2 service nova] Creating event network-changed:671f02d8-28a9-40ae-b26d-134fce8b120d for instance cdd6b413-daee-497e-8632-2be5e151c376 on n-h1-860864-8 Oct 12 22:58:04.450311 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-dfdc9c55-56df-4ac9-aef3-825a09297a9e req-2f80b1fd-8c53-4ef0-9d0b-646472f03bd2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074810 Oct 12 22:58:04.452487 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2454/4769] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:58:04.786922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:04.803784 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-387c3e1e-ac41-49d3-8d19-26aea1c49460 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.825569 Oct 12 22:58:04.806282 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2316/4770] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:03 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:05.007328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:05.010387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:05.015786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:05.016543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:05.051683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.052219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.052661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:05.053441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.053832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.054259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:05.076695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:05.077318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:05.090569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.091069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.091509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:05.106618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.114001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.114879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:05.339690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:05.353593 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4e40e222-afa1-4c10-b6f8-cc0031c132e2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.351441 Oct 12 22:58:05.355452 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2455/4771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:05 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:05.645407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6f5b962-2d68-4954-aaab-cb5d15d7517f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'create', calling method: .version_select at 0x7f44fe4d7c10>, body: {"keypair": {"name": "tempest-keypair-1441873395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPIb3oKC6dTljrVJvaEMB40shwWS+b0NOCYfMVPNRoTlNDx3FxVBj8RHZIBkzTTFAqaOZN8a15GedAe9yArcJ370swjlQQabMaHdNRB+B4roO4i1HhicCNUeG+TFUGZ9Q=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:05.665548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f6f5b962-2d68-4954-aaab-cb5d15d7517f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:05.672717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f6f5b962-2d68-4954-aaab-cb5d15d7517f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for user 7e4d226b490c4451a6b7653a7cdb3737 and project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:05.703858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6f5b962-2d68-4954-aaab-cb5d15d7517f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.347239 Oct 12 22:58:05.705495 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2456/4772] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:58:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:05.716480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:05.717790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:05.726669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.727655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.728408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:05.729606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.730269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.731043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:05.850955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:05.865000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:05.866636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:05.868127 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4b4c85d-18fc-4634-9111-d7be8f42b86f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.161301 Oct 12 22:58:05.883513 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2457/4773] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:05 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:05.895142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:05.896033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:05.904587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.905288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.906078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:05.906976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:05.907588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:05.908195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:06.170661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:06.182094 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c289362-0199-4136-ad8c-a787243a1aae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.294295 Oct 12 22:58:06.182918 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2458/4774] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:05 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:06.203481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f8f4c28e-e0ce-4cf2-a3da-db2a4c63df2d req-87fdbf11-0031-4191-868a-e123a0c7c188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577ee858-4678-4353-a3f9-753f611ca870", "name": "network-vif-plugged", "status": "completed", "tag": "31ddb955-27a0-4ed6-85d9-97ece3f1189a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:06.251261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f8f4c28e-e0ce-4cf2-a3da-db2a4c63df2d req-87fdbf11-0031-4191-868a-e123a0c7c188 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:06.254363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f8f4c28e-e0ce-4cf2-a3da-db2a4c63df2d req-87fdbf11-0031-4191-868a-e123a0c7c188 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:06.254900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f8f4c28e-e0ce-4cf2-a3da-db2a4c63df2d req-87fdbf11-0031-4191-868a-e123a0c7c188 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:06.275399 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f8f4c28e-e0ce-4cf2-a3da-db2a4c63df2d req-87fdbf11-0031-4191-868a-e123a0c7c188 service nova] Creating event network-vif-plugged:31ddb955-27a0-4ed6-85d9-97ece3f1189a for instance 577ee858-4678-4353-a3f9-753f611ca870 on n-h2-860864-8 Oct 12 22:58:06.281249 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f8f4c28e-e0ce-4cf2-a3da-db2a4c63df2d req-87fdbf11-0031-4191-868a-e123a0c7c188 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088782 Oct 12 22:58:06.282214 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2459/4775] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:06.301633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:06.341341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:06.354512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:06.362845 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-989789b7-0f0b-4322-abc7-245d9881069f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2921 microversion: 2.32 time: 1.287099 Oct 12 22:58:06.385249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:06.386601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:06.389658 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2317/4776] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:05 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2921 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:58:06.397233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:06.397862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:06.398413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:06.399221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:06.400440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:06.401054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:06.836823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:06.849852 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32c61bb6-49d1-48c0-81f8-5bd1f9b9ff12 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.470047 Oct 12 22:58:06.850696 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2460/4777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:06 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:06.902056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:06.902891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:06.912134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:06.914791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:06.917091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:06.918705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:06.919999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:06.920656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:07.208036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:07.209175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:07.218318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:07.228865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:07.229565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:07.230741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:07.231378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:07.231982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:07.495147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:07.505231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:07.509674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:07.513735 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40e21aee-ef90-4be2-840a-dc4f056653a8 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1365 microversion: 2.57 time: 0.617221 Oct 12 22:58:07.532199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:07.532815 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2318/4778] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:06 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1365 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:07.537269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-381c362d-5e78-4a23-bc20-f1a001aef9be tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.333145 Oct 12 22:58:07.550805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:07.551007 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2461/4779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:07 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:07.551112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:07.562589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:07.563095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:07.563540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:07.564289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:07.564746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:07.565174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:07.881123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:07.882848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:07.889809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:07.890727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:07.891260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:07.892102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:07.892969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:07.893616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:08.182186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:08.196793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:08.199706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:08.201520 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-865f8f53-f982-40cc-acaf-8ec9cd1e9365 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2900 microversion: 2.32 time: 0.667438 Oct 12 22:58:08.213804 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2319/4780] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:07 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2900 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:08.255318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:08.277749 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b842382a-3d22-44e3-a2af-d67fbbf6dc41 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.400941 Oct 12 22:58:08.280195 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2462/4781] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:07 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:08.552450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:08.553067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:08.553258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "ab6471ab-ea73-4402-ae24-2340cb39c507"}, {"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "e9bd88d0-de17-424f-83f1-820986fe73d2"}, {"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "c6d91645-1f22-43c7-8819-f3f37de52ad7"}, {"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "9d644e7b-03a4-428b-b875-0a7ca3e67f92"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:08.565301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:08.565793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:08.566435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:08.578264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:08.580322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:08.582624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:08.583045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:08.583631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:08.584136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:08.656646 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Creating event network-vif-unplugged:ab6471ab-ea73-4402-ae24-2340cb39c507 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:08.657216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Creating event network-vif-unplugged:e9bd88d0-de17-424f-83f1-820986fe73d2 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:08.662266 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Creating event network-vif-unplugged:c6d91645-1f22-43c7-8819-f3f37de52ad7 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:08.663792 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] Creating event network-vif-unplugged:9d644e7b-03a4-428b-b875-0a7ca3e67f92 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:08.700675 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d7d87dfe-b39e-424f-9c1c-29b7ded4c1fd req-a0618929-6b1e-452a-b741-695e262c8590 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.146854 Oct 12 22:58:08.705551 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2463/4782] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:08.739496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:08.740355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:08.790785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:08.808495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:08.809086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:08.817472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:08.823628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:08.825024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:08.903942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:08.929778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:08.939181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:08.950483 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-579048ef-022f-4c11-ac4d-070a396e15da tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1383 microversion: 2.57 time: 0.399069 Oct 12 22:58:08.964153 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2320/4783] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:08 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1383 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:08.989884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1284272871", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85c32427-fba7-45cc-bd0a-09837c6f6d31"}], "security_groups": [{"name": "tempest-securitygroup--2064997222"}], "key_name": "tempest-keypair-1441873395", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:09.097618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:09.107552 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-43dc6ffe-fd0e-422a-afe8-4d074a59f966 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1216 microversion: 2.1 time: 0.397884 Oct 12 22:58:09.109120 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2464/4784] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:08 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1216 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:09.114039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-eb2eb329-c444-4d50-a809-e9184d700fb0 req-08ce0c15-a333-4c42-90ee-3e53cd88dae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-deleted", "tag": "c6d91645-1f22-43c7-8819-f3f37de52ad7"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:09.131785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-eb2eb329-c444-4d50-a809-e9184d700fb0 req-08ce0c15-a333-4c42-90ee-3e53cd88dae8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:09.132488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-eb2eb329-c444-4d50-a809-e9184d700fb0 req-08ce0c15-a333-4c42-90ee-3e53cd88dae8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:09.133066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-eb2eb329-c444-4d50-a809-e9184d700fb0 req-08ce0c15-a333-4c42-90ee-3e53cd88dae8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:09.147801 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-eb2eb329-c444-4d50-a809-e9184d700fb0 req-08ce0c15-a333-4c42-90ee-3e53cd88dae8 service nova] Creating event network-vif-deleted:c6d91645-1f22-43c7-8819-f3f37de52ad7 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:09.168159 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-eb2eb329-c444-4d50-a809-e9184d700fb0 req-08ce0c15-a333-4c42-90ee-3e53cd88dae8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057536 Oct 12 22:58:09.169384 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2465/4785] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:09.237294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:09.238864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:09.247563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:09.249660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:09.249767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:09.250634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:09.251357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:09.251799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:09.482017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:09.495188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:09.496973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:09.498494 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-853c5127-b3e2-4f05-be94-11ba9c217b02 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2742 microversion: 2.32 time: 0.268320 Oct 12 22:58:09.500138 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2466/4786] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:09 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2742 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:58:09.518452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:09.519084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:09.521726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] validate_networks() for [('85c32427-fba7-45cc-bd0a-09837c6f6d31', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:58:09.528954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:09.529408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:09.529918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:09.530694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:09.531245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:09.531726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:09.823547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:09.834018 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22d6b1a4-c53d-4c82-9736-a22fbec8f93f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.332798 Oct 12 22:58:09.835543 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2467/4787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:09 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:09.982456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:09.983070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:09.995032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:09.995807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:09.998067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:09.999079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:09.999680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:10.003050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:10.123914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:10.135166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:10.141673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:10.147271 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71d1483e-45ff-4af4-9788-c6a949618301 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1371 microversion: 2.57 time: 0.169250 Oct 12 22:58:10.149946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2468/4788] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:09 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:10.154807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:10.175146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:10.183227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:10.184755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:10.185416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:10.186313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:10.186948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:10.187546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:10.424551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:10.431074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:10.442997 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f045a002-3d4f-4349-8811-18057b3b449e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1403 microversion: 2.1 time: 0.291751 Oct 12 22:58:10.444422 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2469/4789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:10 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1403 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:10.473159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:10.474172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:10.494852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:10.497481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:10.498197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:10.498890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:10.499847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:10.500509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:10.501163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:10.876932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:10.895732 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aebe64b2-fa0c-41da-8808-705bc92e4ae2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1403 microversion: 2.1 time: 0.428345 Oct 12 22:58:10.922562 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2470/4790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:10 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1403 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:10.933124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:10.938609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:10.951389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:10.955363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:10.956546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:10.958020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:10.958641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:10.959222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.260055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:11.272506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:11.273991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:11.275831 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-855dd7ba-dd49-4c77-beed-783cc3f150f9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2698 microversion: 2.32 time: 0.351916 Oct 12 22:58:11.277010 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2471/4791] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:10 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2698 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:11.282458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:11.283262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:11.290855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.292368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.292822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.293594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.294057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.294484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.577521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:11.594587 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-888e0d0d-c6ce-407d-9495-eb0e7c51adad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 0.316234 Oct 12 22:58:11.595886 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2472/4792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:11 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:11.610430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:58:11.611380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:58:11.612055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:58:11.612664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:58:11.613255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:58:11.625760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-776434047"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:11.628318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:11.635805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.636700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.637329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.638242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.638886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.639461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.644730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.645224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.645658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.651280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.652245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.653137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.718512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:11.728120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for user 7e4d226b490c4451a6b7653a7cdb3737 and project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:11.760943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:11.777960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:58:11.781529 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.compute.api [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Attempting to quiesce instance before volume snapshot. Oct 12 22:58:11.790187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:58:11.856575 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.compute.api [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 12 22:58:11.863661 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78dbb11c-1113-470d-995e-450cb7446e56 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.909070 Oct 12 22:58:11.865065 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2321/4793] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:58:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:58:11.875403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-03787144-8156-4689-b1b3-117d71f3a889 req-685d7a18-5e47-45df-b409-f8329f6460b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "8b1947f9-175e-4530-af30-9442135dbdc1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:11.898950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-03787144-8156-4689-b1b3-117d71f3a889 req-685d7a18-5e47-45df-b409-f8329f6460b6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.901745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-03787144-8156-4689-b1b3-117d71f3a889 req-685d7a18-5e47-45df-b409-f8329f6460b6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.902184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-03787144-8156-4689-b1b3-117d71f3a889 req-685d7a18-5e47-45df-b409-f8329f6460b6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.934690 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-03787144-8156-4689-b1b3-117d71f3a889 req-685d7a18-5e47-45df-b409-f8329f6460b6 service nova] Creating event network-vif-unplugged:8b1947f9-175e-4530-af30-9442135dbdc1 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:11.943433 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-03787144-8156-4689-b1b3-117d71f3a889 req-685d7a18-5e47-45df-b409-f8329f6460b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076221 Oct 12 22:58:11.944447 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2322/4794] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:11.954008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:11.954936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:11.965795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.966605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.967207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:11.968186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:11.970244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:11.970978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:12.026586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Creating snapshot from volume d116f680-d9f9-4f96-9a80-0572028c0240. {{(pid=120542) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 12 22:58:12.488150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:12.505717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:12.507163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:12.508603 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52ff1afb-470f-4a48-9743-ab5afa081919 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1356 microversion: 2.57 time: 0.562891 Oct 12 22:58:12.509461 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2323/4795] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:11 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1356 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:12.514158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-31fa63b5-db42-4d88-868d-cda26b2fefc9 req-f9e85743-7fa6-4128-be1f-1b9de044b1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-deleted", "tag": "9d644e7b-03a4-428b-b875-0a7ca3e67f92"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:12.543165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-31fa63b5-db42-4d88-868d-cda26b2fefc9 req-f9e85743-7fa6-4128-be1f-1b9de044b1b2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:12.548210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-31fa63b5-db42-4d88-868d-cda26b2fefc9 req-f9e85743-7fa6-4128-be1f-1b9de044b1b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:12.548855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-31fa63b5-db42-4d88-868d-cda26b2fefc9 req-f9e85743-7fa6-4128-be1f-1b9de044b1b2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:12.588684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-31fa63b5-db42-4d88-868d-cda26b2fefc9 req-f9e85743-7fa6-4128-be1f-1b9de044b1b2 service nova] Creating event network-vif-deleted:9d644e7b-03a4-428b-b875-0a7ca3e67f92 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:12.606722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-31fa63b5-db42-4d88-868d-cda26b2fefc9 req-f9e85743-7fa6-4128-be1f-1b9de044b1b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095598 Oct 12 22:58:12.607650 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2324/4796] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:12.630355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-07ca2111-f60a-4c1c-962d-93b3f0bfd7f2 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:12.631848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-07ca2111-f60a-4c1c-962d-93b3f0bfd7f2 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:13.265636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07ca2111-f60a-4c1c-962d-93b3f0bfd7f2 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:13.277612 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-07ca2111-f60a-4c1c-962d-93b3f0bfd7f2 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1238 microversion: 2.1 time: 0.667711 Oct 12 22:58:13.298907 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2325/4797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:12 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1238 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:13.304737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:13.306386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:13.320756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:13.321513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:13.322100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:13.322962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:13.323596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:13.324427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:13.926593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:13.973074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:13.986295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:13.993549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3ab1d31-0eb5-4d2c-8191-9501aed5d752 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2541 microversion: 2.32 time: 0.692023 Oct 12 22:58:13.997301 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2326/4798] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:13 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2541 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:14.018662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:14.027142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:14.067468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.072982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.073991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.076811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.078733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.092929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.195568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:58:14.246644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:14.409823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9123c13d-14e8-4ebc-980c-1bbd5c79ca88 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 204 len: 0 microversion: 2.57 time: 0.402672 Oct 12 22:58:14.415769 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2327/4799] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:58:13 2022] DELETE /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:58:14.437951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:14.438875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:14.450448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.451143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.452474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.454127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.454626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.455070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.483007 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67d35377-3c41-4e79-a219-6da2f4212bd8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870/action" status: 202 len: 0 microversion: 2.1 time: 2.884800 Oct 12 22:58:14.484313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2473/4800] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:11 2022] POST /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870/action => generated 0 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 22:58:14.494741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3a89c9ec-f1a3-449e-bf83-41a1e1683e46 req-5beb3a36-2c3b-427f-8357-0a2d07016be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd6b413-daee-497e-8632-2be5e151c376", "name": "network-vif-plugged", "status": "completed", "tag": "671f02d8-28a9-40ae-b26d-134fce8b120d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:14.522385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3a89c9ec-f1a3-449e-bf83-41a1e1683e46 req-5beb3a36-2c3b-427f-8357-0a2d07016be4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.523113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3a89c9ec-f1a3-449e-bf83-41a1e1683e46 req-5beb3a36-2c3b-427f-8357-0a2d07016be4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.523798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3a89c9ec-f1a3-449e-bf83-41a1e1683e46 req-5beb3a36-2c3b-427f-8357-0a2d07016be4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.564829 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3a89c9ec-f1a3-449e-bf83-41a1e1683e46 req-5beb3a36-2c3b-427f-8357-0a2d07016be4 service nova] Creating event network-vif-plugged:671f02d8-28a9-40ae-b26d-134fce8b120d for instance cdd6b413-daee-497e-8632-2be5e151c376 on n-h1-860864-8 Oct 12 22:58:14.573660 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3a89c9ec-f1a3-449e-bf83-41a1e1683e46 req-5beb3a36-2c3b-427f-8357-0a2d07016be4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086458 Oct 12 22:58:14.583624 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2474/4801] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:14.594738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:14.595523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:14.622772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.623397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.624895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.625870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.628946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.629645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.838765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:14.849564 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9774c4b9-3467-43ae-a5b6-08dc7f089a65 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1296 microversion: 2.1 time: 0.261703 Oct 12 22:58:14.850804 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2475/4802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:14 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1296 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:14.862235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:14.864638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:14.877398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.878692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.879482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:14.880541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:14.881170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:14.898202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:15.046371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:15.070253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:15.074032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:15.075498 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-abeb46b3-0dda-4cde-aedf-1a6e5eca8ed3 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1362 microversion: 2.57 time: 0.222364 Oct 12 22:58:15.076598 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2476/4803] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:14 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:15.081681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:15.083133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:15.090229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:15.090980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:15.091750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:15.092644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:15.093261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:15.093843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:15.357720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:15.393882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:15.398064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:15.409520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-199f099e-7a38-4233-b292-6785852387d6 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2541 microversion: 2.32 time: 0.331694 Oct 12 22:58:15.418007 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2477/4804] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:15 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2541 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:15.437147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d9dd1b9a-617b-4ee2-9fbf-e4bc335a324d req-cdbbe8cc-99a2-4ded-ba51-e77643180d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-deleted", "tag": "8b1947f9-175e-4530-af30-9442135dbdc1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:15.475150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d9dd1b9a-617b-4ee2-9fbf-e4bc335a324d req-cdbbe8cc-99a2-4ded-ba51-e77643180d6a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:15.476504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d9dd1b9a-617b-4ee2-9fbf-e4bc335a324d req-cdbbe8cc-99a2-4ded-ba51-e77643180d6a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:15.478255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d9dd1b9a-617b-4ee2-9fbf-e4bc335a324d req-cdbbe8cc-99a2-4ded-ba51-e77643180d6a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:15.500071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:15.503099 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d9dd1b9a-617b-4ee2-9fbf-e4bc335a324d req-cdbbe8cc-99a2-4ded-ba51-e77643180d6a service nova] Creating event network-vif-deleted:8b1947f9-175e-4530-af30-9442135dbdc1 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:15.521736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d4bf65bd-69fa-4c3a-9c5c-5902a9ab2952 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1315 microversion: 2.1 time: 1.090067 Oct 12 22:58:15.526944 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2328/4805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:14 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:15.546070 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d9dd1b9a-617b-4ee2-9fbf-e4bc335a324d req-cdbbe8cc-99a2-4ded-ba51-e77643180d6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118858 Oct 12 22:58:15.549914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2478/4806] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:15.880990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:15.891283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:15.906047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:15.906645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:15.907328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:15.908312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:15.908766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:15.909633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:16.105982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:16.106760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:16.108955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:16.123227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:16.123735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:16.124303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:16.129628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:16.132366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:16.132776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:16.258342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:16.271165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:16.274181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:16.276677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c81543babf8d4ee0866efbf920bc87f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f73a3edf3a4c168a85f7435aee5ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:16.282862 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b005ce16-b144-4089-bca5-41955a033a7f tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 200 len: 1362 microversion: 2.57 time: 0.181573 Oct 12 22:58:16.284229 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2479/4807] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:16 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:16.285832 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cad9d5b1-3d9f-41c2-8d55-2b0656e9f166 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1296 microversion: 2.1 time: 0.414606 Oct 12 22:58:16.299971 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2329/4808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:15 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1296 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:16.451381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:16.452908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:16.469525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:16.471845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:16.472850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:16.473990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:16.474670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:16.475459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:16.550260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:16.551358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:16.562662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:16.565119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:16.565587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:16.566344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:16.568645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:16.570552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:16.776308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:16.802131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:16.806171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:16.814275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc6ac5b5-bd37-4b17-a843-51541bf663ac tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2211 microversion: 2.32 time: 0.366737 Oct 12 22:58:16.817079 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2480/4809] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:16 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2211 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:58:16.981139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-352940252", "imageRef": "7b82d2a7-6277-49ff-9d8a-7abf22836ef9", "flavorRef": "452", "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:17.095778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:58:17.340895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:17.351493 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ba97009-5d99-42b7-84a2-dc88d1e13442 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1502 microversion: 2.1 time: 0.805117 Oct 12 22:58:17.352671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2330/4810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:16 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1502 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:17.364919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:17.365825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:17.373450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.374278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.374953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.375879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.376844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.377484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.721307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:17.732182 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b3bdbcb-589c-4347-84be-62bcafc89529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1364 microversion: 2.1 time: 0.370818 Oct 12 22:58:17.743914 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2331/4811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:17 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:17.748915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:17.749545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] [instance: 02c14741-29b2-4b2a-8e2f-392a1cdfd017] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:17.756787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.757708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.758892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.759822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.760739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.761586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.793289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] HTTP exception thrown: Instance 02c14741-29b2-4b2a-8e2f-392a1cdfd017 could not be found. Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Request method failure captured: Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 HTTP/1.1 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ZfjE_vQ8dVKrlFCfcOZ05_-CfpfhmBXfqIso1t5BXRUy8huUdwPPUj1aDLpym3YHyQXZGbk0y6ZLZNpAuNX2tGDKtKn8fd5n6Gl3Nd3sP9eLnphMv-L8BWe4SNpiPq_VeTfimKP5HHV1MoAQm8qEWgeSy-D64zSw2-Xgw2-80y_g4 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.57 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 68f73a3edf3a4c168a85f7435aee5ead Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerShowV257Test-296575539 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68f73a3edf3a4c168a85f7435aee5ead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68f73a3edf3a4c168a85f7435aee5ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68f73a3edf3a4c168a85f7435aee5ead"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68f73a3edf3a4c168a85f7435aee5ead"}]}] Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerShowV257Test-296575539 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 68f73a3edf3a4c168a85f7435aee5ead Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerShowV257Test-296575539 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerShowV257Test-296575539-project Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: c81543babf8d4ee0866efbf920bc87f5 Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerShowV257Test-296575539-project Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 02c14741-29b2-4b2a-8e2f-392a1cdfd017 could not be found. Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '02c14741-29b2-4b2a-8e2f-392a1cdfd017'} Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02c14741-29b2-4b2a-8e2f-392a1cdfd017 could not be found. Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02c14741-29b2-4b2a-8e2f-392a1cdfd017 could not be found. Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:17.796199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:17.799990 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:17.799990 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:17.799990 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:17.799990 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:58:17.799990 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:58:17.799990 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02c14741-29b2-4b2a-8e2f-392a1cdfd017 could not be found. Oct 12 22:58:17.799990 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:17.802102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] Returning 404 to user: Instance 02c14741-29b2-4b2a-8e2f-392a1cdfd017 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:58:17.803190 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af0afcd1-ff17-4318-b141-31fcca404658 tempest-ServerShowV257Test-296575539 tempest-ServerShowV257Test-296575539-project] 10.222.0.20 "GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017" status: 404 len: 111 microversion: 2.57 time: 0.069311 Oct 12 22:58:17.803993 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2332/4812] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:17 2022] GET /compute/v2.1/servers/02c14741-29b2-4b2a-8e2f-392a1cdfd017 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:58:17.830523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:17.846038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:58:17.847292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:58:17.848377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:58:17.849078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:58:17.849827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:58:17.855706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:17.869749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.870583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.871787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.873075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.873715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.874141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.874962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.875601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.876543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:17.877451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.878091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:17.879389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:17.952529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:17.969160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:17.996722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-256a001c-1682-4df6-818a-5899ef629703 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.172099 Oct 12 22:58:18.002137 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2333/4813] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:17 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:58:18.011411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b548246e-d7c4-4d1a-b006-22dc5537ed1b req-edd0fba9-0e2e-4681-a8f3-3e612922a349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-deleted", "tag": "e9bd88d0-de17-424f-83f1-820986fe73d2"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:18.020440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:58:18.025010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='94c57984-2b38-433a-9661-c7028a795b88',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:58:18.025971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b548246e-d7c4-4d1a-b006-22dc5537ed1b req-edd0fba9-0e2e-4681-a8f3-3e612922a349 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:18.026459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b548246e-d7c4-4d1a-b006-22dc5537ed1b req-edd0fba9-0e2e-4681-a8f3-3e612922a349 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:18.027063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b548246e-d7c4-4d1a-b006-22dc5537ed1b req-edd0fba9-0e2e-4681-a8f3-3e612922a349 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:18.051967 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b548246e-d7c4-4d1a-b006-22dc5537ed1b req-edd0fba9-0e2e-4681-a8f3-3e612922a349 service nova] Creating event network-vif-deleted:e9bd88d0-de17-424f-83f1-820986fe73d2 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:18.058305 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b548246e-d7c4-4d1a-b006-22dc5537ed1b req-edd0fba9-0e2e-4681-a8f3-3e612922a349 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054463 Oct 12 22:58:18.059746 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2334/4814] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:18.080012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:18.081613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:18.103958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:18.104930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:18.107085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:18.108754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:18.112510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:18.113830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:18.163848 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49f50982-39ad-4d4e-8c02-600f8e8a25e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186568 Oct 12 22:58:18.166360 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2481/4815] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:58:18.182520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0993b18-08f5-48e8-bea5-8c7d6755e016 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:18.186840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0993b18-08f5-48e8-bea5-8c7d6755e016 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:18.373055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0993b18-08f5-48e8-bea5-8c7d6755e016 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:18.385786 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0993b18-08f5-48e8-bea5-8c7d6755e016 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1229 microversion: 2.1 time: 0.204250 Oct 12 22:58:18.390762 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2482/4816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:18 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1229 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:18.772266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:18.772930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:18.794891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:18.795607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:18.798681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:18.801500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:18.802696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:18.805260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:18.913915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:18.930601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:18.935665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:18.942140 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6a11ab1-ef4e-4aa3-b39c-4b326d00f152 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 2032 microversion: 2.32 time: 0.878112 Oct 12 22:58:18.943982 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2335/4817] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:18 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 2032 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:19.011819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:19.015645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:19.034235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:19.034814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:19.035258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:19.036018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:19.041231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:19.041857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:19.136471 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a5b64b75-1d30-4400-a689-ac8820074955 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.128141 Oct 12 22:58:19.139377 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2336/4818] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:19 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:58:19.161513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:19.189161 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0a405d44-513c-423c-b72a-f3e92f1a20b4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1364 microversion: 2.1 time: 0.433428 Oct 12 22:58:19.194349 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2483/4819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:18 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1364 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:19.435664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:19.436817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:19.478648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:19.479247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:19.480682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:19.481450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:19.481907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:19.483910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:19.749672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:19.768799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25259382-fd14-4eff-b45a-334a3e265425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1281 microversion: 2.1 time: 0.356966 Oct 12 22:58:19.773958 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2337/4820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:19 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1281 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:19.975372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:19.976206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:19.995873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.005351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.006473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.007201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.007689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.014853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.151260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:20.155745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:20.176330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.178072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.178746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.181081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.183403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.185808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.241292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:20.262579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:20.264199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:20.265439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b1f3cdff-e776-49b2-a524-d7ed6216690b tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.294653 Oct 12 22:58:20.280007 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2484/4821] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:19 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:20.293298 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6cd9598e-e1e4-425b-a369-6342a2eed878 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.146443 Oct 12 22:58:20.305761 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2338/4822] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:20 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:58:20.308180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5a65e645-d9b8-4a48-91dd-4b2ab1a5bca0 req-c4233813-0f42-4464-aa14-d522b09ecd15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d202a4-d7a0-4e50-a514-8f8d89ae3fd5", "name": "network-vif-deleted", "tag": "ab6471ab-ea73-4402-ae24-2340cb39c507"}, {"name": "network-changed", "server_uuid": "4df8e9d9-29a8-46d7-9df4-cfcdaceaf167", "tag": "53e47db0-d2df-4fa1-a717-4902bcc4abfc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:20.324182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5a65e645-d9b8-4a48-91dd-4b2ab1a5bca0 req-c4233813-0f42-4464-aa14-d522b09ecd15 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.325621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5a65e645-d9b8-4a48-91dd-4b2ab1a5bca0 req-c4233813-0f42-4464-aa14-d522b09ecd15 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.326404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5a65e645-d9b8-4a48-91dd-4b2ab1a5bca0 req-c4233813-0f42-4464-aa14-d522b09ecd15 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.334668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:20.335396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:20.346544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5a65e645-d9b8-4a48-91dd-4b2ab1a5bca0 req-c4233813-0f42-4464-aa14-d522b09ecd15 service nova] Creating event network-vif-deleted:ab6471ab-ea73-4402-ae24-2340cb39c507 for instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 on n-h1-860864-8 Oct 12 22:58:20.347524 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5a65e645-d9b8-4a48-91dd-4b2ab1a5bca0 req-c4233813-0f42-4464-aa14-d522b09ecd15 service nova] Creating event network-changed:53e47db0-d2df-4fa1-a717-4902bcc4abfc for instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 on n-h1-860864-8 Oct 12 22:58:20.357638 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5a65e645-d9b8-4a48-91dd-4b2ab1a5bca0 req-c4233813-0f42-4464-aa14-d522b09ecd15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.074793 Oct 12 22:58:20.360187 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2485/4823] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:20.370789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.375061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.375599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.376379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.377046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.377302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.802933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:20.804200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:20.819439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:20.828698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.830203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.831067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:20.832483 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-51b9f869-bfb1-4e61-92b3-3c09caee93c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1364 microversion: 2.1 time: 0.523529 Oct 12 22:58:20.833563 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2339/4824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:20 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1364 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:20.834568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:20.837659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:20.838225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:21.073454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:21.085834 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3952f5dd-2ed6-4f51-915b-ce83f9dc8c14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1299 microversion: 2.1 time: 0.290721 Oct 12 22:58:21.100258 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2486/4825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:20 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1299 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:21.314163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:21.324360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:21.325053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:21.326980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:21.342699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:21.343189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:21.347987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:21.348689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:21.351060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:21.351662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:21.353456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:21.354412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:21.361183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:21.361647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:21.362846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:21.363299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:21.478066 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b99c47a0-ea81-4adb-90d4-9ec18abf86fb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.167326 Oct 12 22:58:21.478714 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2487/4826] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:21 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:58:21.558706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:21.569916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:21.577275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:21.583219 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7884ef2d-5487-4a4b-a9bc-d2c8857eea7f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.276397 Oct 12 22:58:21.584382 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2340/4827] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:21 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:21.728164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ef7a9ba-2d44-481f-a11e-6022e1d0290e tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] Calling method '.version_select at 0x7f44fe434dc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:21.848797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ef7a9ba-2d44-481f-a11e-6022e1d0290e tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21/defaults" status: 200 len: 371 microversion: 2.1 time: 0.368823 Oct 12 22:58:21.858031 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2488/4828] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:58:21 2022] GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21/defaults => generated 371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:21.864354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:21.865129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:21.869788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41c47963-9508-48e3-aaa8-c7a28a51a103 tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] Calling method '.version_select at 0x7f44fe441280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:21.876995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:21.879532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:21.880342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:21.904094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:21.907093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:21.908807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:21.909908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:22.044855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41c47963-9508-48e3-aaa8-c7a28a51a103 tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21" status: 200 len: 371 microversion: 2.1 time: 0.185253 Oct 12 22:58:22.049078 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2489/4829] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 22:58:21 2022] GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21 => generated 371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:22.068774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b3ee9ca-389a-4087-a334-ac11816a8eb8 tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] Calling method '.version_select at 0x7f44fc3811f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:22.248420 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b3ee9ca-389a-4087-a334-ac11816a8eb8 tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21/defaults" status: 200 len: 371 microversion: 2.1 time: 0.189373 Oct 12 22:58:22.249707 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2490/4830] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 22:58:22 2022] GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21/defaults => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:58:22.272900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:22.279029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:22.305538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:22.306936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:22.310015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:22.311638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:22.313522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:22.314987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:22.385012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:22.562151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:22.570408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-216f3e33-9819-4ac2-8aa0-a00952a5057d tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1364 microversion: 2.1 time: 0.711922 Oct 12 22:58:22.591039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2341/4831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:21 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1364 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:22.613917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1d49ffd-2c33-4203-8f1c-ec2457ee771b tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] Calling method '.version_select at 0x7f4507a7d4c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:22.814139 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c1d49ffd-2c33-4203-8f1c-ec2457ee771b tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21" status: 200 len: 371 microversion: 2.1 time: 0.222602 Oct 12 22:58:22.815270 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2342/4832] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 22:58:22 2022] GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21 => generated 371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:22.822196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:22.825037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:22.832856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:22.841732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:22.842717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:22.843674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:22.844354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:22.844968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:22.917314 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-598a9b59-a33f-4f68-a23e-44821f8caade tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.099666 Oct 12 22:58:22.921429 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2343/4833] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:22 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:58:22.927188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:22.927955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:22.944340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:22.945107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:22.945784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:22.946707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:22.947354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:22.947973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.098473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:23.110727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:23.112234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:23.113459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb592a0c-57d9-4f98-86d3-9798f2b404ea tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.190816 Oct 12 22:58:23.114032 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2344/4834] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:22 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:23.136949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46e3c1f4-9db1-45c0-af42-0c927fd6da52 tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] Calling method '.version_select at 0x7f44ff57cf70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:23.294784 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46e3c1f4-9db1-45c0-af42-0c927fd6da52 tempest-QuotasTestJSON-1902291440 tempest-QuotasTestJSON-1902291440-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21?user_id=c1b376767e564a6495b8f612b2fc253d" status: 200 len: 371 microversion: 2.1 time: 0.170207 Oct 12 22:58:23.298241 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2345/4835] 10.222.0.20 () {58 vars in 1323 bytes} [Wed Oct 12 22:58:23 2022] GET /compute/v2.1/os-quota-sets/0426a5b85db64ad5ba235882b919cc21?user_id=c1b376767e564a6495b8f612b2fc253d => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:23.597590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:23.598919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:23.619805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.628077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.630193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.636103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.636992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.640166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.652369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:23.661776 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e24f3f9a-7331-4fdd-b7f8-b0dfcc835220 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 1.410685 Oct 12 22:58:23.662330 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2491/4836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:22 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:23.929263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:23.931516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:23.950308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.956197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.956786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:23.957591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:23.957996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:23.958730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:24.058138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6569cfa8-adc0-48fd-9636-45a65c503173 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.132834 Oct 12 22:58:24.058799 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2492/4837] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:23 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 22:58:24.140734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:24.141449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:24.166983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:24.167789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:24.168470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:24.170049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:24.173930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:24.175665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:24.276462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:24.301822 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc1b6376-8260-4e5a-bffc-e64a7c54e086 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1364 microversion: 2.1 time: 0.707327 Oct 12 22:58:24.302441 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2346/4838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:23 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1364 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:24.383345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:24.401155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:24.403503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:24.405935 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78087424-340f-4240-8279-a3613974d218 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.269456 Oct 12 22:58:24.418267 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2493/4839] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:24 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:24.686631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:24.687757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:24.698873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:24.712775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:24.713171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:24.718283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:24.718785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:24.719233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.069966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:25.073722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:25.094721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.101487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.102734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.104836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.105488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.106077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.226448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-426ccd3d-9a49-4a3e-8d1a-c89d866eaede tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.160189 Oct 12 22:58:25.233066 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2494/4840] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:25 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:58:25.329705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:25.330855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:25.344643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.350662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.353162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.354949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.355620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.356403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.779724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:25.794699 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f83e1db4-c0c6-441f-9a44-020ab8451875 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1364 microversion: 2.1 time: 0.468456 Oct 12 22:58:25.795418 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2495/4841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:25 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1364 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:25.805219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-636d484f-ecfe-4bef-8974-35c59e8d48dc req-a224d802-f7a5-438a-9e71-2d7cc5edc7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd372e0-16ac-4525-b874-2a450fd05c53", "tag": "0f6fddd1-0f32-4b29-9c20-82988da2bd88"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:25.854551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-636d484f-ecfe-4bef-8974-35c59e8d48dc req-a224d802-f7a5-438a-9e71-2d7cc5edc7d4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.855217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-636d484f-ecfe-4bef-8974-35c59e8d48dc req-a224d802-f7a5-438a-9e71-2d7cc5edc7d4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.858115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-636d484f-ecfe-4bef-8974-35c59e8d48dc req-a224d802-f7a5-438a-9e71-2d7cc5edc7d4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.940520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-636d484f-ecfe-4bef-8974-35c59e8d48dc req-a224d802-f7a5-438a-9e71-2d7cc5edc7d4 service nova] Creating event network-changed:0f6fddd1-0f32-4b29-9c20-82988da2bd88 for instance 3bd372e0-16ac-4525-b874-2a450fd05c53 on n-h2-860864-8 Oct 12 22:58:25.960263 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-636d484f-ecfe-4bef-8974-35c59e8d48dc req-a224d802-f7a5-438a-9e71-2d7cc5edc7d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160709 Oct 12 22:58:25.963291 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2496/4842] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:25.971602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:25.972426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:25.993505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.994047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.994505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:25.995308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:25.995706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:25.998210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:26.050954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:26.054201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:26.062016 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b18c7b39-58ba-4344-a696-d725684a1eb0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 1.380912 Oct 12 22:58:26.081340 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2347/4843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:24 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:26.094127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-93199aaa-0e24-4b15-912a-c018a399ca82 req-356a973e-7b6f-4368-b867-09129fb18ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df8e9d9-29a8-46d7-9df4-cfcdaceaf167", "name": "network-vif-plugged", "status": "completed", "tag": "53e47db0-d2df-4fa1-a717-4902bcc4abfc"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:26.117343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-93199aaa-0e24-4b15-912a-c018a399ca82 req-356a973e-7b6f-4368-b867-09129fb18ccc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:26.118448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-93199aaa-0e24-4b15-912a-c018a399ca82 req-356a973e-7b6f-4368-b867-09129fb18ccc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:26.121384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-93199aaa-0e24-4b15-912a-c018a399ca82 req-356a973e-7b6f-4368-b867-09129fb18ccc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:26.175727 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-93199aaa-0e24-4b15-912a-c018a399ca82 req-356a973e-7b6f-4368-b867-09129fb18ccc service nova] Creating event network-vif-plugged:53e47db0-d2df-4fa1-a717-4902bcc4abfc for instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 on n-h1-860864-8 Oct 12 22:58:26.200765 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-93199aaa-0e24-4b15-912a-c018a399ca82 req-356a973e-7b6f-4368-b867-09129fb18ccc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108575 Oct 12 22:58:26.209550 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2348/4844] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:26.227522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:26.241522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:26.247604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:26.251495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:26.255318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:26.257426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6217f95-7839-4b36-a1db-345e98afd69d tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.292650 Oct 12 22:58:26.263454 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2497/4845] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:25 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:26.291818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:26.300309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:26.303155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:26.305929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:26.306653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:26.309542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:26.401642 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7576a369-a62c-41e7-8ea1-023756f89c4c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.165443 Oct 12 22:58:26.406568 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2349/4846] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:26 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:58:26.817954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:26.819971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:26.838335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:26.839394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:26.840467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:26.842312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:26.843514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:26.844664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.095380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:27.097087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:27.123316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:27.126915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:27.129989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.132915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:27.133639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:27.135440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.279686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:27.295512 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-01ecbcc8-7345-4e55-818f-a50563201322 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1364 microversion: 2.1 time: 0.481420 Oct 12 22:58:27.299748 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2498/4847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:26 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1364 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:27.308500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:27.309676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:27.329225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:27.330923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:27.333813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.335043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:27.335737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:27.337718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.635446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:27.670902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:27.672166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:27.673412 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c958b6f-edba-4f44-b04e-180f85539906 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.372333 Oct 12 22:58:27.690558 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2499/4848] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:27 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:27.718988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:27.727509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:27.758305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:27.759644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:27.761703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.763940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:27.774033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:27.775445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:27.876121 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b6acc252-2927-496c-942e-a02977a86308 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 14 microversion: 2.1 time: 0.179846 Oct 12 22:58:27.881065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2500/4849] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:27 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 22:58:28.331677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:28.337353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:28.360526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:28.404954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.405486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.405933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:28.413547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.415079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.415799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:28.452825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:28.462743 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-825882a7-d3e4-4411-b169-4d32a66aed4d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 1.371705 Oct 12 22:58:28.466793 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2350/4850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:27 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:28.706267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:28.707276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:28.718622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.723403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.724246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:28.736305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.737253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.737923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:28.873407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:28.897651 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1df9b6dc-90b9-4da3-bb20-7f41d21573ae tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1550 microversion: 2.1 time: 0.568779 Oct 12 22:58:28.898843 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2501/4851] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:28 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1550 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:28.917246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:28.920350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:28.931851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.933980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.935302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:28.936960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:28.937663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:28.938344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.000443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:29.014893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:29.016647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:29.017868 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7094638e-d7e4-4511-a6c4-01ee888ee0fc tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.318086 Oct 12 22:58:29.027685 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2351/4852] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:28 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:29.043510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:29.046437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:29.081955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.089103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.089374 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-785ad7bd-2ebf-47f0-bf3c-ebc7a843b779 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action" status: 200 len: 8206 microversion: 2.1 time: 0.186534 Oct 12 22:58:29.090609 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2502/4853] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:28 2022] POST /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376/action => generated 8206 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:29.093436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.094353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.094570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.095007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.105798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:29.112560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:29.126031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.136701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.137397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.138339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.138966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.139575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.459807 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f6df18a-dc78-4796-a855-174deefd93b0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.430473 Oct 12 22:58:29.461186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2352/4854] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 22:58:29 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-interface => generated 284 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:29.493345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:29.494211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:29.521848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.529130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.532543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.533965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:29.534603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:29.535216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:29.976359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:29.985735 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e3f8f67a-a991-4792-b2ca-2deb8cc64d15 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.888900 Oct 12 22:58:29.990678 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2503/4855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:29 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:30.040989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:30.045672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:30.061661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:30.063384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:30.063792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:30.065919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:30.066920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:30.067615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:30.379449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:30.389160 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c78c4b67-a2d7-4794-90d8-9de586ac4b8e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.901357 Oct 12 22:58:30.393599 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2353/4856] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:29 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:30.401692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:30.402823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:30.409394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:30.410221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:30.411022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:30.415431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:30.416290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:30.416963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:30.761095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:30.807283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:30.812377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:30.822972 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc434030-52bc-4ab1-afa9-8dce5b429347 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.427712 Oct 12 22:58:30.826568 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2354/4857] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:30 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:31.182179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:31.212839 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b8b96b7-2aeb-49e2-8dc1-bf6af9f469a2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 1.172333 Oct 12 22:58:31.213913 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2504/4858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:30 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:31.241024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:31.242021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:31.258479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:31.261486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:31.262484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:31.263425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:31.268619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:31.269638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:31.426114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:31.426679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:31.441185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:31.441909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:31.442641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:31.443528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:31.445927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:31.447212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:31.934321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:31.962569 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4fd44136-7f47-41a4-a768-cab9d886d77c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.726678 Oct 12 22:58:31.965121 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2355/4859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:31 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:31.973171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:31.977765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:32.012193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:32.014761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:32.019263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:32.020687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:32.024606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:32.026230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:32.034442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:32.246781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:32.256807 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0e67411-3fb3-4170-a151-8f92a73a8c4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.835471 Oct 12 22:58:32.258812 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2505/4860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:31 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:32.276796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:32.280094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:32.306062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:32.308003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:32.312465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:32.317696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:32.319413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:32.323268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:33.237294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:33.260977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:33.263044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:33.265190 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2c36ade-852d-4475-b139-09ec68ea0fad tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 1.298880 Oct 12 22:58:33.267747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2356/4861] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:31 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:33.287967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:33.291574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:33.299639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=14 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:33.303789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:33.305540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:33.306194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:33.307557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:33.308271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:33.308909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:33.522324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:33.548557 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4faaa3d8-9ad2-491f-a944-b968c5d36c1d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 1.283496 Oct 12 22:58:33.550853 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2506/4862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:32 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:33.582657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:33.584561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:33.605607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:33.608853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:33.609856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:33.618853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:33.620820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:33.621732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:33.784024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Locking {{(pid=120542) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 12 22:58:33.935285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:33.955875 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17c8d88e-201f-4f3b-969b-fef1deb42663 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.378732 Oct 12 22:58:33.958582 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2507/4863] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:33 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:58:33.995424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:33.997316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:34.045028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:34.050202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:34.062223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.069444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:34.070468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:34.070714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.426534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:34.452203 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea56de36-32ce-4f38-9430-7378f3f546e5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 1.167403 Oct 12 22:58:34.478182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2357/4864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:33 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:34.497623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:34.498270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:34.513913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:34.514414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:34.514860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.515584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:34.516071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:34.516501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.648945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:34.674055 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0232bb0-9410-41e5-97d6-4d50423a3c06 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.710618 Oct 12 22:58:34.691310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:34.700891 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2508/4865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:33 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:34.715065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:34.726905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:34.732718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:34.737366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:34.738117 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6cdce572-4e4d-428d-9595-2dfffb9d919f tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.258691 Oct 12 22:58:34.738591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:34.739332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.742514 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2358/4866] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:34 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:34.785865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] HTTP exception thrown: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e is locked Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Request method failure captured: Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action HTTP/1.1 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 15 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0We39ZUeQZmjVL-3duGV7SiqzM_4PxH2YWvrb736LqQdTw2C_YL1vAiGBwjlPSJUN8aNoRlV03jMdwDpHkWd78SSN39dR4fnpAVSQXtZrTjuH3GGu-3Atd3aBJgyqwLBgbZ3fCKOmlW8Go10S1MoHEJlUH8G9PH_ZQwmtwBykULhsI Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d1909b9808794051a8d86451506ca5bb Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1909b9808794051a8d86451506ca5bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}] Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-238797932 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d1909b9808794051a8d86451506ca5bb Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-238797932-project Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b103c953780a4dce8d8872ee8b47d186 Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-238797932-project Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: {"os-stop": {}} Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e is locked Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2b334a2a-d3a5-490a-a1a1-46232024383e', 'body': {'os-stop': {}}} Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e is locked Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e is locked Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e is locked Oct 12 22:58:34.787934 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:58:34.800660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Returning 409 to user: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e is locked {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:58:34.801611 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e54ad687-2348-478b-af35-9a38a87e2031 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 409 len: 107 microversion: 2.1 time: 0.099397 Oct 12 22:58:34.805785 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2509/4867] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:34 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 107 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:58:34.811269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:34.812005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:34.830936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:34.831557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:34.831939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.832651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:34.838786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:34.839603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:34.964869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Unlocking {{(pid=120543) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 12 22:58:35.086581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-86922153-d8a9-46c8-8d61-d82c827504bf req-9101e570-7582-491b-9cda-2dfdc487b6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df8e9d9-29a8-46d7-9df4-cfcdaceaf167", "tag": "53e47db0-d2df-4fa1-a717-4902bcc4abfc"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:35.122538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-86922153-d8a9-46c8-8d61-d82c827504bf req-9101e570-7582-491b-9cda-2dfdc487b6eb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.123031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-86922153-d8a9-46c8-8d61-d82c827504bf req-9101e570-7582-491b-9cda-2dfdc487b6eb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.123476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-86922153-d8a9-46c8-8d61-d82c827504bf req-9101e570-7582-491b-9cda-2dfdc487b6eb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:35.151601 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef16240b-ce14-455c-bd0e-9104ba4f3147 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.344249 Oct 12 22:58:35.152757 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2359/4868] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:34 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:58:35.153972 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-86922153-d8a9-46c8-8d61-d82c827504bf req-9101e570-7582-491b-9cda-2dfdc487b6eb service nova] Creating event network-changed:53e47db0-d2df-4fa1-a717-4902bcc4abfc for instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 on n-h1-860864-8 Oct 12 22:58:35.165411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f2cc49e-4ca4-4bde-8063-c7a95e91e9c3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:35.168789 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-86922153-d8a9-46c8-8d61-d82c827504bf req-9101e570-7582-491b-9cda-2dfdc487b6eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086406 Oct 12 22:58:35.184113 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2510/4869] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:58:35.185345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f2cc49e-4ca4-4bde-8063-c7a95e91e9c3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.185893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f2cc49e-4ca4-4bde-8063-c7a95e91e9c3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.187413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f2cc49e-4ca4-4bde-8063-c7a95e91e9c3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:35.272563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f2cc49e-4ca4-4bde-8063-c7a95e91e9c3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Going to try to stop instance {{(pid=120543) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:58:35.438235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f2cc49e-4ca4-4bde-8063-c7a95e91e9c3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.280959 Oct 12 22:58:35.448720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2360/4870] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:35 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:58:35.454208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:35.455088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:35.472155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:35.480125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.486749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.487739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:35.497831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.498787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.501633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:35.503101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:35.504178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:35.534779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.560338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.560786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:35.561721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:35.562346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:35.562981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:36.245965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:36.267703 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fee505f-75df-45fc-a0fc-c74ebef5519f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.817737 Oct 12 22:58:36.273817 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2511/4871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:35 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:36.292061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:36.293277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:36.314675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:36.315184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:36.315635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:36.322590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:36.323188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:36.329567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:36.390451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:36.405645 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62d06392-0fd4-4e30-9b95-d0a59e75179d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.910788 Oct 12 22:58:36.412675 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2361/4872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:35 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:36.743108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:36.753725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:36.767856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:36.771993 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-213533ac-03a6-41ab-af20-2df86dead744 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.495119 Oct 12 22:58:36.778029 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2512/4873] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:36 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:37.304838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:37.305730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:37.329355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:37.330880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:37.331398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:37.342277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:37.343028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:37.343523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:37.343974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:37.416602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:37.441348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:37.442616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:37.469020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:37.470698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:37.476259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:37.477315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:37.477994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:37.478595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:38.047771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:38.059226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-33570a17-97d7-4e79-8d13-ef3e1654a2f9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.619596 Oct 12 22:58:38.059870 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2513/4874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:37 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:38.064903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:38.065766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:38.075302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:38.080496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:38.081153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:38.082080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:38.082707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:38.083290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:38.157467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:38.167323 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d1db086-a2d7-4cdb-b710-93bb59a15214 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.867132 Oct 12 22:58:38.175026 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2362/4875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:37 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:38.247665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:38.264480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:38.276262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:38.277916 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74c41796-974c-489d-9312-8386b8adcde9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.216820 Oct 12 22:58:38.278847 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2514/4876] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:38 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:39.083206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:39.084512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:39.104377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.107503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.110829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.117070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.117666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.118205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.201999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:39.202669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:39.221201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.231486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.231975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.232904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.233449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.237649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.488468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:39.500700 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b4d7a30-9a22-4c46-b061-7acf2843f2af tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.422206 Oct 12 22:58:39.501298 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2363/4877] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:39 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:39.535158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:39.535422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:39.535781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:39.550129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.550966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.551612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.552567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:39.554933 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd3ca97e-3dd3-4d7d-8a88-7acd89182005 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.356711 Oct 12 22:58:39.555538 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2515/4878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:39 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:39.556298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:39.557029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:39.777262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:39.792347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:39.794924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:39.798401 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-291eb062-fe6f-46ce-a5ec-da7d710a141a tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.279212 Oct 12 22:58:39.800770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2364/4879] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:39 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:40.531161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:40.531869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:40.549322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:40.549836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:40.550289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:40.556448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:40.561312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:40.564031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:40.584075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:40.584703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:40.602429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:40.603020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:40.603476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:40.607390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:40.607903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:40.620320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.424979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:41.435360 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-68e72b66-105f-4b73-9417-e9ef94adfc52 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.855688 Oct 12 22:58:41.471002 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2365/4880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:40 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:41.476710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:41.477808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:41.486265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.487103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.487758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.488745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:41.492215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:41.492974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:41.528115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:41.568276 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ec0506c-f854-4e9a-a051-bf3e37331760 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 1.037303 Oct 12 22:58:41.570185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2516/4881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:40 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:41.755472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:41.765543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:41.773847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:41.782390 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b7fcfda-2327-4444-9ac1-a46133ecae12 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.304871 Oct 12 22:58:41.783342 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2366/4882] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:41 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:42.146782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6e3064e-c2d0-4ff0-b4b7-fe6df4db9c83 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'create', calling method: .version_select at 0x7f44fc3d49d0>, body: {"keypair": {"name": "tempest-keypair-729431696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV+2WnFJodEmJz1gx5XDXek/MhEyWRzYRXk2rLVVXHyI5p8xOHk6vOG12lgADHs42wvD6+ffTjNlWbLon8laaFhB9w4Bkot2OA88hdcjHeoTbmqakCv3Ez6vejLfSZrAQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:42.187927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c6e3064e-c2d0-4ff0-b4b7-fe6df4db9c83 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for project 8523b5fafc5447e8b3b370133590195e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:42.203396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c6e3064e-c2d0-4ff0-b4b7-fe6df4db9c83 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for user 4fdc00d99b344f69a42a4b60ceaed051 and project 8523b5fafc5447e8b3b370133590195e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:42.292833 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6e3064e-c2d0-4ff0-b4b7-fe6df4db9c83 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.516337 Oct 12 22:58:42.294081 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2517/4883] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 22:58:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 522 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 22:58:42.473165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:42.473903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:42.491603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:42.496073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:42.496650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:42.497423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:42.497887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:42.498318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:42.601126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:42.601777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:42.622269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:42.626512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:42.627139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:42.628097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:42.629793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:42.635096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:43.018742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:43.032892 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c319707d-3e78-4e32-be1e-8d7241423ff8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.436080 Oct 12 22:58:43.040655 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2518/4884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:42 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:43.059575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:43.063861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:43.098843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:43.099347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:43.100449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:43.101709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:43.102183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:43.105921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:43.320891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:43.334178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:43.341940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:43.345876 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b854d198-e714-4e73-97f7-ded5f6a7eea8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.304086 Oct 12 22:58:43.348373 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2519/4885] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:43 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:44.007204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:44.039860 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f37226f-4298-4381-8237-5145a3afec5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 1.570934 Oct 12 22:58:44.058355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2367/4886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:42 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:44.065937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:44.067242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:44.092161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:44.093957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:44.126933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:44.129467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:44.133739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:44.134595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:44.374091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:44.375267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:44.385618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:44.388109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:44.391451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:44.392237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:44.392710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:44.393151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:44.727154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:44.747918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:44.752490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:44.782501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:44.803806 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d23201b9-9f79-4fd2-a6dc-0deb819d33e5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.428634 Oct 12 22:58:44.808694 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2368/4887] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:44 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:44.809614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47a97250-ba4c-47fa-8b39-86d8af8f415a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.737715 Oct 12 22:58:44.810988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2520/4888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:44 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:45.072769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:45.073521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:45.094809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.095315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.100336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:45.104814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.105320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.105762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:45.683473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:45.692898 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ea0eb88-0eaa-4a1b-abce-e45c452ae9db tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.626040 Oct 12 22:58:45.696758 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2369/4889] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:45 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:45.839733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:45.840645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:45.841595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:45.841807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:45.861549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.867438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.870242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.873624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.877930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:45.882682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.885495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.889724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:45.909807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:45.911295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:45.915853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:45.917145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:46.103179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:46.151925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:46.166096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:46.179239 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30767c32-fb2b-45e8-993c-129210f77aa8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.343493 Oct 12 22:58:46.181489 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2521/4890] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:45 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:46.213479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1605009277", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9dff008d-e9d4-4e10-a049-f696efdc5171"}], "security_groups": [{"name": "tempest-securitygroup--1042225109"}], "key_name": "tempest-keypair-729431696", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:46.280517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:46.289960 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d13d2be3-18e0-4cc8-b155-368297467791 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.453365 Oct 12 22:58:46.301431 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2370/4891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:45 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:46.659571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] validate_networks() for [('9dff008d-e9d4-4e10-a049-f696efdc5171', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:58:46.718054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:46.719021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:46.731585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:46.732819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:46.733826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:46.734777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:46.741401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:46.742235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:47.032618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:47.050629 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac62c9e4-4942-46d0-82f5-d7fd55dcefc5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1653 microversion: 2.1 time: 0.336418 Oct 12 22:58:47.072499 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2371/4892] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:46 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1653 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:47.088015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3baa7b6d-7637-4df4-beba-7477791a11c6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:47.099140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3baa7b6d-7637-4df4-beba-7477791a11c6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:47.100203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3baa7b6d-7637-4df4-beba-7477791a11c6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:47.103237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3baa7b6d-7637-4df4-beba-7477791a11c6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:47.162512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3baa7b6d-7637-4df4-beba-7477791a11c6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Going to try to start instance {{(pid=120543) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:58:47.290391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3baa7b6d-7637-4df4-beba-7477791a11c6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.206360 Oct 12 22:58:47.291331 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2372/4893] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:47 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:58:47.298384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:47.299069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:47.315543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:47.316454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:47.320602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:47.321661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:47.323850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:47.324690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:47.577865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:47.587880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:47.589347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:47.590549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f09e8f6e-7edd-4e14-8ff4-5708600d6eb9 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.297801 Oct 12 22:58:47.600139 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2373/4894] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:47 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:47.615837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:47.616924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:47.634015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:47.634508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:47.634940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:47.635685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:47.636242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:47.636709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.078951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.092149 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f016157-0603-43ee-82e2-9b7851e96b4e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1662 microversion: 2.1 time: 0.485349 Oct 12 22:58:48.093134 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2374/4895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:47 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1662 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:48.097890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:48.098504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:48.105237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.105726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.106163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.106858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.107309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.107731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.411842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:58:48.414075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:58:48.414925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:58:48.415534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:58:48.416216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:58:48.437108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.438635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.441117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.442319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.443043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.443640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.500167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for project 8523b5fafc5447e8b3b370133590195e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:48.516836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for user 4fdc00d99b344f69a42a4b60ceaed051 and project 8523b5fafc5447e8b3b370133590195e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:48.536471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:58:48.539751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:58:48.571986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.586548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-50b02537-c589-4173-a246-5392ad1914e6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.491809 Oct 12 22:58:48.588110 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2375/4896] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:48 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:48.625526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:48.626393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:48.637968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.638696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.640774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.641991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:48.645374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:48.646416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:48.671379 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61c0e36f-5e09-4433-a8b0-0659d2826ca2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.483915 Oct 12 22:58:48.678236 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2522/4897] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 22:58:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 22:58:48.687371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eae2331c-785d-4e70-9dc5-f872989ce51f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:48.688275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eae2331c-785d-4e70-9dc5-f872989ce51f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:48.819827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.832045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.843108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.844645 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a57404a8-24bc-4e2e-81c1-57ab15601bef tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.223988 Oct 12 22:58:48.851115 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2376/4898] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:48 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:48.967357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eae2331c-785d-4e70-9dc5-f872989ce51f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.983395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eae2331c-785d-4e70-9dc5-f872989ce51f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.984968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eae2331c-785d-4e70-9dc5-f872989ce51f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:48.986197 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eae2331c-785d-4e70-9dc5-f872989ce51f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1281 microversion: 2.20 time: 0.306407 Oct 12 22:58:49.007695 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2523/4899] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:48 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:58:49.122171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:49.122804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:49.144189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.145311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.145773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:49.146505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.150180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.152020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:49.610789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:49.612069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:49.621578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.632789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.638415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:49.639601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.644504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.645150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:49.821571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:49.828918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:49.854080 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8cfd1abb-cdc1-4440-9fad-7f4faa1fddb8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1662 microversion: 2.1 time: 0.737738 Oct 12 22:58:49.861024 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2377/4900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:49 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1662 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:49.882371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:49.883022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:49.891044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.892243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.892933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:49.894349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:49.895018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:49.895649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.021152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.041460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.044999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.050075 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd0b6966-c19b-49f2-b6f7-cbcf3ccd34dd tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.171787 Oct 12 22:58:50.065832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2378/4901] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:49 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:50.085956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:50.088086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:50.100147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.100891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.101476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.113754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.114694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.116280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.287048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.302521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.308993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.313148 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-573509d8-689f-47ee-8357-c127b1d8c099 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1285 microversion: 2.20 time: 0.245954 Oct 12 22:58:50.313859 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2379/4902] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:50 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:50.508876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:50.524641 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-535d3fc0-0ac1-4550-abd8-d218e5ddd400 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.913448 Oct 12 22:58:50.527958 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2524/4903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:49 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:50.884579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:50.886877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:50.932166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.936925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.937579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:50.943117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:50.943975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:50.944632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.092524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:51.093494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:51.107197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.107825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.109851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.113932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.114805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.115433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.316960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.339224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.348694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.360275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c51831e-be6f-43e3-a40e-7208ee8e5a99 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1605 microversion: 2.32 time: 0.276951 Oct 12 22:58:51.363174 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2525/4904] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:51 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:51.386690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:51.390394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:51.390748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.401041 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b36395a-3b2c-41d6-b95a-b68965a61edf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1662 microversion: 2.1 time: 0.523258 Oct 12 22:58:51.403701 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2380/4905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:50 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1662 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:51.412906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.413526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.413978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.415751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.418716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.420699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.556217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:51.557132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:51.576142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.578488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.579157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.580124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.581404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.586413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.630143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.666116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.671857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.673534 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f8b8cb3-d82a-4299-a5ce-f4985faab142 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1277 microversion: 2.20 time: 0.300685 Oct 12 22:58:51.679832 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2526/4906] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:51 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:51.890523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:51.892439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.893551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.894309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.895911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:51.900223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:51.900951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:51.938105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:51.951290 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6857d66-f9ac-4928-9dc8-fec6fa529754 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.149501 Oct 12 22:58:51.952473 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2527/4907] 10.222.0.20 () {58 vars in 1185 bytes} [Wed Oct 12 22:58:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:58:51.954257 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-261e4bd4-b3c4-43ae-b489-5f0ffe972970 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.405045 Oct 12 22:58:51.954844 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2381/4908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:51 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:58:52.305689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-845746165", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "availability_zone": "nova:n-h2-860864-8", "networks": [{"uuid": "d4a0452f-b445-4b6e-b0de-906364c4a6f9"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:52.396843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:52.399549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:52.410468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] validate_networks() for [('d4a0452f-b445-4b6e-b0de-906364c4a6f9', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:58:52.414354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.417159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.431019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.432107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.433709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.434511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.516104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.516950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.517585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.517832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lazy-loading 'fault' on Instance uuid 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:58:52.598794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:52.611508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:52.613294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c0944ea55824ccb8b6c8c812439293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e166451124234653b4ebda1b54d31af9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:52.614993 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d96a8999-8248-47b9-bc42-6f064f5cf7c8 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 200 len: 1610 microversion: 2.32 time: 0.225224 Oct 12 22:58:52.617089 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2382/4909] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:52 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 1610 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:52.624857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:52.625724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:52.635325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.636136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.637391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.638319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:52.639153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:52.639871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:52.978373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:52.993653 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae5f40df-cacb-45b3-a366-e4109ce90106 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.375188 Oct 12 22:58:52.996985 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2383/4910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:52 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:53.018766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:53.020030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:53.032615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:53.033308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:53.034015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:53.034888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:53.035512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:53.036305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:53.213048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:53.229750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:53.231533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:53.235775 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f9a1a68-54fb-47c8-a34b-6e129d56f61e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1351 microversion: 2.20 time: 0.237491 Oct 12 22:58:53.265072 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2384/4911] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:52 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1351 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:53.290188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:53.293311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:53.308437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:53.310950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:53.311652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:53.313147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:53.313862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:53.314516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:53.622316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:53.650498 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7847ad16-9bcd-4b0b-9014-32a153f34149 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.382949 Oct 12 22:58:53.654084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2385/4912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:53 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:53.671273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:53.680209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:53.728221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:53.737237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:53.751215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:53.754920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:53.759786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:53.764226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.025623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:54.042607 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b97a15f2-d6a6-4e81-9b10-8fc925991444 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.385984 Oct 12 22:58:54.043445 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2386/4913] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:53 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:54.080815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.087678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.104525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.105340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.105793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.106508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.107968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.108433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.130790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] HTTP exception thrown: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Request method failure captured: Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 HTTP/1.1 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0TlVIugzKkUa4Yu-aVB0xBAsycrdziVXshPfK0K93AlQVxRQfELVsla8D_L0VsFhA2Z1MUP66f6WXW0noiVYKHr5yaqE8ij_rkDquMf9973KDO5HpKyu1OtputrFoRMG0SftMbNBPokyeElPCjBAQ7uHiNq2bafMZiUVMdqh7enC9c Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: e166451124234653b4ebda1b54d31af9 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e166451124234653b4ebda1b54d31af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e166451124234653b4ebda1b54d31af9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e166451124234653b4ebda1b54d31af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e166451124234653b4ebda1b54d31af9"}]}] Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: e166451124234653b4ebda1b54d31af9 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TaggedBootDevicesTest-1084021292-project Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6c0944ea55824ccb8b6c8c812439293b Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TaggedBootDevicesTest-1084021292-project Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '77d202a4-d7a0-4e50-a514-8f8d89ae3fd5'} Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.133104 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Returning 404 to user: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-72a49631-42bd-4cee-b8fc-8b28c178a95e tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 404 len: 111 microversion: 2.32 time: 0.082840 Oct 12 22:58:54.138514 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2387/4914] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:54 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:58:54.141422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:54.141593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.150047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.150544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.151134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.151848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.152330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.152759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.184652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:58:54.185213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:58:54.185626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:58:54.186086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:58:54.186568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:58:54.209861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.211432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.212192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.222069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.227056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.227780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.234891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Unlocking {{(pid=120543) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 12 22:58:54.255926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Getting quotas for project 4b031487b12f493ba78cc45e58cd8dbd. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:58:54.264176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Getting quotas for user fe2a6f543fe34285b0dbe9473451d48f and project 4b031487b12f493ba78cc45e58cd8dbd. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:58:54.298232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:58:54.301641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:58:54.333766 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d4fe5c3-a09d-4538-b29f-f3faab57b551 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.197019 Oct 12 22:58:54.339096 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2388/4915] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:54 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:58:54.345016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b79bd3c3-a6be-4aad-b845-e94b5e78bf14 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '.version_select at 0x7f4507ab1040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.390612 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b79bd3c3-a6be-4aad-b845-e94b5e78bf14 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990537770" status: 204 len: 0 microversion: 2.32 time: 0.054934 Oct 12 22:58:54.396255 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2389/4916] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 22:58:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990537770 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 22:58:54.400491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.401857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.410217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.410705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.411144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.415126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.415623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.416230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.419991 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e78b31ab-7455-421b-8a1e-c9b76497b0a6 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.116070 Oct 12 22:58:54.423798 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2528/4917] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:58:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:58:54.441120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.441762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.465923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.469029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.472029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.472825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.473676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.473770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.493878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:54.636335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:54.651546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:54.653027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:54.654159 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-591c43cc-e562-4fd3-93bc-eba2dd587f52 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1339 microversion: 2.20 time: 0.259816 Oct 12 22:58:54.671927 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2390/4918] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:54 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1339 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:54.671927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0eb29551-a5f9-4504-8ac8-24d7aac7c312 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.671927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0eb29551-a5f9-4504-8ac8-24d7aac7c312 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.905850 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0eb29551-a5f9-4504-8ac8-24d7aac7c312 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1328 microversion: 2.1 time: 0.249757 Oct 12 22:58:54.908973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2391/4919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:54 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1328 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:54.923133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:54.924672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:54.947581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.948586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.950765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:54.952649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:54.954347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:54.955952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:55.582904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:55.613440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4bee7e75-a81f-4dba-8ec2-7c9db832d12d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.700680 Oct 12 22:58:55.641455 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2392/4920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:54 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:55.706591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:55.707963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:55.718561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:55.722618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:55.723338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:55.724838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:55.728787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:55.731431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:55.997812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:56.017313 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf2587f5-2b7f-433e-81e6-edab10a56472 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 1.592242 Oct 12 22:58:56.041731 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2529/4921] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:54 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:56.057026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:56.057975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:56.071738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.072653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.074838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.075818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.077797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.078429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.306777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:56.328641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:56.331043 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c02502d4-fc17-4645-81dc-b5354a32bd5f tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1345 microversion: 2.1 time: 0.285772 Oct 12 22:58:56.332139 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2530/4922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:56 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:56.337619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:56.338659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:56.343156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:56.345985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.346208 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4957c39-8620-4eea-97c7-f34cc883942c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.649758 Oct 12 22:58:56.346792 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2393/4923] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:55 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:58:56.361238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.361910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.374512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.391615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.396719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.651470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:56.654805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:56.667842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.672311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.672973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.673606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:56.674170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:56.676821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:56.705789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:58:57.149270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:57.179615 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7fe785c6-7399-493d-8b39-ce9967f3dce0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.842355 Oct 12 22:58:57.207844 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2531/4924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:56 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:57.218004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:57.218672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:57.237498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.239487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.240977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.245005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.247780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.248493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.356545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:57.372602 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-649dcc69-8a55-4956-968a-61baac35520d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 0.720490 Oct 12 22:58:57.388485 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2394/4925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:56 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:57.393719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:57.399590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:57.416590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.418675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.423234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.424642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.425627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.426156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.728065 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56171d94-c55f-4ba0-af8e-a797e4425d74 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1415 microversion: 2.1 time: 0.335432 Oct 12 22:58:57.762462 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2395/4926] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:57 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1415 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:57.789275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:57.790366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:57.813499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.815918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.816753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:57.818011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:57.821173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:57.822453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.109168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:58.121681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1918167c-4d91-4ce9-a646-e4900db5737b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.912376 Oct 12 22:58:58.125841 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2532/4927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:57 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:58.154718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:58:58.156102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:58.166673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.169658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.170350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.172124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.172615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.173127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.351084 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34660c34-5f99-4083-9411-81b5d1461440 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.199776 Oct 12 22:58:58.355967 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2533/4928] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:58:58 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:58:58.367941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:58.368966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:58.416683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.417490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.418107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.419113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.419749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.420424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.735988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:58.748963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:58.753062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:58.758339 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e0525e49-0f78-4244-8b94-2427627ed040 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.991947 Oct 12 22:58:58.761407 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2396/4929] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:57 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:58:58.773415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:58.775316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:58.802113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.804231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.804885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:58.807641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:58.808338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:58.808934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:59.254523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:58:59.270745 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ea651c1-e03c-4001-80a1-140e7e75ca20 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1671 microversion: 2.1 time: 0.909745 Oct 12 22:58:59.271355 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2534/4930] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:58 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1671 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:59.283406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:59.284099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:59.313374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:59.313869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:59.316543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:59.324876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:59.332743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:59.333616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:59.632752 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b7c00dc6-bb54-46af-88cb-57c9f4edcbd3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1421 microversion: 2.1 time: 0.360130 Oct 12 22:58:59.645305 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2535/4931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:59 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1421 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:58:59.794844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:58:59.795508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:58:59.811629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:59.813677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:59.816353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:58:59.819029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:58:59.819830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:58:59.824183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.105219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:00.119874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f895fa8-b0bc-4224-8e1b-4907b59f0661 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1341 microversion: 2.1 time: 1.357396 Oct 12 22:59:00.132051 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2397/4932] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:58:58 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1341 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:00.212948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7f8941ec-c500-4396-8b9f-fbbe8033c953 req-26e15b27-5dcf-4dad-bee1-729de36e461e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:00.234139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7f8941ec-c500-4396-8b9f-fbbe8033c953 req-26e15b27-5dcf-4dad-bee1-729de36e461e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.237386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7f8941ec-c500-4396-8b9f-fbbe8033c953 req-26e15b27-5dcf-4dad-bee1-729de36e461e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.238915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7f8941ec-c500-4396-8b9f-fbbe8033c953 req-26e15b27-5dcf-4dad-bee1-729de36e461e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.270231 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7f8941ec-c500-4396-8b9f-fbbe8033c953 req-26e15b27-5dcf-4dad-bee1-729de36e461e service nova] Creating event network-changed:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h2-860864-8 Oct 12 22:59:00.291028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7f8941ec-c500-4396-8b9f-fbbe8033c953 req-26e15b27-5dcf-4dad-bee1-729de36e461e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083054 Oct 12 22:59:00.292304 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2398/4933] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:00.312696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:00.312696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:00.355109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.355109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.355109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.355109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.355109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.355109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.777403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:00.788361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:00.793834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:00.797029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:00.797951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac6369b9-56dc-42ef-b581-d7f2b597cd78 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1651 microversion: 2.1 time: 0.504200 Oct 12 22:59:00.798578 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2399/4934] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:00 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1651 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:00.800583 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab5b0f7c-8c18-4662-a0f7-3e7aa648bbef tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 1.010072 Oct 12 22:59:00.805034 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2536/4935] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:58:59 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:00.812747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:00.815403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:00.835357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.837559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.841351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:00.842721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:00.842869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.843827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.845819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.846570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.855780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.857280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.858690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:00.862112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:00.862620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:00.864692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.047847 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a03c1c6a-3171-4454-a65f-02e71ed2bc2b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.212307 Oct 12 22:59:01.053483 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2537/4936] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:59:00 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:59:01.061413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:01.063619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:01.111821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:01.139088 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d0687cd-0ae9-417b-8191-4bdbfc8c552c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.335127 Oct 12 22:59:01.139745 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2400/4937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:00 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:01.145749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.146517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.149564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.150001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.150507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.156988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.171461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:01.173098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:01.196229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.203335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.204975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.206572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.209437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.211360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.284974 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e4f1153-cfc3-4c3a-a68b-a9d3aa5fd567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/ips" status: 200 len: 145 microversion: 2.1 time: 0.144060 Oct 12 22:59:01.293943 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2401/4938] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 22:59:01 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/ips => generated 145 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:01.302561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:01.311446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:01.321347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.322279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.322902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.325363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.326029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.328310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.571182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:01.579264 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b9a3b0a-8f34-403a-8b6d-1eec9b684bb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.281399 Oct 12 22:59:01.579935 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2402/4939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:01 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:01.746563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:01.756766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-475d227f-82b5-4067-9907-e488f21b854c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1658 microversion: 2.1 time: 0.701008 Oct 12 22:59:01.777764 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2538/4940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:01 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1658 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:01.840469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:01.841087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:01.849106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.852745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.854152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:01.856278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:01.856984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:01.857633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.061216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:02.073113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:02.075287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:02.077415 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cc8ec58e-15dd-4345-8585-397e53ec331f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.240752 Oct 12 22:59:02.078687 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2403/4941] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:01 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:02.169041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:02.170028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:02.176548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.177513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.179306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.180277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.180864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.181397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.529707 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-037f07c5-7407-4b10-8c2b-e043140af6cd tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.364123 Oct 12 22:59:02.530145 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2539/4942] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:02 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:02.596228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:02.597268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:02.606765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.607448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.611630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.612574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.613285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.613991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.617351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:02.618061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:02.624420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.625289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.625953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.627264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.627929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.629196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.637989 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] HTTP exception thrown: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Request method failure captured: Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 HTTP/1.1 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0TlVIugzKkUa4Yu-aVB0xBAsycrdziVXshPfK0K93AlQVxRQfELVsla8D_L0VsFhA2Z1MUP66f6WXW0noiVYKHr5yaqE8ij_rkDquMf9973KDO5HpKyu1OtputrFoRMG0SftMbNBPokyeElPCjBAQ7uHiNq2bafMZiUVMdqh7enC9c Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: e166451124234653b4ebda1b54d31af9 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e166451124234653b4ebda1b54d31af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e166451124234653b4ebda1b54d31af9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e166451124234653b4ebda1b54d31af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e166451124234653b4ebda1b54d31af9"}]}] Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: e166451124234653b4ebda1b54d31af9 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TaggedBootDevicesTest-1084021292-project Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6c0944ea55824ccb8b6c8c812439293b Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TaggedBootDevicesTest-1084021292-project Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '77d202a4-d7a0-4e50-a514-8f8d89ae3fd5'} Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:02.639824 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Returning 404 to user: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:02.643541 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4968d086-99eb-4aa8-94a3-da12042e3ca5 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 404 len: 111 microversion: 2.32 time: 0.049298 Oct 12 22:59:02.647272 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2404/4943] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 22:59:02 2022] DELETE /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:59:02.652759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:02.653379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] [instance: 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:02.662648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.663155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.663790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.664955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.665426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.666042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.686637 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] HTTP exception thrown: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Request method failure captured: Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 HTTP/1.1 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0TlVIugzKkUa4Yu-aVB0xBAsycrdziVXshPfK0K93AlQVxRQfELVsla8D_L0VsFhA2Z1MUP66f6WXW0noiVYKHr5yaqE8ij_rkDquMf9973KDO5HpKyu1OtputrFoRMG0SftMbNBPokyeElPCjBAQ7uHiNq2bafMZiUVMdqh7enC9c Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: e166451124234653b4ebda1b54d31af9 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e166451124234653b4ebda1b54d31af9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e166451124234653b4ebda1b54d31af9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e166451124234653b4ebda1b54d31af9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e166451124234653b4ebda1b54d31af9"}]}] Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: e166451124234653b4ebda1b54d31af9 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1084021292 Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TaggedBootDevicesTest-1084021292-project Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 6c0944ea55824ccb8b6c8c812439293b Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TaggedBootDevicesTest-1084021292-project Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '77d202a4-d7a0-4e50-a514-8f8d89ae3fd5'} Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.688657 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] Returning 404 to user: Instance 77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:02.692159 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6876ba7f-43b5-45ec-ae35-46f696d97650 tempest-TaggedBootDevicesTest-1084021292 tempest-TaggedBootDevicesTest-1084021292-project] 10.222.0.20 "GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5" status: 404 len: 111 microversion: 2.32 time: 0.041613 Oct 12 22:59:02.696554 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2405/4944] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:02 2022] GET /compute/v2.1/servers/77d202a4-d7a0-4e50-a514-8f8d89ae3fd5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 22:59:02.792530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:02.793304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:02.805625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.806696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.807166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.808948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:02.809422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:02.809997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:02.961136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:02.971627 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57bbf548-62b4-48e5-b261-761d57d5c93a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.360893 Oct 12 22:59:02.978849 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2540/4945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:02 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:03.053266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:03.062768 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41f8bc0e-0bcb-4f98-b74c-af66dc9d6e72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.275952 Oct 12 22:59:03.063327 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2406/4946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:02 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:03.087587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:03.088440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:03.095243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.096304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.096980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.102484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.103941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.104478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:03.105408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.106228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:03.119408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.124508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.131210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.132561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.133192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.135032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.406608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:03.419396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:03.420890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:03.422026 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40ce3f81-dc39-4964-9ece-72a72ba50af1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.323420 Oct 12 22:59:03.422670 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2407/4947] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:03 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:59:03.428732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3a350676-9f48-431b-8176-e3f78b38645c req-b0ca9c6f-4c56-47a6-b215-20cfca96f299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6def7879-c384-49d4-8c02-fe027394e472", "tag": "284ba03e-7dd3-4b6c-8129-2e2625496739"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:03.438754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a350676-9f48-431b-8176-e3f78b38645c req-b0ca9c6f-4c56-47a6-b215-20cfca96f299 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.439421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a350676-9f48-431b-8176-e3f78b38645c req-b0ca9c6f-4c56-47a6-b215-20cfca96f299 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.440106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a350676-9f48-431b-8176-e3f78b38645c req-b0ca9c6f-4c56-47a6-b215-20cfca96f299 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.453491 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3a350676-9f48-431b-8176-e3f78b38645c req-b0ca9c6f-4c56-47a6-b215-20cfca96f299 service nova] Creating event network-changed:284ba03e-7dd3-4b6c-8129-2e2625496739 for instance 6def7879-c384-49d4-8c02-fe027394e472 on n-h2-860864-8 Oct 12 22:59:03.462146 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3a350676-9f48-431b-8176-e3f78b38645c req-b0ca9c6f-4c56-47a6-b215-20cfca96f299 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Oct 12 22:59:03.463759 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2408/4948] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:03.539402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:03.547551 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6dd2c922-5066-4bc4-8398-a071f0f7e198 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.463851 Oct 12 22:59:03.564641 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2541/4949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:03 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:03.570296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:03.571010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:03.575404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:03.576175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:03.577014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:03.579014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.579500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.580442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.581521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.582561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.583257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.583684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.584348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.584844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.585584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:03.586037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:03.586632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:03.744799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c67f3e7-d719-4c5c-a133-72636f2420e7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.179551 Oct 12 22:59:03.745407 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2409/4950] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:03 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:03.996949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:03.998484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:04.009332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.010239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.010900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.011974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.012677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.013494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.242637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:04.244987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:04.254808 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ac87a4c-b318-4b13-ab42-4e2fde0a11a9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.263042 Oct 12 22:59:04.256095 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2410/4951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:03 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:04.281898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=18 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:04.450553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:04.457067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:04.457919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:04.473087 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f21d19f-c4c1-4d5c-944a-04a2a0479349 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.901307 Oct 12 22:59:04.478209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.478703 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2542/4952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:03 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:04.479375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.484068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.485161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.485781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.486383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.503283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:04.503931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:04.524806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.528764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.529487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.530492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.533139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.534561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.751258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:04.769732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:04.771321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:04.776357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5581b907-5ec4-45aa-83f0-3a2b04797300 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.333522 Oct 12 22:59:04.777482 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2411/4953] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:04 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:04.784106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:04.784874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:04.793242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.793921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.794536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.795535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.796333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.796923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.901817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:04.933060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:04.936777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:04.943163 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-191ef34a-0681-4232-bc7b-08837b6033e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.444268 Oct 12 22:59:04.944110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2543/4954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:04 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:04.970502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:04.971305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:04.981618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.985426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.986020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.988450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:04.989053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:04.990856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:04.992618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e52d06f2-6b8d-4ea2-b2b2-d8cd4a77f146 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.213698 Oct 12 22:59:05.005526 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2412/4955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:04 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:05.151056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:05.159180 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b5b4d93-81f3-433d-be6f-1cb86f4e5850 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.193422 Oct 12 22:59:05.160029 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2544/4956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:04 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:05.183585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:05.184232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:05.198507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.199332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.200448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.201321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.201926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.202824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.285225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:05.286085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:05.300149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.300761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.301286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.302162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.304970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.305551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.484210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:05.495004 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a97ee36-8794-4912-94ad-22438faf15d3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.315845 Oct 12 22:59:05.496031 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2413/4957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:05 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:05.592772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:05.603340 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c342953-2443-4c9d-87bd-e502e740bd2c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.324497 Oct 12 22:59:05.615919 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2545/4958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:05 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:05.811066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:05.813778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:05.822008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.822871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.823979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.825090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:05.825768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:05.826385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:05.830747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:06.020964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:06.023471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:06.024561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:06.037214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:06.038054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:06.040311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:06.041001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:06.041458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:06.042372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:06.043736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a117720e-0bf6-464b-a3d9-a7b488584ddb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.241742 Oct 12 22:59:06.044467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:06.045147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:06.047418 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2414/4959] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:05 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:06.277303 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39e5f049-135e-4a0c-b55c-17bdd6699aeb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.263685 Oct 12 22:59:06.280575 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2546/4960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:06 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:06.421541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "039a7956-3ecd-413c-b3a8-690818c92ee8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:06.424212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:06.431813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:06.432474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:06.432984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:06.433765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:06.434164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:06.434669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:06.628141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:06.629350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:06.637908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:06.638773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:06.639422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:06.640277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:06.640970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:06.641954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:06.743160 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6b7cfdf7-c60d-4f5b-9182-d5fb93ea8825 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325594 Oct 12 22:59:06.744158 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2415/4961] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 22:59:06 2022] POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:06.841549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:06.866396 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3644357-a9c4-4168-b798-9c7471a575cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.242062 Oct 12 22:59:06.866993 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2547/4962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:06 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:07.073784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:07.074737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:07.094003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:07.094680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:07.095277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:07.096160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:07.096764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:07.097530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:07.261139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:07.280693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:07.282765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:07.284205 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-910ab3a2-683f-4fb4-b62e-e156e5c052cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.215675 Oct 12 22:59:07.306858 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2416/4963] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:07 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:07.310797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:07.311730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:07.319175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:07.319914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:07.320537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:07.321586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:07.322198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:07.322730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:07.549809 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f4e9bd4-4900-4fd7-9c5e-c62a8517af9c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.249549 Oct 12 22:59:07.550401 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2548/4964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:07 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:07.779182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-131192b6-b59b-4fb6-a414-a9c26239dea1 req-4ca83b0e-d470-4c48-9c53-89004a898f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "name": "network-vif-plugged", "status": "completed", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:07.792094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-131192b6-b59b-4fb6-a414-a9c26239dea1 req-4ca83b0e-d470-4c48-9c53-89004a898f99 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:07.792982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-131192b6-b59b-4fb6-a414-a9c26239dea1 req-4ca83b0e-d470-4c48-9c53-89004a898f99 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:07.793635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-131192b6-b59b-4fb6-a414-a9c26239dea1 req-4ca83b0e-d470-4c48-9c53-89004a898f99 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:07.807120 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-131192b6-b59b-4fb6-a414-a9c26239dea1 req-4ca83b0e-d470-4c48-9c53-89004a898f99 service nova] Creating event network-vif-plugged:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h2-860864-8 Oct 12 22:59:07.824362 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-131192b6-b59b-4fb6-a414-a9c26239dea1 req-4ca83b0e-d470-4c48-9c53-89004a898f99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060735 Oct 12 22:59:07.826183 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2417/4965] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:07.892645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:07.893626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:07.903297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:07.904149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:07.904975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:07.906113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:07.906758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:07.907364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:08.111407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:08.120292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb0f6e5d-d2c1-420c-9b56-bbb178246720 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.232965 Oct 12 22:59:08.121296 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2549/4966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:07 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:08.316306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:08.316926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:08.324615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:08.325158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:08.325600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:08.326298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:08.326749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:08.327192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:08.492115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:08.501942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:08.503406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:08.504853 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ff95e42-a8f1-4b96-8eb2-b42ad1ae4406 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1407 microversion: 2.20 time: 0.193779 Oct 12 22:59:08.506485 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2418/4967] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:08 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:08.574693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:08.576133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:08.585059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:08.586184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:08.586869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:08.588197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:08.588886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:08.589873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:08.779773 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fea85f85-3c69-4afd-a935-6120db2e2455 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.205592 Oct 12 22:59:08.779773 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2550/4968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:08 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:09.146741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:09.147817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:09.156301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.157095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.157751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:09.159144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.159823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.160874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:09.355753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:09.369163 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2afadeb4-f5ea-4d4c-9690-d2a28bc5e198 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.226878 Oct 12 22:59:09.383158 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2419/4969] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:09 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:09.531395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:09.532105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:09.544389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.544951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.545426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:09.546188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.546660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.547098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:09.806318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:09.807222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:09.823587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.825432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.828343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:09.829545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.835174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.836127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:09.839876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:09.853843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:09.856662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:09.885838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9fbfa149-8759-4a0b-b102-202650dfbb65 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1599 microversion: 2.20 time: 0.356725 Oct 12 22:59:09.888216 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2551/4970] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:09 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1599 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:09.914642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:09.915388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:09.926947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.928321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.928651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:09.929455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:09.930207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:09.931029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:10.072259 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e73e9347-b446-4b77-a8c1-cbdd5e87ac8b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.272090 Oct 12 22:59:10.073300 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2420/4971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:09 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:10.102487 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-145ca4e5-35ff-465b-8946-9a5af6f3adc9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.193017 Oct 12 22:59:10.103360 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2552/4972] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 22:59:09 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:59:10.397476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:10.398080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:10.410722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:10.411218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:10.411736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:10.412482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:10.412934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:10.413350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:10.764114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:10.777568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a21e6aa-f34b-4b57-aec7-77ead462b756 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.379771 Oct 12 22:59:10.778223 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2421/4973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:10 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:11.099709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:11.100417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:11.119698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:11.120224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:11.120675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:11.121401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:11.121927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:11.122365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:11.558718 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce279544-fd8b-4c4c-96f8-9fb5dfa2ffb4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.464159 Oct 12 22:59:11.572373 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2553/4974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:11 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:11.801283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:11.801796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:11.815742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:11.816259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:11.816697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:11.817426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:11.818490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:11.818917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:12.144510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:12.154753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89cb38b9-48a7-4cd9-ab9a-c5ec343b324d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.357216 Oct 12 22:59:12.158806 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2422/4975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:11 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:12.225149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ee4d5f90-ddf6-48f0-8d08-98cc09571488 req-80d85a8e-053a-4e74-a65f-921cc0cbaac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:12.236302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ee4d5f90-ddf6-48f0-8d08-98cc09571488 req-80d85a8e-053a-4e74-a65f-921cc0cbaac5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:12.236849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ee4d5f90-ddf6-48f0-8d08-98cc09571488 req-80d85a8e-053a-4e74-a65f-921cc0cbaac5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:12.237333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ee4d5f90-ddf6-48f0-8d08-98cc09571488 req-80d85a8e-053a-4e74-a65f-921cc0cbaac5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:12.274307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ee4d5f90-ddf6-48f0-8d08-98cc09571488 req-80d85a8e-053a-4e74-a65f-921cc0cbaac5 service nova] Creating event network-changed:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h2-860864-8 Oct 12 22:59:12.309476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ee4d5f90-ddf6-48f0-8d08-98cc09571488 req-80d85a8e-053a-4e74-a65f-921cc0cbaac5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088683 Oct 12 22:59:12.315866 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2554/4976] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:59:12.586185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:12.586794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:12.606072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:12.606575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:12.607014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:12.607920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:12.608544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:12.609100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:12.842948 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a22c6a9e-ce9d-41d7-a630-66ac3e420d9b tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.261183 Oct 12 22:59:12.843567 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2423/4977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:12 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:13.051730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6c3d84d8-c87a-436d-a5db-4900bf376a11 req-4b50236b-02a7-4495-8fbd-e0aa86e2674e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd372e0-16ac-4525-b874-2a450fd05c53", "name": "network-vif-plugged", "status": "completed", "tag": "0f6fddd1-0f32-4b29-9c20-82988da2bd88"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:13.075980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6c3d84d8-c87a-436d-a5db-4900bf376a11 req-4b50236b-02a7-4495-8fbd-e0aa86e2674e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:13.077288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6c3d84d8-c87a-436d-a5db-4900bf376a11 req-4b50236b-02a7-4495-8fbd-e0aa86e2674e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:13.080309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6c3d84d8-c87a-436d-a5db-4900bf376a11 req-4b50236b-02a7-4495-8fbd-e0aa86e2674e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:13.107261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6c3d84d8-c87a-436d-a5db-4900bf376a11 req-4b50236b-02a7-4495-8fbd-e0aa86e2674e service nova] Creating event network-vif-plugged:0f6fddd1-0f32-4b29-9c20-82988da2bd88 for instance 3bd372e0-16ac-4525-b874-2a450fd05c53 on n-h2-860864-8 Oct 12 22:59:13.117384 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6c3d84d8-c87a-436d-a5db-4900bf376a11 req-4b50236b-02a7-4495-8fbd-e0aa86e2674e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070800 Oct 12 22:59:13.120988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2555/4978] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:13.184011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:13.184843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:13.197588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:13.198331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:13.199267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:13.200359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:13.200994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:13.202933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:13.419715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:13.432195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa49f3b4-8c23-485e-a484-0993d136495c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.252008 Oct 12 22:59:13.433624 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2424/4979] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:13 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:13.869335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:13.872347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:13.893255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:13.894096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:13.897307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:13.898429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:13.899121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:13.900451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:14.135518 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-646bd59f-d774-467f-b11c-0dbb03227946 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.272010 Oct 12 22:59:14.136071 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2556/4980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:13 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:14.462818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:14.465020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:14.476104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:14.476594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:14.477458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:14.478468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:14.479077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:14.479683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:14.719584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:14.733565 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a4775a5-ca40-47cf-874c-7ed92db26682 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1375 microversion: 2.1 time: 0.274477 Oct 12 22:59:14.748124 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2425/4981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:14 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:15.160976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:15.162527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:15.178943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:15.179456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:15.179941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:15.180662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:15.181128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:15.181557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:15.186778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a4732725-583e-4513-80e9-236b6ca8ad2e req-4f41247a-7772-4272-8b99-42c9d3c659b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6def7879-c384-49d4-8c02-fe027394e472", "name": "network-vif-plugged", "status": "completed", "tag": "284ba03e-7dd3-4b6c-8129-2e2625496739"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:15.217191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a4732725-583e-4513-80e9-236b6ca8ad2e req-4f41247a-7772-4272-8b99-42c9d3c659b3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:15.220530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a4732725-583e-4513-80e9-236b6ca8ad2e req-4f41247a-7772-4272-8b99-42c9d3c659b3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:15.221141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a4732725-583e-4513-80e9-236b6ca8ad2e req-4f41247a-7772-4272-8b99-42c9d3c659b3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:15.236674 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a4732725-583e-4513-80e9-236b6ca8ad2e req-4f41247a-7772-4272-8b99-42c9d3c659b3 service nova] Creating event network-vif-plugged:284ba03e-7dd3-4b6c-8129-2e2625496739 for instance 6def7879-c384-49d4-8c02-fe027394e472 on n-h2-860864-8 Oct 12 22:59:15.253710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a4732725-583e-4513-80e9-236b6ca8ad2e req-4f41247a-7772-4272-8b99-42c9d3c659b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074310 Oct 12 22:59:15.260232 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2426/4982] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:15.439503 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-980d1240-726a-48ab-ab87-ea89a561cc6c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.282318 Oct 12 22:59:15.445496 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2557/4983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:15 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:15.766294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:15.767423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:15.781357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:15.786881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:15.787732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:15.791523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:15.792040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:15.792582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.019012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:16.029489 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd02b2cb-6532-4289-816b-d98bd81300d4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1562 microversion: 2.1 time: 0.267676 Oct 12 22:59:16.030618 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2427/4984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:15 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:16.057601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:16.058603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:16.065921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.067042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.067945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.068919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.069768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.070142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.243089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:16.253006 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a9eec8e-f2a2-47c5-9ef2-5d8d827e3eee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1562 microversion: 2.1 time: 0.199477 Oct 12 22:59:16.259932 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2558/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:16 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1562 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:16.342558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:16.343060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:16.350829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.351675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.353119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.353119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.353119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.353119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.382120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:59:16.469230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:16.470233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:16.479774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.480612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.482054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.484579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.486057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.486718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.509093 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-626ee0f6-cd22-4809-8247-8bdc65ed9d31 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 204 len: 0 microversion: 2.1 time: 0.169921 Oct 12 22:59:16.509610 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2428/4986] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:59:16 2022] DELETE /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:59:16.520439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:16.521524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:16.528658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.529459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.529684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.530378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:16.531004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:16.531595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:16.537104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:16.752711 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-296e63c7-26aa-4033-a90e-e014277c9619 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1463 microversion: 2.1 time: 0.286596 Oct 12 22:59:16.773368 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2559/4987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:16 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1463 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:16.856513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:16.871107 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0fd8641d-75e2-4293-9bde-0ff1d187334c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1568 microversion: 2.1 time: 0.355501 Oct 12 22:59:16.873771 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2429/4988] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:16 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1568 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:17.785306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:17.786184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:17.806650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:17.810280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:17.810775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:17.812052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:17.812755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:17.813548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:17.901518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:17.902818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:17.917994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:17.918432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:17.918871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:17.919731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:17.920452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:17.924671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:18.012833 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2c39447-539f-4790-80af-3630697aacfc tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1648 microversion: 2.1 time: 0.234979 Oct 12 22:59:18.046589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2560/4989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:17 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1648 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:18.062822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:18.071979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:18.096113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:18.100101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:18.100776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:18.101653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:18.102337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:18.102939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:18.240614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:18.251184 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-168bf876-6a9d-4752-ac34-aa6f27e99833 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1568 microversion: 2.1 time: 0.355553 Oct 12 22:59:18.251778 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2430/4990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:17 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1568 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:18.440115 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35a306ab-2dbe-4e31-b9ac-f6d560e29d88 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1648 microversion: 2.1 time: 0.392033 Oct 12 22:59:18.440722 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2561/4991] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:18 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1648 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:18.466040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:18.467119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:18.474542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:18.475271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:18.475908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:18.476962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:18.477607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:18.478215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:18.784978 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21f5e32e-549d-4797-94a7-79ba9d4bca3d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1648 microversion: 2.1 time: 0.322495 Oct 12 22:59:18.788967 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2431/4992] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:18 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1648 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:18.887622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1507095622", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "availability_zone": "nova:n-h1-860864-8", "networks": [{"uuid": "d4a0452f-b445-4b6e-b0de-906364c4a6f9"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:19.000228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c2f41a3c-9554-476c-9c85-acfe9b8571ed req-c4a414d2-68d3-4be6-97d7-d7491c966d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd372e0-16ac-4525-b874-2a450fd05c53", "name": "network-vif-deleted", "tag": "0f6fddd1-0f32-4b29-9c20-82988da2bd88"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:19.022525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] validate_networks() for [('d4a0452f-b445-4b6e-b0de-906364c4a6f9', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:59:19.036557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c2f41a3c-9554-476c-9c85-acfe9b8571ed req-c4a414d2-68d3-4be6-97d7-d7491c966d77 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:19.037038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c2f41a3c-9554-476c-9c85-acfe9b8571ed req-c4a414d2-68d3-4be6-97d7-d7491c966d77 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:19.037455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c2f41a3c-9554-476c-9c85-acfe9b8571ed req-c4a414d2-68d3-4be6-97d7-d7491c966d77 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:19.066069 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c2f41a3c-9554-476c-9c85-acfe9b8571ed req-c4a414d2-68d3-4be6-97d7-d7491c966d77 service nova] Creating event network-vif-deleted:0f6fddd1-0f32-4b29-9c20-82988da2bd88 for instance 3bd372e0-16ac-4525-b874-2a450fd05c53 on n-h2-860864-8 Oct 12 22:59:19.095796 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c2f41a3c-9554-476c-9c85-acfe9b8571ed req-c4a414d2-68d3-4be6-97d7-d7491c966d77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083582 Oct 12 22:59:19.098471 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2432/4993] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:19.279525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:19.280261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:19.307432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:19.307432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:19.307432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:19.308264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:19.313023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:19.313023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:19.752979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:19.789051 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75b16acd-8357-4e03-84db-59a4eca91240 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1360 microversion: 2.1 time: 0.514428 Oct 12 22:59:19.789664 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2433/4994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:19 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1360 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:19.969892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:59:19.970442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:59:19.970812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:59:19.971236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:59:19.971663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:59:19.982554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:19.983064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:19.983758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:19.984564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:19.985035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:19.985624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:19.995668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:20.008691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Getting quotas for project 4b031487b12f493ba78cc45e58cd8dbd. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:59:20.015613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Getting quotas for user fe2a6f543fe34285b0dbe9473451d48f and project 4b031487b12f493ba78cc45e58cd8dbd. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:59:20.031968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:59:20.035118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:59:20.120029 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9fd1ade-6437-4ba9-a53f-90ec576d6740 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245699 Oct 12 22:59:20.122064 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2562/4995] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:59:20.134860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d87b81a-dc0d-4184-b198-6466c75c44b3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:20.136274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d87b81a-dc0d-4184-b198-6466c75c44b3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:20.287984 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d87b81a-dc0d-4184-b198-6466c75c44b3 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1329 microversion: 2.1 time: 0.159038 Oct 12 22:59:20.290902 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2434/4996] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:20 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1329 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:20.812696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:20.813334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:20.824226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:20.824714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:20.825176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:20.832486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:20.840833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:20.841751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:20.978300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:20.988140 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-505f956c-7c00-49be-a4e7-9f96eba3f1d0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1360 microversion: 2.1 time: 0.179241 Oct 12 22:59:20.990512 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2563/4997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:20 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:21.314798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:21.315492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:21.350566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:21.351466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:21.352254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:21.354139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:21.354805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:21.356237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:21.496474 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f03d13f-dffd-4a36-b7b7-ba1158a64a49 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1338 microversion: 2.1 time: 0.181575 Oct 12 22:59:21.500246 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2435/4998] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:21 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:22.012693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:22.014037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:22.023932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:22.024813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:22.025142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:22.026028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:22.026681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:22.027696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:22.488664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:22.499004 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fbed3067-b5d6-4b1e-b366-125aa364e84c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1360 microversion: 2.1 time: 0.490586 Oct 12 22:59:22.503397 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2564/4999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:22 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1360 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:22.526412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:22.526886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:22.538872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:22.540461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:22.541694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:22.544840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:22.545780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:22.548484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:22.696408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88dc8704-844d-4fb1-ab00-5eed92738015 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1422 microversion: 2.1 time: 0.173889 Oct 12 22:59:22.699379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2436/5000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:22 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1422 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:22.944532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ccd68acd-3901-4cd4-80fb-c0b114b94683 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:22.951483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccd68acd-3901-4cd4-80fb-c0b114b94683 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:22.952259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccd68acd-3901-4cd4-80fb-c0b114b94683 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:22.953078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccd68acd-3901-4cd4-80fb-c0b114b94683 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:23.001687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ccd68acd-3901-4cd4-80fb-c0b114b94683 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 22:59:23.099261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ccd68acd-3901-4cd4-80fb-c0b114b94683 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action" status: 202 len: 0 microversion: 2.1 time: 0.146522 Oct 12 22:59:23.111942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:23.112723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:23.122447 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2565/5001] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:59:22 2022] POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:59:23.126681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:23.127448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:23.130188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:23.131715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:23.132475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:23.133154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:23.475172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:23.488043 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1669fabb-288e-44a5-80d3-9f838b0fee90 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1724 microversion: 2.1 time: 0.380497 Oct 12 22:59:23.489506 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2437/5002] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:23 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:23.529294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:23.530170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:23.560635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:23.566001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:23.567741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:23.568617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:23.572249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:23.572699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:23.721446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:23.722084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:23.740061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:23.740884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:23.741519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:23.742426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:23.743069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:23.743684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:23.868506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:23.882033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39f4edd9-6205-4455-97d3-392ca17ea7a8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1360 microversion: 2.1 time: 0.355589 Oct 12 22:59:23.892996 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2566/5003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:23 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1360 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:24.134018 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4136899d-0045-408a-8f36-f09e4736b6f2 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1464 microversion: 2.1 time: 0.416173 Oct 12 22:59:24.138306 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2438/5004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:23 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1464 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:24.520803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:24.521428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:24.524924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5d096db3-3ddc-4f4b-8fbd-629dbf98d110 req-b0a4de62-537d-4982-a082-78937ae95d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b198cdb-9748-4798-a532-a40bbf5ee2f4", "tag": "20f85973-528b-4d88-bfea-71f1d14cec10"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:24.549696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:24.550390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:24.554017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:24.554795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:24.557680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:24.558663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:24.562624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5d096db3-3ddc-4f4b-8fbd-629dbf98d110 req-b0a4de62-537d-4982-a082-78937ae95d67 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:24.563124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5d096db3-3ddc-4f4b-8fbd-629dbf98d110 req-b0a4de62-537d-4982-a082-78937ae95d67 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:24.563568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5d096db3-3ddc-4f4b-8fbd-629dbf98d110 req-b0a4de62-537d-4982-a082-78937ae95d67 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:24.629162 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5d096db3-3ddc-4f4b-8fbd-629dbf98d110 req-b0a4de62-537d-4982-a082-78937ae95d67 service nova] Creating event network-changed:20f85973-528b-4d88-bfea-71f1d14cec10 for instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 on n-h1-860864-8 Oct 12 22:59:24.647133 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5d096db3-3ddc-4f4b-8fbd-629dbf98d110 req-b0a4de62-537d-4982-a082-78937ae95d67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134169 Oct 12 22:59:24.647772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2567/5005] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:24.907512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:24.908801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:24.925517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:24.926419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:24.927562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:24.928568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:24.929381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:24.930033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:25.153012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:25.162835 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61843ede-33a9-4c16-a613-380de2720a66 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1360 microversion: 2.1 time: 0.260197 Oct 12 22:59:25.163441 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2568/5006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:24 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1360 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:25.178217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:25.188240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:25.209255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:25.211649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:25.212284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:25.214449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:25.222908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:25.230670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:25.232223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:25.239780 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8d6a08ea-3dc5-44a5-aa40-7044dec5c98e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1724 microversion: 2.1 time: 0.729297 Oct 12 22:59:25.241274 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2439/5007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:24 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1724 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:25.812640 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad1b7997-7a5a-4fe8-ac28-dbb8b410d68d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1464 microversion: 2.1 time: 0.643861 Oct 12 22:59:25.813890 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2569/5008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:25 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1464 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:26.187609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:26.188833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:26.198518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:26.199610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:26.200588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:26.201661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:26.202305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:26.202963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:26.266231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:26.266810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:26.282015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:26.285135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:26.286567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:26.294151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:26.295567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:26.297315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:26.324033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:26.325454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:26.325933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:26.327728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lazy-loading 'fault' on Instance uuid 3bd372e0-16ac-4525-b874-2a450fd05c53 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:59:26.407408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:26.420772 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ab40479-ca49-4696-b823-8916f2bd1ab7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 200 len: 1365 microversion: 2.1 time: 0.238381 Oct 12 22:59:26.423005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2440/5009] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:26 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:26.531327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:26.547439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dcbe7e46-c7f2-4e37-9d95-6d5c7ea4b00f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1724 microversion: 2.1 time: 0.286515 Oct 12 22:59:26.548795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2570/5010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:26 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:26.839524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:26.840595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:26.850264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:26.852908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:26.856168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:26.857232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:26.857922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:26.861157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:27.381875 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8381d2d-ccd5-4903-bf29-c2e57048896d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1464 microversion: 2.1 time: 0.547244 Oct 12 22:59:27.392672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2441/5011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:26 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1464 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:27.446489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:27.447109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:27.461145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:27.461749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:27.462429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:27.463359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:27.464130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:27.464944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:27.483875 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 HTTP/1.1 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3bd372e0-16ac-4525-b874-2a450fd05c53'} Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:27.485859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:27.492198 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:27.492198 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:27.492198 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:27.492198 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:27.492198 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:27.492198 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:27.492198 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:27.494095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:27.495428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd1bd2c3-f0be-4cee-8c09-dc6ef35c0c76 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 404 len: 111 microversion: 2.1 time: 0.053607 Oct 12 22:59:27.497336 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2571/5012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:27 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:27.571831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:27.572465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:27.584250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:27.586037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:27.588526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:27.589371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:27.590090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:27.590740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:27.861821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:27.878094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f76aca9-7941-4190-907d-4e6c6362d408 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1724 microversion: 2.1 time: 0.309547 Oct 12 22:59:27.881747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2442/5013] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:27 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:28.348434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:28.352121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:28.360212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.361716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.362569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:28.364291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.364999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.365657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:28.405925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:28.407108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:28.417563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.418061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.421872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:28.422605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.426937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.427428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:28.489177 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1904bb4d-9177-4ac7-8db6-869e0083e7b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.413800 Oct 12 22:59:28.489833 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2572/5014] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:59:28 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 22:59:28.507627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:28.508415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:28.516777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.518213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.518852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:28.520271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.521361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.521977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:28.751800 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-068591ba-c45c-41a5-b163-a13d4798f1fe tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1464 microversion: 2.1 time: 0.349716 Oct 12 22:59:28.775328 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2443/5015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:28 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1464 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:28.823965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:28.834530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f2513142-d2f0-4f7b-abca-0ce82f4b4ed3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1668 microversion: 2.1 time: 0.339542 Oct 12 22:59:28.837717 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2573/5016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:28 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1668 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:28.909393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:28.910109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:28.918851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.920053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.920672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:28.921556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:28.922409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:28.928258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:29.174937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:29.185994 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d4ab17db-b358-4ab6-a965-5ab0f875c600 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1724 microversion: 2.1 time: 0.281018 Oct 12 22:59:29.204481 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2444/5017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:28 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:29.799327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:29.804684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:29.827534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:29.828468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:29.829407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:29.831596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:29.837027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:29.840773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:29.867801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:29.867801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:29.872083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:29.873562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:29.874003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:29.896307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:29.898886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:29.899380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:29.996840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:30.026513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:30.142803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:30.154418 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dae6fae8-0091-47c2-bb72-ab366c527942 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1673 microversion: 2.1 time: 0.296158 Oct 12 22:59:30.172675 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9633ba7d-921b-4644-8b1a-3c1e7fdb8a3c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1464 microversion: 2.1 time: 0.375658 Oct 12 22:59:30.172675 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2574/5019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:29 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:30.172960 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2445/5019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:29 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1673 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:30.214235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:30.215104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:30.223655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:30.224327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:30.224777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:30.225493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:30.226133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:30.226744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:30.396069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:30.404879 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d748b923-7da3-42c9-b92d-f209503ae4d0 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1724 microversion: 2.1 time: 0.198391 Oct 12 22:59:30.405836 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2575/5020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:30 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:31.188939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:31.189703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:31.194602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:31.195233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:31.197529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:31.205494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:31.205996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:31.206447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:31.207207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:31.207670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:31.219826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:31.220722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:31.221629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:31.224299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:31.224443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:31.225278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:31.226055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:31.972959 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aa9a27b1-8399-4cc4-9a8b-4dd888c2ed41 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1464 microversion: 2.1 time: 0.781693 Oct 12 22:59:31.974412 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2576/5021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:31 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1464 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:31.986793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:31.987746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:31.992032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:32.009208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:32.011816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:32.012342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:32.026418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:32.031499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:32.032774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:32.142373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:32.155613 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-69dcec21-70cd-48a4-ab35-1bf2f78fdf94 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.977255 Oct 12 22:59:32.156832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2446/5022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:31 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:32.163267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-caca144a-d469-401e-b5dc-9b73a246064c req-5399f300-f0f2-45f4-8a2c-13c98a665561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b198cdb-9748-4798-a532-a40bbf5ee2f4", "name": "network-vif-plugged", "status": "completed", "tag": "20f85973-528b-4d88-bfea-71f1d14cec10"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:32.189378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-caca144a-d469-401e-b5dc-9b73a246064c req-5399f300-f0f2-45f4-8a2c-13c98a665561 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:32.190104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-caca144a-d469-401e-b5dc-9b73a246064c req-5399f300-f0f2-45f4-8a2c-13c98a665561 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:32.190586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-caca144a-d469-401e-b5dc-9b73a246064c req-5399f300-f0f2-45f4-8a2c-13c98a665561 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:32.216473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:32.219462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-caca144a-d469-401e-b5dc-9b73a246064c req-5399f300-f0f2-45f4-8a2c-13c98a665561 service nova] Creating event network-vif-plugged:20f85973-528b-4d88-bfea-71f1d14cec10 for instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 on n-h1-860864-8 Oct 12 22:59:32.236504 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-caca144a-d469-401e-b5dc-9b73a246064c req-5399f300-f0f2-45f4-8a2c-13c98a665561 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077535 Oct 12 22:59:32.238144 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2447/5023] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:32.539692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:32.554530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f201350-5bca-4845-a890-96c47142ea69 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1724 microversion: 2.1 time: 0.577640 Oct 12 22:59:32.556795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2577/5024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:31 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1724 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:33.002619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:33.003717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:33.021060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:33.021957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:33.022656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:33.023649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:33.024420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:33.024891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:33.315551 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-757ed112-ea3f-40d5-a157-d5f141300f09 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1464 microversion: 2.1 time: 0.320376 Oct 12 22:59:33.322735 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2448/5025] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:32 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:33.590707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:33.601908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:33.620094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:33.620876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:33.623346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:33.624946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:33.629310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:33.630355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.072846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:34.079465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:34.082499 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b6e7651-7e17-4846-a4cc-6c82537f58ec tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1701 microversion: 2.1 time: 0.505456 Oct 12 22:59:34.096388 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2578/5026] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:33 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1701 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:34.106874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a4704f31-315b-40d9-a7c6-e20d8cbe12b5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:34.109454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:34.118370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4704f31-315b-40d9-a7c6-e20d8cbe12b5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.119112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4704f31-315b-40d9-a7c6-e20d8cbe12b5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.119700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4704f31-315b-40d9-a7c6-e20d8cbe12b5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.161873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a4704f31-315b-40d9-a7c6-e20d8cbe12b5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Going to try to start instance {{(pid=120543) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 22:59:34.225994 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a4704f31-315b-40d9-a7c6-e20d8cbe12b5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action" status: 202 len: 0 microversion: 2.1 time: 0.123207 Oct 12 22:59:34.226115 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2449/5027] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 22:59:34 2022] POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 22:59:34.236652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:34.237284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:34.249888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.250397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.250855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.258307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.258799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:34.259401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:34.260830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.261278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.283150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.283654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.284127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.284844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.285848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.286293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.344805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:59:34.570379 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f3b99e2-a43e-4ad3-92ac-4606a06305cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 204 len: 0 microversion: 2.1 time: 0.316307 Oct 12 22:59:34.571348 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2450/5028] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:59:34 2022] DELETE /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:59:34.581384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:34.588679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:34.595113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.599011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.600169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.601114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.602214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.603345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.664737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:34.687499 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3605cf95-51e3-4a47-823c-f5572282f86e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1710 microversion: 2.1 time: 0.456862 Oct 12 22:59:34.688509 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2579/5029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:34 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1710 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:34.698901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:34.699826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:34.718222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.719025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.719656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.720646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.721293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.721900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.882155 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a049eed8-a686-48d4-9f3c-800ca9e6d30a tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1650 microversion: 2.1 time: 0.309257 Oct 12 22:59:34.900313 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2451/5030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:34 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1650 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:34.915201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:34.915831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:34.932294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.932780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.933218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:34.934140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:34.934748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:34.935331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:35.151103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:35.160514 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf31113c-5275-4549-829d-f23a6c918800 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1409 microversion: 2.1 time: 0.470072 Oct 12 22:59:35.172324 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2580/5031] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:34 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1409 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:35.448785 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-668672cf-d719-4c5d-9428-c8a7dc9ca0c4 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1650 microversion: 2.1 time: 0.544247 Oct 12 22:59:35.456031 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2452/5032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:34 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1650 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:35.479479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:35.480304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:35.490996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:35.491517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:35.501218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:35.502010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:35.502501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:35.502947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:35.714687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:35.715428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:35.731413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:35.731979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:35.732409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:35.733306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:35.733919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:35.734551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:35.969638 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-675f8ec6-60da-4603-8c6a-f8314abff717 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1650 microversion: 2.1 time: 0.493846 Oct 12 22:59:35.973106 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2581/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:35 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1650 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:35.977183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:35.989298 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-918c8c17-b300-41e1-abef-5f1936aa47bf tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1710 microversion: 2.1 time: 0.278853 Oct 12 22:59:35.990452 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2453/5034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:35 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1710 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:36.000573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:36.001303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:36.013616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:36.014713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:36.015332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:36.016247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:36.017789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:36.018562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:36.050026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:59:36.143809 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44e8a584-e1da-4ba4-aa57-c27479946f28 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 204 len: 0 microversion: 2.1 time: 0.146814 Oct 12 22:59:36.145242 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2582/5035] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:59:35 2022] DELETE /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 22:59:36.164868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:36.165514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:36.192987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:36.193713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:36.197026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:36.199194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:36.199841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:36.201477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:36.202182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:36.202411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:36.202688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:36.202864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:36.203143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:36.203863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:36.204356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:36.204799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:36.387274 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0dd2e4f7-fbfc-4130-a644-44482b3b84f7 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1656 microversion: 2.1 time: 0.235094 Oct 12 22:59:36.388507 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2454/5036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:36 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1656 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:36.535636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:36.546945 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8bb5a22d-a3b5-4214-94fc-55ed9740cf2f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1409 microversion: 2.1 time: 0.359303 Oct 12 22:59:36.548221 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2583/5037] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:36 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1409 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:37.034095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:37.035830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:37.051169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:37.051937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:37.053810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:37.055781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:37.056471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:37.057402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:37.276291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-33d08a2d-a27a-4814-b3ea-c89532c15d67 req-c36cd7e3-cdf2-4f6c-adac-86dcf26482ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577ee858-4678-4353-a3f9-753f611ca870", "name": "network-vif-deleted", "tag": "31ddb955-27a0-4ed6-85d9-97ece3f1189a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:37.326509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:37.331538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-33d08a2d-a27a-4814-b3ea-c89532c15d67 req-c36cd7e3-cdf2-4f6c-adac-86dcf26482ad service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:37.334635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-33d08a2d-a27a-4814-b3ea-c89532c15d67 req-c36cd7e3-cdf2-4f6c-adac-86dcf26482ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:37.337178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-33d08a2d-a27a-4814-b3ea-c89532c15d67 req-c36cd7e3-cdf2-4f6c-adac-86dcf26482ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:37.346018 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5ce2fb6-db61-4156-ab3b-2118664cc90a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1710 microversion: 2.1 time: 0.333733 Oct 12 22:59:37.348844 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2455/5038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:37 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1710 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:37.402874 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-33d08a2d-a27a-4814-b3ea-c89532c15d67 req-c36cd7e3-cdf2-4f6c-adac-86dcf26482ad service nova] Creating event network-vif-deleted:31ddb955-27a0-4ed6-85d9-97ece3f1189a for instance 577ee858-4678-4353-a3f9-753f611ca870 on n-h2-860864-8 Oct 12 22:59:37.416048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:37.416896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:37.417918 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-33d08a2d-a27a-4814-b3ea-c89532c15d67 req-c36cd7e3-cdf2-4f6c-adac-86dcf26482ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166764 Oct 12 22:59:37.421092 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2584/5039] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:37.428588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:37.429066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:37.429693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:37.431030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:37.432435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:37.434133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:37.573013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:37.574053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:37.585646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:37.586472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:37.589267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:37.590277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:37.593564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:37.594308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:37.744247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:37.754543 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bae2f789-f6b9-4e20-b98d-ae5331e140ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1201 microversion: 2.1 time: 0.186511 Oct 12 22:59:37.768885 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2585/5040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:37 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1201 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:38.022673 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12743cc8-ebb2-427c-b6a2-e822cb393246 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 200 len: 1656 microversion: 2.1 time: 0.610620 Oct 12 22:59:38.026866 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2456/5041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:37 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 1656 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:38.387577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:38.391338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:38.418190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:38.422125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:38.424399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:38.434104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:38.435132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:38.435869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:38.780622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:38.807019 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41e8239b-c6c8-4f9c-a509-a441e52bfca3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1714 microversion: 2.1 time: 0.428688 Oct 12 22:59:38.810274 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2586/5042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:38 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1714 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:38.832205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:38.833175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:38.862170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:38.863541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:38.868527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:38.869331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:38.873111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:38.874401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:39.082540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1038782601", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "c760fb12-bea0-4dcb-b484-8c8f6a73db90"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:39.200346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] validate_networks() for [('c760fb12-bea0-4dcb-b484-8c8f6a73db90', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 22:59:39.830313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:39.838711 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-713239be-dd8a-4583-97c1-3b46b215c7a4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1201 microversion: 2.1 time: 1.027187 Oct 12 22:59:39.854506 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2587/5043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:38 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1201 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:39.860077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-257e9ab5-f407-484f-819a-5be4b8b8157b req-e7cee114-35b9-4170-add3-09ca74c88e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b198cdb-9748-4798-a532-a40bbf5ee2f4", "name": "network-vif-deleted", "tag": "20f85973-528b-4d88-bfea-71f1d14cec10"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:39.870791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-257e9ab5-f407-484f-819a-5be4b8b8157b req-e7cee114-35b9-4170-add3-09ca74c88e65 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:39.871606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-257e9ab5-f407-484f-819a-5be4b8b8157b req-e7cee114-35b9-4170-add3-09ca74c88e65 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:39.871971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 22:59:39.872403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 22:59:39.872746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-257e9ab5-f407-484f-819a-5be4b8b8157b req-e7cee114-35b9-4170-add3-09ca74c88e65 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:39.873192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 22:59:39.873777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 22:59:39.874200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 22:59:39.901237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:39.901729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:39.902255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:39.903039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:39.903666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:39.904285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:39.939878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Getting quotas for project c6e55e5cdc6942e09726af39b10e3ccd. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:59:39.950857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Getting quotas for user 8d2de2ea1b43493a89b6c2a6707b1f6b and project c6e55e5cdc6942e09726af39b10e3ccd. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:59:39.971014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 22:59:39.974097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 22:59:40.043031 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08864597-9d7b-4c82-b4d1-6c38b08f5f00 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362353 Oct 12 22:59:40.044551 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2457/5044] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 22:59:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 22:59:40.061587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:40.062612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 2b198cdb-9748-4798-a532-a40bbf5ee2f4] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:40.074573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.075127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.075580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:40.076412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.076943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.077535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:40.102266 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] HTTP exception thrown: Instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 could not be found. Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Request method failure captured: Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 HTTP/1.1 Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0arTkXwlwaT8Q2S8rbtfUH7eIpI8l1ujJx7E1evE96kByDNG8k7721uAST_NCwaAlx2XQo1P49dNYLEZ57upaW4WJuqU6XNyEvVC-Hion7UpCdbUjunoKxx1PDb1sOUGdt_kXOKjWNa3g830BsNhlOWuh1AeLU8y0JgdeA11IaJsVI Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 4b031487b12f493ba78cc45e58cd8dbd Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestServerMultinode-1005102649 Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b031487b12f493ba78cc45e58cd8dbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b031487b12f493ba78cc45e58cd8dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b031487b12f493ba78cc45e58cd8dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b031487b12f493ba78cc45e58cd8dbd"}]}] Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestServerMultinode-1005102649 Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 4b031487b12f493ba78cc45e58cd8dbd Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestServerMultinode-1005102649 Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestServerMultinode-1005102649-project-admin Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fe2a6f543fe34285b0dbe9473451d48f Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestServerMultinode-1005102649-project-admin Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 could not be found. Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '2b198cdb-9748-4798-a532-a40bbf5ee2f4'} Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 could not be found. Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 could not be found. Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:40.105520 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:40.109562 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:40.109562 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:40.109562 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:40.109562 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:40.109562 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:40.109562 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 could not be found. Oct 12 22:59:40.109562 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:40.110924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Returning 404 to user: Instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:40.112259 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37a9f605-be09-4888-947d-6680692b21bb tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4" status: 404 len: 111 microversion: 2.1 time: 0.066297 Oct 12 22:59:40.112889 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2458/5045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:40 2022] GET /compute/v2.1/servers/2b198cdb-9748-4798-a532-a40bbf5ee2f4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:40.119719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ce9aa28-4df1-4db6-a058-12f000b0be94 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:40.121329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ce9aa28-4df1-4db6-a058-12f000b0be94 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:40.202565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ce9aa28-4df1-4db6-a058-12f000b0be94 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:40.212391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ce9aa28-4df1-4db6-a058-12f000b0be94 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1225 microversion: 2.1 time: 0.096465 Oct 12 22:59:40.226052 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2459/5046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:40 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:40.238964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:40.239563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:40.250673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.252898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.253363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:40.256914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.259142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.259593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:40.298377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:59:40.396574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-257e9ab5-f407-484f-819a-5be4b8b8157b req-e7cee114-35b9-4170-add3-09ca74c88e65 service nova] Creating event network-vif-deleted:20f85973-528b-4d88-bfea-71f1d14cec10 for instance 2b198cdb-9748-4798-a532-a40bbf5ee2f4 on n-h1-860864-8 Oct 12 22:59:40.416261 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-257e9ab5-f407-484f-819a-5be4b8b8157b req-e7cee114-35b9-4170-add3-09ca74c88e65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.559964 Oct 12 22:59:40.417934 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2588/5047] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:40.431687 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ea33cfc-5710-4044-b5cf-eee147dab4ef tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 204 len: 0 microversion: 2.1 time: 0.198948 Oct 12 22:59:40.432607 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2460/5048] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:59:40 2022] DELETE /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:59:40.441662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:40.442428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:40.451921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.452441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.452873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:40.453583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.454080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.454518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:40.627858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9bd1858f-c72b-4348-b95f-93c29a3a0d30 tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1654 microversion: 2.1 time: 0.190427 Oct 12 22:59:40.630385 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2589/5049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:40 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1654 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:40.864458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:40.865179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:40.874180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.874667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.875102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:40.884027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:40.885450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:40.886114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:41.017182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:41.028947 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b03da65-c504-487d-9766-480090752bd6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1201 microversion: 2.1 time: 0.170510 Oct 12 22:59:41.034024 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2461/5050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:40 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1201 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:41.240484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:41.241659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:41.254738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:41.255264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:41.256177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:41.256909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:41.260104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:41.260983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:41.380977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:41.388971 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8bacea1f-0586-4f14-98ac-4e73c8e5bbc8 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1277 microversion: 2.1 time: 0.154125 Oct 12 22:59:41.404911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2590/5051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:41 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:41.655138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:41.656346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:41.672180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:41.673852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:41.674863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:41.676186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:41.676914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:41.677558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:41.723646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:41.975879 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9142d67e-ac01-4730-876d-41c20cd3c91c tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1654 microversion: 2.1 time: 0.325737 Oct 12 22:59:41.989805 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2462/5052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:41 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1654 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:42.058344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:42.059253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:42.073106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:42.075332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:42.078124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:42.079291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:42.080252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:42.082564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:42.233944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:42.245186 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0a64a48-0282-4482-8b5d-93db8a479e72 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1201 microversion: 2.1 time: 0.191412 Oct 12 22:59:42.251393 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2591/5053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:42 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1201 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:42.418717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:42.420212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:42.439316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:42.443470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:42.443470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:42.443470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:42.443470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:42.451106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:42.582296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:42.607768 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f2b5a97-972c-4fb7-b022-5566964095d5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1283 microversion: 2.1 time: 0.194864 Oct 12 22:59:42.610333 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2463/5054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:42 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1283 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:43.006128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:43.007135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:43.019179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:43.020199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:43.023336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:43.024648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:43.027297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:43.030099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:43.079122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-01257155-4a73-4a0d-8657-83ec831cb9ad req-d2b12f73-41d9-446c-8bec-072544a69291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6def7879-c384-49d4-8c02-fe027394e472", "name": "network-vif-deleted", "tag": "284ba03e-7dd3-4b6c-8129-2e2625496739"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:43.116921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-01257155-4a73-4a0d-8657-83ec831cb9ad req-d2b12f73-41d9-446c-8bec-072544a69291 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:43.117504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-01257155-4a73-4a0d-8657-83ec831cb9ad req-d2b12f73-41d9-446c-8bec-072544a69291 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:43.119158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-01257155-4a73-4a0d-8657-83ec831cb9ad req-d2b12f73-41d9-446c-8bec-072544a69291 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:43.198129 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-01257155-4a73-4a0d-8657-83ec831cb9ad req-d2b12f73-41d9-446c-8bec-072544a69291 service nova] Creating event network-vif-deleted:284ba03e-7dd3-4b6c-8129-2e2625496739 for instance 6def7879-c384-49d4-8c02-fe027394e472 on n-h2-860864-8 Oct 12 22:59:43.220337 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-01257155-4a73-4a0d-8657-83ec831cb9ad req-d2b12f73-41d9-446c-8bec-072544a69291 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143554 Oct 12 22:59:43.220990 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2464/5055] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:43.235408 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c398ffd-f470-4254-8569-8f306841df6d tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 200 len: 1612 microversion: 2.1 time: 0.233822 Oct 12 22:59:43.252351 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2592/5056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:43 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 1612 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:43.273983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:43.274627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:43.293792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:43.306149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:43.316221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:43.318369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:43.320815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:43.321434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:43.478508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:43.494772 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05e44ee3-761a-4166-a32b-a2518a0f8b4e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1201 microversion: 2.1 time: 0.224772 Oct 12 22:59:43.495695 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2465/5057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:43 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1201 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:43.635881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:43.636531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:43.646924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:43.651216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:43.651992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:43.652920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:43.654661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:43.656308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:43.971813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:43.982674 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-842afdbc-12e0-4def-87e4-e499bb42a3b5 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1325 microversion: 2.1 time: 0.350074 Oct 12 22:59:43.987534 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2593/5058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:43 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:44.281458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:44.282716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] [instance: 6def7879-c384-49d4-8c02-fe027394e472] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:44.295270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:44.295780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:44.296250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:44.296966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:44.297443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:44.297871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:44.315036 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] HTTP exception thrown: Instance 6def7879-c384-49d4-8c02-fe027394e472 could not be found. Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Request method failure captured: Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 HTTP/1.1 Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0arTkXwlwaT8Q2S8rbtfUH7eIpI8l1ujJx7E1evE96kByDNG8k7721uAST_NCwaAlx2XQo1P49dNYLEZ57upaW4WJuqU6XNyEvVC-Hion7UpCdbUjunoKxx1PDb1sOUGdt_kXOKjWNa3g830BsNhlOWuh1AeLU8y0JgdeA11IaJsVI Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 4b031487b12f493ba78cc45e58cd8dbd Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestServerMultinode-1005102649 Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b031487b12f493ba78cc45e58cd8dbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b031487b12f493ba78cc45e58cd8dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b031487b12f493ba78cc45e58cd8dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b031487b12f493ba78cc45e58cd8dbd"}]}] Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestServerMultinode-1005102649 Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 4b031487b12f493ba78cc45e58cd8dbd Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestServerMultinode-1005102649 Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestServerMultinode-1005102649-project-admin Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: fe2a6f543fe34285b0dbe9473451d48f Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestServerMultinode-1005102649-project-admin Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 6def7879-c384-49d4-8c02-fe027394e472 could not be found. Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '6def7879-c384-49d4-8c02-fe027394e472'} Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6def7879-c384-49d4-8c02-fe027394e472 could not be found. Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6def7879-c384-49d4-8c02-fe027394e472 could not be found. Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:44.317486 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6def7879-c384-49d4-8c02-fe027394e472 could not be found. Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] Returning 404 to user: Instance 6def7879-c384-49d4-8c02-fe027394e472 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bff4a2d2-dca2-4342-b1a9-ddff754ba69e tempest-TestServerMultinode-1005102649 tempest-TestServerMultinode-1005102649-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472" status: 404 len: 111 microversion: 2.1 time: 0.046747 Oct 12 22:59:44.321357 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2466/5059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:44 2022] GET /compute/v2.1/servers/6def7879-c384-49d4-8c02-fe027394e472 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:44.481325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5e7c6e0e-572b-43d5-924a-be9506b917fb req-49213f4c-9700-4044-b9dd-52a427d84738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0677fba5-e3a1-4ab0-bdfa-baaac0311b50", "tag": "272a20e4-86cf-43fd-8362-a7ed70c179c7"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:44.511738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5e7c6e0e-572b-43d5-924a-be9506b917fb req-49213f4c-9700-4044-b9dd-52a427d84738 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:44.512277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5e7c6e0e-572b-43d5-924a-be9506b917fb req-49213f4c-9700-4044-b9dd-52a427d84738 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:44.512890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5e7c6e0e-572b-43d5-924a-be9506b917fb req-49213f4c-9700-4044-b9dd-52a427d84738 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:44.518442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:44.519483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:44.531066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:44.533639 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5e7c6e0e-572b-43d5-924a-be9506b917fb req-49213f4c-9700-4044-b9dd-52a427d84738 service nova] Creating event network-changed:272a20e4-86cf-43fd-8362-a7ed70c179c7 for instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 on n-h1-860864-8 Oct 12 22:59:44.543575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:44.544178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:44.546872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:44.547643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:44.547769 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5e7c6e0e-572b-43d5-924a-be9506b917fb req-49213f4c-9700-4044-b9dd-52a427d84738 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070086 Oct 12 22:59:44.548485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:44.553997 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2594/5060] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:44.679864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:44.690968 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f557252e-29cb-4718-982a-d6d1608a9ad4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 200 len: 1201 microversion: 2.1 time: 0.176634 Oct 12 22:59:44.693115 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2467/5061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:44 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 1201 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:45.007622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:45.008714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:45.020865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:45.021715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:45.024053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:45.026961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:45.028072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:45.031083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:45.311049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:45.316454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:45.324515 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-062fa2fe-bdaa-44a6-bb4d-0d67710e784f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1325 microversion: 2.1 time: 0.319524 Oct 12 22:59:45.325437 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2595/5062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:45 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1325 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:45.726288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:45.727172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:45.739209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:45.742595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:45.743320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:45.744309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:45.744989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:45.745630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:45.766123 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 HTTP/1.1 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '577ee858-4678-4353-a3f9-753f611ca870'} Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:45.768423 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:45.772166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:45.772166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:45.772166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:45.772166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:45.772166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:45.772166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:45.772166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:45.774079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:45.775188 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-43f83471-7a16-4810-8862-866b06b956e7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 404 len: 111 microversion: 2.1 time: 0.063485 Oct 12 22:59:45.776476 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2468/5063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:45 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:46.353273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:46.353813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:46.370170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:46.371001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:46.371688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:46.372634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:46.376750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:46.377782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:46.785520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:46.793662 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7078fb93-f028-4f61-88c7-d10b05766882 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1325 microversion: 2.1 time: 0.444521 Oct 12 22:59:46.808750 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2596/5064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:46 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:47.332264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:47.333462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:47.342362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:47.343214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:47.343910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:47.344843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:47.345639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:47.346265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:47.383255 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d410f434-375f-4583-b499-a7dd4e9ba86b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/ips" status: 200 len: 151 microversion: 2.20 time: 0.055719 Oct 12 22:59:47.384246 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2469/5065] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Oct 12 22:59:47 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 22:59:47.819742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:47.820612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:47.849296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:47.849962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:47.853894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:47.853894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:47.853894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:47.856356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:48.536548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:48.550883 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2359a560-b212-4faa-b4e2-efc9641af4e9 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1325 microversion: 2.1 time: 0.738729 Oct 12 22:59:48.553793 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2597/5066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:47 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1325 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:49.189990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:49.190566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:49.209492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:49.210004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:49.210449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:49.211171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:49.211624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:49.212084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:49.274736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 HTTP/1.1 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '3bd372e0-16ac-4525-b874-2a450fd05c53'} Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:49.276259 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:49.280194 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d78fb51-68af-4964-8a3b-c4d75a48c868 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 404 len: 111 microversion: 2.1 time: 0.091800 Oct 12 22:59:49.287124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:49.287752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 3bd372e0-16ac-4525-b874-2a450fd05c53] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:49.296612 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2470/5067] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:59:49 2022] DELETE /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:49.298169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:49.298675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:49.299126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:49.300425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:49.300886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:49.301356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:49.327884 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 HTTP/1.1 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3bd372e0-16ac-4525-b874-2a450fd05c53'} Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:49.329598 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 3bd372e0-16ac-4525-b874-2a450fd05c53 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b6951fc-802b-4a46-ba9e-72ffac2f268d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53" status: 404 len: 111 microversion: 2.1 time: 0.048544 Oct 12 22:59:49.333755 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2598/5068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:49 2022] GET /compute/v2.1/servers/3bd372e0-16ac-4525-b874-2a450fd05c53 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 22:59:49.589046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:49.589665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:49.606555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:49.614546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:49.616507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:49.620512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:49.625620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:49.626479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:49.843178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-97a6de51-7d45-474b-bf08-3c26c653d442 req-66d92606-4b1e-448d-af53-824c6765e9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0677fba5-e3a1-4ab0-bdfa-baaac0311b50", "name": "network-vif-plugged", "status": "completed", "tag": "272a20e4-86cf-43fd-8362-a7ed70c179c7"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:49.871570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-97a6de51-7d45-474b-bf08-3c26c653d442 req-66d92606-4b1e-448d-af53-824c6765e9a0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:49.872107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-97a6de51-7d45-474b-bf08-3c26c653d442 req-66d92606-4b1e-448d-af53-824c6765e9a0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:49.872737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-97a6de51-7d45-474b-bf08-3c26c653d442 req-66d92606-4b1e-448d-af53-824c6765e9a0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:49.914021 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-97a6de51-7d45-474b-bf08-3c26c653d442 req-66d92606-4b1e-448d-af53-824c6765e9a0 service nova] Creating event network-vif-plugged:272a20e4-86cf-43fd-8362-a7ed70c179c7 for instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 on n-h1-860864-8 Oct 12 22:59:49.923230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:49.926392 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-97a6de51-7d45-474b-bf08-3c26c653d442 req-66d92606-4b1e-448d-af53-824c6765e9a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093844 Oct 12 22:59:49.932556 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2599/5069] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 22:59:49.950490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:49.961529 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c09759fb-ca39-4216-bac0-e8ccebe0163f tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1325 microversion: 2.1 time: 0.386155 Oct 12 22:59:49.972157 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2471/5070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:49 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:50.458520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:50.459134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:50.466448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:50.467006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:50.467733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:50.468657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:50.469420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:50.473770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:50.489665 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 HTTP/1.1 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '577ee858-4678-4353-a3f9-753f611ca870'} Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:50.491542 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0af41a6f-9c08-4e16-9a24-595b6642dd14 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 404 len: 111 microversion: 2.1 time: 0.041374 Oct 12 22:59:50.495621 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2600/5071] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:59:50 2022] DELETE /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:50.502382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:50.503517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 577ee858-4678-4353-a3f9-753f611ca870] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:50.506434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:50.512278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:50.512773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:50.513210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:50.514320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:50.514994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:50.515594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:50.530683 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 HTTP/1.1 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '577ee858-4678-4353-a3f9-753f611ca870'} Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:50.532463 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 577ee858-4678-4353-a3f9-753f611ca870 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-06b2a6f9-097d-4a71-b143-ee4ff1999605 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870" status: 404 len: 111 microversion: 2.1 time: 0.035438 Oct 12 22:59:50.536920 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2472/5072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:50 2022] GET /compute/v2.1/servers/577ee858-4678-4353-a3f9-753f611ca870 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:50.614511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ef87b27-08f4-4263-b6d9-d9b5f2526b03 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: .version_select at 0x7f44fc3d4f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1695750862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Mr83Ys4DvjDWIdAlUBFj9ZyV1v0szlVRDXIgil8qwMydCYqkzrJmQKr3aoaOHUxJeN/PTyCoSX7SqpO1+eXcSxsCyH0xax1hAwljVOmJWtmuMOqTTYgdy8RZw+a2/sQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:50.631923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7ef87b27-08f4-4263-b6d9-d9b5f2526b03 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 22:59:50.638189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7ef87b27-08f4-4263-b6d9-d9b5f2526b03 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 22:59:50.691449 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ef87b27-08f4-4263-b6d9-d9b5f2526b03 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.081481 Oct 12 22:59:50.692104 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2601/5073] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 22:59:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 22:59:50.870087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:50.871399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:50.884059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:50.884449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:50.886172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:50.887871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:50.893068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:50.894442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:50.947058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lazy-loading 'flavor' on Instance uuid 69b3e3aa-ae92-4854-981d-68a9796316f5 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:59:50.993373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:50.994989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:51.006128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:51.007519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:51.008364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:51.009334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:51.010122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:51.011600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:51.210277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:51.223291 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-507ac15d-b499-4adb-887f-994887e97486 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1325 microversion: 2.1 time: 0.238594 Oct 12 22:59:51.227418 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2602/5074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:50 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:51.246873 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21a4e328-87ef-4301-a7b4-81dfb1ef7c76 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/action" status: 202 len: 0 microversion: 2.20 time: 0.381346 Oct 12 22:59:51.247615 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2473/5075] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 22:59:50 2022] POST /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:59:51.262864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:51.263514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:51.272903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:51.273642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:51.274373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:51.275259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:51.275933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:51.276690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:51.540420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:51.554433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:51.556267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:51.557502 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb8b5940-4bc7-43ab-8228-bd7ded801ea2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.302767 Oct 12 22:59:51.561631 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2603/5076] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:51 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:52.251668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:52.252458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:52.262358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.262841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.270844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.272688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.274419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.274890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.599706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:52.609530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:52.610149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:52.631093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.632118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.632881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.633859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.634556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.635260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.635384 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cac3129c-bbf8-4be7-97dc-933f1a80e531 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1522 microversion: 2.1 time: 0.388899 Oct 12 22:59:52.662405 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2474/5077] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:52 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:52.668477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:52.669376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:52.676534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.677412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.678064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.680629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.681412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.682847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.741802 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] HTTP exception thrown: Action 999 not found Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Request method failure captured: Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50/os-instance-actions/999 HTTP/1.1 Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ba_Xy9tItoRPNg3nnPjIjgpO8B0pZMcdGmGaIqcME0paRFByR1upwlaSESi08KlXzwwNAx4VARc4dm_Y8WSz9y32ljrCCEMQkGHzz0YumLYgLh0gE4YLabPT0nN2wWeBS0X4x4l4i4bt0KGXRDqTVtPhUVxl_p9KYLVCNhW0AD01w Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c6e55e5cdc6942e09726af39b10e3ccd Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6e55e5cdc6942e09726af39b10e3ccd"}]}] Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c6e55e5cdc6942e09726af39b10e3ccd Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-InstanceActionsNegativeTestJSON-861248461-project Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 8d2de2ea1b43493a89b6c2a6707b1f6b Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-861248461-project Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: exception: Action 999 not found Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '0677fba5-e3a1-4ab0-bdfa-baaac0311b50', 'id': '999'} Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 12 22:59:52.762563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.767348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Returning 404 to user: Action 999 not found {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:52.767348 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-574b912b-16f4-4a67-8270-675e063a09fa tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.100431 Oct 12 22:59:52.767348 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2475/5078] 10.222.0.20 () {58 vars in 1308 bytes} [Wed Oct 12 22:59:52 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50/os-instance-actions/999 => generated 66 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 22:59:52.778075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7099d4e1-b6c2-4ca4-8d9c-f77b299e0067 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '.version_select at 0x7f44ff496280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:52.779174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7099d4e1-b6c2-4ca4-8d9c-f77b299e0067 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 09bb1b2f-9c50-4cfb-87b1-ff217d6488a3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:52.788610 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-7099d4e1-b6c2-4ca4-8d9c-f77b299e0067 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] HTTP exception thrown: Instance 09bb1b2f-9c50-4cfb-87b1-ff217d6488a3 could not be found. Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7099d4e1-b6c2-4ca4-8d9c-f77b299e0067 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Request method failure captured: Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/09bb1b2f-9c50-4cfb-87b1-ff217d6488a3/os-instance-actions HTTP/1.1 Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ba_Xy9tItoRPNg3nnPjIjgpO8B0pZMcdGmGaIqcME0paRFByR1upwlaSESi08KlXzwwNAx4VARc4dm_Y8WSz9y32ljrCCEMQkGHzz0YumLYgLh0gE4YLabPT0nN2wWeBS0X4x4l4i4bt0KGXRDqTVtPhUVxl_p9KYLVCNhW0AD01w Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c6e55e5cdc6942e09726af39b10e3ccd Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6e55e5cdc6942e09726af39b10e3ccd"}]}] Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c6e55e5cdc6942e09726af39b10e3ccd Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-InstanceActionsNegativeTestJSON-861248461-project Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 8d2de2ea1b43493a89b6c2a6707b1f6b Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-861248461-project Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 09bb1b2f-9c50-4cfb-87b1-ff217d6488a3 could not be found. Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '09bb1b2f-9c50-4cfb-87b1-ff217d6488a3'} Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09bb1b2f-9c50-4cfb-87b1-ff217d6488a3 could not be found. Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:52.791801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09bb1b2f-9c50-4cfb-87b1-ff217d6488a3 could not be found. Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09bb1b2f-9c50-4cfb-87b1-ff217d6488a3 could not be found. Oct 12 22:59:52.800701 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:52.802519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7099d4e1-b6c2-4ca4-8d9c-f77b299e0067 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Returning 404 to user: Instance 09bb1b2f-9c50-4cfb-87b1-ff217d6488a3 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:52.802519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7099d4e1-b6c2-4ca4-8d9c-f77b299e0067 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/09bb1b2f-9c50-4cfb-87b1-ff217d6488a3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.029841 Oct 12 22:59:52.804336 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2476/5079] 10.222.0.20 () {58 vars in 1296 bytes} [Wed Oct 12 22:59:52 2022] GET /compute/v2.1/servers/09bb1b2f-9c50-4cfb-87b1-ff217d6488a3/os-instance-actions => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:52.812548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:52.813417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:52.821627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.822465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.823158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.824155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:52.824835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:52.825545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:52.856135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 22:59:53.020076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b75e987-1191-4677-b918-b491fe9e4016 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 204 len: 0 microversion: 2.1 time: 0.208619 Oct 12 22:59:53.025280 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2477/5080] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 22:59:52 2022] DELETE /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 22:59:53.035094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:53.040226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:53.043298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:53.058624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:53.059721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:53.060101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:53.060821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:53.061222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:53.062428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc7cd164-9bd8-477f-9667-8d81dfd9c276 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.476204 Oct 12 22:59:53.063600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:53.064436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:53.066003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:53.081355 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2604/5081] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:52 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:53.358062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:53.371548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e168d073-e696-496a-ae2c-453fa9283217 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1528 microversion: 2.1 time: 0.342561 Oct 12 22:59:53.373277 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2478/5082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:53 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1528 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:54.089269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:54.089901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:54.098601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:54.099484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:54.100231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:54.101313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:54.102029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:54.102684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:54.374307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:54.398740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:54.400990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:54.402120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:54.405368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:54.413696 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1f5b55b-6b7b-4d03-bfa9-3a448d22ca70 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.321839 Oct 12 22:59:54.421536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:54.422257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:54.423176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:54.424078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:54.425245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:54.425816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:54.433595 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2605/5083] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:54 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:54.707378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:54.715911 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57ae8381-2795-41fa-af02-3de3affc1550 tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1528 microversion: 2.1 time: 0.319387 Oct 12 22:59:54.718870 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2479/5084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:54 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1528 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:55.448266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:55.448895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:55.468750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:55.469255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:55.469701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:55.472550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e19396d9-0551-4d6e-9e97-43f3339606d0 req-72ea270d-f01d-4fc8-ab10-af481b7e21f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0677fba5-e3a1-4ab0-bdfa-baaac0311b50", "name": "network-vif-deleted", "tag": "272a20e4-86cf-43fd-8362-a7ed70c179c7"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 22:59:55.474627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:55.475425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:55.476912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:55.491924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e19396d9-0551-4d6e-9e97-43f3339606d0 req-72ea270d-f01d-4fc8-ab10-af481b7e21f7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:55.492647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e19396d9-0551-4d6e-9e97-43f3339606d0 req-72ea270d-f01d-4fc8-ab10-af481b7e21f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:55.496049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e19396d9-0551-4d6e-9e97-43f3339606d0 req-72ea270d-f01d-4fc8-ab10-af481b7e21f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:55.514949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:55.518998 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e19396d9-0551-4d6e-9e97-43f3339606d0 req-72ea270d-f01d-4fc8-ab10-af481b7e21f7 service nova] Creating event network-vif-deleted:272a20e4-86cf-43fd-8362-a7ed70c179c7 for instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 on n-h1-860864-8 Oct 12 22:59:55.544648 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e19396d9-0551-4d6e-9e97-43f3339606d0 req-72ea270d-f01d-4fc8-ab10-af481b7e21f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065703 Oct 12 22:59:55.545827 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2480/5085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 22:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 22:59:55.746108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:55.747149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:55.796599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:55.798538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:55.800299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:55.801581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:55.806931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:55.808817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:55.912736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:55.928278 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a13eafc-f40b-43d0-b916-a9f5e05d6cda tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1310 microversion: 2.1 time: 0.186655 Oct 12 22:59:55.929097 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2481/5086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:55 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1310 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 22:59:55.958385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:55.968510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:55.970314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:55.973216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4cfb6f59-799c-4276-9ef9-d9efed049ff6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.529441 Oct 12 22:59:55.974622 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2606/5087] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:55 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:56.957272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:56.957896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:56.962707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 22:59:56.975754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:56.976496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:56.977159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:56.979406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:56.981334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:56.984796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:57.004418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:57.005780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:57.027941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:57.028713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:57.031161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:57.035520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:57.036256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:57.038203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:57.099181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:57.099677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:57.100165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:57.100624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lazy-loading 'fault' on Instance uuid 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 22:59:57.250250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d2de2ea1b43493a89b6c2a6707b1f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e55e5cdc6942e09726af39b10e3ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:57.276241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34ba0f72-ffa6-4779-91f2-41dbd8de8aea tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 200 len: 1315 microversion: 2.1 time: 0.323206 Oct 12 22:59:57.277609 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2482/5088] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:56 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 22:59:57.488866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:57.498161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:57.511787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:57.513296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-282bfb8c-8811-47c3-b8cd-e8ca129f2d18 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.516061 Oct 12 22:59:57.513915 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2607/5089] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:56 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 22:59:58.310568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:58.311185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] [instance: 0677fba5-e3a1-4ab0-bdfa-baaac0311b50] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:58.319872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:58.320462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:58.320899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:58.321662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:58.322031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:58.322775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:58.339810 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] HTTP exception thrown: Instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 could not be found. Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Request method failure captured: Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 HTTP/1.1 Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ba_Xy9tItoRPNg3nnPjIjgpO8B0pZMcdGmGaIqcME0paRFByR1upwlaSESi08KlXzwwNAx4VARc4dm_Y8WSz9y32ljrCCEMQkGHzz0YumLYgLh0gE4YLabPT0nN2wWeBS0X4x4l4i4bt0KGXRDqTVtPhUVxl_p9KYLVCNhW0AD01w Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: c6e55e5cdc6942e09726af39b10e3ccd Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6e55e5cdc6942e09726af39b10e3ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6e55e5cdc6942e09726af39b10e3ccd"}]}] Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: c6e55e5cdc6942e09726af39b10e3ccd Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-861248461 Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-InstanceActionsNegativeTestJSON-861248461-project Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 8d2de2ea1b43493a89b6c2a6707b1f6b Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-861248461-project Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 could not be found. Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '0677fba5-e3a1-4ab0-bdfa-baaac0311b50'} Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 could not be found. Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 could not be found. Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:58.341566 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 could not be found. Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] Returning 404 to user: Instance 0677fba5-e3a1-4ab0-bdfa-baaac0311b50 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 22:59:58.346932 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca0ad5cc-b095-4592-8634-958dc413b68a tempest-InstanceActionsNegativeTestJSON-861248461 tempest-InstanceActionsNegativeTestJSON-861248461-project] 10.222.0.20 "GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50" status: 404 len: 111 microversion: 2.1 time: 0.036839 Oct 12 22:59:58.347735 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2483/5090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 22:59:58 2022] GET /compute/v2.1/servers/0677fba5-e3a1-4ab0-bdfa-baaac0311b50 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 22:59:58.543389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:58.552999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:58.562691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:58.563339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:58.563802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:58.564595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:58.565883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:58.566589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:58.804571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:58.816103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:58.818227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 22:59:58.820291 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93ad9023-4c36-4cf8-8d85-344b6a94e231 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.280895 Oct 12 22:59:58.821619 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2608/5091] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:58 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 22:59:59.846646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 22:59:59.847255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 22:59:59.857263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:59.857761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:59.860038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 22:59:59.860773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 22:59:59.861229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 22:59:59.861725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:00.183462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:00.195929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:00.197390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:00.204677 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98754444-8230-4e90-94bc-a7d83f2db327 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.361759 Oct 12 23:00:00.207624 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2484/5092] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 22:59:59 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:01.231010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:01.231646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:01.242485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:01.244149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:01.244580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:01.247088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:01.249571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:01.252247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:01.254901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:01.571068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:01.598502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:01.605794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:01.612781 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b08ab93-5883-4e01-bbec-b98991a11c0e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.385457 Oct 12 23:00:01.616930 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2609/5093] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:01 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:02.645443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:02.647036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:02.661141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:02.661562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:02.661999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:02.663528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:02.664018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:02.665544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:02.956929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:02.971660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:02.974613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:02.983622 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c52da73b-bf80-46fb-9ad9-5e6b1c9335ba tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.341565 Oct 12 23:00:02.984518 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2485/5094] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:02 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:04.012514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:04.013318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:04.016192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:04.039373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:04.043029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:04.043647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:04.044511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:04.045006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:04.048425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:04.493584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:04.512704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:04.515451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:04.533042 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd84bf98-1caa-496d-aae9-0f98c98c6f5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.508542 Oct 12 23:00:04.547925 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2610/5095] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:04 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:04.717736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:04.718644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:04.732428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:04.734269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:04.739202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:04.740388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:04.742717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:04.744295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.110952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:05.120906 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7ba63c93-ef64-48f3-8fc2-132a2ee7d6be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.408763 Oct 12 23:00:05.122348 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2486/5096] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:04 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:05.153926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:05.157597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:05.172419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.179090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.179556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.185881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.186595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.187207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.539176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:05.551341 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5196ba8f-f177-4d6b-8da8-ff9c7508ad46 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.401700 Oct 12 23:00:05.553410 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2611/5097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:05 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:05.562256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:05.562874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:05.572520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.577954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:05.581703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.583665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.584687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.585035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:05.587397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.588401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.604031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.604503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.605032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.605692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.616632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.617172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.881075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:05.890675 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5fff3b04-73b6-45a2-8fde-646e37ba6eb9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.316202 Oct 12 23:00:05.905007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:05.905908 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2612/5098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:05 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:05.915877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:05.917852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:05.919147 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7ac33e5f-91cf-4ff4-9573-714f6c767009 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.361292 Oct 12 23:00:05.919792 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2487/5099] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:05 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:05.921802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:05.922066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:05.931734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.932267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.932918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:05.934077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:05.934709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:05.935311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:06.103191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:06.114636 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ec45008-807e-4542-a1a3-8cee182ce1f0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.203017 Oct 12 23:00:06.116292 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2613/5100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:05 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:06.307371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1347583745", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "41c00e0a-6171-41b3-913b-03da316da8e7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:06.393271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] validate_networks() for [('41c00e0a-6171-41b3-913b-03da316da8e7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:00:06.946025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:06.946580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:06.962696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:06.963215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:06.963680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:06.964451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:06.965026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:06.965353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:06.966824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:00:06.967239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:00:06.967688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:00:06.968124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:00:06.968523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:00:06.995674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:06.997602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:06.998223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:06.999722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:07.001810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:07.002901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:07.032474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:00:07.043451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for user b103c953780a4dce8d8872ee8b47d186 and project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:00:07.065610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:00:07.068364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:00:07.134412 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ed85a278-3737-41c7-81e5-5ce2a4f6f392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831118 Oct 12 23:00:07.151223 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2488/5101] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:00:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:00:07.156642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f11cc04-6a6c-4de3-9bb0-8fc9d61a9da3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:07.160415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f11cc04-6a6c-4de3-9bb0-8fc9d61a9da3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:07.333665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:07.350346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:07.354440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:07.357839 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d6feb706-9b3c-4867-8ac8-9fb40cb1eee8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1744 microversion: 2.20 time: 0.415845 Oct 12 23:00:07.368215 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2614/5102] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:06 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1744 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:07.430285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f11cc04-6a6c-4de3-9bb0-8fc9d61a9da3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:07.440636 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f11cc04-6a6c-4de3-9bb0-8fc9d61a9da3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1215 microversion: 2.1 time: 0.287971 Oct 12 23:00:07.441219 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2489/5103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:07 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:08.387211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:08.387844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:08.401297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:08.402356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:08.404700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:08.406593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:08.407377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:08.409252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:08.447241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:08.468224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:08.471489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:08.487709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:08.488439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:08.495835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:08.497808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:08.499310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:08.500300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:08.646272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:08.656531 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8cfc45d5-a85c-4f9b-9b9c-06c563e9a3af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1267 microversion: 2.1 time: 0.192421 Oct 12 23:00:08.657581 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2490/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:08 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:08.754123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:08.774989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:08.777604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:08.779982 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-16f0562d-4d35-438d-a84c-40a7ab345dd5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1744 microversion: 2.20 time: 0.397244 Oct 12 23:00:08.780927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2615/5105] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:08 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1744 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:09.691775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:09.694052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:09.707094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:09.708087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:09.708712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:09.709593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:09.710227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:09.710928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:09.812037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:09.813456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:09.828859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:09.833064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:09.835314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:09.837268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:09.849451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:09.851006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:09.873253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:09.939706 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4581db87-ebb6-40e3-bd54-d1f2202ac9b1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1273 microversion: 2.1 time: 0.237810 Oct 12 23:00:09.942770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2491/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:09 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:10.599740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:10.620275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:10.622460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:10.623932 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10255eb2-3721-48e4-a70f-d18826879aed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.819035 Oct 12 23:00:10.628644 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2616/5107] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:09 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:10.968864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:10.970430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:10.993625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:10.994454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:10.995080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:10.997581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:10.998281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:11.000942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:11.391524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:11.404534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6693e2f4-6208-4f83-9dde-542efb058b0a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 0.437495 Oct 12 23:00:11.407254 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2492/5108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:10 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:11.617617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:11.618160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:11.655968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:11.656599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:11.657117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:11.657627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:11.658615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:11.659333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:11.659794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:11.663859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:11.680501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:11.680692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:11.681042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:11.681805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:11.682279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:11.694905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:11.922395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lazy-loading 'services' on Instance uuid 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:00:12.022157 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ec1c045-5751-4c3f-b739-b4d02134da21 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-volume_attachments/039a7956-3ecd-413c-b3a8-690818c92ee8" status: 202 len: 0 microversion: 2.1 time: 0.411197 Oct 12 23:00:12.026779 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2617/5109] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:00:11 2022] DELETE /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-volume_attachments/039a7956-3ecd-413c-b3a8-690818c92ee8 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:00:12.436455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:12.438133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:12.466289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:12.478518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:12.479050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:12.487140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:12.488324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:12.494204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:12.913689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:12.924551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:12.934928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:12.936348 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f1fc1095-26ed-48ce-a321-5379b9382ae6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 1.285767 Oct 12 23:00:12.951348 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2493/5110] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:11 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:00:13.928926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:13.942087 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3db79efa-9759-4bcb-b2ca-244f6576a993 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 1.511514 Oct 12 23:00:13.943338 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2618/5111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:12 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:13.965897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:13.967458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:13.980263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:13.991553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:13.992417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:13.993380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:13.996192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:14.000212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:14.867550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:14.876354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:14.881131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:14.886649 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2303b852-154b-4f84-be91-b907adef0959 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.927852 Oct 12 23:00:14.890177 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2494/5112] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:13 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:14.971196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:14.972599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:14.992605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:14.993425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:14.998595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:14.999803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:15.003115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:15.008488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:15.924973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:15.927671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:15.952918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:15.956308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:15.959780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:15.963006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:15.963701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:15.967088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:16.242293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:16.253512 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bcba187c-3e81-4665-914f-fff332b32922 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 1.287226 Oct 12 23:00:16.260097 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2619/5113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:14 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:16.301421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-97be3537-0873-4a00-a4a9-c647fc4089d1 req-4f844dc4-738f-4351-9c4e-630be346a272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "name": "network-vif-plugged", "status": "completed", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:16.326098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-97be3537-0873-4a00-a4a9-c647fc4089d1 req-4f844dc4-738f-4351-9c4e-630be346a272 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:16.330636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-97be3537-0873-4a00-a4a9-c647fc4089d1 req-4f844dc4-738f-4351-9c4e-630be346a272 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:16.331299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-97be3537-0873-4a00-a4a9-c647fc4089d1 req-4f844dc4-738f-4351-9c4e-630be346a272 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:16.355650 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-97be3537-0873-4a00-a4a9-c647fc4089d1 req-4f844dc4-738f-4351-9c4e-630be346a272 service nova] Creating event network-vif-plugged:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h2-860864-8 Oct 12 23:00:16.377804 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-97be3537-0873-4a00-a4a9-c647fc4089d1 req-4f844dc4-738f-4351-9c4e-630be346a272 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103180 Oct 12 23:00:16.378853 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2620/5114] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:17.013935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:17.254546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:17.277221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:17.278780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:17.280051 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b505c2f2-fe3a-4849-9be5-8b9d9c780f19 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 1.364308 Oct 12 23:00:17.288782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:17.290835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:17.309181 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2495/5115] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:15 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:17.325518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:17.326272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:17.347268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-47ae5e0a-cae3-4d79-9d04-24b013aecc9a req-afad3992-5c76-4dc4-9163-5ac6ff88aaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5d6453-fd32-4604-8b08-a6297fff60cb", "tag": "6172a951-5664-4f54-a355-802020424486"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:17.349457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:17.360060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:17.360569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:17.369536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:17.413039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-47ae5e0a-cae3-4d79-9d04-24b013aecc9a req-afad3992-5c76-4dc4-9163-5ac6ff88aaf2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:17.413837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-47ae5e0a-cae3-4d79-9d04-24b013aecc9a req-afad3992-5c76-4dc4-9163-5ac6ff88aaf2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:17.416881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-47ae5e0a-cae3-4d79-9d04-24b013aecc9a req-afad3992-5c76-4dc4-9163-5ac6ff88aaf2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:17.457425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:17.505945 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-47ae5e0a-cae3-4d79-9d04-24b013aecc9a req-afad3992-5c76-4dc4-9163-5ac6ff88aaf2 service nova] Creating event network-changed:6172a951-5664-4f54-a355-802020424486 for instance ba5d6453-fd32-4604-8b08-a6297fff60cb on n-h2-860864-8 Oct 12 23:00:17.563747 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-47ae5e0a-cae3-4d79-9d04-24b013aecc9a req-afad3992-5c76-4dc4-9163-5ac6ff88aaf2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239704 Oct 12 23:00:17.583424 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2496/5116] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:00:18.214571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:18.228877 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f3ce493b-b3cc-4990-830a-b9502e4aed1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 0.945582 Oct 12 23:00:18.243290 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2621/5117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:17 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:18.312740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:18.313454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:18.336622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:18.337016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:18.340360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:18.344237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:18.344737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:18.351245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:18.718206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:18.731484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:18.733063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:18.734286 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d93b6e7e-92f3-4a46-a2d1-cba613cbfb8a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.428296 Oct 12 23:00:18.737027 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2497/5118] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:18 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:19.255725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:19.256996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:19.267656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:19.272643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:19.273324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:19.274268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:19.276296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:19.277018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:19.770428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:19.770428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:19.787391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:19.788215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:19.789306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:19.792808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:19.793722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:19.795034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:20.112396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:20.126750 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41908716-4492-4985-9050-cee210cc4bd7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 0.870908 Oct 12 23:00:20.132771 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2622/5119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:19 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:20.212791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:20.231099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:20.238413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:20.242463 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-efb85461-6043-4d11-8fb1-4395199a93c1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.481621 Oct 12 23:00:20.268074 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2498/5120] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:19 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:00:21.160063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:21.161616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:21.180783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:21.181554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:21.184275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:21.185456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:21.186660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:21.189679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:21.279582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:21.281136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:21.300186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:21.314076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:21.316986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:21.317684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:21.318157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:21.318597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:21.794745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:21.822993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:21.824593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:21.826048 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-211f885f-6d33-4c94-8ad5-19eff649c2d1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.550479 Oct 12 23:00:21.827300 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2499/5121] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:21 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:00:22.052674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:22.064911 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ccf6c630-5372-4610-a30c-2cbeb1ac9ecf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 0.907890 Oct 12 23:00:22.084182 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2623/5122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:21 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:22.859665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:22.860359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:22.881095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:22.881780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:22.882409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:22.883297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:22.883945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:22.884532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:22.947123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:23.102039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:23.103441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:23.128811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:23.137215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:23.142257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:23.143442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:23.157754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:23.158236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:23.281174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:23.304405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:23.306442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:23.320696 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8897ddbc-784c-4a07-9017-5c788f5baa3c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.463462 Oct 12 23:00:23.343561 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2500/5123] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:22 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:24.033283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:24.046311 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cca0712-9384-4158-966b-d2b8126fac54 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 0.959471 Oct 12 23:00:24.047194 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2624/5124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:23 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:24.351598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:24.357543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:24.368928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:24.369673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:24.370333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:24.371242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:24.371859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:24.372460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:24.951689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-906195446", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "b8945b13-46d6-4f18-9de9-f8b223509bc8"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:24.984925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:24.999440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:25.000965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:25.002165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae5a575c-9bda-4c45-81ca-4c1197ec0d1c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.654531 Oct 12 23:00:25.002732 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2501/5125] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:24 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:25.082417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:25.083358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:25.105201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:25.105956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:25.126305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:25.127972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:25.128620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:25.135423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:25.647533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:25.691064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8b29396-1024-49c6-8f5f-f49c4e63fa09 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 0.619562 Oct 12 23:00:25.691064 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2502/5126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:25 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:25.696437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d15e83ce-36d1-4a56-aed9-c12c6a5debf9 req-4b0bdc03-e23e-472d-a8fb-37117a3bac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5d6453-fd32-4604-8b08-a6297fff60cb", "name": "network-vif-plugged", "status": "completed", "tag": "6172a951-5664-4f54-a355-802020424486"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:25.715567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d15e83ce-36d1-4a56-aed9-c12c6a5debf9 req-4b0bdc03-e23e-472d-a8fb-37117a3bac0f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:25.716472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d15e83ce-36d1-4a56-aed9-c12c6a5debf9 req-4b0bdc03-e23e-472d-a8fb-37117a3bac0f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:25.717987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d15e83ce-36d1-4a56-aed9-c12c6a5debf9 req-4b0bdc03-e23e-472d-a8fb-37117a3bac0f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:25.772623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d15e83ce-36d1-4a56-aed9-c12c6a5debf9 req-4b0bdc03-e23e-472d-a8fb-37117a3bac0f service nova] Creating event network-vif-plugged:6172a951-5664-4f54-a355-802020424486 for instance ba5d6453-fd32-4604-8b08-a6297fff60cb on n-h2-860864-8 Oct 12 23:00:25.793502 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d15e83ce-36d1-4a56-aed9-c12c6a5debf9 req-4b0bdc03-e23e-472d-a8fb-37117a3bac0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103750 Oct 12 23:00:25.794124 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2503/5127] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:26.034240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:26.035201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:26.067096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:26.072780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:26.073370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:26.074155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:26.074633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:26.075070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:26.511929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:26.528392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:26.532776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:26.534652 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dc1eb2b-3286-416c-aeac-4f46aeef5820 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.506184 Oct 12 23:00:26.539448 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2504/5128] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:26 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:26.734430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:26.736371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:26.746263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:26.747183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:26.748015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:26.753816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:26.754854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:26.755822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:27.050731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:27.059980 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a356327-7b3f-4c98-bb9f-7be8033b2f7b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1315 microversion: 2.1 time: 0.333370 Oct 12 23:00:27.072960 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2505/5129] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:26 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:27.085206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-914cb681-0141-4c6a-ba13-a35cd7bbdb0c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:27.097789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-914cb681-0141-4c6a-ba13-a35cd7bbdb0c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:27.098278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-914cb681-0141-4c6a-ba13-a35cd7bbdb0c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:27.098714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-914cb681-0141-4c6a-ba13-a35cd7bbdb0c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:27.141984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-914cb681-0141-4c6a-ba13-a35cd7bbdb0c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Going to try to stop instance {{(pid=120543) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 23:00:27.233592 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-914cb681-0141-4c6a-ba13-a35cd7bbdb0c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action" status: 202 len: 0 microversion: 2.1 time: 0.158584 Oct 12 23:00:27.244013 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2506/5130] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:00:27 2022] POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:00:27.268757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:27.272505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:27.294284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:27.306779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:27.306779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:27.307482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:27.308725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:27.309392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:27.310019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:27.572071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:27.580727 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f1b848c-70e1-4978-98e5-67106b212d4b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1678 microversion: 2.1 time: 0.329880 Oct 12 23:00:27.581317 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2507/5131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:27 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1678 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:27.600348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:27.611177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:27.637098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:27.641913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:27.645441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:27.647044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:27.647679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:27.648312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:27.879795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:27.909830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:27.912062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:27.919577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2770ade-5f3d-4d7e-9d16-dbca19aa3fe2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.324498 Oct 12 23:00:27.924220 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2508/5132] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:27 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:28.086686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:28.087483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:28.102594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:28.105492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:28.106061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:28.109387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:28.110036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:28.114266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:28.294798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:28.305016 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-739e955a-eb62-4206-af67-0974f580bbef tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1502 microversion: 2.1 time: 0.222201 Oct 12 23:00:28.306402 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2509/5133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:28 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:28.329433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:28.330351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:28.337257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:28.338103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:28.338695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:28.339498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:28.340252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:28.340786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:28.523616 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.network.security_group_api [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Removing security group fbbfbe36-a08c-45a5-8617-5f1aec7837b0 from port 6172a951-5664-4f54-a355-802020424486 Oct 12 23:00:28.993005 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e54b146-e0bb-4066-90e8-6adea65008b9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb/action" status: 202 len: 0 microversion: 2.1 time: 0.668154 Oct 12 23:00:28.997523 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2510/5134] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:00:28 2022] POST /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:00:29.003068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:29.004140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:29.022633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:29.028003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:29.029148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:29.031397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:29.032609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:29.037221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:29.355638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:29.372353 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1cf0f22-38ce-48b0-8ee9-07c767940943 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1678 microversion: 2.1 time: 0.372712 Oct 12 23:00:29.384021 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2511/5135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:28 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1678 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:29.384021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:29.384021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:29.386158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:29.386648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:29.387087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:29.387779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:29.388276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:29.388868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:29.534646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:29.543682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:29.545311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:29.546556 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fab01c40-1a80-41d6-a6b9-0c3b2916e2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.171848 Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2512/5136] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:29 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:29.565743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:29.658409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:29.667312 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6ed9001-c6e0-455e-a762-efd44b3cb5af tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1460 microversion: 2.1 time: 0.117735 Oct 12 23:00:29.680687 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2513/5137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:29 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1460 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:29.691239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-214c9e73-861b-4420-b236-20b329951e27 req-31c26bd3-0902-45a8-87d4-7e30194ab2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5d6453-fd32-4604-8b08-a6297fff60cb", "tag": "6172a951-5664-4f54-a355-802020424486"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:29.700288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-214c9e73-861b-4420-b236-20b329951e27 req-31c26bd3-0902-45a8-87d4-7e30194ab2a4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:29.701035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-214c9e73-861b-4420-b236-20b329951e27 req-31c26bd3-0902-45a8-87d4-7e30194ab2a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:29.701327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-214c9e73-861b-4420-b236-20b329951e27 req-31c26bd3-0902-45a8-87d4-7e30194ab2a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:29.714241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-214c9e73-861b-4420-b236-20b329951e27 req-31c26bd3-0902-45a8-87d4-7e30194ab2a4 service nova] Creating event network-changed:6172a951-5664-4f54-a355-802020424486 for instance ba5d6453-fd32-4604-8b08-a6297fff60cb on n-h2-860864-8 Oct 12 23:00:29.718333 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-214c9e73-861b-4420-b236-20b329951e27 req-31c26bd3-0902-45a8-87d4-7e30194ab2a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036199 Oct 12 23:00:29.719205 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2514/5138] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:29.728243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1144546766", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695750862", "security_groups": [{"name": "tempest-secgroup-smoke-566887922"}], "block_device_mapping_v2": [{"uuid": "07341337-282f-4478-aa8b-e6d1dc375db3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:29.908846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:00:30.603004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:00:30.604309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:00:30.606660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:00:30.607126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:00:30.610833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:00:30.629419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:30.630193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:30.634332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:30.635345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:30.635842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:30.636290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:30.675708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:00:30.685020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:00:30.792684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:00:30.795751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07341337-282f-4478-aa8b-e6d1dc375db3',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:00:31.038718 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9453dca4-cfa8-4cd0-8ebd-9f8353f16c0d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.314458 Oct 12 23:00:31.039381 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2515/5139] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:00:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:00:31.039381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:31.046087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:31.054052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.054939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.055135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.055826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.056447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.057161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.340668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:31.354643 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-db1ee918-c53c-49a0-ba2d-8967b94567e0 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.313971 Oct 12 23:00:31.357044 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2516/5140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:31 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:31.371181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:31.372926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:31.408071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.410873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.412217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.415687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.418239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.421100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.702369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:31.711700 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-44699be4-496b-45cd-8835-576fb1310069 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1678 microversion: 2.1 time: 0.350940 Oct 12 23:00:31.717912 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2517/5141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:31 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1678 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:31.738601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:31.739525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:31.774582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.775204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.775661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.776715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:31.777177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:31.777606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:31.783203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:31.939404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:31.960568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:31.961718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:31.964602 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-474ce45c-5f18-43a1-8ad5-7c83643c4bb8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 0.243982 Oct 12 23:00:31.985483 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2518/5142] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:31 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:31.992706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:31.993586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:32.008090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.009005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.009603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.010478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.011085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.011666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.090537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:32.099816 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a41aa4a9-e936-4d4a-b244-d8191fd6b886 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1145 microversion: 2.1 time: 0.110917 Oct 12 23:00:32.101770 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2519/5143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:31 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:32.121661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:32.122731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:32.134331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.135146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.136861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.137765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.138219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.138673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.376763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:32.385241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4ab912c-44f5-4712-9d80-6e22ab8d45e6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.282254 Oct 12 23:00:32.386676 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2520/5144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:32 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:32.412375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:32.418424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:32.433420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.433924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.434367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.435098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.435555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.436012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.739752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:32.754650 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e9fabc9-c86f-40a0-a73c-cd2b55552a55 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.346514 Oct 12 23:00:32.764036 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2521/5145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:32 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:32.764036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:32.764036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:32.771035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.771462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.772155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:32.773256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:32.773772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:32.774210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:33.029720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:33.038420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e59d863-7ac0-47ec-88d4-1daa256e91f1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1678 microversion: 2.1 time: 0.281620 Oct 12 23:00:33.048197 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2522/5146] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:32 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:33.055351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:33.056360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:33.091449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:33.092222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:33.092686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:33.104858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:33.105369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:33.105821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:33.389116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:33.404239 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b04c4ba-43ab-430e-a23e-c1ebc4feb152 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.359986 Oct 12 23:00:33.405260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2523/5147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:33 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:33.415391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:33.416403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:33.447844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:33.448683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:33.449926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:33.455796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:33.456794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:33.457717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:34.038779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:34.408448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:34.416923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:34.425863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:34.428316 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70df1c09-5b20-4ee8-9bbf-f8e34f5bd467 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1739 microversion: 2.20 time: 1.020129 Oct 12 23:00:34.432593 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2524/5148] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:33 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1739 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:34.444114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:34.444764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:34.455181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:34.455691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:34.456207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:34.456930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:34.457391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:34.457894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:34.602364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:34.614753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89ed0588-6ed2-44da-a30d-59854f88d63f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1211 microversion: 2.1 time: 0.180156 Oct 12 23:00:34.618526 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2525/5149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:34 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1211 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:34.631479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-854533232", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "41c00e0a-6171-41b3-913b-03da316da8e7"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:34.988316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=31 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:36.155408 n-d-860864-8 devstack@n-api.service[120543]: Exception ignored in: . at 0x7f44ff89b3a0> Oct 12 23:00:36.155408 n-d-860864-8 devstack@n-api.service[120543]: Traceback (most recent call last): Oct 12 23:00:36.155408 n-d-860864-8 devstack@n-api.service[120543]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 12 23:00:36.162420 n-d-860864-8 devstack@n-api.service[120543]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 12 23:00:36.162695 n-d-860864-8 devstack@n-api.service[120543]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 12 23:00:36.164272 n-d-860864-8 devstack@n-api.service[120543]: connection_record.checkin() Oct 12 23:00:36.164539 n-d-860864-8 devstack@n-api.service[120543]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 12 23:00:36.165031 n-d-860864-8 devstack@n-api.service[120543]: pool.dispatch.checkin(connection, self) Oct 12 23:00:36.165267 n-d-860864-8 devstack@n-api.service[120543]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 12 23:00:36.177930 n-d-860864-8 devstack@n-api.service[120543]: fn(*args, **kw) Oct 12 23:00:36.178256 n-d-860864-8 devstack@n-api.service[120543]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 12 23:00:36.186699 n-d-860864-8 devstack@n-api.service[120543]: time.sleep(0) Oct 12 23:00:36.187085 n-d-860864-8 devstack@n-api.service[120543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 12 23:00:36.193251 n-d-860864-8 devstack@n-api.service[120543]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 12 23:00:36.193660 n-d-860864-8 devstack@n-api.service[120543]: AssertionError: do not call blocking functions from the mainloop Oct 12 23:00:36.534503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] validate_networks() for [('b8945b13-46d6-4f18-9de9-f8b223509bc8', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:00:36.542217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] validate_networks() for [('41c00e0a-6171-41b3-913b-03da316da8e7', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:00:37.037287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:00:37.037970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:00:37.038634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:00:37.039230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:00:37.039826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:00:37.051786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.052341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.052798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.053572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.054121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.055031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.076116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Getting quotas for project 7d70a588a44b41ee9c73d01daa0df970. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:00:37.084438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Getting quotas for user eccd22f3e6ce434dbfa7351a023c67bb and project 7d70a588a44b41ee9c73d01daa0df970. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:00:37.099816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Going to run 3 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:00:37.102760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:00:37.151405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=08c66eda-b61a-448d-a27b-81439b928426,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:00:37.200677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=f6953f55-12b2-4f7c-90d3-29c460273e85,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:00:37.291255 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5043ef5-1eeb-48c2-9519-41f481fcdc9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.668640 Oct 12 23:00:37.299549 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2625/5150] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 12678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:00:37.306809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:37.308038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:37.316487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.317267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.317899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.318802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.319428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.320070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.468918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:00:37.470299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:00:37.471159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:00:37.471683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:00:37.472239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:00:37.487594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.488232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.489031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.489875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.490511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.491040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.513647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:00:37.521072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Getting quotas for user b103c953780a4dce8d8872ee8b47d186 and project d1909b9808794051a8d86451506ca5bb. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:00:37.540497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:00:37.543836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:00:37.661034 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-50a2ccf7-0119-45e9-a365-37ffb3f421e1 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.041153 Oct 12 23:00:37.668697 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2526/5151] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:00:37.675056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:37.676106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:37.684265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.685491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.686107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.687064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.688384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.689440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.707376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:37.717990 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3e52daa-813e-40f0-b6bf-31d334843718 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1678 microversion: 2.1 time: 0.416926 Oct 12 23:00:37.720468 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2626/5152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:37 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1678 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:37.725771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:37.726696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:37.735646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.736521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.737232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:37.738338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:37.739055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:37.739868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:38.038109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.049133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.053722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.057408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e5ffa9c-8972-4327-b325-2a0b5fc9273c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1721 microversion: 2.20 time: 0.385946 Oct 12 23:00:38.058547 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2527/5153] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:37 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1721 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:38.065885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-006cffe7-4169-4d03-8e02-a92b8a697e69 req-b6315956-fbe1-4f5d-ba4e-34a4bd085609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b34a38-c58d-42c0-a992-e4a1ee820eb0", "tag": "7283bdc3-025f-4e97-9a34-9cba12a31575"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:38.087230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-006cffe7-4169-4d03-8e02-a92b8a697e69 req-b6315956-fbe1-4f5d-ba4e-34a4bd085609 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:38.088675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-006cffe7-4169-4d03-8e02-a92b8a697e69 req-b6315956-fbe1-4f5d-ba4e-34a4bd085609 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:38.091137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-006cffe7-4169-4d03-8e02-a92b8a697e69 req-b6315956-fbe1-4f5d-ba4e-34a4bd085609 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:38.122543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.126967 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-006cffe7-4169-4d03-8e02-a92b8a697e69 req-b6315956-fbe1-4f5d-ba4e-34a4bd085609 service nova] Creating event network-changed:7283bdc3-025f-4e97-9a34-9cba12a31575 for instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 on n-h1-860864-8 Oct 12 23:00:38.136062 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-006cffe7-4169-4d03-8e02-a92b8a697e69 req-b6315956-fbe1-4f5d-ba4e-34a4bd085609 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076014 Oct 12 23:00:38.137053 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24ace44f-9708-4169-ac3d-1446cdb3389d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1278 microversion: 2.1 time: 0.415034 Oct 12 23:00:38.137287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2528/5154] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:38.138056 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2627/5155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:37 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1278 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:38.146813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7dd4652d-cd23-4545-af4a-48340ff27fcf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:38.149974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7dd4652d-cd23-4545-af4a-48340ff27fcf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:38.159294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:38.166508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.168577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:00:38.218962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:38.220890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:38.222510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:38.224898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:38.226125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:38.230222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:38.237896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7dd4652d-cd23-4545-af4a-48340ff27fcf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.248851 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7dd4652d-cd23-4545-af4a-48340ff27fcf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1214 microversion: 2.1 time: 0.109262 Oct 12 23:00:38.251047 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2628/5156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:38 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:38.268206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04d97de1-f6da-44a9-beae-97a15a57a21b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.117330 Oct 12 23:00:38.274588 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2529/5157] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 23:00:38 2022] GET /compute/v2.1/servers => generated 1015 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:38.286984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d70eb191-6a9a-4f25-a2a2-ee457f863191 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:38.288202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d70eb191-6a9a-4f25-a2a2-ee457f863191 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:38.636914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d70eb191-6a9a-4f25-a2a2-ee457f863191 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:38.651242 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d70eb191-6a9a-4f25-a2a2-ee457f863191 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1222 microversion: 2.1 time: 0.368696 Oct 12 23:00:38.667947 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2629/5158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:38 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1222 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:38.747107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:38.748079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:38.762673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:38.763992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:38.766300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:38.767767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:38.769230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:38.771526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.088612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:39.089434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:39.092180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.101952 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4597f1fc-eecc-4bf1-82bd-c897352ce451 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1655 microversion: 2.1 time: 0.358595 Oct 12 23:00:39.104400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.105418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.106058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.106973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.107593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.108208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.120078 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2530/5159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:38 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1655 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:39.125723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d4a57093-f7ee-49f7-8c58-94b8b7d359c9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:39.132527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4a57093-f7ee-49f7-8c58-94b8b7d359c9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.133541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4a57093-f7ee-49f7-8c58-94b8b7d359c9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.134169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4a57093-f7ee-49f7-8c58-94b8b7d359c9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.170156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d4a57093-f7ee-49f7-8c58-94b8b7d359c9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Going to try to start instance {{(pid=120543) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 23:00:39.242285 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d4a57093-f7ee-49f7-8c58-94b8b7d359c9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action" status: 202 len: 0 microversion: 2.1 time: 0.120417 Oct 12 23:00:39.246831 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2531/5160] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:00:39 2022] POST /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:00:39.254005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:39.255100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:39.264105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.264836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.266272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.267955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.268799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.272307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.313560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.323774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.325847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.328964 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bbd06670-e198-44ed-bea6-4c6aa10fdcf5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1721 microversion: 2.20 time: 0.245254 Oct 12 23:00:39.330045 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2630/5161] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:39 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:39.334871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:39.335648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:39.342095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.342778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.343403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.344922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.345580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.346203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.523584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.531607 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9691f55-f41d-41f7-b4db-0c4dd7e03b54 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1664 microversion: 2.1 time: 0.200310 Oct 12 23:00:39.532250 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2631/5162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:39 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1664 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:39.537581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:39.538265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:39.544498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.545211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.545908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.547089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.547617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.548279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.628529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.695359 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70379c61-72f1-4373-a719-e4cf5fec349b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1218 microversion: 2.1 time: 0.158348 Oct 12 23:00:39.717636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2632/5163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:39 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:39.732692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:39.733345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:39.754434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.758189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.758840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.761531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:39.762182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:39.762775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:39.764876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.807367 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-926c4415-6428-4c3e-940e-53a8b2e6533e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1278 microversion: 2.1 time: 0.559189 Oct 12 23:00:39.820797 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2532/5164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:39 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1278 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:39.881756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:39.908137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d608555-d173-4a67-bb2f-8a9f1bb2d3d2 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1226 microversion: 2.1 time: 0.182700 Oct 12 23:00:39.909105 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2633/5165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:39 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1226 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:40.359861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:40.361468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:40.379544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.381613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.382352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.386251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.386983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.387754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.559608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:40.560277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:40.576084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.576650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.577124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.577922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.578412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.578854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.704783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:40.721537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:40.731783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:40.753176 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b08ec7e-63a7-47ee-9574-96f81ac42165 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1724 microversion: 2.20 time: 0.395349 Oct 12 23:00:40.753817 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2533/5166] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:40 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:00:40.760785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:40.762104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:40.770028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.770598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.770939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.772127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:40.772622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:40.773102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:40.965097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:40.975023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a1101b38-ad19-4281-a6db-64118113573a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1210 microversion: 2.1 time: 0.218529 Oct 12 23:00:40.992359 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2534/5167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:40 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1210 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:40.995398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:41.014656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7bf5825f-20b2-4aec-98b1-a0489bd91fd4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1664 microversion: 2.1 time: 0.460748 Oct 12 23:00:41.016235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8e9016f-1394-4712-a7f3-26eed49dab2a"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:41.025074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:41.036212 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2634/5168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:40 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1664 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:41.041402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:41.045221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:41.052093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.052548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.053025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.053743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.054191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.054624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.063764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.064630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.065996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.068717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.069446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.071684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.212477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:41.360081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:41.368402 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ebd9da4-e537-4cb7-a066-a7a070473dae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.330817 Oct 12 23:00:41.383920 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2635/5169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:41 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:41.383920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-af5d70e8-fc4d-4686-822c-241c62378374 req-d60c3a9e-97ef-43ef-8072-a1b79eaf7067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "name": "network-vif-unplugged", "status": "completed", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:41.446033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-af5d70e8-fc4d-4686-822c-241c62378374 req-d60c3a9e-97ef-43ef-8072-a1b79eaf7067 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.446545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-af5d70e8-fc4d-4686-822c-241c62378374 req-d60c3a9e-97ef-43ef-8072-a1b79eaf7067 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.446998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-af5d70e8-fc4d-4686-822c-241c62378374 req-d60c3a9e-97ef-43ef-8072-a1b79eaf7067 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.513558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-af5d70e8-fc4d-4686-822c-241c62378374 req-d60c3a9e-97ef-43ef-8072-a1b79eaf7067 service nova] Creating event network-vif-unplugged:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h2-860864-8 Oct 12 23:00:41.530701 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-af5d70e8-fc4d-4686-822c-241c62378374 req-d60c3a9e-97ef-43ef-8072-a1b79eaf7067 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146241 Oct 12 23:00:41.533041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2636/5170] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:41.541328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:41.542304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:41.550090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.551076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.551527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.552287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.553159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.553751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.598482 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a53666a-7a44-472e-94b4-503a893e1e90 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.616579 Oct 12 23:00:41.602752 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2535/5171] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Oct 12 23:00:40 2022] POST /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 188 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:00:41.791088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:41.805653 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3074fc98-15cd-4b04-9969-fac3703b9160 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1218 microversion: 2.1 time: 0.270833 Oct 12 23:00:41.806226 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2637/5172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:41 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:41.930182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:41.931412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:41.938921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.939782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.940404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:41.941787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:41.942403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:41.943214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.001572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:42.002221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:42.016535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.017435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.024981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.026007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.026877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.027518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.061054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120543) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 23:00:42.120819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:42.135390 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f38054ff-9096-4c82-8d49-9bf8b096da5f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1272 microversion: 2.1 time: 0.138244 Oct 12 23:00:42.141547 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2638/5173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:41 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:42.143198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:42.144050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:42.164172 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c784020c-1f62-4618-9797-d280bd4c68a0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/action" status: 202 len: 0 microversion: 2.20 time: 0.239876 Oct 12 23:00:42.168244 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2536/5174] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 23:00:41 2022] POST /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:00:42.173535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:42.174485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:42.181225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.182015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.182669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.184399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.185069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.185703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.220538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.232943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.234756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.239577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.240577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.241238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.469648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:42.497709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:42.503295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:42.518202 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1bcfb78-d675-4e68-a10b-66356b114cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1810 microversion: 2.20 time: 0.344348 Oct 12 23:00:42.535926 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2537/5175] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:42 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1810 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:42.535926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:42.535926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:42.554137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.556488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.557207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.558941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.561031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.576661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.774106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:42.792146 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8929cecf-7d1c-4cc4-884b-55f494ca1386 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1668 microversion: 2.1 time: 0.654163 Oct 12 23:00:42.801848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2639/5176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:42 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1668 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:42.846395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:42.849218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:42.863448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.867338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.878674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.879460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:42.879972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:42.880420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:42.922015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:42.948874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9200b27e-3a78-4424-84f1-e5cdd36070f2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.426220 Oct 12 23:00:42.949511 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2538/5177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:42 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:43.128909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:43.160132 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79c9397a-f453-437e-90c8-11d09d2a02d7 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1274 microversion: 2.1 time: 0.325350 Oct 12 23:00:43.162308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:43.163083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:43.164601 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2640/5178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:42 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:43.166772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:43.177188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.177889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.178479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:43.179339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.180647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.181755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:43.459711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:43.468326 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-74b64c57-eb93-4154-a53d-3f5f9194d4a5 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1272 microversion: 2.1 time: 0.310192 Oct 12 23:00:43.472315 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2539/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:43 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:43.567464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:43.568738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:43.579614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.580783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.581462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:43.582555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.583292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.584615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:43.972451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:43.973164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:43.986457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.987071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.987579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:43.988429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:43.988965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:43.989532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.230397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:44.246473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:44.254059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:44.255483 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bd9ec25-0049-44cf-a70e-7e69d78eeefc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1750 microversion: 2.20 time: 0.702978 Oct 12 23:00:44.272415 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2641/5180] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:43 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1750 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:44.272415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-93709225-2ebc-44da-978b-1c9a71e525e3 req-27fff25b-7bb3-43d4-b591-3a5928c25f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6953f55-12b2-4f7c-90d3-29c460273e85", "tag": "6cc976b9-c87d-4689-8a24-2b0cec2b0c24"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:44.292112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93709225-2ebc-44da-978b-1c9a71e525e3 req-27fff25b-7bb3-43d4-b591-3a5928c25f0c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:44.292754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93709225-2ebc-44da-978b-1c9a71e525e3 req-27fff25b-7bb3-43d4-b591-3a5928c25f0c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:44.295608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93709225-2ebc-44da-978b-1c9a71e525e3 req-27fff25b-7bb3-43d4-b591-3a5928c25f0c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.321313 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-93709225-2ebc-44da-978b-1c9a71e525e3 req-27fff25b-7bb3-43d4-b591-3a5928c25f0c service nova] Creating event network-changed:6cc976b9-c87d-4689-8a24-2b0cec2b0c24 for instance f6953f55-12b2-4f7c-90d3-29c460273e85 on n-h1-860864-8 Oct 12 23:00:44.349183 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-93709225-2ebc-44da-978b-1c9a71e525e3 req-27fff25b-7bb3-43d4-b591-3a5928c25f0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088596 Oct 12 23:00:44.349183 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2642/5181] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:44.357934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:44.360413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:44.370764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:44.371446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:44.375245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.376220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:44.376883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:44.377476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.535384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:44.557750 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6db50fbd-91f4-4411-969a-76631bd978b1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1280 microversion: 2.1 time: 0.205683 Oct 12 23:00:44.559156 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2643/5182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:44 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:44.572734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:44.576273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:44.590813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:44.593153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:44.595875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.597052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:44.598198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:44.598917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:44.637611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:44.653840 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80366896-bd98-485d-a59a-b16f9e8b0e88 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.685048 Oct 12 23:00:44.654461 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2540/5183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:43 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:45.283584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:45.284332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:45.295670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.296201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.296696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:45.297388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.297833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.298260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:45.389741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:45.408001 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0ebe78c-2943-42dc-b54a-8b233cc51c8d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.846248 Oct 12 23:00:45.423659 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2644/5184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:44 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:45.585393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:45.586019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:45.596348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.597040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.608639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:45.609701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.610340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.610933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:45.643560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:45.688158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:45.700125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:45.705103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:45.709327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4870f704-2a81-4731-99ce-f6c6f3b41236 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1752 microversion: 2.20 time: 0.430455 Oct 12 23:00:45.709914 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2541/5185] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:45 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1752 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:00:45.721089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:45.721884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:45.736256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.736748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.737186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:45.739049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:45.739535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:45.739992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:46.096508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:46.105619 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1c38fb7-d8c3-4a87-9f06-d8db35c64289 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.524149 Oct 12 23:00:46.120835 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2645/5186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:45 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:46.149645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:46.158492 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c25c2ee-703b-4b96-95ab-ed85c841f9ee tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.446604 Oct 12 23:00:46.159218 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2542/5187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:45 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:46.227954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-bc10ff66-d3df-473d-9521-c6605a8da488 req-696cdde0-2688-4353-9fce-17deed41b5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c66eda-b61a-448d-a27b-81439b928426", "tag": "ea471db4-59d2-4ba3-a1a6-099d4943ec02"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:46.253282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bc10ff66-d3df-473d-9521-c6605a8da488 req-696cdde0-2688-4353-9fce-17deed41b5da service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:46.254244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bc10ff66-d3df-473d-9521-c6605a8da488 req-696cdde0-2688-4353-9fce-17deed41b5da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:46.254884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bc10ff66-d3df-473d-9521-c6605a8da488 req-696cdde0-2688-4353-9fce-17deed41b5da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:46.287454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-bc10ff66-d3df-473d-9521-c6605a8da488 req-696cdde0-2688-4353-9fce-17deed41b5da service nova] Creating event network-changed:ea471db4-59d2-4ba3-a1a6-099d4943ec02 for instance 08c66eda-b61a-448d-a27b-81439b928426 on n-h2-860864-8 Oct 12 23:00:46.298505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-bc10ff66-d3df-473d-9521-c6605a8da488 req-696cdde0-2688-4353-9fce-17deed41b5da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080769 Oct 12 23:00:46.299691 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2646/5188] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:00:46.430974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:46.432228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:46.443133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:46.447265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:46.447875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:46.451212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:46.452026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:46.454692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:46.741637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:46.743230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:46.761465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:46.763453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:46.764156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:46.768299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:46.769328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:46.769970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:46.859923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:46.869624 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef69b930-b940-448e-8b10-c4bb52e8f402 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.441463 Oct 12 23:00:46.887310 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2543/5189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:46 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:47.062983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8a77d1f0-8320-4f40-98e7-516b93a63321 req-678c58df-06bb-4b8a-931d-ad58bc2d7d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2699c238-f1ba-475a-a2b2-c7c656571d20", "tag": "43f89b97-59a9-4f2b-8e37-76fb4ad9c8c4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:47.066421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:47.073719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8a77d1f0-8320-4f40-98e7-516b93a63321 req-678c58df-06bb-4b8a-931d-ad58bc2d7d06 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.074427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8a77d1f0-8320-4f40-98e7-516b93a63321 req-678c58df-06bb-4b8a-931d-ad58bc2d7d06 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.075011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8a77d1f0-8320-4f40-98e7-516b93a63321 req-678c58df-06bb-4b8a-931d-ad58bc2d7d06 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.086814 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8a77d1f0-8320-4f40-98e7-516b93a63321 req-678c58df-06bb-4b8a-931d-ad58bc2d7d06 service nova] Creating event network-changed:43f89b97-59a9-4f2b-8e37-76fb4ad9c8c4 for instance 2699c238-f1ba-475a-a2b2-c7c656571d20 on n-h2-860864-8 Oct 12 23:00:47.092129 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8a77d1f0-8320-4f40-98e7-516b93a63321 req-678c58df-06bb-4b8a-931d-ad58bc2d7d06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032761 Oct 12 23:00:47.092910 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2544/5190] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:00:47.132830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:47.133823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:47.148096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.148844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.149452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.150315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.151011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.151589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.221345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:47.233485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:47.236926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:47.238369 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72cdab45-2d81-48ad-9118-df20b045db01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1752 microversion: 2.20 time: 0.502493 Oct 12 23:00:47.254513 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2647/5191] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:46 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1752 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:47.267733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:47.268802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:47.277061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.277993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.278661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.279609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.280383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.281075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.407251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:47.415448 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f269febf-6558-43c9-b581-b32fdd2e49f3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.289272 Oct 12 23:00:47.418113 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2545/5192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:47 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:47.474004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:47.485361 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34536828-e71c-4914-ac89-32bc55bbf20d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.227907 Oct 12 23:00:47.486003 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2648/5193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:47 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:47.895574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:47.896225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:47.900562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:47.906279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.906875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.907388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:47.908193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:47.908739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:47.909239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.230648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:48.248532 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80c3fe43-3ff6-413d-ad75-e3533103906b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.357425 Oct 12 23:00:48.250137 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2546/5194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:47 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:48.270644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:48.271426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:48.294538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.295065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.295531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.302357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.303057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.303531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.378476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-22de60df-2804-41ad-a66e-12fc89d776b1 req-365c1112-1b1f-48a9-bd9d-55db5c9266e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283daca0-928d-42b0-8c90-5ad9f7139753", "tag": "5b81b377-0cbe-4aff-94c6-a691ebacb822"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:48.387009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:48.396164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-22de60df-2804-41ad-a66e-12fc89d776b1 req-365c1112-1b1f-48a9-bd9d-55db5c9266e9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.396988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-22de60df-2804-41ad-a66e-12fc89d776b1 req-365c1112-1b1f-48a9-bd9d-55db5c9266e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.397700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-22de60df-2804-41ad-a66e-12fc89d776b1 req-365c1112-1b1f-48a9-bd9d-55db5c9266e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.430599 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-22de60df-2804-41ad-a66e-12fc89d776b1 req-365c1112-1b1f-48a9-bd9d-55db5c9266e9 service nova] Creating event network-changed:5b81b377-0cbe-4aff-94c6-a691ebacb822 for instance 283daca0-928d-42b0-8c90-5ad9f7139753 on n-h2-860864-8 Oct 12 23:00:48.440381 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-22de60df-2804-41ad-a66e-12fc89d776b1 req-365c1112-1b1f-48a9-bd9d-55db5c9266e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064779 Oct 12 23:00:48.446091 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2547/5195] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:48.456487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:48.469705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:48.487353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.487845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.488627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.490305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.491103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.491968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.649829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:48.769776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:48.794761 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be38b436-e816-4936-8481-c831f76fb2d1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.344332 Oct 12 23:00:48.795642 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2548/5196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:48 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:48.828353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:48.829106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:48.839930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.840909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.841117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.842018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:48.842405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:48.845222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:48.868882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:48.903211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:48.909839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:48.915915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-afdde90f-f965-4b50-946a-378e92752462 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1752 microversion: 2.20 time: 0.648441 Oct 12 23:00:48.936140 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2649/5197] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:48 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1752 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:49.261774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:49.276230 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00f4150b-be45-448b-b1f4-07eaa8e03289 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.463218 Oct 12 23:00:49.277061 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2549/5198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:48 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:49.280734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:49.281909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:49.298721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.299478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.300126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:49.301012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.301640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.302242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:49.486649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:49.495342 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc0d12b2-c6ba-45fc-aa37-9f32efb46372 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.220590 Oct 12 23:00:49.496509 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2650/5199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:49 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:49.826175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:49.827147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:49.846819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.848852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.852036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:49.853047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.854381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.856018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:49.866703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:49.949464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:49.950436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:49.960949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.961890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.962516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:49.963881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:49.964598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:49.965197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.224522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:50.235489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:50.239031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:50.240491 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a81417de-97e2-49d9-b054-16385e3403f4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1752 microversion: 2.20 time: 0.296702 Oct 12 23:00:50.240744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:50.241941 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2651/5200] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:49 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1752 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:50.255996 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc48cd59-d463-428b-8981-003a56db20e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.437500 Oct 12 23:00:50.257194 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2550/5201] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:49 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:50.271145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f7af5125-513a-412c-96e2-66b01cf22aed req-6fbb2e22-4471-4abc-b2b1-c4d2ace12543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6953f55-12b2-4f7c-90d3-29c460273e85", "name": "network-vif-plugged", "status": "completed", "tag": "6cc976b9-c87d-4689-8a24-2b0cec2b0c24"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:50.286834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f7af5125-513a-412c-96e2-66b01cf22aed req-6fbb2e22-4471-4abc-b2b1-c4d2ace12543 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.288931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f7af5125-513a-412c-96e2-66b01cf22aed req-6fbb2e22-4471-4abc-b2b1-c4d2ace12543 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.290009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f7af5125-513a-412c-96e2-66b01cf22aed req-6fbb2e22-4471-4abc-b2b1-c4d2ace12543 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.302784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:50.303999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:50.311881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.311881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.312417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.313337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.314002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.315402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.322214 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f7af5125-513a-412c-96e2-66b01cf22aed req-6fbb2e22-4471-4abc-b2b1-c4d2ace12543 service nova] Creating event network-vif-plugged:6cc976b9-c87d-4689-8a24-2b0cec2b0c24 for instance f6953f55-12b2-4f7c-90d3-29c460273e85 on n-h1-860864-8 Oct 12 23:00:50.331791 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f7af5125-513a-412c-96e2-66b01cf22aed req-6fbb2e22-4471-4abc-b2b1-c4d2ace12543 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067164 Oct 12 23:00:50.344273 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2652/5202] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:00:50.521878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:50.522941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:50.531392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.532186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.532814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.533799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:50.534436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:50.535041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:50.557249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:50.569373 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f290b95-05ab-440c-9a32-9225ba51914e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.271517 Oct 12 23:00:50.578812 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2551/5203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:50 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:50.690973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:50.699083 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fb57d01-f52c-4f14-8987-f076c6251e97 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.181909 Oct 12 23:00:50.715914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2653/5204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:50 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:51.299192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:51.299809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:51.301438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:51.302898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:51.309163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.309652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.310089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.310795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.311249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.311676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.319485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.320303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.320915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.321770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.322407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.323757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.494997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:51.516194 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-74406ad9-9e7e-493e-a7b3-a2a79bf05fb3 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.212176 Oct 12 23:00:51.516194 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2552/5205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:51 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:51.594345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:51.595178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:51.601668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.602349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.603226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.604190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.604818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.605248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.825759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:51.834388 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40e8f16e-b3ad-4ab2-aa7d-f92135b8acf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.245099 Oct 12 23:00:51.840281 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2553/5206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:51 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:51.855672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:51.856684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:51.864739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.865493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.866338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.867858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:51.868807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:51.869429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:51.870893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:51.884976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:51.886466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:51.887832 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b96dd9d5-1340-42e6-acd3-ba0a34df094f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1752 microversion: 2.20 time: 0.590495 Oct 12 23:00:51.889080 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2654/5207] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:51 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1752 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:52.051079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:52.060992 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7174c5b1-57e6-479d-a443-2811f8e4ef5c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.219162 Oct 12 23:00:52.064462 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2554/5208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:51 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:52.368211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0f60c459-7718-4e09-a7c8-a4ada9ad14e9 req-3dbca084-985e-448f-bc05-9f037bbc28e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c66eda-b61a-448d-a27b-81439b928426", "name": "network-vif-plugged", "status": "completed", "tag": "ea471db4-59d2-4ba3-a1a6-099d4943ec02"}, {"server_uuid": "05b34a38-c58d-42c0-a992-e4a1ee820eb0", "name": "network-vif-plugged", "status": "completed", "tag": "7283bdc3-025f-4e97-9a34-9cba12a31575"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:52.381288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0f60c459-7718-4e09-a7c8-a4ada9ad14e9 req-3dbca084-985e-448f-bc05-9f037bbc28e3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:52.381778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0f60c459-7718-4e09-a7c8-a4ada9ad14e9 req-3dbca084-985e-448f-bc05-9f037bbc28e3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:52.382247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0f60c459-7718-4e09-a7c8-a4ada9ad14e9 req-3dbca084-985e-448f-bc05-9f037bbc28e3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:52.396480 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0f60c459-7718-4e09-a7c8-a4ada9ad14e9 req-3dbca084-985e-448f-bc05-9f037bbc28e3 service nova] Creating event network-vif-plugged:ea471db4-59d2-4ba3-a1a6-099d4943ec02 for instance 08c66eda-b61a-448d-a27b-81439b928426 on n-h2-860864-8 Oct 12 23:00:52.396996 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0f60c459-7718-4e09-a7c8-a4ada9ad14e9 req-3dbca084-985e-448f-bc05-9f037bbc28e3 service nova] Creating event network-vif-plugged:7283bdc3-025f-4e97-9a34-9cba12a31575 for instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 on n-h1-860864-8 Oct 12 23:00:52.406438 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0f60c459-7718-4e09-a7c8-a4ada9ad14e9 req-3dbca084-985e-448f-bc05-9f037bbc28e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042618 Oct 12 23:00:52.407046 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2655/5209] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:52.535024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:52.535638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:52.542510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:52.543021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:52.543461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:52.544179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:52.544630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:52.545060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:52.785001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:52.795536 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-81827183-a130-4a59-b7f4-cd0de6a11456 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.264383 Oct 12 23:00:52.796924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2555/5210] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:52 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:52.862852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:52.863850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:52.870506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:52.871278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:52.871914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:52.873573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:52.874242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:52.874845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:52.921067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:52.925857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:52.937051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:52.937842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:52.948603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:52.949597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:52.950228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:52.950816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:53.079439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:53.088419 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96a0c13d-b482-4b15-ae7d-43c6bc03a24f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.230266 Oct 12 23:00:53.089051 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2656/5211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:52 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:53.094584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:53.095569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:53.101855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:53.102550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:53.103195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:53.104230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:53.104989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:53.105750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:53.249672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:53.250297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:53.258225 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc829e9a-e6d6-4cfc-809f-d5314ebd920d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.168066 Oct 12 23:00:53.258862 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2657/5212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:53 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:53.264496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:53.266498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:53.267871 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9434d869-825c-493b-82ac-d78be37f0cbc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.353362 Oct 12 23:00:53.268447 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2556/5213] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:52 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:53.819416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:53.820205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:53.828675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:53.829455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:53.830105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:53.831333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:53.832015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:53.832676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:53.973357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:53.982681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2db24e3c-864d-4f8e-ab94-baaf059e2fe8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.167082 Oct 12 23:00:53.983987 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2658/5214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:53 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:54.116544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:54.118346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:54.128120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.129258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.130019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.131393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.132021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.132715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.184700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-143f9f56-a5ad-426c-9922-a9c574baad0e req-21ba5f91-42eb-47ea-8cb0-b3e5de00c219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:54.198678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-143f9f56-a5ad-426c-9922-a9c574baad0e req-21ba5f91-42eb-47ea-8cb0-b3e5de00c219 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.199441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-143f9f56-a5ad-426c-9922-a9c574baad0e req-21ba5f91-42eb-47ea-8cb0-b3e5de00c219 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.200809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-143f9f56-a5ad-426c-9922-a9c574baad0e req-21ba5f91-42eb-47ea-8cb0-b3e5de00c219 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.212877 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-143f9f56-a5ad-426c-9922-a9c574baad0e req-21ba5f91-42eb-47ea-8cb0-b3e5de00c219 service nova] Creating event network-changed:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h1-860864-8 Oct 12 23:00:54.217944 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-143f9f56-a5ad-426c-9922-a9c574baad0e req-21ba5f91-42eb-47ea-8cb0-b3e5de00c219 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036876 Oct 12 23:00:54.219065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2659/5215] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:00:54.282438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:54.283275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:54.292167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.292756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.293281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.294060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.295329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.295850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.437736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:54.445976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:54.449132 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-451f7c42-ae0c-4a0c-a189-b18115d393bd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1266 microversion: 2.1 time: 0.336919 Oct 12 23:00:54.449725 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2557/5216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:54 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:54.456246 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04f0fa9d-43af-4c14-aea8-bb06679436fa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.177923 Oct 12 23:00:54.456962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2660/5217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:54 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:00:54.461888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6d1dca39-752f-4f0c-9954-2e400cf78131 req-b0c3795a-7a96-4c4d-b7ab-0f493d363d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2699c238-f1ba-475a-a2b2-c7c656571d20", "name": "network-vif-plugged", "status": "completed", "tag": "43f89b97-59a9-4f2b-8e37-76fb4ad9c8c4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:54.471411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:54.472288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:54.472683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d1dca39-752f-4f0c-9954-2e400cf78131 req-b0c3795a-7a96-4c4d-b7ab-0f493d363d89 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.473173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d1dca39-752f-4f0c-9954-2e400cf78131 req-b0c3795a-7a96-4c4d-b7ab-0f493d363d89 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.473636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d1dca39-752f-4f0c-9954-2e400cf78131 req-b0c3795a-7a96-4c4d-b7ab-0f493d363d89 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.478695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.479170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.479821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.480719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:54.481329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:54.481752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:54.489706 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6d1dca39-752f-4f0c-9954-2e400cf78131 req-b0c3795a-7a96-4c4d-b7ab-0f493d363d89 service nova] Creating event network-vif-plugged:43f89b97-59a9-4f2b-8e37-76fb4ad9c8c4 for instance 2699c238-f1ba-475a-a2b2-c7c656571d20 on n-h2-860864-8 Oct 12 23:00:54.494602 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6d1dca39-752f-4f0c-9954-2e400cf78131 req-b0c3795a-7a96-4c4d-b7ab-0f493d363d89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036180 Oct 12 23:00:54.495194 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2661/5218] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:00:54.689219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:54.697971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:54.699426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:54.700630 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd767c5f-ab97-4289-a5ed-ce0c71a9c8ff tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.234350 Oct 12 23:00:54.701378 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2558/5219] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:54 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:55.007636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:55.008415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:55.011861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:55.018415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.019744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.020429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.021602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.022227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.022836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.229476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:55.238262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0f8d3a9-e933-4487-b296-98d6b0f56936 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1322 microversion: 2.1 time: 0.235727 Oct 12 23:00:55.252839 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2662/5220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:55 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:55.483313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:55.484367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:55.485528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:55.486084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:55.504047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.504642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.506150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.506886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.507232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.508999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.509863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.510346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.511195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.512509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.513433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.513807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.810599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:55.823019 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44b3a8a7-0abb-408d-b6a1-e7ea9ac45b72 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.345943 Oct 12 23:00:55.823856 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2663/5221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:55 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:55.850259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:55.851099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:55.867506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.868334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.868944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:55.869997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:55.870622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:55.876512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.117686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:56.133751 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4c4e73b-3046-427e-aab3-04f12647d425 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1452 microversion: 2.1 time: 0.659831 Oct 12 23:00:56.136704 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2559/5222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:55 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1452 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:56.158961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:56.159665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:56.176894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.177666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.178264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.179128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.179737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.180333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.358863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:56.388062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:56.389624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:56.391151 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-213a7564-934b-446a-9ef3-6201de39e0eb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.550543 Oct 12 23:00:56.403916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2664/5223] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:55 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:56.424345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:56.425465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:56.438215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.442820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.446460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.447479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.448169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.448833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.466732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:56.479788 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6b0bfc1-0e20-48ef-9226-a92c8ca64077 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1452 microversion: 2.1 time: 0.324560 Oct 12 23:00:56.491964 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2560/5224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:56 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1452 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:56.507353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:56.515824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9ceba936-8b96-4968-a780-5cd4daf05c3a req-db4195ab-0e2b-4db6-9e98-9d16a692392a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283daca0-928d-42b0-8c90-5ad9f7139753", "name": "network-vif-plugged", "status": "completed", "tag": "5b81b377-0cbe-4aff-94c6-a691ebacb822"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:00:56.535981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9ceba936-8b96-4968-a780-5cd4daf05c3a req-db4195ab-0e2b-4db6-9e98-9d16a692392a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.538164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9ceba936-8b96-4968-a780-5cd4daf05c3a req-db4195ab-0e2b-4db6-9e98-9d16a692392a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.539499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9ceba936-8b96-4968-a780-5cd4daf05c3a req-db4195ab-0e2b-4db6-9e98-9d16a692392a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.566665 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9ceba936-8b96-4968-a780-5cd4daf05c3a req-db4195ab-0e2b-4db6-9e98-9d16a692392a service nova] Creating event network-vif-plugged:5b81b377-0cbe-4aff-94c6-a691ebacb822 for instance 283daca0-928d-42b0-8c90-5ad9f7139753 on n-h2-860864-8 Oct 12 23:00:56.579076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9ceba936-8b96-4968-a780-5cd4daf05c3a req-db4195ab-0e2b-4db6-9e98-9d16a692392a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066127 Oct 12 23:00:56.580678 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2561/5225] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:00:56.804495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:56.815787 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e7f7412-df2a-4786-abf3-d4fd2d2091e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 200 len: 1514 microversion: 2.1 time: 0.422942 Oct 12 23:00:56.816619 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2665/5226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:56 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 1514 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:56.848483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:56.849291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:56.853048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:56.853691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:56.855761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.856313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.856753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.857463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.857920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.858996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.872353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.872867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.873319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:56.874242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:56.878810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:56.879608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.154887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:57.165074 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2bd9fd40-e551-4700-b877-677e4638fb95 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 200 len: 1514 microversion: 2.1 time: 0.328965 Oct 12 23:00:57.171637 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2562/5227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:56 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 1514 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:57.195227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:57.197043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:57.204669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.205450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.206298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.207354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.208190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.208827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.429733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:57.447604 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93df6815-8bb9-435d-b86f-86696567772b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 200 len: 1515 microversion: 2.1 time: 0.256041 Oct 12 23:00:57.453386 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2563/5228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:57 2022] GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:57.460803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:57.463473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:57.471112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.471882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.472520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.473402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.481540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.481995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.668052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:57.677867 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aef01dec-7ef1-4a97-8ad3-ddacddbfb5fe tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.833978 Oct 12 23:00:57.680875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:57.697056 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2666/5229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:56 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:57.707028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:57.708562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:57.708908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:57.709520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:57.709781 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16694d3c-6d24-4103-9164-c492a8019173 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.255058 Oct 12 23:00:57.723923 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2564/5230] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:57 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:00:57.724155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.724155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.724155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.724155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.724155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.728480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.793633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:00:57.926769 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea89c3b5-f744-42b2-a34b-79ec14fa0a4d tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "DELETE /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 204 len: 0 microversion: 2.1 time: 0.226041 Oct 12 23:00:57.927865 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2667/5231] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:00:57 2022] DELETE /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:00:57.936012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:57.937443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:57.952829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.953702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.954363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:57.955297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:57.956024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:57.956675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:58.196473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:58.214230 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c8667b2-6d89-435f-8124-6eecdb539f1f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 200 len: 1521 microversion: 2.1 time: 0.282139 Oct 12 23:00:58.218572 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2565/5232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:57 2022] GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:58.706111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:58.707468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:58.716333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:58.717090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:58.718307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:58.719223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:58.719856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:58.720489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:58.740330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:58.741525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:58.754243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:58.754743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:58.755262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:58.762797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:58.771994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:58.772823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:58.999807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:59.026493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:59.028193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:59.029559 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9435e9fe-eebc-4b5d-ba82-c8b2113d8765 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.293357 Oct 12 23:00:59.030410 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2566/5233] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:00:58 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:00:59.104834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:59.113344 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cefa28c9-6cac-4073-ad44-ba6be11a3b92 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1314 microversion: 2.1 time: 0.412492 Oct 12 23:00:59.114148 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2668/5234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:58 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:00:59.243366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:00:59.244389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:00:59.251426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:59.252533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:59.253165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:59.254144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:00:59.254892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:00:59.255623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:00:59.279816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:00:59.473967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:00:59.483071 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-184496af-99ef-4c34-aa50-a766ccd9b462 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 200 len: 1521 microversion: 2.1 time: 0.244081 Oct 12 23:00:59.484062 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2567/5235] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:00:59 2022] GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:00.068142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:00.069051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:00.077522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.078036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.079218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.080139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.080612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.081052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.136898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:00.137566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:00.145968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.146463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.147033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.147747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.148393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.148717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.460779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:00.479970 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c844584f-ddd3-4901-83f5-69564650848c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1502 microversion: 2.1 time: 0.347126 Oct 12 23:01:00.484253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2568/5236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:00 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1502 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:00.507863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:00.508838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:00.522683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.524235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.525992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.528435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.530304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.531324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.725066 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12339ced-3eb5-4de3-8adb-61d66b297adb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753/action" status: 202 len: 0 microversion: 2.1 time: 0.221476 Oct 12 23:01:00.726392 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2569/5237] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:01:00 2022] POST /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:01:00.749716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:00.755400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:00.783222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.790286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.791067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.792295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:00.793012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:00.793725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:00.919820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:00.933777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:00.957500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:00.968353 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85b5fea2-a601-4dde-b305-90ce0390c6a1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.896967 Oct 12 23:01:00.968353 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2669/5238] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:00 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:00.993305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:00.995165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:01.009794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.028507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.029325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.029578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:01.031017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.031697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.032325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.043043 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0aebed44-d6a1-4729-94e4-56078be22a35 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 200 len: 1479 microversion: 2.1 time: 0.315249 Oct 12 23:01:01.061334 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2570/5239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:00 2022] GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 1479 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:01.076656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c5635cdd-8758-4421-9bcd-fc64d437119d req-9a99aaeb-5a9e-4d28-9dfb-070aeeb4f940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b34a38-c58d-42c0-a992-e4a1ee820eb0", "tag": "7283bdc3-025f-4e97-9a34-9cba12a31575"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:01.113276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5635cdd-8758-4421-9bcd-fc64d437119d req-9a99aaeb-5a9e-4d28-9dfb-070aeeb4f940 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:01.128156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5635cdd-8758-4421-9bcd-fc64d437119d req-9a99aaeb-5a9e-4d28-9dfb-070aeeb4f940 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:01.128685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5635cdd-8758-4421-9bcd-fc64d437119d req-9a99aaeb-5a9e-4d28-9dfb-070aeeb4f940 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:01.157144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c5635cdd-8758-4421-9bcd-fc64d437119d req-9a99aaeb-5a9e-4d28-9dfb-070aeeb4f940 service nova] Creating event network-changed:7283bdc3-025f-4e97-9a34-9cba12a31575 for instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 on n-h1-860864-8 Oct 12 23:01:01.176783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c5635cdd-8758-4421-9bcd-fc64d437119d req-9a99aaeb-5a9e-4d28-9dfb-070aeeb4f940 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111610 Oct 12 23:01:01.178048 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2571/5240] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:01.398362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:01.429740 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47d355f7-91c3-492d-8a1a-23484a44b3d7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1507 microversion: 2.1 time: 0.463374 Oct 12 23:01:01.434627 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2670/5241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:00 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:01.996365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:01.997111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:02.013341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.014151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.015279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.016128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.016796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.017240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.091935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.094074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:02.106456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.122577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.123318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.124309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.133350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.135142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.183111 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] HTTP exception thrown: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 HTTP/1.1 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '08c66eda-b61a-448d-a27b-81439b928426'} Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.186069 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:02.191387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.192977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 404 to user: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:02.194023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b84a08a9-6cde-487c-a3e7-62116e2d1c4a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 404 len: 111 microversion: 2.1 time: 0.106852 Oct 12 23:01:02.195156 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2671/5242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:02.206027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.209833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.222526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.227578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.229635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.231144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4bb31173-41e5-48f4-b432-9eba4a41dfc1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.239732 Oct 12 23:01:02.232531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:02.247915 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2572/5243] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:01 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:02.248131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.248131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.248131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.248131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.248131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.248131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.372431 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b35d60a4-4d23-4d12-877b-56cb1b760904 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.172630 Oct 12 23:01:02.373395 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2672/5244] 10.222.0.20 () {58 vars in 1230 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 23:01:02.414037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6373f23e-64a7-4cef-b2ba-38ef9f6aaea9 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6373f23e-64a7-4cef-b2ba-38ef9f6aaea9 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: action_args: {} Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 23:01:02.422348 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6373f23e-64a7-4cef-b2ba-38ef9f6aaea9 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6373f23e-64a7-4cef-b2ba-38ef9f6aaea9 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026029 Oct 12 23:01:02.426595 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2573/5245] 10.222.0.20 () {58 vars in 1182 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:01:02.434964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.439823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.440532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:02.448964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.449642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.450459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.451442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.452472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.452907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.461834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.462955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:02.473187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.474635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.475325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.476312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.477147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.478024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.498293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:01:02.535473 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6b3495b-0c02-495a-976c-beebb2e1d699 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.104142 Oct 12 23:01:02.536864 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2673/5246] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers => generated 681 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:02.548408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.553751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.554448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.compute.servers [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Removing options 'limit' from query {{(pid=120542) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 23:01:02.555399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:02.561023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.561770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.562382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.563296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.564104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.565463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.594761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:01:02.632774 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78814af3-77ba-453d-8a07-3196ebf2cc34 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.087062 Oct 12 23:01:02.634238 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2674/5247] 10.222.0.20 () {58 vars in 1144 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:02.648255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15a5ab22-d64e-4258-8eb7-a63539fed0dd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15a5ab22-d64e-4258-8eb7-a63539fed0dd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi '-1' Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 23:01:02.652797 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.657820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15a5ab22-d64e-4258-8eb7-a63539fed0dd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:02.659147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.659259 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-15a5ab22-d64e-4258-8eb7-a63539fed0dd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010256 Oct 12 23:01:02.659259 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2675/5248] 10.222.0.20 () {58 vars in 1142 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 23:01:02.664359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b91b382e-8457-4466-9091-696370fbfcfd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b91b382e-8457-4466-9091-696370fbfcfd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: action_args: {} Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'testing' Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 23:01:02.668843 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 23:01:02.673586 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:02.674472 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3f8dfb2-8057-4636-8d81-21410c36c36c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1487 microversion: 2.1 time: 0.210784 Oct 12 23:01:02.674559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b91b382e-8457-4466-9091-696370fbfcfd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:02.674641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2574/5249] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1487 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:02.674726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b91b382e-8457-4466-9091-696370fbfcfd tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010084 Oct 12 23:01:02.674726 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2676/5250] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:01:02.682477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-499c5d56-8de8-4ddd-bd24-99d3b6c26ab5 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.688900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-499c5d56-8de8-4ddd-bd24-99d3b6c26ab5 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.689944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-499c5d56-8de8-4ddd-bd24-99d3b6c26ab5 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:02.694275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:02.695057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:02.696865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.servers [None req-499c5d56-8de8-4ddd-bd24-99d3b6c26ab5 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Flavor 'non_existing_flavor' could not be found {{(pid=120543) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 12 23:01:02.698475 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-499c5d56-8de8-4ddd-bd24-99d3b6c26ab5 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.020036 Oct 12 23:01:02.701599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.702859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.703466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.704497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.705112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.705697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.707347 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2575/5251] 10.222.0.20 () {58 vars in 1178 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:01:02.715252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.720587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.721374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:02.731979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lazy-loading 'flavor' on Instance uuid 283daca0-928d-42b0-8c90-5ad9f7139753 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:02.732221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.732798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.733525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.734368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.734922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.735659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.827773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bacb68a4-c2db-4827-8f1f-484a3113d0e4 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.116969 Oct 12 23:01:02.828567 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2576/5252] 10.222.0.20 () {58 vars in 1174 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 23:01:02.840347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.846912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.847585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:02.853360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.853843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.854278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.855002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.855450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.856585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.938623 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35e9d53a-e638-4dcc-8c7c-3e3af7b7ed5a tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.101879 Oct 12 23:01:02.939216 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2577/5253] 10.222.0.20 () {58 vars in 1184 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 23:01:02.951440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.957128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:02.958112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:02.963737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.965106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.965701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.966038 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9363c486-29e1-4774-86d9-abe530a6953a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753/action" status: 202 len: 0 microversion: 2.1 time: 0.276640 Oct 12 23:01:02.966857 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2677/5254] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:01:02 2022] POST /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:01:02.967248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:02.968463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:02.969057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:02.997233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:02.998003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:03.011837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:01:03.020777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.021874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.021874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.022800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.024251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.032658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.073885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.082723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.083207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.094443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.240166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.249759 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b8d24b9-9196-4c97-8ebc-6d5b79a123cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1493 microversion: 2.1 time: 0.267618 Oct 12 23:01:03.250575 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2678/5255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1493 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:03.257781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8b5c5a2f-b157-4ce5-a496-116c59af236c req-f1ac7ebd-4e11-4e16-97af-4f6cfb0645e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c66eda-b61a-448d-a27b-81439b928426", "name": "network-vif-deleted", "tag": "ea471db4-59d2-4ba3-a1a6-099d4943ec02"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:03.269260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8b5c5a2f-b157-4ce5-a496-116c59af236c req-f1ac7ebd-4e11-4e16-97af-4f6cfb0645e9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.269934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8b5c5a2f-b157-4ce5-a496-116c59af236c req-f1ac7ebd-4e11-4e16-97af-4f6cfb0645e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.270445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8b5c5a2f-b157-4ce5-a496-116c59af236c req-f1ac7ebd-4e11-4e16-97af-4f6cfb0645e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.282914 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8b5c5a2f-b157-4ce5-a496-116c59af236c req-f1ac7ebd-4e11-4e16-97af-4f6cfb0645e9 service nova] Creating event network-vif-deleted:ea471db4-59d2-4ba3-a1a6-099d4943ec02 for instance 08c66eda-b61a-448d-a27b-81439b928426 on n-h2-860864-8 Oct 12 23:01:03.288265 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8b5c5a2f-b157-4ce5-a496-116c59af236c req-f1ac7ebd-4e11-4e16-97af-4f6cfb0645e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036097 Oct 12 23:01:03.289126 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2679/5256] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:03.295508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:03.296495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:03.303131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.303980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.304650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.305484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.306033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.306550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.349532 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-905703bf-b1a5-451a-b5cd-b317d76f338f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.401758 Oct 12 23:01:03.351128 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2578/5257] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 23:01:02 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:03.379287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b6fe8e83-e983-4dd9-8425-457c9352a51e tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:03.385732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6fe8e83-e983-4dd9-8425-457c9352a51e tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.387773 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b6fe8e83-e983-4dd9-8425-457c9352a51e tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012450 Oct 12 23:01:03.388542 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2579/5258] 10.222.0.20 () {58 vars in 1178 bytes} [Wed Oct 12 23:01:03 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 23:01:03.419285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:03.441063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.443679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Searching by: {'deleted': False, 'project_id': '7d70a588a44b41ee9c73d01daa0df970'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:01:03.463765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.467369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.467857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.470750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.471425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.471855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.520120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:01:03.578403 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd84be7a-af21-4030-91c2-ffff79292525 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.169173 Oct 12 23:01:03.579457 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2580/5259] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 23:01:03 2022] GET /compute/v2.1/servers => generated 681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:03.583955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.593156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:03.593932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:03.598566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.600352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.600718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:03.600920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.601202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.601904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.602357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.602784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.603359 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f263092-029a-4c42-8bdf-0647f53e3442 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.312704 Oct 12 23:01:03.604705 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2680/5260] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:03 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:03.617530 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] HTTP exception thrown: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 HTTP/1.1 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '08c66eda-b61a-448d-a27b-81439b928426'} Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:03.619097 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 404 to user: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:03.623053 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f445be7f-1e11-4a9e-ae53-fc9528365245 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "DELETE /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 404 len: 111 microversion: 2.1 time: 0.032589 Oct 12 23:01:03.625541 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2581/5261] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:03 2022] DELETE /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:01:03.632185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:03.632703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:03.639038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.640441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.640889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.641623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.642083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.642514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.674642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:03.681878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:03.781889 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a7ff94f1-0045-4015-893e-4ebc1ba07fe1 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 204 len: 0 microversion: 2.1 time: 0.154671 Oct 12 23:01:03.785827 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2681/5262] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:03 2022] DELETE /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:03.796484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:03.797314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:03.809129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.810127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.811691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.813588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:03.814048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:03.814476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:03.861137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:03.985179 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc06b4e6-ee72-44e4-ae58-2d83ce62bce8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 204 len: 0 microversion: 2.1 time: 0.194219 Oct 12 23:01:03.985840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2582/5263] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:03 2022] DELETE /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:03.994460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:03.995262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 08c66eda-b61a-448d-a27b-81439b928426] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:04.002554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.003055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.003506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.004246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.004725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.005257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.020559 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] HTTP exception thrown: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 HTTP/1.1 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '08c66eda-b61a-448d-a27b-81439b928426'} Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:04.022439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 404 to user: Instance 08c66eda-b61a-448d-a27b-81439b928426 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:04.026984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a75d5bd-e79f-45ca-9be1-3911aa4d3826 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426" status: 404 len: 111 microversion: 2.1 time: 0.033786 Oct 12 23:01:04.027885 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2682/5264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:03 2022] GET /compute/v2.1/servers/08c66eda-b61a-448d-a27b-81439b928426 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:04.034586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:04.035360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:04.044228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.044845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.045901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.046708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.047233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.047661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.210837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:04.222023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62e84ae4-0ae5-431c-86f6-3e05286c9eaa tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 200 len: 1520 microversion: 2.1 time: 0.192410 Oct 12 23:01:04.223518 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2583/5265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:04 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:04.276157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:04.276845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:04.284353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.284848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.285297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.286006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.286468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.286905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.461242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:04.471123 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8a50b33e-ff45-4e06-b44b-5175b2a4bb56 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1514 microversion: 2.1 time: 0.198970 Oct 12 23:01:04.471719 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2683/5266] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:04 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:04.637021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:04.643355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:04.649422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.650166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.650608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.651549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:04.652015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:04.652439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:04.823015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:04.835039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:04.836725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:04.838179 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b5bb6d7-e399-4d1f-8977-d46a2563f3e6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.205645 Oct 12 23:01:04.838877 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2584/5267] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:04 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:05.246308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:05.247002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:05.253354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.253798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.254261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:05.254985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.255455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.255925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:05.394763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:05.403409 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c228b3d1-5547-4e9e-97a1-9f0450cc71ec tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 200 len: 1520 microversion: 2.1 time: 0.160870 Oct 12 23:01:05.409069 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2684/5268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:05 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:05.496706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:05.497231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:05.503526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.504053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.504493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:05.505194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.505646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.506125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:05.671193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:05.679537 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-794d6a26-e8fe-426c-8758-4ebd7dd86ad3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1514 microversion: 2.1 time: 0.186997 Oct 12 23:01:05.680549 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2585/5269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:05 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:05.865993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:05.866755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:05.876446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.877234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.877899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:05.879881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:05.880731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:05.881566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.138358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:06.153250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:06.155519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:06.157210 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4212dc5-8126-4d5e-80f3-1f0a5de12869 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.295441 Oct 12 23:01:06.173967 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2685/5270] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:05 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:06.373080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c7a8233a-1306-40c8-b7f7-17d52825b9b9 req-4867a41c-5112-4bdb-af60-4a56cb13569a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2699c238-f1ba-475a-a2b2-c7c656571d20", "name": "network-vif-deleted", "tag": "43f89b97-59a9-4f2b-8e37-76fb4ad9c8c4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:06.421969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7a8233a-1306-40c8-b7f7-17d52825b9b9 req-4867a41c-5112-4bdb-af60-4a56cb13569a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.421969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7a8233a-1306-40c8-b7f7-17d52825b9b9 req-4867a41c-5112-4bdb-af60-4a56cb13569a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.421969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7a8233a-1306-40c8-b7f7-17d52825b9b9 req-4867a41c-5112-4bdb-af60-4a56cb13569a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.427608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:06.428493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:06.442825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.445161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.445643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.447521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.448665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.449366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.453092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:06.528463 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c7a8233a-1306-40c8-b7f7-17d52825b9b9 req-4867a41c-5112-4bdb-af60-4a56cb13569a service nova] Creating event network-vif-deleted:43f89b97-59a9-4f2b-8e37-76fb4ad9c8c4 for instance 2699c238-f1ba-475a-a2b2-c7c656571d20 on n-h2-860864-8 Oct 12 23:01:06.555861 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c7a8233a-1306-40c8-b7f7-17d52825b9b9 req-4867a41c-5112-4bdb-af60-4a56cb13569a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196460 Oct 12 23:01:06.562786 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2586/5271] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:06.705916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:06.706726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:06.714771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:06.742817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.745820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.746533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.748890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.749556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.750158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.755400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:06.768296 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4baf99e1-37ce-4c90-b8f4-349b1244d326 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 200 len: 1520 microversion: 2.1 time: 0.344857 Oct 12 23:01:06.777598 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2686/5272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:06 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:06.895162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2b1f3270-88e1-48d3-994e-b0d0a42a958b req-41b6dbec-46ae-403d-a4d0-455321b2f105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283daca0-928d-42b0-8c90-5ad9f7139753", "name": "network-vif-plugged", "status": "completed", "tag": "5b81b377-0cbe-4aff-94c6-a691ebacb822"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:06.912551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2b1f3270-88e1-48d3-994e-b0d0a42a958b req-41b6dbec-46ae-403d-a4d0-455321b2f105 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:06.915322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2b1f3270-88e1-48d3-994e-b0d0a42a958b req-41b6dbec-46ae-403d-a4d0-455321b2f105 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:06.916245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2b1f3270-88e1-48d3-994e-b0d0a42a958b req-41b6dbec-46ae-403d-a4d0-455321b2f105 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:06.934539 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2b1f3270-88e1-48d3-994e-b0d0a42a958b req-41b6dbec-46ae-403d-a4d0-455321b2f105 service nova] Creating event network-vif-plugged:5b81b377-0cbe-4aff-94c6-a691ebacb822 for instance 283daca0-928d-42b0-8c90-5ad9f7139753 on n-h2-860864-8 Oct 12 23:01:06.940197 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2b1f3270-88e1-48d3-994e-b0d0a42a958b req-41b6dbec-46ae-403d-a4d0-455321b2f105 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050675 Oct 12 23:01:06.941230 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2687/5273] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:07.052188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:07.075345 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32425dd4-5daa-49ff-bdb4-a02e7cf145d2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.374824 Oct 12 23:01:07.094406 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2587/5274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:06 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:07.191087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:07.191817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:07.208747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:07.209260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:07.209720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:07.210454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:07.210924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:07.211367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:07.353862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:07.364819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:07.367134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:07.367585 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf398962-33ba-4463-94e0-78c2fc58abbd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.182796 Oct 12 23:01:07.368643 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2688/5275] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:07 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:07.794319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:07.796762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:07.805618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:07.806431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:07.807094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:07.808063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:07.808732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:07.809373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:07.977816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:07.986963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-672607fc-a4a8-4745-8c2d-34562ffae8cb tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 200 len: 1520 microversion: 2.1 time: 0.196954 Oct 12 23:01:07.989223 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2588/5276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:07 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:08.106686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:08.107323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:08.114745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:08.115550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:08.116145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:08.116958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:08.117649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:08.118309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:08.285854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:08.294907 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-423bc299-2353-42f8-aaca-432c2844fc62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.191737 Oct 12 23:01:08.312464 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2689/5277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:08 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:08.399140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:08.400122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:08.410275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:08.411236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:08.411917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:08.413082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:08.413759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:08.414472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:08.964946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:08.981791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:08.983706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:08.985409 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-789a5961-6954-4eb3-8cfb-2426bf9d26a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.590451 Oct 12 23:01:09.000273 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2589/5278] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:08 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:09.017568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:09.018566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:09.024979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.025894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.026569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:09.027493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.028253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.028932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:09.207139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:09.220717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b036dbe-a98e-44c1-9e0a-302144ce4662 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 200 len: 1520 microversion: 2.1 time: 0.204871 Oct 12 23:01:09.221915 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2690/5279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:09 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:09.323775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:09.324425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:09.334118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.336901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.339551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:09.340578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.343958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.344639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:09.607653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2e825488-f4a6-4f0c-a491-0c93d0f8e238 req-dae174da-db40-479b-9584-a44376d533e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6953f55-12b2-4f7c-90d3-29c460273e85", "name": "network-vif-deleted", "tag": "6cc976b9-c87d-4689-8a24-2b0cec2b0c24"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:09.640394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2e825488-f4a6-4f0c-a491-0c93d0f8e238 req-dae174da-db40-479b-9584-a44376d533e4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:09.646150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2e825488-f4a6-4f0c-a491-0c93d0f8e238 req-dae174da-db40-479b-9584-a44376d533e4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:09.651085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2e825488-f4a6-4f0c-a491-0c93d0f8e238 req-dae174da-db40-479b-9584-a44376d533e4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:09.719083 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2e825488-f4a6-4f0c-a491-0c93d0f8e238 req-dae174da-db40-479b-9584-a44376d533e4 service nova] Creating event network-vif-deleted:6cc976b9-c87d-4689-8a24-2b0cec2b0c24 for instance f6953f55-12b2-4f7c-90d3-29c460273e85 on n-h1-860864-8 Oct 12 23:01:09.747097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2e825488-f4a6-4f0c-a491-0c93d0f8e238 req-dae174da-db40-479b-9584-a44376d533e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143309 Oct 12 23:01:09.751363 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2691/5280] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:09.777373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:09.786339 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae40c303-13c7-4b4d-8c07-84e6ed8d9af4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.471512 Oct 12 23:01:09.792082 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2590/5281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:09 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:10.012351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:10.013022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:10.022194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:10.032796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:10.033278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:10.034137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:10.034605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:10.035067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:10.248916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:10.250645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:10.266610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:10.267345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:10.280567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:10.281591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:10.282227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:10.282560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:10.283411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:10.295207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:10.305299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:10.306856 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ad6d243-2e1a-4487-bbc6-3b250551f8cf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.299266 Oct 12 23:01:10.315599 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2692/5282] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:10 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:10.327514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:10.330603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:10.331339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:10.332063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lazy-loading 'fault' on Instance uuid f6953f55-12b2-4f7c-90d3-29c460273e85 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:10.388604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eccd22f3e6ce434dbfa7351a023c67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d70a588a44b41ee9c73d01daa0df970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:10.399307 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30bb51d1-a7a8-45e1-9d17-f9ff35a742a8 tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 200 len: 1312 microversion: 2.1 time: 0.154864 Oct 12 23:01:10.400435 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2591/5283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:10 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:10.818609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:10.819590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:10.832933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:10.839424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:10.840278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:10.841242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:10.842496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:10.845670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.036845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:11.045445 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8a076a1-251c-4d50-a2af-e901de3b1f75 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.230956 Oct 12 23:01:11.046591 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2693/5284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:10 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:11.339856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:11.343044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:11.351728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.352576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.355121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.356193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.356847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.359822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.425191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:11.426597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: f6953f55-12b2-4f7c-90d3-29c460273e85] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:11.434067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.434860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.436232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.437210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.437888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.438538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.460942 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] HTTP exception thrown: Instance f6953f55-12b2-4f7c-90d3-29c460273e85 could not be found. Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 HTTP/1.1 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance f6953f55-12b2-4f7c-90d3-29c460273e85 could not be found. Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f6953f55-12b2-4f7c-90d3-29c460273e85'} Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6953f55-12b2-4f7c-90d3-29c460273e85 could not be found. Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6953f55-12b2-4f7c-90d3-29c460273e85 could not be found. Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.463645 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6953f55-12b2-4f7c-90d3-29c460273e85 could not be found. Oct 12 23:01:11.469409 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.472043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 404 to user: Instance f6953f55-12b2-4f7c-90d3-29c460273e85 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:11.473598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14b8db97-0edd-4877-bfe2-85615d719d9b tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85" status: 404 len: 111 microversion: 2.1 time: 0.053037 Oct 12 23:01:11.479603 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2694/5285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:11 2022] GET /compute/v2.1/servers/f6953f55-12b2-4f7c-90d3-29c460273e85 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:11.485898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:11.486753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] [instance: 2699c238-f1ba-475a-a2b2-c7c656571d20] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:11.493748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.494455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.494970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.495972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:11.496671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:11.497300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:11.529437 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] HTTP exception thrown: Instance 2699c238-f1ba-475a-a2b2-c7c656571d20 could not be found. Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Request method failure captured: Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 HTTP/1.1 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0cI23oxe4plHQCB4kPwi-oLy01ssXT1kJLWLq3Zcgkf5Qkb-hnalIPZbIfRLQ7QT53AbhX82oKrbkp8aaz5jxEflCem7Xp5u1kD1k58N62FyUrcAdN3tftYFZKPcclCKr59ouiZWldeF4LIo8aZJsO_CpLTW1UTG3cjdtEqdnBQ9lc Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d70a588a44b41ee9c73d01daa0df970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d70a588a44b41ee9c73d01daa0df970"}]}] Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 7d70a588a44b41ee9c73d01daa0df970 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-997509246 Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: eccd22f3e6ce434dbfa7351a023c67bb Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ListServersNegativeTestJSON-997509246-project Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 2699c238-f1ba-475a-a2b2-c7c656571d20 could not be found. Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2699c238-f1ba-475a-a2b2-c7c656571d20'} Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2699c238-f1ba-475a-a2b2-c7c656571d20 could not be found. Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2699c238-f1ba-475a-a2b2-c7c656571d20 could not be found. Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.536565 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2699c238-f1ba-475a-a2b2-c7c656571d20 could not be found. Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] Returning 404 to user: Instance 2699c238-f1ba-475a-a2b2-c7c656571d20 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4660522f-2ff2-4d27-b296-eb5fa167f16f tempest-ListServersNegativeTestJSON-997509246 tempest-ListServersNegativeTestJSON-997509246-project] 10.222.0.20 "GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20" status: 404 len: 111 microversion: 2.1 time: 0.060221 Oct 12 23:01:11.542387 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2695/5286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:11 2022] GET /compute/v2.1/servers/2699c238-f1ba-475a-a2b2-c7c656571d20 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:11.575288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:11.585169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:11.586905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:11.588133 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-07c6e45a-fff7-4fdc-aa1f-c1d14480722c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.257002 Oct 12 23:01:11.600650 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2592/5287] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:11 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:12.070037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:12.070882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:12.078295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:12.079075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:12.079690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:12.080682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:12.081377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:12.082040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:12.576214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:12.579727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:12.588250 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5f37da3-2c3c-4d24-a9a0-9fd22ebd3625 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.522085 Oct 12 23:01:12.590548 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2696/5288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:12 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:12.618846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:12.619730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:12.636202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:12.638147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:12.639232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:12.642339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:12.643031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:12.651550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:12.844241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:12.854230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:12.856101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:12.858079 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54e559e7-21e8-4c06-aa78-42a01ad5ac86 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.242723 Oct 12 23:01:12.859177 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2593/5289] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:12 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:13.642164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:13.644366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:13.661314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:13.662220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:13.662903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:13.663864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:13.667223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:13.668832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:13.887475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:13.888916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:13.897513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:13.900082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:13.903186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:13.903686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:13.904722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:13.908139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:13.908995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:13.909604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:14.006317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:14.017148 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3459855d-fed2-4ad4-95fe-3c8616c5ddbf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.382204 Oct 12 23:01:14.020914 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2697/5290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:13 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:14.135563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:14.156728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:14.158460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:14.160344 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1fcdf3f-a3b2-4443-b6c1-8f30bf531ef7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.277466 Oct 12 23:01:14.161460 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2594/5291] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:13 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:15.055921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:15.058796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:15.070497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:15.071105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:15.071598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:15.072848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:15.073407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:15.073921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:15.186643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:15.187337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:15.194936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:15.195766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:15.196456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:15.197398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:15.198074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:15.198716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:15.389615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:15.399667 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57d16b5f-0fb6-4cba-88a9-f31e578e6870 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.356897 Oct 12 23:01:15.417065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2698/5292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:15 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:15.489588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:15.502503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:15.504735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:15.506197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e89398d6-cdda-470e-9099-267ccf6e1da4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.323566 Oct 12 23:01:15.507447 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2595/5293] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:15 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:16.442642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:16.443839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:16.470513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:16.471418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:16.502409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:16.508213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:16.509025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:16.509681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:16.538719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:16.540004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:16.550765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:16.551548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:16.552161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:16.553109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:16.553721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:16.555130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:16.926707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:16.944534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:16.944534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:16.944534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c3980cb-7fcb-42dc-8c94-d6f641135e71 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.408025 Oct 12 23:01:16.954875 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2596/5294] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:16 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:17.093847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:17.117963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35cbb899-89b1-459d-a891-a511b43eb320 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.680334 Oct 12 23:01:17.133569 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2699/5295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:16 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:17.987075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:17.988487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:17.996586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:17.997327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:17.998630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:17.999863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:18.001716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:18.002501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:18.088049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-38864379-948d-4da5-8346-cd243ce1591a req-baab73f7-aade-4207-b9ce-9fe1c9d5aabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "name": "network-vif-plugged", "status": "completed", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:18.121727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-38864379-948d-4da5-8346-cd243ce1591a req-baab73f7-aade-4207-b9ce-9fe1c9d5aabf service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:18.122302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-38864379-948d-4da5-8346-cd243ce1591a req-baab73f7-aade-4207-b9ce-9fe1c9d5aabf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:18.123326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-38864379-948d-4da5-8346-cd243ce1591a req-baab73f7-aade-4207-b9ce-9fe1c9d5aabf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:18.133547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:18.149719 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-38864379-948d-4da5-8346-cd243ce1591a req-baab73f7-aade-4207-b9ce-9fe1c9d5aabf service nova] Creating event network-vif-plugged:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h1-860864-8 Oct 12 23:01:18.158370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-38864379-948d-4da5-8346-cd243ce1591a req-baab73f7-aade-4207-b9ce-9fe1c9d5aabf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073198 Oct 12 23:01:18.159065 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2700/5296] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:18.165557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:18.166805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:18.178514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:18.179300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:18.180515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:18.183722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:18.185501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:18.187648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:18.222289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:18.239730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:18.249434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:18.250831 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac0fbabb-c9cc-4471-b74c-f1a1282fd315 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.268775 Oct 12 23:01:18.252071 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2597/5297] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:17 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:18.434595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:18.454869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5a120cf-5072-45da-9534-f8543eed4b6e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.293204 Oct 12 23:01:18.456526 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2701/5298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:18 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:19.295136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:19.295820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:19.312297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:19.316939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:19.317648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:19.318559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:19.319171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:19.319749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:19.488552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:19.490193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:19.502754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:19.503272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:19.503804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:19.504546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:19.515964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:19.515964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:19.529880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:19.546956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:19.548543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:19.549777 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ea4ac07-a62e-43bc-8ae0-0ad0e7fab079 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.268647 Oct 12 23:01:19.554281 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2598/5299] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:19 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:19.747067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:19.757030 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1de42db-363f-4da2-a2a9-e913f5aa5ac9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.273510 Oct 12 23:01:19.776271 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2702/5300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:19 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:20.589972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:20.594301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:20.610830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:20.619189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:20.625018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:20.626065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:20.626820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:20.628779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:20.787715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:20.788558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:20.808105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:20.809650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:20.810912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:20.813500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:20.814328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:20.815206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:20.878902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:20.900837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:20.906108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:20.910395 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7159d77c-9b98-4f58-b195-679b8a3c3484 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1808 microversion: 2.20 time: 0.325533 Oct 12 23:01:20.913952 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2599/5301] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:20 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1808 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:01:21.133469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:21.136236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:21.145617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.146424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.147046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.148036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.148646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.149225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.196568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6e63ce3-0218-486b-8411-c16cb48bb12e tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068017 Oct 12 23:01:21.198229 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2600/5302] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:01:21 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:01:21.243024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:21.266425 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3813c2b3-529f-4328-a122-646b3e0517c4 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1509 microversion: 2.1 time: 0.484393 Oct 12 23:01:21.267317 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2703/5303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:20 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:21.271056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:21.271613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:21.280320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.281159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.281836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.283004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.283759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.284431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.321856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:21.397092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:21.438613 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f06f5686-47c3-4a1d-bfd1-95e4e1975902 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 204 len: 0 microversion: 2.1 time: 0.172027 Oct 12 23:01:21.439835 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2601/5304] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:21 2022] DELETE /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:01:21.450312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:21.451992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:21.460401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.461551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.462374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.463475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.464418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.465218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.948617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:21.950049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:21.959955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.960708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.961314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:21.962368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:21.963081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:21.963657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.106335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.118803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2cd88507-3fa0-4328-bbbd-ecf093da7931 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1674 microversion: 2.1 time: 0.674292 Oct 12 23:01:22.121099 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2704/5305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:21 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1674 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:22.129381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.141542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.143787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.145526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c0154b09-9612-4bb8-be7b-fd8df56e0fd1 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1795 microversion: 2.20 time: 0.207119 Oct 12 23:01:22.146572 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2602/5306] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:21 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1795 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:01:22.292548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:22.293359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:22.301092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.301590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.302041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.302942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:22.303497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:22.304105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:22.674052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:22.688808 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea9904d3-b025-4821-8db4-802decbbbf43 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1506 microversion: 2.1 time: 0.400370 Oct 12 23:01:22.701308 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2705/5307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:22 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:23.143774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:23.144582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:23.151655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:23.152732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:23.153416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:23.154480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:23.155141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:23.156036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:23.349009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:23.358470 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-07013f7e-b8d6-4e03-b50d-1ff55bf613a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1674 microversion: 2.1 time: 0.219082 Oct 12 23:01:23.371498 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2603/5308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:23 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:23.719592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:23.721794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:23.739047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:23.739617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:23.740137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:23.745105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:23.746155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:23.748567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:24.007714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:24.021821 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3121e159-b82b-4596-abea-35d785875b33 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1506 microversion: 2.1 time: 0.306592 Oct 12 23:01:24.023041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2706/5309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:23 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:24.386304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:24.388420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:24.401069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:24.406299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:24.406975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:24.408505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:24.409315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:24.411209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:24.660467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:24.671648 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-07cbb950-f8e4-4847-b96c-85c1460be6bb tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1606 microversion: 2.1 time: 0.290515 Oct 12 23:01:24.672295 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2604/5310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:24 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1606 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:25.053782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:25.054427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:25.069818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.072433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.086197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.099807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.100544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.101173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.207148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-557350fd-a66e-4721-873e-b82d7837c9fb req-b4670100-7ea5-45ae-9892-0a17d35e01b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283daca0-928d-42b0-8c90-5ad9f7139753", "name": "network-vif-unplugged", "status": "completed", "tag": "5b81b377-0cbe-4aff-94c6-a691ebacb822"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:25.233580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-557350fd-a66e-4721-873e-b82d7837c9fb req-b4670100-7ea5-45ae-9892-0a17d35e01b0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.234105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-557350fd-a66e-4721-873e-b82d7837c9fb req-b4670100-7ea5-45ae-9892-0a17d35e01b0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.234536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-557350fd-a66e-4721-873e-b82d7837c9fb req-b4670100-7ea5-45ae-9892-0a17d35e01b0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.271395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.server_external_events [req-557350fd-a66e-4721-873e-b82d7837c9fb req-b4670100-7ea5-45ae-9892-0a17d35e01b0 service nova] Unable to find a host for instance 283daca0-928d-42b0-8c90-5ad9f7139753. Dropping event network-vif-unplugged {{(pid=120543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 23:01:25.276209 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-557350fd-a66e-4721-873e-b82d7837c9fb req-b4670100-7ea5-45ae-9892-0a17d35e01b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.073199 Oct 12 23:01:25.284372 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2605/5311] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 23:01:25.578716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:25.593356 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e67f5696-6cd4-4309-b53b-11997649066e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 200 len: 1449 microversion: 2.1 time: 0.547535 Oct 12 23:01:25.595208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2707/5312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:25 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 1449 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:25.622988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:25.623964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:25.635347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:25.639534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.642690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.643356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.648543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.649214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.650482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.674206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6fde9656-b189-4c63-9637-9f26c24e2284 req-ffc77885-f3e5-4bba-b5b1-daa4523c318f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df8e9d9-29a8-46d7-9df4-cfcdaceaf167", "name": "network-vif-deleted", "tag": "53e47db0-d2df-4fa1-a717-4902bcc4abfc"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:25.704932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6fde9656-b189-4c63-9637-9f26c24e2284 req-ffc77885-f3e5-4bba-b5b1-daa4523c318f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.706411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6fde9656-b189-4c63-9637-9f26c24e2284 req-ffc77885-f3e5-4bba-b5b1-daa4523c318f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.708332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6fde9656-b189-4c63-9637-9f26c24e2284 req-ffc77885-f3e5-4bba-b5b1-daa4523c318f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.725229 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6fde9656-b189-4c63-9637-9f26c24e2284 req-ffc77885-f3e5-4bba-b5b1-daa4523c318f service nova] Creating event network-vif-deleted:53e47db0-d2df-4fa1-a717-4902bcc4abfc for instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 on n-h1-860864-8 Oct 12 23:01:25.732398 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6fde9656-b189-4c63-9637-9f26c24e2284 req-ffc77885-f3e5-4bba-b5b1-daa4523c318f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.408705 Oct 12 23:01:25.733991 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2606/5313] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:25.741680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:25.742816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:25.752186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.753111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.753873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.772622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.773353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.774932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.817114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:25.817629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:25.818101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:25.818618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lazy-loading 'fault' on Instance uuid 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:25.866508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:25.875664 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6231af7e-3e6f-4160-bf02-6242bd0521cd tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 200 len: 1328 microversion: 2.1 time: 0.140210 Oct 12 23:01:25.894089 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2607/5314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:25 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 1328 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:26.015171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:26.064977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96827950-fa81-42d9-b619-e9fe2f9000b2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.446211 Oct 12 23:01:26.065851 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2708/5315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:25 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:26.094498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:26.095400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:26.104153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:26.104944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:26.105597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:26.106525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:26.107790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:26.108462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:26.750677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:26.776116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12572b6e-c9a9-4673-8528-be49c1731967 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.686681 Oct 12 23:01:26.776947 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2608/5316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:26 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:26.799504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:26.800578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:26.808214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:26.808968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:26.809609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:26.811521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:26.812441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:26.813190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:26.945820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1650480407", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "efec0c63-de9e-4807-a66d-c47e18f69c79"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:27.019403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] validate_networks() for [('efec0c63-de9e-4807-a66d-c47e18f69c79', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:01:27.038671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:27.049493 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0ea5d11-07cb-4d2c-be82-a67e9aaf52a8 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.253648 Oct 12 23:01:27.064297 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2709/5317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:26 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:27.069847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:27.074786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:27.089116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.089636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.098389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.100799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.102168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.102794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.119556 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] HTTP exception thrown: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Request method failure captured: Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 HTTP/1.1 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Z9WGmlm91FejbP4P3Wz7eNhvalElqdvyffB_g9yNupHRr1WnJIYsgCSTocYGT_X0eqTlHAR-CUx0W776stv0vutMMSXBL-CIzuQALQbl0RYHMJ1047nl1facYEfND1_cN491dmpRBvlDUYAxDtVJHeX-8ghxMny_Zj0tZeLr_KLt8 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}] Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7e4d226b490c4451a6b7653a7cdb3737 Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4df8e9d9-29a8-46d7-9df4-cfcdaceaf167'} Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:27.121951 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:27.126814 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:27.126814 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:27.126814 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:27.126814 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:27.126814 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:27.126814 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:01:27.126814 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:27.128702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Returning 404 to user: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:27.129748 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0021f5ec-b474-4894-9607-14a6a8754c9b tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 404 len: 111 microversion: 2.1 time: 0.064014 Oct 12 23:01:27.130707 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2710/5318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:27 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:27.135872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:27.136997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:27.145136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.145648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.146096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.147079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.147768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.148461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.361039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:27.369629 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf24865a-bcb1-4f4f-b19e-de00006a78cd tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.237535 Oct 12 23:01:27.370799 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2711/5319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:27 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:27.375656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92b2d378-2585-4065-bf96-df5366117192 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '.version_select at 0x7f44fe4d73a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:27.428529 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92b2d378-2585-4065-bf96-df5366117192 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441873395" status: 202 len: 0 microversion: 2.1 time: 0.056417 Oct 12 23:01:27.429369 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2712/5320] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 23:01:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441873395 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:01:27.441893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fbaf28a8-6724-4702-8d0d-536cc10f0baf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:27.449817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf28a8-6724-4702-8d0d-536cc10f0baf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.450378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf28a8-6724-4702-8d0d-536cc10f0baf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.450823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf28a8-6724-4702-8d0d-536cc10f0baf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.483715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fbaf28a8-6724-4702-8d0d-536cc10f0baf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 23:01:27.551238 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fbaf28a8-6724-4702-8d0d-536cc10f0baf tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.120223 Oct 12 23:01:27.551771 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2713/5321] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:01:27 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:01:27.561183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:27.562062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:27.563755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:01:27.564449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:01:27.565105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:01:27.565947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:01:27.566602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:01:27.568932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.569420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.569875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.570652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.571780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.572302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.616839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.617758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.619671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.624471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:27.626019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:27.626634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:27.664603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Getting quotas for project 5d0622cf75e54e849a893be146658857. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:01:27.685573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Getting quotas for user 1e9a0f4f8d754e6ea33a05145640ccf7 and project 5d0622cf75e54e849a893be146658857. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:01:27.729727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:01:27.732588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:01:27.819715 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-39e0194f-f910-4259-8124-70f310812717 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.978514 Oct 12 23:01:27.832099 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2609/5322] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 23:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 12 23:01:27.845933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aadc6690-29cf-4249-9c3d-71d719907dc4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:27.848528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aadc6690-29cf-4249-9c3d-71d719907dc4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:27.866135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:27.896532 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58b3b51e-6473-4a24-82a9-4ba6fc44f628 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.339923 Oct 12 23:01:27.897141 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2714/5323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:27 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:28.062325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aadc6690-29cf-4249-9c3d-71d719907dc4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:28.070430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aadc6690-29cf-4249-9c3d-71d719907dc4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:28.076105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aadc6690-29cf-4249-9c3d-71d719907dc4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:28.078034 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aadc6690-29cf-4249-9c3d-71d719907dc4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1262 microversion: 2.26 time: 0.240610 Oct 12 23:01:28.079868 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2610/5324] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:27 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1262 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:28.554368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37c2f20d-c31f-484c-b9df-b03a942eb883 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'create', calling method: .version_select at 0x7f44fedfa5e0>, body: {"keypair": {"name": "tempest-keypair-300799630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3NifSi23ZsIu3pNxNc5uKGQySmyZItLy2gtKrKx6lsiY2WyGJRksukMuE55C3v4x/zBqxczVvYcUGSfHbI+1eZya2lydO6eiqghmc2lAyK+8k/Sj6X42WTYPo74lVt+g=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:28.580112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-37c2f20d-c31f-484c-b9df-b03a942eb883 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:01:28.586424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-37c2f20d-c31f-484c-b9df-b03a942eb883 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for user 7e4d226b490c4451a6b7653a7cdb3737 and project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:01:28.616547 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37c2f20d-c31f-484c-b9df-b03a942eb883 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070288 Oct 12 23:01:28.617196 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2715/5325] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:01:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:28.922647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:28.923483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:28.931357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:28.931962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:28.932730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:28.933646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:28.934304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:28.935691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:29.114840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:29.115913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:29.130024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:29.131729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:29.132546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:29.133496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:29.134123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:29.135537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:29.156082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:29.191794 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7dea94a8-411f-4320-9a49-75b19959c574 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.272865 Oct 12 23:01:29.193668 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2611/5326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:28 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:29.355830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:29.366659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:29.371310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:29.375592 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44f8d0a3-901c-4885-8da0-d62d8117f2c9 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1314 microversion: 2.26 time: 0.271561 Oct 12 23:01:29.386485 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2716/5327] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:29 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:01:30.222898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:30.225412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:30.242430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:30.244827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:30.245774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:30.249983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:30.252869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:30.253713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:30.405057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:30.405763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:30.414957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:30.422509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:30.423234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:30.424231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:30.424873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:30.425480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:30.537925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:30.556253 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f729a4f4-5fcc-44ad-af5f-9d657e3ec4df tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.337119 Oct 12 23:01:30.556883 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2612/5328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:30 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:30.669500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1412742459", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85c32427-fba7-45cc-bd0a-09837c6f6d31"}], "security_groups": [{"name": "tempest-securitygroup--1510286263"}], "key_name": "tempest-keypair-300799630", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:30.733884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:30.753532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:30.772890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:30.774852 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a7a9d56c-1b1c-4e5a-ba42-a39aa1ba5a46 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1320 microversion: 2.26 time: 0.374132 Oct 12 23:01:30.788795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2717/5329] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:30 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:01:30.863724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] validate_networks() for [('85c32427-fba7-45cc-bd0a-09837c6f6d31', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:01:31.581905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:31.583021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:01:31.583449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:01:31.583941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:31.584065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:01:31.584483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:01:31.584938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:01:31.599683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:31.602652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:31.602806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:31.603532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:31.604041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:31.604675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:31.604891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:31.605369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:31.606469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:31.608354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:31.611346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:31.611530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:31.658415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:01:31.666422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Getting quotas for user 7e4d226b490c4451a6b7653a7cdb3737 and project 2a9b22748cb7457b94c17fe298e1b760. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:01:31.699568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:01:31.708312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:01:31.793085 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7ea14b9-7029-4f40-8498-089eae7b3eb9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.128202 Oct 12 23:01:31.797563 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2613/5330] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:01:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:01:31.806560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4155cfc0-b5c6-4374-b12d-34fe9c931da5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:31.808859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4155cfc0-b5c6-4374-b12d-34fe9c931da5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:31.902649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4155cfc0-b5c6-4374-b12d-34fe9c931da5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:31.910375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4155cfc0-b5c6-4374-b12d-34fe9c931da5 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1237 microversion: 2.1 time: 0.108189 Oct 12 23:01:31.910909 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2614/5331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:31 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:31.926515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:31.927244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:31.933370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:31.945789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:31.946233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:31.946685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:31.947409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:31.947924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:31.952416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.038382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:32.053641 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19e35b74-69f0-40c6-baa0-46f45c57959e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.476134 Oct 12 23:01:32.054342 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2718/5332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:31 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:32.261550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:32.277805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:32.287680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:32.289589 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ecf3be3a-595f-4c79-9c46-ea55bb4cfacc tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1362 microversion: 2.26 time: 0.377740 Oct 12 23:01:32.291179 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2615/5333] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:31 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:32.379696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-56ae1939-031e-4e92-bf43-655c137edce7 req-d33aca3c-3147-493a-bcc5-220b7bd97529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9713a7c5-c4fb-44d5-9006-64d8da755acf", "tag": "9b50c9e1-0eff-4943-9cf4-cf757988d1c7"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:32.400332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-56ae1939-031e-4e92-bf43-655c137edce7 req-d33aca3c-3147-493a-bcc5-220b7bd97529 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.400830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-56ae1939-031e-4e92-bf43-655c137edce7 req-d33aca3c-3147-493a-bcc5-220b7bd97529 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.401610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-56ae1939-031e-4e92-bf43-655c137edce7 req-d33aca3c-3147-493a-bcc5-220b7bd97529 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.408196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:32.429551 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-56ae1939-031e-4e92-bf43-655c137edce7 req-d33aca3c-3147-493a-bcc5-220b7bd97529 service nova] Creating event network-changed:9b50c9e1-0eff-4943-9cf4-cf757988d1c7 for instance 9713a7c5-c4fb-44d5-9006-64d8da755acf on n-h2-860864-8 Oct 12 23:01:32.443616 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-56ae1939-031e-4e92-bf43-655c137edce7 req-d33aca3c-3147-493a-bcc5-220b7bd97529 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067844 Oct 12 23:01:32.453246 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2719/5334] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:32.943086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:32.948426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:32.957369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.958288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.958936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:32.959859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:32.960533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:32.961145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.047199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:33.056722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d4ed6dae-4276-441e-a709-1c9270fd81d9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1289 microversion: 2.1 time: 0.121939 Oct 12 23:01:33.057808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2616/5335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:32 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:33.085109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:33.085975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:33.094489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.095068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.095594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.096411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.096974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.097476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.260480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:33.270226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe539a62-ec15-4bfc-bba3-381083d998be tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.191435 Oct 12 23:01:33.271155 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2720/5336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:33 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:33.320759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:33.321377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:33.328819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.329304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.329772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.330462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:33.330915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:33.331339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:33.510029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:33.521418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:33.527327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:33.528855 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9df5bc1c-1647-418d-ad23-b9fbae232d98 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1362 microversion: 2.26 time: 0.211802 Oct 12 23:01:33.531983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2617/5337] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:33 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:34.081430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:34.082178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:34.089278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:34.091005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:34.091699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:34.092505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:34.093169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:34.093801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:34.185521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:34.193361 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0223a2b8-175a-4daa-8b3d-514243a29529 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1295 microversion: 2.1 time: 0.115938 Oct 12 23:01:34.193943 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2721/5338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:34 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:34.295930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:34.297569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:34.305179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:34.306950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:34.307880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:34.309068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:34.309791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:34.310705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:34.544093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:34.553122 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d9cffc93-4448-4eae-9009-a9d9c8b1e86a tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.261991 Oct 12 23:01:34.553971 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2618/5339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:34 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:34.555598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:34.556249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:34.563328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:34.564130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:34.564778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:34.565703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:34.566619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:34.567326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:34.755885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:34.772548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:34.774161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:34.775333 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9cc18b7c-06b3-4e25-abd5-47f20cd2a259 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1362 microversion: 2.26 time: 0.223693 Oct 12 23:01:34.776229 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2722/5340] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:34 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:01:35.216800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:35.217667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:35.235520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:35.236038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:35.236658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:35.237563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:35.238019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:35.238452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:35.262978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-98000c3f-191f-4a22-8a62-81aced9e9a52 req-6a89b314-da91-49b0-9acb-6bdd13c1ee50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48", "tag": "fd3e2f53-ada2-43d4-ae8a-9b563fcdd394"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:35.281418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-98000c3f-191f-4a22-8a62-81aced9e9a52 req-6a89b314-da91-49b0-9acb-6bdd13c1ee50 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:35.282241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-98000c3f-191f-4a22-8a62-81aced9e9a52 req-6a89b314-da91-49b0-9acb-6bdd13c1ee50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:35.282936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-98000c3f-191f-4a22-8a62-81aced9e9a52 req-6a89b314-da91-49b0-9acb-6bdd13c1ee50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:35.297675 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-98000c3f-191f-4a22-8a62-81aced9e9a52 req-6a89b314-da91-49b0-9acb-6bdd13c1ee50 service nova] Creating event network-changed:fd3e2f53-ada2-43d4-ae8a-9b563fcdd394 for instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 on n-h1-860864-8 Oct 12 23:01:35.303777 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-98000c3f-191f-4a22-8a62-81aced9e9a52 req-6a89b314-da91-49b0-9acb-6bdd13c1ee50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049456 Oct 12 23:01:35.304781 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2723/5341] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:35.495513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:35.504873 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e8831d0a-3d51-4c04-a21d-e835976d58b3 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1363 microversion: 2.1 time: 0.292772 Oct 12 23:01:35.505930 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2619/5342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:35 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:35.579119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:35.580230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:35.589129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:35.589896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:35.591662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:35.592672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:35.593215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:35.593727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:35.759364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:35.769634 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3772a67-b454-46fc-821f-fbf894f783dc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.195848 Oct 12 23:01:35.770656 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2724/5343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:35 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:35.801862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:35.802753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:35.810046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:35.811048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:35.811956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:35.812855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:35.813477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:35.814086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:36.217558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:36.227088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:36.228875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:36.230400 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0262aba1-5fc8-4c34-8cad-2cb389b908c2 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1362 microversion: 2.26 time: 0.432917 Oct 12 23:01:36.230958 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2620/5344] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:35 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:36.531636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:36.532375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:36.539197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:36.539730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:36.540208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:36.540941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:36.541411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:36.541850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:36.677034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:36.684799 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd79eec2-3909-4d79-90b3-4eecb4ef2850 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1363 microversion: 2.1 time: 0.157279 Oct 12 23:01:36.685374 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2725/5345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:36 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:36.794223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:36.795032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:36.802636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:36.802636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:36.802636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:36.803693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:36.804381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:36.804893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:36.906573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3cfcf9f7-4b4f-4c2a-bdd7-8414ce5f7e1b req-35093045-89be-4371-a7b4-c294d8ec89e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713a7c5-c4fb-44d5-9006-64d8da755acf", "name": "network-vif-plugged", "status": "completed", "tag": "9b50c9e1-0eff-4943-9cf4-cf757988d1c7"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:36.925043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cfcf9f7-4b4f-4c2a-bdd7-8414ce5f7e1b req-35093045-89be-4371-a7b4-c294d8ec89e6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:36.929256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cfcf9f7-4b4f-4c2a-bdd7-8414ce5f7e1b req-35093045-89be-4371-a7b4-c294d8ec89e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:36.931138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3cfcf9f7-4b4f-4c2a-bdd7-8414ce5f7e1b req-35093045-89be-4371-a7b4-c294d8ec89e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:36.956341 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3cfcf9f7-4b4f-4c2a-bdd7-8414ce5f7e1b req-35093045-89be-4371-a7b4-c294d8ec89e6 service nova] Creating event network-vif-plugged:9b50c9e1-0eff-4943-9cf4-cf757988d1c7 for instance 9713a7c5-c4fb-44d5-9006-64d8da755acf on n-h2-860864-8 Oct 12 23:01:36.962135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3cfcf9f7-4b4f-4c2a-bdd7-8414ce5f7e1b req-35093045-89be-4371-a7b4-c294d8ec89e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059922 Oct 12 23:01:36.963225 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2726/5346] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:37.002625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:37.011715 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-019bf607-df03-41cf-adea-a080c997bb9f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1676 microversion: 2.1 time: 0.221303 Oct 12 23:01:37.012874 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2621/5347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:36 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:37.256995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:37.257714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:37.264798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:37.265298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:37.265743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:37.266453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:37.266916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:37.267347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:37.418815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:37.427360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:37.429040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:37.430183 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eca47a85-2e0a-4a5c-a443-6c24807e3d65 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1362 microversion: 2.26 time: 0.177557 Oct 12 23:01:37.430750 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2727/5348] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:37 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:01:37.706678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:37.707403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:37.714208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:37.714759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:37.715345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:37.716198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:37.716748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:37.717249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:37.733061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:37.850447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:37.859722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5369476a-a952-4a0b-b9ba-d8c1053ec023 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1363 microversion: 2.1 time: 0.157077 Oct 12 23:01:37.860451 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2622/5349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:37 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:38.037470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:38.038222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:38.046362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.046868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.047324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.048332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.048805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.049252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.214663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:38.224044 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19134d83-870c-44db-b5e5-a87949fd039c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1653 microversion: 2.1 time: 0.190269 Oct 12 23:01:38.224796 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2728/5350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:38 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1653 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:38.251029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1feac57a-18d0-40bf-b6b5-3b65e5c9b4bc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:38.258289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1feac57a-18d0-40bf-b6b5-3b65e5c9b4bc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.258791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1feac57a-18d0-40bf-b6b5-3b65e5c9b4bc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.259263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1feac57a-18d0-40bf-b6b5-3b65e5c9b4bc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.284790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1feac57a-18d0-40bf-b6b5-3b65e5c9b4bc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Going to try to start instance {{(pid=120543) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 23:01:38.326797 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1feac57a-18d0-40bf-b6b5-3b65e5c9b4bc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.080085 Oct 12 23:01:38.327400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2623/5351] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:01:38 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:01:38.335559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:38.336483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:38.343367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.344116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.344743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.345600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.346214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.346824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.459765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:38.461549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:38.472200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.473197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.473796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.474880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.475593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.476221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.525712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:38.535548 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c15c5654-a145-4962-9c68-dc9ec8d10ce2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1662 microversion: 2.1 time: 0.203809 Oct 12 23:01:38.536988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2729/5352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:38 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1662 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:38.726047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:38.734944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:38.736702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:38.737930 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a114bef0-7ec4-4bd8-90ba-fda32b5e3879 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1545 microversion: 2.26 time: 0.284738 Oct 12 23:01:38.746217 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2624/5353] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:38 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1545 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:38.767491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fec7aca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:38.775385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:38.779445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.779980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.780427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.780926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:38.787186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.787670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.788141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.788827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.789287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.789721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.819041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.819552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.820013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.837295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.837793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.838239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.869486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:38.884173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:38.885083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:38.891237 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61d78999-3ec8-47da-8963-ca435b9aea5c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-125258122" status: 201 len: 0 microversion: 2.26 time: 0.128776 Oct 12 23:01:38.894547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.895690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.896929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.897731 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2730/5354] 10.222.0.20 () {62 vars in 1377 bytes} [Wed Oct 12 23:01:38 2022] PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-125258122 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 23:01:38.898179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.899756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.900457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.903906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-642eb1f8-2332-422b-bed7-19bc1399a350 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fec7a9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:38.912851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-642eb1f8-2332-422b-bed7-19bc1399a350 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.913729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-642eb1f8-2332-422b-bed7-19bc1399a350 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.914192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-642eb1f8-2332-422b-bed7-19bc1399a350 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.926137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-642eb1f8-2332-422b-bed7-19bc1399a350 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-125258122" status: 204 len: 0 microversion: 2.26 time: 0.027143 Oct 12 23:01:38.926937 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2731/5355] 10.222.0.20 () {60 vars in 1358 bytes} [Wed Oct 12 23:01:38 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-125258122 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:01:38.936239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fec7a790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:38.945019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.945513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.945955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.946503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:38.952991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.953478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.954120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.954822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.955290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.955719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:38.983939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:38.983939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:38.983939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.001730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:39.021729 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3f78a0e6-6d58-45f3-a37f-d9b635f5f903 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 204 len: 0 microversion: 2.26 time: 0.090152 Oct 12 23:01:39.026464 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2732/5356] 10.222.0.20 () {60 vars in 1295 bytes} [Wed Oct 12 23:01:38 2022] DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:01:39.031650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4524a285-c23b-46af-9268-fb92166740b8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe489310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.039600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4524a285-c23b-46af-9268-fb92166740b8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.040304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4524a285-c23b-46af-9268-fb92166740b8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.040648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4524a285-c23b-46af-9268-fb92166740b8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.051667 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4524a285-c23b-46af-9268-fb92166740b8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 200 len: 12 microversion: 2.26 time: 0.024114 Oct 12 23:01:39.052484 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2733/5357] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 23:01:39 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:39.062921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe6e6670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.073481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.073970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.074557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.075122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:39.080515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.080989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.081429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.082136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.082595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.083026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.112862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.113553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.114003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.123655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.124173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.124613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.133904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:39.142451 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ac91506-06dc-4ac4-b6be-33b3af7b50fe tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1363 microversion: 2.1 time: 0.262659 Oct 12 23:01:39.143136 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2625/5358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:38 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:39.158171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:39.162047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:39.177053 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72cd09d6-f4e2-4fce-bfbb-d67055de677e tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-287616961" status: 201 len: 0 microversion: 2.26 time: 0.118598 Oct 12 23:01:39.178277 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2734/5359] 10.222.0.20 () {62 vars in 1377 bytes} [Wed Oct 12 23:01:39 2022] PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-287616961 => generated 0 bytes in 120 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 12 23:01:39.188617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ccb4c1f7-f684-4824-ad76-4ca66bc25b1a tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe8100d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.198049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccb4c1f7-f684-4824-ad76-4ca66bc25b1a tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.198469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccb4c1f7-f684-4824-ad76-4ca66bc25b1a tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.198910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccb4c1f7-f684-4824-ad76-4ca66bc25b1a tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.213243 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ccb4c1f7-f684-4824-ad76-4ca66bc25b1a tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 200 len: 35 microversion: 2.26 time: 0.029536 Oct 12 23:01:39.214045 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2626/5360] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 23:01:39 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 35 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:39.224890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fee325e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.235495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.236013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.236457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.236938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:39.242921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.243682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.244689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.245628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.246093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.247261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.274746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.275253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.275691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.299882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:39.314182 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bac845bc-44dd-44ef-b6e0-06a3abc87bd8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-287616961" status: 204 len: 0 microversion: 2.26 time: 0.093606 Oct 12 23:01:39.314800 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2735/5361] 10.222.0.20 () {60 vars in 1361 bytes} [Wed Oct 12 23:01:39 2022] DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-287616961 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:01:39.323145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ec83230-bad6-49b1-bbdb-e65e91f752e8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe810d30>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.331728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec83230-bad6-49b1-bbdb-e65e91f752e8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.332232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec83230-bad6-49b1-bbdb-e65e91f752e8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.332676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec83230-bad6-49b1-bbdb-e65e91f752e8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.342119 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ec83230-bad6-49b1-bbdb-e65e91f752e8 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 200 len: 12 microversion: 2.26 time: 0.023040 Oct 12 23:01:39.342702 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2627/5362] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 23:01:39 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 12 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:39.352890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fedbe160>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.360837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.361358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.361836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.362321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:39.367480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.367996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.368445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.369122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.369588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.370023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.393003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.393521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.393965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.404388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:39.418433 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c65fded-ae7a-4d7d-bef9-5bcdca1472a5 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 204 len: 0 microversion: 2.26 time: 0.069652 Oct 12 23:01:39.419044 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2736/5363] 10.222.0.20 () {60 vars in 1295 bytes} [Wed Oct 12 23:01:39 2022] DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 23:01:39.428332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe810f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.438052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.438533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.438975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.439444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:39.444496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.444972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.445408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.446075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.446529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.446958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.474071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.474624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.475127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.484222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.484690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.485123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.508790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:39.525255 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [9b26d12c-696e-4a3b-bb32-e9ce563ca448] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:01:39.560479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:39.561112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:39.567179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.567671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.568522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.568845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:39.569332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:39.570168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:39.718019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:39.729582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e14a2951-43e7-46a3-a6da-3e516feda1bb tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1662 microversion: 2.1 time: 0.172512 Oct 12 23:01:39.730205 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2737/5364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:39 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:40.166516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.167776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:40.175630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.176153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.176601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.177329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.177787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.178218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.322050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:40.331059 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86b2e2b6-21cc-449c-94d3-ede4670122c6 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1363 microversion: 2.1 time: 0.168438 Oct 12 23:01:40.331633 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2738/5365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:40 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:40.535063 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [9b26d12c-696e-4a3b-bb32-e9ce563ca448] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40144. Oct 12 23:01:40.542034 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6b7b3da-1145-4b11-a8c7-64cbe5da51d7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-573903819" status: 201 len: 0 microversion: 2.26 time: 1.117645 Oct 12 23:01:40.542824 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2628/5366] 10.222.0.20 () {62 vars in 1377 bytes} [Wed Oct 12 23:01:39 2022] PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-573903819 => generated 0 bytes in 1119 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 23:01:40.553565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe50adc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.564765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.565404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.565981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.566568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:40.572338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.572946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.573500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.574295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.574872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.575431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.602610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.603484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.604006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.614593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.615120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.615821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.640506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:40.656606 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b4b3ca0-99d4-4d80-b317-e5addf98a208 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-1259755948" status: 201 len: 0 microversion: 2.26 time: 0.107311 Oct 12 23:01:40.657503 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2739/5367] 10.222.0.20 () {62 vars in 1380 bytes} [Wed Oct 12 23:01:40 2022] PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-1259755948 => generated 0 bytes in 109 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 12 23:01:40.667095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe7f8310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.677434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.677928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.678371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.681710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:40.688460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.689161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.689797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.690666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.691280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.691868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.715624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.716149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.716591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.732869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:40.750236 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c0678fc-0a01-457e-89ff-f3cc97d56cd7 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 204 len: 0 microversion: 2.26 time: 0.087218 Oct 12 23:01:40.750967 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2629/5368] 10.222.0.20 () {60 vars in 1295 bytes} [Wed Oct 12 23:01:40 2022] DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:01:40.753143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.753803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:40.759981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-638165e6-9903-4989-9218-282196b70471 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe6dd790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.760332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.760835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.761377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.762023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.763025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.763025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.774014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638165e6-9903-4989-9218-282196b70471 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.774566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638165e6-9903-4989-9218-282196b70471 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.775021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638165e6-9903-4989-9218-282196b70471 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.784591 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-638165e6-9903-4989-9218-282196b70471 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 200 len: 12 microversion: 2.26 time: 0.028262 Oct 12 23:01:40.785424 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2630/5369] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 23:01:40 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:40.796058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe7f8820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.804826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.805361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.805875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.806547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:40.813233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.813799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.814548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.815592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.816217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.816645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.841557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.842133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.845141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.855993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:40.872873 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29f6d5ec-7c49-480b-97c8-53afe080df0c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 204 len: 0 microversion: 2.26 time: 0.081337 Oct 12 23:01:40.873771 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2631/5370] 10.222.0.20 () {60 vars in 1295 bytes} [Wed Oct 12 23:01:40 2022] DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 23:01:40.884003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe849160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.896439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.897132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.897607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.898314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:40.905730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.906595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.906717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.907327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.907782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.908248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.922074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:40.930801 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0716b7cf-b01f-4455-9534-df58bdce2e42 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.181613 Oct 12 23:01:40.931699 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2740/5371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:40 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:40.936431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.936923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.937363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.946522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.946993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.947479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.955584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:40.956333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:40.963186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.963679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.964438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.964925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:40.965430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:40.965898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:40.972661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:40.988233 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f1c3f8a9-4784-4e47-918e-c9221ecc2210 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-985893270" status: 201 len: 0 microversion: 2.26 time: 0.108728 Oct 12 23:01:40.993450 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2632/5372] 10.222.0.20 () {62 vars in 1377 bytes} [Wed Oct 12 23:01:40 2022] PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-985893270 => generated 0 bytes in 110 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 23:01:40.999362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe729f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.009519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.010010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.010451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.010940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.017539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.018014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.018453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.019173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.019630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.020095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.046804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.047293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.047764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.056804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.057281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.057723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.067168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:41.086360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:41.103369 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c48514cd-06be-49ce-802c-372d94f873be tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-316693458" status: 201 len: 0 microversion: 2.26 time: 0.108459 Oct 12 23:01:41.104113 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2633/5373] 10.222.0.20 () {62 vars in 1377 bytes} [Wed Oct 12 23:01:40 2022] PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags/tempest-tag-316693458 => generated 0 bytes in 110 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 12 23:01:41.113790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Action: 'update_all', calling method: .version_select at 0x7f44ff523d30>, body: {"tags": ["tempest-tag-1065062172", "tempest-tag-1239853625"]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:41.116399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.125718 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5de10fa8-5861-44a4-985b-0a97aa5d856c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.173940 Oct 12 23:01:41.126574 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2741/5374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:40 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:41.126698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.127274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.127790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.128358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.134135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.134754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.135267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.136066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.136584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.137751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.151401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.152184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.158162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.158671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.159125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.159930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.160398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.160836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.164469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.164955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.165579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.186033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:41.204434 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79e4baeb-1db1-4c3b-834d-c831b21e49ad tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 200 len: 62 microversion: 2.26 time: 0.094567 Oct 12 23:01:41.209902 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2634/5375] 10.222.0.20 () {62 vars in 1312 bytes} [Wed Oct 12 23:01:41 2022] PUT /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 62 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:41.217280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-acbd7af7-47a4-4ff8-a26b-975734ee01ef tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe7f8af0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.225198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbd7af7-47a4-4ff8-a26b-975734ee01ef tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.225684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbd7af7-47a4-4ff8-a26b-975734ee01ef tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.226124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acbd7af7-47a4-4ff8-a26b-975734ee01ef tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.236300 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-acbd7af7-47a4-4ff8-a26b-975734ee01ef tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 200 len: 62 microversion: 2.26 time: 0.022697 Oct 12 23:01:41.236300 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2635/5376] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 12 23:01:41 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 62 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:41.246998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '.version_select at 0x7f44fe804c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.254438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.254926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.255361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.255839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.261436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.261951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.262387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.263125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.263804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.264548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.292612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.293101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.294075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.310619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lazy-loading 'flavor' on Instance uuid 9713a7c5-c4fb-44d5-9006-64d8da755acf {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:41.325031 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-875b9af0-9360-4996-8efa-6d065b008007 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags" status: 204 len: 0 microversion: 2.26 time: 0.082350 Oct 12 23:01:41.330429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.333065 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2636/5377] 10.222.0.20 () {60 vars in 1295 bytes} [Wed Oct 12 23:01:41 2022] DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf/tags => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 23:01:41.337871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.338019 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bcb6b8e9-8bbc-4b29-a9e1-05bc8f8ec549 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.190833 Oct 12 23:01:41.338389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.338754 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2742/5378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:41 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:41.346051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.346558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.347005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.347703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.349372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.349372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.354515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.355157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.361721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.362372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.363310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.364298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.365124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.365585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.382308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:41.476035 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ddc4346-6b3f-4516-81db-489cf4a16c9f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 204 len: 0 microversion: 2.26 time: 0.141203 Oct 12 23:01:41.477396 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2637/5379] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 23:01:41 2022] DELETE /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:01:41.484292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.485142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.491453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.492197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.492726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.493465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.493905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.494428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.529302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.538037 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be0cded8-1915-4258-913c-ab351ac95872 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1363 microversion: 2.1 time: 0.187224 Oct 12 23:01:41.544163 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2743/5380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:41 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:41.549920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.550713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.558237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.559491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.560110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.561030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.561544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.562138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.634727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:41.646935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.656070 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-309c9f9c-738b-4f85-8a38-63efd562715d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.177570 Oct 12 23:01:41.656826 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2638/5381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:41 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:41.680811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:41.681480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.689212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.689212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.689619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.690451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.690864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.691291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.722992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.733981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.735519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.736839 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec556a16-0f95-4057-8e1b-7e5366f43f4c tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1551 microversion: 2.26 time: 0.196542 Oct 12 23:01:41.737527 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2744/5382] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:41 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1551 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:41.846824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:41.857135 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-168e6a0b-2c38-427b-a444-c9ef9e501e7f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.180596 Oct 12 23:01:41.857914 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2639/5383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:41 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:41.881310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:41.881889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:41.888914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.889563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.889988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.890669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:41.891326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:41.891678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:41.918727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lazy-loading 'flavor' on Instance uuid 2b334a2a-d3a5-490a-a1a1-46232024383e {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:41.996400 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-751b32fc-74c4-4835-83df-2c63139ac45c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.119026 Oct 12 23:01:42.000366 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2745/5384] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:01:41 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:01:42.009217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:42.010183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:42.015266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:42.031115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:42.031865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:42.032949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:42.034646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:42.035442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:42.036415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:42.101917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e57358e1-9881-44c7-a661-bbd6af1538aa req-23d8658c-c14a-4862-97c7-8ed1549befc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48", "name": "network-vif-plugged", "status": "completed", "tag": "fd3e2f53-ada2-43d4-ae8a-9b563fcdd394"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:42.109975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:42.121506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e57358e1-9881-44c7-a661-bbd6af1538aa req-23d8658c-c14a-4862-97c7-8ed1549befc6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:42.122026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e57358e1-9881-44c7-a661-bbd6af1538aa req-23d8658c-c14a-4862-97c7-8ed1549befc6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:42.122471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e57358e1-9881-44c7-a661-bbd6af1538aa req-23d8658c-c14a-4862-97c7-8ed1549befc6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:42.140929 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e57358e1-9881-44c7-a661-bbd6af1538aa req-23d8658c-c14a-4862-97c7-8ed1549befc6 service nova] Creating event network-vif-plugged:fd3e2f53-ada2-43d4-ae8a-9b563fcdd394 for instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 on n-h1-860864-8 Oct 12 23:01:42.153258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e57358e1-9881-44c7-a661-bbd6af1538aa req-23d8658c-c14a-4862-97c7-8ed1549befc6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055418 Oct 12 23:01:42.154313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2746/5385] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:42.196742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:42.206112 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77783268-eb8e-4e4b-aace-e521930dd974 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1674 microversion: 2.1 time: 0.202193 Oct 12 23:01:42.207033 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2640/5386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:42 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:42.566232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:42.567106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:42.574328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:42.575478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:42.575943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:42.576656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:42.577403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:42.577833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:42.581811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:42.737992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:42.745983 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c7dfb51e-d35d-4bde-8c53-016c8c304c5f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1363 microversion: 2.1 time: 0.186890 Oct 12 23:01:42.747256 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2747/5387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:42 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:42.769883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:42.773689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:42.782370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:42.783145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:42.783784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:42.784727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:42.785547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:42.786301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:42.927135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:42.938558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:42.940301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e9a0f4f8d754e6ea33a05145640ccf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0622cf75e54e849a893be146658857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:42.941875 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b191819-70d0-4dba-83ec-6fda35ae1b0f tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 200 len: 1551 microversion: 2.26 time: 0.176352 Oct 12 23:01:42.943557 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2641/5388] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:42 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 1551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:01:43.232058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:43.233064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:43.247255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.248164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.249169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.250310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.251993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.253279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.254614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8026e9ab-f6a5-431c-957e-1c5f75f27ac4 req-e9ae904b-8b98-4289-a631-9483fc5eab0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713a7c5-c4fb-44d5-9006-64d8da755acf", "name": "network-vif-deleted", "tag": "9b50c9e1-0eff-4943-9cf4-cf757988d1c7"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:43.265348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8026e9ab-f6a5-431c-957e-1c5f75f27ac4 req-e9ae904b-8b98-4289-a631-9483fc5eab0e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.265933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8026e9ab-f6a5-431c-957e-1c5f75f27ac4 req-e9ae904b-8b98-4289-a631-9483fc5eab0e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.266386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8026e9ab-f6a5-431c-957e-1c5f75f27ac4 req-e9ae904b-8b98-4289-a631-9483fc5eab0e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.281253 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8026e9ab-f6a5-431c-957e-1c5f75f27ac4 req-e9ae904b-8b98-4289-a631-9483fc5eab0e service nova] Creating event network-vif-deleted:9b50c9e1-0eff-4943-9cf4-cf757988d1c7 for instance 9713a7c5-c4fb-44d5-9006-64d8da755acf on n-h2-860864-8 Oct 12 23:01:43.300882 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8026e9ab-f6a5-431c-957e-1c5f75f27ac4 req-e9ae904b-8b98-4289-a631-9483fc5eab0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050450 Oct 12 23:01:43.303426 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2642/5389] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:43.475292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:43.494000 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-820e64c4-8621-490a-a1bc-dfea8eeb02a6 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1657 microversion: 2.1 time: 0.262698 Oct 12 23:01:43.500834 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2748/5390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:43 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1657 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:43.529615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:43.530385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:43.539276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.539957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.540431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.541160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.541623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.542056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.614206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-68e2a63f-289e-4a8b-8c92-86fc144e2579 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action" status: 202 len: 0 microversion: 2.1 time: 0.089948 Oct 12 23:01:43.617771 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2643/5391] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:01:43 2022] POST /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:01:43.623443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:43.624725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:43.633725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.634353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.634868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.635842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.636604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.637636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.776758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:43.777654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:43.785995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.786624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.787162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.788000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.788550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.789215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.835059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:43.852578 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3df0bff1-6291-4ab3-8844-6ec569738e62 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1663 microversion: 2.1 time: 0.233034 Oct 12 23:01:43.853187 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2749/5392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:43 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1663 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:43.967553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:43.968235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] [instance: 9713a7c5-c4fb-44d5-9006-64d8da755acf] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:43.975010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.975511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.975977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.977187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:43.977662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:43.978101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:43.994951 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] HTTP exception thrown: Instance 9713a7c5-c4fb-44d5-9006-64d8da755acf could not be found. Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Request method failure captured: Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf HTTP/1.1 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0dGW-9nSgXU_WvCb6ObfSPRUCltgy6OvPrsDibTTYz5uj13RIuLRMwLyZKdjYNHnHrySaxKmk52NuHX1CxLhGcDjSVywkvJ8n2dVGv80VEN_PHwho33JEipPWOqU6850mlyM1qOeW5x7WoNCRPMEAOwJhufy-OmyalQSa4Ue7DW3Gw Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.26 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5d0622cf75e54e849a893be146658857 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerTagsTestJSON-2045028968 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d0622cf75e54e849a893be146658857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d0622cf75e54e849a893be146658857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d0622cf75e54e849a893be146658857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d0622cf75e54e849a893be146658857"}]}] Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerTagsTestJSON-2045028968 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5d0622cf75e54e849a893be146658857 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerTagsTestJSON-2045028968 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerTagsTestJSON-2045028968-project Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 1e9a0f4f8d754e6ea33a05145640ccf7 Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerTagsTestJSON-2045028968-project Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 9713a7c5-c4fb-44d5-9006-64d8da755acf could not be found. Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '9713a7c5-c4fb-44d5-9006-64d8da755acf'} Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9713a7c5-c4fb-44d5-9006-64d8da755acf could not be found. Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9713a7c5-c4fb-44d5-9006-64d8da755acf could not be found. Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:43.997141 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9713a7c5-c4fb-44d5-9006-64d8da755acf could not be found. Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] Returning 404 to user: Instance 9713a7c5-c4fb-44d5-9006-64d8da755acf could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1c5253f4-4102-4250-8b7e-ad379e399db4 tempest-ServerTagsTestJSON-2045028968 tempest-ServerTagsTestJSON-2045028968-project] 10.222.0.20 "GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf" status: 404 len: 111 microversion: 2.26 time: 0.035541 Oct 12 23:01:44.003298 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2750/5393] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:01:43 2022] GET /compute/v2.1/servers/9713a7c5-c4fb-44d5-9006-64d8da755acf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 23:01:44.075902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:44.087299 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0bd68f75-7db1-47fb-b9d3-b6c9014d59dc tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1549 microversion: 2.1 time: 0.314319 Oct 12 23:01:44.088619 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2644/5394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:43 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:44.111682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:44.112481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:44.119666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:44.120405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:44.121013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:44.121931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:44.122549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:44.123151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:44.255165 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0fa03c73-be7b-4db7-86a9-1a04be7383fa tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147359 Oct 12 23:01:44.264848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2751/5395] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:01:44 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:44.876221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:44.877428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:44.884921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:44.885610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:44.886325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:44.887759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:44.888400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:44.889229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:45.204823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:45.219926 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c1a46d8-ac19-4388-9387-acaecf5fc913 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1663 microversion: 2.1 time: 0.348338 Oct 12 23:01:45.221826 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2645/5396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:44 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1663 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:45.738731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8e07cd65-c988-42b2-aa1e-f59c98d69fef req-45b8ed35-7f6c-4295-912a-bd2fa02d89a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48", "tag": "fd3e2f53-ada2-43d4-ae8a-9b563fcdd394"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:45.757216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8e07cd65-c988-42b2-aa1e-f59c98d69fef req-45b8ed35-7f6c-4295-912a-bd2fa02d89a4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:45.764243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8e07cd65-c988-42b2-aa1e-f59c98d69fef req-45b8ed35-7f6c-4295-912a-bd2fa02d89a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:45.764795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8e07cd65-c988-42b2-aa1e-f59c98d69fef req-45b8ed35-7f6c-4295-912a-bd2fa02d89a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:45.798781 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8e07cd65-c988-42b2-aa1e-f59c98d69fef req-45b8ed35-7f6c-4295-912a-bd2fa02d89a4 service nova] Creating event network-changed:fd3e2f53-ada2-43d4-ae8a-9b563fcdd394 for instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 on n-h1-860864-8 Oct 12 23:01:45.803815 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8e07cd65-c988-42b2-aa1e-f59c98d69fef req-45b8ed35-7f6c-4295-912a-bd2fa02d89a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069746 Oct 12 23:01:45.804821 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2752/5397] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:46.250487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:46.252028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:46.263092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:46.269948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:46.272822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:46.276003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:46.277106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:46.279487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:46.700782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:46.704247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=2,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:46.735289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5fb5c3d-b11f-476d-b959-d1f158d29578 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.483699 Oct 12 23:01:46.748412 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2646/5398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:46 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:46.762634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:46.763325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:46.787600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:46.787600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:46.787600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:46.788570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:46.788570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:46.788570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:47.070510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:47.080740 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf6a69e0-2db8-4af2-bc6f-174b3e07fbfa tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1666 microversion: 2.1 time: 0.323457 Oct 12 23:01:47.090160 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2753/5399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:46 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1666 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:47.113838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:47.115055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:47.123345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:47.124476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:47.125342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:47.126566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:47.127212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:47.127884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:47.191192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:47.216507 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Working on deleting snapshot b017988f-8b7e-4684-b50f-f9ababf9f1af from shelved instance... Oct 12 23:01:48.042425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Doing local delete in cell 868d7b64-7f61-47de-bdbf-7158aa15f4f1(cell1) {{(pid=120543) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 12 23:01:48.044222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:48.045014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:48.045614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:48.046731 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 12 23:01:48.052593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] deallocate_for_instance() {{(pid=120543) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 12 23:01:48.810371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Updating instance_info_cache with network_info: [] {{(pid=120543) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 23:01:48.828386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fefb3e11-b6f6-490e-b61f-fabebcff2dab req-e712cf64-80d2-4fa0-949d-99a9c178fe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283daca0-928d-42b0-8c90-5ad9f7139753", "name": "network-vif-deleted", "tag": "5b81b377-0cbe-4aff-94c6-a691ebacb822"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:48.840740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fefb3e11-b6f6-490e-b61f-fabebcff2dab req-e712cf64-80d2-4fa0-949d-99a9c178fe77 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:48.842015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fefb3e11-b6f6-490e-b61f-fabebcff2dab req-e712cf64-80d2-4fa0-949d-99a9c178fe77 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:48.842728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fefb3e11-b6f6-490e-b61f-fabebcff2dab req-e712cf64-80d2-4fa0-949d-99a9c178fe77 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:48.856295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.compute.server_external_events [req-fefb3e11-b6f6-490e-b61f-fabebcff2dab req-e712cf64-80d2-4fa0-949d-99a9c178fe77 service nova] Unable to find a host for instance 283daca0-928d-42b0-8c90-5ad9f7139753. Dropping event network-vif-deleted {{(pid=120542) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 23:01:48.857934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fefb3e11-b6f6-490e-b61f-fabebcff2dab req-e712cf64-80d2-4fa0-949d-99a9c178fe77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034983 Oct 12 23:01:48.859175 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2754/5400] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 23:01:49.243025 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-973f000d-6e7c-4c22-8b39-18d133428fce tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "DELETE /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 204 len: 0 microversion: 2.1 time: 2.135472 Oct 12 23:01:49.243941 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2647/5401] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:47 2022] DELETE /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 0 bytes in 2137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:49.252032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:49.252752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 283daca0-928d-42b0-8c90-5ad9f7139753] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:49.259160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.259731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.260281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:49.261056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.261760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.262424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:49.276222 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] HTTP exception thrown: Instance 283daca0-928d-42b0-8c90-5ad9f7139753 could not be found. Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Request method failure captured: Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 HTTP/1.1 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0We39ZUeQZmjVL-3duGV7SiqzM_4PxH2YWvrb736LqQdTw2C_YL1vAiGBwjlPSJUN8aNoRlV03jMdwDpHkWd78SSN39dR4fnpAVSQXtZrTjuH3GGu-3Atd3aBJgyqwLBgbZ3fCKOmlW8Go10S1MoHEJlUH8G9PH_ZQwmtwBykULhsI Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1909b9808794051a8d86451506ca5bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}] Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b103c953780a4dce8d8872ee8b47d186 Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 283daca0-928d-42b0-8c90-5ad9f7139753 could not be found. Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '283daca0-928d-42b0-8c90-5ad9f7139753'} Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283daca0-928d-42b0-8c90-5ad9f7139753 could not be found. Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283daca0-928d-42b0-8c90-5ad9f7139753 could not be found. Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:49.278353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283daca0-928d-42b0-8c90-5ad9f7139753 could not be found. Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Returning 404 to user: Instance 283daca0-928d-42b0-8c90-5ad9f7139753 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-60ca2330-7f58-43f6-8185-492d5da8d898 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753" status: 404 len: 111 microversion: 2.1 time: 0.031966 Oct 12 23:01:49.284417 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2755/5402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:49 2022] GET /compute/v2.1/servers/283daca0-928d-42b0-8c90-5ad9f7139753 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:01:49.290836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:49.291439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:49.300007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.300496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.300941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:49.301635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.302093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.302523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:49.333963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:49.409301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:49.424108 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1ff5479-e68e-4379-b0d7-daed3098766d tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 204 len: 0 microversion: 2.1 time: 0.136808 Oct 12 23:01:49.424720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2648/5403] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:49 2022] DELETE /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:49.432724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:49.433385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:49.454306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.455110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.456413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:49.457332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:49.458198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:49.458979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:49.576672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:49.594218 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9db649db-9906-473b-a8ac-d963c4a034c9 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1466 microversion: 2.1 time: 0.165222 Oct 12 23:01:49.594964 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2756/5404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:49 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1466 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:50.618342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:50.619141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:50.631240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:50.631240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:50.631240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:50.631240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:50.631240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:50.631240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:50.731161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:50.739654 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-037bac5b-9fdd-42da-9b88-d5908309371e tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 200 len: 1466 microversion: 2.1 time: 0.125481 Oct 12 23:01:50.742669 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2649/5405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:50 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 1466 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:51.210325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-fcf98ca7-1523-43d8-8856-1c82ffc24c36 req-01df017e-f44c-4fbf-b1c5-fccf2ac13ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5d6453-fd32-4604-8b08-a6297fff60cb", "name": "network-vif-deleted", "tag": "6172a951-5664-4f54-a355-802020424486"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:51.238298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fcf98ca7-1523-43d8-8856-1c82ffc24c36 req-01df017e-f44c-4fbf-b1c5-fccf2ac13ce9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:51.238920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fcf98ca7-1523-43d8-8856-1c82ffc24c36 req-01df017e-f44c-4fbf-b1c5-fccf2ac13ce9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:51.239584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-fcf98ca7-1523-43d8-8856-1c82ffc24c36 req-01df017e-f44c-4fbf-b1c5-fccf2ac13ce9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:51.258275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-fcf98ca7-1523-43d8-8856-1c82ffc24c36 req-01df017e-f44c-4fbf-b1c5-fccf2ac13ce9 service nova] Creating event network-vif-deleted:6172a951-5664-4f54-a355-802020424486 for instance ba5d6453-fd32-4604-8b08-a6297fff60cb on n-h2-860864-8 Oct 12 23:01:51.264921 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-fcf98ca7-1523-43d8-8856-1c82ffc24c36 req-01df017e-f44c-4fbf-b1c5-fccf2ac13ce9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059074 Oct 12 23:01:51.269542 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2757/5406] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:01:51.772187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:51.772187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: ba5d6453-fd32-4604-8b08-a6297fff60cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:51.785315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:51.787322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:51.788031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:51.788838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:51.789301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:51.789734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:51.810686 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] HTTP exception thrown: Instance ba5d6453-fd32-4604-8b08-a6297fff60cb could not be found. Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Request method failure captured: Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb HTTP/1.1 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0We39ZUeQZmjVL-3duGV7SiqzM_4PxH2YWvrb736LqQdTw2C_YL1vAiGBwjlPSJUN8aNoRlV03jMdwDpHkWd78SSN39dR4fnpAVSQXtZrTjuH3GGu-3Atd3aBJgyqwLBgbZ3fCKOmlW8Go10S1MoHEJlUH8G9PH_ZQwmtwBykULhsI Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1909b9808794051a8d86451506ca5bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}] Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: b103c953780a4dce8d8872ee8b47d186 Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance ba5d6453-fd32-4604-8b08-a6297fff60cb could not be found. Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ba5d6453-fd32-4604-8b08-a6297fff60cb'} Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5d6453-fd32-4604-8b08-a6297fff60cb could not be found. Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5d6453-fd32-4604-8b08-a6297fff60cb could not be found. Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:51.812540 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5d6453-fd32-4604-8b08-a6297fff60cb could not be found. Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Returning 404 to user: Instance ba5d6453-fd32-4604-8b08-a6297fff60cb could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-404da7cd-2fac-4992-ac68-c996f6248b04 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb" status: 404 len: 111 microversion: 2.1 time: 0.052293 Oct 12 23:01:51.820186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2650/5407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:51 2022] GET /compute/v2.1/servers/ba5d6453-fd32-4604-8b08-a6297fff60cb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:01:51.823407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:51.823816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:51.833117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:51.833739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:51.834204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:51.834944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:51.835422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:51.836102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:51.879288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:51.983577 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67a8a621-81f5-4225-b129-60b3b245d53c tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 204 len: 0 microversion: 2.1 time: 0.164417 Oct 12 23:01:51.986851 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2758/5408] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:51 2022] DELETE /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:51.995096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:51.996262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:52.002330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:52.003413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:52.003863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:52.004590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:52.005425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:52.005997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:52.513037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:52.522473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-730cfed0-123d-448b-8368-749d956d3c25 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1508 microversion: 2.1 time: 0.531344 Oct 12 23:01:52.523055 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2651/5409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:51 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:53.553960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:53.556985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:53.568674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:53.569497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:53.570172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:53.571114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:53.571786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:53.572440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:53.752119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:53.770139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-441abf51-6f3e-4e43-8b6f-1faba2b862cc tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1508 microversion: 2.1 time: 0.224576 Oct 12 23:01:53.771620 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2759/5410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:53 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:53.993135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d51fac53-b0f1-49f0-9ed0-274f5c36d3e3 req-22fee1c0-4211-42ad-a7b8-818206c7963c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd6b413-daee-497e-8632-2be5e151c376", "name": "network-vif-deleted", "tag": "671f02d8-28a9-40ae-b26d-134fce8b120d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:54.012243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d51fac53-b0f1-49f0-9ed0-274f5c36d3e3 req-22fee1c0-4211-42ad-a7b8-818206c7963c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:54.013133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d51fac53-b0f1-49f0-9ed0-274f5c36d3e3 req-22fee1c0-4211-42ad-a7b8-818206c7963c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:54.013981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d51fac53-b0f1-49f0-9ed0-274f5c36d3e3 req-22fee1c0-4211-42ad-a7b8-818206c7963c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:54.031482 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d51fac53-b0f1-49f0-9ed0-274f5c36d3e3 req-22fee1c0-4211-42ad-a7b8-818206c7963c service nova] Creating event network-vif-deleted:671f02d8-28a9-40ae-b26d-134fce8b120d for instance cdd6b413-daee-497e-8632-2be5e151c376 on n-h1-860864-8 Oct 12 23:01:54.037997 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d51fac53-b0f1-49f0-9ed0-274f5c36d3e3 req-22fee1c0-4211-42ad-a7b8-818206c7963c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049272 Oct 12 23:01:54.038808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2652/5411] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:54.794958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:54.796266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:54.807774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:54.808551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:54.809001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:54.809727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:54.810337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:54.810753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:54.859734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:54.860662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:54.861520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:54.861985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lazy-loading 'fault' on Instance uuid cdd6b413-daee-497e-8632-2be5e151c376 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:54.911910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:54.919696 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35e6c3a3-7869-42c6-9c6c-0d26feec11ae tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 200 len: 1305 microversion: 2.1 time: 0.129769 Oct 12 23:01:54.920477 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2760/5412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:54 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:55.296874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:55.297423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:55.304727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.305213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.305711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.306347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.306805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.307233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.340223 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-348df74e-3e3b-4d07-9e2b-96783a2b7349 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments/b8e9016f-1394-4712-a7f3-26eed49dab2a" status: 200 len: 194 microversion: 2.20 time: 0.048401 Oct 12 23:01:55.340911 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2653/5413] 10.222.0.20 () {60 vars in 1454 bytes} [Wed Oct 12 23:01:55 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments/b8e9016f-1394-4712-a7f3-26eed49dab2a => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:01:55.423328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:55.424131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:55.431252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.432025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.432664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.434092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.434773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.435497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.520035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lazy-loading 'services' on Instance uuid 69b3e3aa-ae92-4854-981d-68a9796316f5 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:55.601711 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42b31cc6-437e-400e-9573-98af5a6c1a55 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments/b8e9016f-1394-4712-a7f3-26eed49dab2a" status: 202 len: 0 microversion: 2.20 time: 0.184462 Oct 12 23:01:55.602564 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2761/5414] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Oct 12 23:01:55 2022] DELETE /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments/b8e9016f-1394-4712-a7f3-26eed49dab2a => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:55.613954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:55.617030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:55.626172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.626715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.627192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.627870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.628358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.628962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.665385 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d57566b-334d-4c45-846a-455e2e2e3f3b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056465 Oct 12 23:01:55.666450 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2654/5415] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:01:55 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:01:55.944634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:55.945442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: cdd6b413-daee-497e-8632-2be5e151c376] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:55.951985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.952582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.953268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.954050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.954755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.955266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.970693 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] HTTP exception thrown: Instance cdd6b413-daee-497e-8632-2be5e151c376 could not be found. Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Request method failure captured: Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 HTTP/1.1 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0We39ZUeQZmjVL-3duGV7SiqzM_4PxH2YWvrb736LqQdTw2C_YL1vAiGBwjlPSJUN8aNoRlV03jMdwDpHkWd78SSN39dR4fnpAVSQXtZrTjuH3GGu-3Atd3aBJgyqwLBgbZ3fCKOmlW8Go10S1MoHEJlUH8G9PH_ZQwmtwBykULhsI Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1909b9808794051a8d86451506ca5bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}] Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b103c953780a4dce8d8872ee8b47d186 Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance cdd6b413-daee-497e-8632-2be5e151c376 could not be found. Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'cdd6b413-daee-497e-8632-2be5e151c376'} Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd6b413-daee-497e-8632-2be5e151c376 could not be found. Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd6b413-daee-497e-8632-2be5e151c376 could not be found. Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:55.972415 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd6b413-daee-497e-8632-2be5e151c376 could not be found. Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Returning 404 to user: Instance cdd6b413-daee-497e-8632-2be5e151c376 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d728c516-4a24-41f0-843e-2c218a9c0e1f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376" status: 404 len: 111 microversion: 2.1 time: 0.034621 Oct 12 23:01:55.981200 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2762/5416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:55 2022] GET /compute/v2.1/servers/cdd6b413-daee-497e-8632-2be5e151c376 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:55.984641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:55.985481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:55.992659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.993310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.993760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:55.994462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:55.994923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:55.995351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:56.032205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:56.069101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:56.123673 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-92d8397e-4cf2-4a11-bc17-e329e38397ad tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 204 len: 0 microversion: 2.1 time: 0.144463 Oct 12 23:01:56.124312 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2655/5417] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:55 2022] DELETE /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:01:56.132690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:56.133661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:56.145008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:56.145411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:56.145874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:56.146720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:56.148301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:56.149701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:56.303273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:56.312079 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc8af55d-41ae-4cd3-8ebb-968d7041adf2 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1495 microversion: 2.1 time: 0.183512 Oct 12 23:01:56.312867 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2763/5418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:56 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1495 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:01:56.680549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:56.683452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:56.692284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:56.692822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:56.693463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:56.694234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:56.694695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:56.695290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:56.732613 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ee564d8-df06-4d2f-a9b5-462362712fe5 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057021 Oct 12 23:01:56.733180 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2656/5419] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:01:56 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:01:57.337438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:57.338962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:57.348060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:57.349158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:57.350099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:57.351819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:57.352508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:57.353173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:57.498957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:57.508228 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24a5ead1-92f0-4fe5-af19-64e63402c7b7 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1495 microversion: 2.1 time: 0.174547 Oct 12 23:01:57.509374 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2764/5420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:57 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1495 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:57.745430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:57.748386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:57.774832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:57.775801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:57.778136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:57.779980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:57.780903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:57.783583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:57.826794 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ffcb7d7f-042d-463c-a3a0-8b1f58364851 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085395 Oct 12 23:01:57.829452 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2657/5421] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:01:57 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:01:58.255988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3e472159-cb79-448c-8472-512e9894db39 req-d1b52bff-7a04-4bb5-b1d4-607161130eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97dc7de-4628-4c6d-9f78-53941bd984f9", "name": "network-vif-deleted", "tag": "5afe1bc2-e0a9-41de-b206-5b439f6fe890"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:01:58.269245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3e472159-cb79-448c-8472-512e9894db39 req-d1b52bff-7a04-4bb5-b1d4-607161130eeb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.269847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3e472159-cb79-448c-8472-512e9894db39 req-d1b52bff-7a04-4bb5-b1d4-607161130eeb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.270909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3e472159-cb79-448c-8472-512e9894db39 req-d1b52bff-7a04-4bb5-b1d4-607161130eeb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.285801 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3e472159-cb79-448c-8472-512e9894db39 req-d1b52bff-7a04-4bb5-b1d4-607161130eeb service nova] Creating event network-vif-deleted:5afe1bc2-e0a9-41de-b206-5b439f6fe890 for instance c97dc7de-4628-4c6d-9f78-53941bd984f9 on n-h1-860864-8 Oct 12 23:01:58.293477 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3e472159-cb79-448c-8472-512e9894db39 req-d1b52bff-7a04-4bb5-b1d4-607161130eeb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041499 Oct 12 23:01:58.294499 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2765/5422] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:01:58.534225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:58.534851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:58.548287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.549465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.550082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.551672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.552162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.552498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.592158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.593011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.593687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.594258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lazy-loading 'fault' on Instance uuid c97dc7de-4628-4c6d-9f78-53941bd984f9 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:01:58.653078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:01:58.663641 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c03e8217-fb7a-431c-bedf-d3d1c09fae85 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 200 len: 1305 microversion: 2.1 time: 0.133380 Oct 12 23:01:58.664992 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2658/5423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:58 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:01:58.841529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:58.843864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:58.861552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.862056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.862502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.863210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:58.863671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:58.864135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:58.877725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:01:58.927667 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c9c62f9-1d31-4388-b635-d3477cf176b3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090949 Oct 12 23:01:58.928952 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2766/5424] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:01:58 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:01:59.687853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:59.689326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: c97dc7de-4628-4c6d-9f78-53941bd984f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:59.696870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.697543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.698139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.699188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.699818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.700426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.717681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] HTTP exception thrown: Instance c97dc7de-4628-4c6d-9f78-53941bd984f9 could not be found. Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Request method failure captured: Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 HTTP/1.1 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0We39ZUeQZmjVL-3duGV7SiqzM_4PxH2YWvrb736LqQdTw2C_YL1vAiGBwjlPSJUN8aNoRlV03jMdwDpHkWd78SSN39dR4fnpAVSQXtZrTjuH3GGu-3Atd3aBJgyqwLBgbZ3fCKOmlW8Go10S1MoHEJlUH8G9PH_ZQwmtwBykULhsI Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1909b9808794051a8d86451506ca5bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}] Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: b103c953780a4dce8d8872ee8b47d186 Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance c97dc7de-4628-4c6d-9f78-53941bd984f9 could not be found. Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'c97dc7de-4628-4c6d-9f78-53941bd984f9'} Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97dc7de-4628-4c6d-9f78-53941bd984f9 could not be found. Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97dc7de-4628-4c6d-9f78-53941bd984f9 could not be found. Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:01:59.719866 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:59.724677 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:01:59.724677 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:01:59.724677 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:01:59.724677 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:01:59.724677 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:01:59.724677 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97dc7de-4628-4c6d-9f78-53941bd984f9 could not be found. Oct 12 23:01:59.724677 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:01:59.726012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Returning 404 to user: Instance c97dc7de-4628-4c6d-9f78-53941bd984f9 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:01:59.727052 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-caf29c4d-140c-49b0-b745-97165dbfc835 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9" status: 404 len: 111 microversion: 2.1 time: 0.043107 Oct 12 23:01:59.728233 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2659/5425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:59 2022] GET /compute/v2.1/servers/c97dc7de-4628-4c6d-9f78-53941bd984f9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:01:59.736617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:59.737429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:59.749483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.750459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.751367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.752451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.753079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.753676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.791043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:01:59.913384 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3d40845-69a8-4f79-b31c-2041971afc17 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 204 len: 0 microversion: 2.1 time: 0.180485 Oct 12 23:01:59.914350 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2767/5426] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:01:59 2022] DELETE /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:01:59.933967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:59.943692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:59.943872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:01:59.944658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:01:59.958719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.959478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.960157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.960769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.961868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.962853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.964807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.964939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.965331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:01:59.966077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:01:59.966559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:01:59.967002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:00.032531 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-663a1f32-e4fc-4d15-9189-8bb501dc2abf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094024 Oct 12 23:02:00.041019 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2768/5427] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:01:59 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:02:00.166658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:00.175845 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd233aea-a813-4efe-a158-d63db20f7771 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1672 microversion: 2.1 time: 0.256434 Oct 12 23:02:00.177166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2660/5428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:01:59 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1672 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:02:01.055633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:01.059651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:01.074502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:01.075428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:01.076135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:01.077218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:01.077934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:01.078916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:01.122084 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1de1d0a5-651c-4470-b671-a4e92e17ed37 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072453 Oct 12 23:02:01.123253 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2769/5429] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:02:01 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:02:01.201779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:01.202351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:01.209741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:01.210236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:01.210681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:01.213021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:01.213491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:01.214479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:01.376202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:01.392365 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d390bcf8-6a1b-47ab-8654-1439839d8de3 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1672 microversion: 2.1 time: 0.195143 Oct 12 23:02:01.393238 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2661/5430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:01 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:02.134978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:02.138376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:02.145671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:02.146525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:02.147146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:02.148059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:02.148681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:02.149858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:02.182406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d203e0d9-95a5-4378-8487-615941e68777 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051458 Oct 12 23:02:02.184532 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2770/5431] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:02:02 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:02:02.425139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:02.427968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:02.440878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:02.441657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:02.442269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:02.443362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:02.444180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:02.444848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:02.559785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b103c953780a4dce8d8872ee8b47d186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1909b9808794051a8d86451506ca5bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:02.594275 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-111a6dec-21f7-41bc-8512-4fbbed24674f tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 200 len: 1605 microversion: 2.1 time: 0.166570 Oct 12 23:02:02.594275 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2662/5432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:02 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:02.801243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c3ebe9ac-927f-4431-8cd5-d18265ca01c0 req-aa32545f-cce6-423e-a75e-43de29593cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b334a2a-d3a5-490a-a1a1-46232024383e", "name": "network-vif-deleted", "tag": "cc2a93fb-f74f-48e8-a05f-eb61d13a7bca"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:02.811839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c3ebe9ac-927f-4431-8cd5-d18265ca01c0 req-aa32545f-cce6-423e-a75e-43de29593cb6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:02.812429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c3ebe9ac-927f-4431-8cd5-d18265ca01c0 req-aa32545f-cce6-423e-a75e-43de29593cb6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:02.812809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c3ebe9ac-927f-4431-8cd5-d18265ca01c0 req-aa32545f-cce6-423e-a75e-43de29593cb6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:02.831991 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c3ebe9ac-927f-4431-8cd5-d18265ca01c0 req-aa32545f-cce6-423e-a75e-43de29593cb6 service nova] Creating event network-vif-deleted:cc2a93fb-f74f-48e8-a05f-eb61d13a7bca for instance 2b334a2a-d3a5-490a-a1a1-46232024383e on n-h1-860864-8 Oct 12 23:02:02.837797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c3ebe9ac-927f-4431-8cd5-d18265ca01c0 req-aa32545f-cce6-423e-a75e-43de29593cb6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040214 Oct 12 23:02:02.838492 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2771/5433] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:03.196302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:03.199530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:03.207635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.209328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.209935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.210752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.211366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.211802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.246268 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c547f3ad-38c5-4db8-be83-c40e967aab16 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051709 Oct 12 23:02:03.250973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2663/5434] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:02:03 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:03.317779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:03.319221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:03.326290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.327138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.327685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.328671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.329255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.329694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.358404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:02:03.521500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22789c3e-9320-4e20-a56d-e9cebebfa6c2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 204 len: 0 microversion: 2.20 time: 0.207071 Oct 12 23:02:03.522664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2772/5435] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 23:02:03 2022] DELETE /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:02:03.532106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:03.532727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:03.541224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.541848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.543221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.544951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.547241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.547922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.610808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:03.611625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] [instance: 2b334a2a-d3a5-490a-a1a1-46232024383e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:03.618112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.618713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.619239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.620096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:03.620636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:03.621164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:03.636561 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] HTTP exception thrown: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e could not be found. Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Request method failure captured: Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e HTTP/1.1 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0We39ZUeQZmjVL-3duGV7SiqzM_4PxH2YWvrb736LqQdTw2C_YL1vAiGBwjlPSJUN8aNoRlV03jMdwDpHkWd78SSN39dR4fnpAVSQXtZrTjuH3GGu-3Atd3aBJgyqwLBgbZ3fCKOmlW8Go10S1MoHEJlUH8G9PH_ZQwmtwBykULhsI Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1909b9808794051a8d86451506ca5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1909b9808794051a8d86451506ca5bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1909b9808794051a8d86451506ca5bb"}]}] Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-238797932 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d1909b9808794051a8d86451506ca5bb Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-238797932 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: b103c953780a4dce8d8872ee8b47d186 Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-238797932-project Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e could not be found. Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '2b334a2a-d3a5-490a-a1a1-46232024383e'} Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e could not be found. Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e could not be found. Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:03.638704 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e could not be found. Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Returning 404 to user: Instance 2b334a2a-d3a5-490a-a1a1-46232024383e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:03.642600 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cec8e19e-39ff-40d1-ab0f-f90a03dd7392 tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e" status: 404 len: 111 microversion: 2.1 time: 0.033760 Oct 12 23:02:03.644050 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2773/5436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:03 2022] GET /compute/v2.1/servers/2b334a2a-d3a5-490a-a1a1-46232024383e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:02:03.648937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dba76b2f-39b5-472a-a690-818eec873a8b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] Calling method '.version_select at 0x7f44fec1d9d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:03.671986 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dba76b2f-39b5-472a-a690-818eec873a8b tempest-ServerActionsTestJSON-238797932 tempest-ServerActionsTestJSON-238797932-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-14197385" status: 202 len: 0 microversion: 2.1 time: 0.026702 Oct 12 23:02:03.676785 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2774/5437] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 12 23:02:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-14197385 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:02:03.713733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:03.723455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:03.725067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:03.726303 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-72f5d7af-715d-4977-88e0-6c0ea1afd6d2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.198667 Oct 12 23:02:03.727191 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2664/5438] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:03 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:04.759674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:04.761505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:04.769665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:04.770506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:04.771123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:04.772115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:04.773141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:04.773251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:05.006412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:05.016006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:05.017490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:05.018681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2bc7806-bf7f-47d6-9b70-2085acb7c433 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1723 microversion: 2.20 time: 0.265577 Oct 12 23:02:05.019535 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2775/5439] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:04 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:06.045172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:06.045848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:06.052585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:06.053288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:06.053895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.054797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:06.055763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:06.056388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.214777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-975350a9-f8f1-4a32-85e8-928a2e5e31bd req-7ad50465-f253-4172-bc99-cc5eedac06a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b3e3aa-ae92-4854-981d-68a9796316f5", "name": "network-vif-deleted", "tag": "20bc9dc1-2206-4cc1-846f-ad5b3f3750a1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:06.238847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:06.248810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:06.256259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:06.262633 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c5a059af-8dae-44d4-b554-2845bdd8bfa6 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 200 len: 1655 microversion: 2.20 time: 0.222651 Oct 12 23:02:06.265356 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2665/5440] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:06 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 1655 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:06.277952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-975350a9-f8f1-4a32-85e8-928a2e5e31bd req-7ad50465-f253-4172-bc99-cc5eedac06a5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:06.278650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-975350a9-f8f1-4a32-85e8-928a2e5e31bd req-7ad50465-f253-4172-bc99-cc5eedac06a5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:06.279263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-975350a9-f8f1-4a32-85e8-928a2e5e31bd req-7ad50465-f253-4172-bc99-cc5eedac06a5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:06.321713 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-975350a9-f8f1-4a32-85e8-928a2e5e31bd req-7ad50465-f253-4172-bc99-cc5eedac06a5 service nova] Creating event network-vif-deleted:20bc9dc1-2206-4cc1-846f-ad5b3f3750a1 for instance 69b3e3aa-ae92-4854-981d-68a9796316f5 on n-h1-860864-8 Oct 12 23:02:06.331693 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-975350a9-f8f1-4a32-85e8-928a2e5e31bd req-7ad50465-f253-4172-bc99-cc5eedac06a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126129 Oct 12 23:02:06.338373 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2776/5441] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:07.295002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:07.295742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:07.305793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:07.308119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:07.310485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:07.311345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:07.313922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:07.314876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:07.351024 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] HTTP exception thrown: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Request method failure captured: Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 HTTP/1.1 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ah-lDf01bNKmlyBb1kW833quo_mhiDILphOsWNn0uAtE7ST3NZrhwytqx61fpWLFsC4fXa6ocHrRkcO8iPJpjcXLbwq7bylP1MwHPYXO0c0PEiSwtvTbTTI_XpMIbJsoIFtKQytF6v7d9vbFa0uvehGq_wngolEixDrSgIg2_TxoY Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8523b5fafc5447e8b3b370133590195e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}] Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4fdc00d99b344f69a42a4b60ceaed051 Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '69b3e3aa-ae92-4854-981d-68a9796316f5'} Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:07.365831 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:02:07.370926 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:07.372446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Returning 404 to user: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:07.380665 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46d3fa82-f5d2-4328-b2f5-5a5a8da5ec61 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 404 len: 111 microversion: 2.20 time: 0.091766 Oct 12 23:02:07.381370 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2666/5442] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:07 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:02:07.392398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60ccd26f-6766-4a63-91c9-caed3d9b6f4d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '.version_select at 0x7f4507a389d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:07.429379 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-60ccd26f-6766-4a63-91c9-caed3d9b6f4d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-729431696" status: 204 len: 0 microversion: 2.20 time: 0.033180 Oct 12 23:02:07.434147 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2777/5443] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Oct 12 23:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-729431696 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:02:09.121350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afdcc949-8d5f-42d9-8626-596972def56c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'create', calling method: .version_select at 0x7f44fe7f8820>, body: {"keypair": {"name": "tempest-keypair-2080828481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0EX71LD18MgGY4KKm89Cd3k+gMtJOmFxAtHrBWvNeIbFeF1dI1D1oXCe8ZDYiMbJAtg9xd232zZFv/b03FEjIpi0O3vgWM5dl4PsdNr+w2Hsxbdev3abVXTSZM7IAQGw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:09.146596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-afdcc949-8d5f-42d9-8626-596972def56c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for project 8523b5fafc5447e8b3b370133590195e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:09.154829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-afdcc949-8d5f-42d9-8626-596972def56c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for user 4fdc00d99b344f69a42a4b60ceaed051 and project 8523b5fafc5447e8b3b370133590195e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:09.208146 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afdcc949-8d5f-42d9-8626-596972def56c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.084443 Oct 12 23:02:09.222336 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2667/5444] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 12 23:02:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 23:02:11.357852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-990306048", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9dff008d-e9d4-4e10-a049-f696efdc5171"}], "security_groups": [{"name": "tempest-securitygroup--1582386829"}], "key_name": "tempest-keypair-2080828481", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:11.502563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] validate_networks() for [('9dff008d-e9d4-4e10-a049-f696efdc5171', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:02:12.026644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:02:12.028440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:02:12.029130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:02:12.029609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:02:12.030254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:02:12.039807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:12.040617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:12.041222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:12.042161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:12.042839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:12.043422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:12.104754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for project 8523b5fafc5447e8b3b370133590195e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:12.115080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Getting quotas for user 4fdc00d99b344f69a42a4b60ceaed051 and project 8523b5fafc5447e8b3b370133590195e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:12.125243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:12.129948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:02:12.132812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:02:12.202984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13502129-43ba-4ebb-bdbb-bbb6e51b5a01 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.850900 Oct 12 23:02:12.206514 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2778/5445] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 12 23:02:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 23:02:12.217081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9aa60a74-cd14-41ea-b9d7-d61bac43f724 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:12.217707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9aa60a74-cd14-41ea-b9d7-d61bac43f724 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:12.331223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9aa60a74-cd14-41ea-b9d7-d61bac43f724 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:12.342176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9aa60a74-cd14-41ea-b9d7-d61bac43f724 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:12.343781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9aa60a74-cd14-41ea-b9d7-d61bac43f724 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:12.346321 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9aa60a74-cd14-41ea-b9d7-d61bac43f724 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1281 microversion: 2.20 time: 0.135111 Oct 12 23:02:12.347074 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2668/5446] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:12 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:13.376849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:13.377720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:13.390111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:13.390827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:13.392114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:13.393058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:13.393542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:13.393986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:13.463146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:13.477327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:13.483703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:13.492102 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f7bdd27-6bd4-4598-863c-eff795d7496b tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1333 microversion: 2.20 time: 0.120298 Oct 12 23:02:13.493003 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2779/5447] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:13 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:14.518821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:14.519446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:14.535482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:14.536021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:14.536467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:14.537183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:14.537643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:14.538074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:14.628146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:14.643113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:14.644834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:14.646245 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eebd8afd-918a-4b82-88ce-fc8a86ec34a3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1339 microversion: 2.20 time: 0.131350 Oct 12 23:02:14.647315 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2669/5448] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:14 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:15.673731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:15.675517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:15.685140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:15.685870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:15.686536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:15.687401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:15.688640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:15.689417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:16.393512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:16.403671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:16.405580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:16.406915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-deacdd61-a45a-4abc-ad04-d1e166f698b0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1407 microversion: 2.20 time: 0.738312 Oct 12 23:02:16.407644 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2780/5449] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:15 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1407 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:02:17.247540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4f35da45-a819-4f54-be1f-0a9d0ebf9da8 req-0fd983f3-85cf-4252-bbd8-1a66a20c6508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:17.261765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f35da45-a819-4f54-be1f-0a9d0ebf9da8 req-0fd983f3-85cf-4252-bbd8-1a66a20c6508 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:17.262419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f35da45-a819-4f54-be1f-0a9d0ebf9da8 req-0fd983f3-85cf-4252-bbd8-1a66a20c6508 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:17.263249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f35da45-a819-4f54-be1f-0a9d0ebf9da8 req-0fd983f3-85cf-4252-bbd8-1a66a20c6508 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:17.289743 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4f35da45-a819-4f54-be1f-0a9d0ebf9da8 req-0fd983f3-85cf-4252-bbd8-1a66a20c6508 service nova] Creating event network-changed:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h2-860864-8 Oct 12 23:02:17.299352 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4f35da45-a819-4f54-be1f-0a9d0ebf9da8 req-0fd983f3-85cf-4252-bbd8-1a66a20c6508 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057542 Oct 12 23:02:17.301293 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2670/5450] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:17.433986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:17.435634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:17.443338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:17.444619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:17.445454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:17.446733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:17.448514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:17.449170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:17.643733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-542516814", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "76849c1b-c566-419b-8057-e070c494f062"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:17.708077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:17.721435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:17.724146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:17.725941 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8073ce73-b369-489a-a9fa-fbb254435b2f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1407 microversion: 2.20 time: 0.296673 Oct 12 23:02:17.726793 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2671/5451] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:17 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:17.751823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] validate_networks() for [('76849c1b-c566-419b-8057-e070c494f062', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:02:18.242871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:02:18.243429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:02:18.244234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:02:18.244845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:02:18.245372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:02:18.255241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:18.255796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:18.256367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:18.257196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:18.257909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:18.258404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:18.277503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Getting quotas for project b309efdab68141749cb97dbaa47316b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:18.282732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Getting quotas for user e7996b50c09c4888a30f58fcd068ba95 and project b309efdab68141749cb97dbaa47316b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:18.295693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:02:18.298059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:02:18.358041 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-efdc8052-680b-41bd-bf6e-6f98d76c0c2c tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957625 Oct 12 23:02:18.361875 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2781/5452] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:02:18.373318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2274bae4-5ffe-4a42-ad06-7632fc6cdbf5 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:18.374514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2274bae4-5ffe-4a42-ad06-7632fc6cdbf5 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:18.451458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2274bae4-5ffe-4a42-ad06-7632fc6cdbf5 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:18.458885 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2274bae4-5ffe-4a42-ad06-7632fc6cdbf5 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1224 microversion: 2.1 time: 0.089975 Oct 12 23:02:18.461275 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2672/5453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:18 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:18.766025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:18.767241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:18.792567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:18.793471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:18.794119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:18.795041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:18.795796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:18.796418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:19.166704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:19.190503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:19.201925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:19.207220 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3667eaa9-fe9a-48ec-a692-aa8a17a553cb tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1407 microversion: 2.20 time: 0.456243 Oct 12 23:02:19.208541 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2782/5454] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:18 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:19.484904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:19.486531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:19.499806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:19.500947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:19.505314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:19.506336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:19.506819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:19.507400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:19.582794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:19.597526 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ffccd962-fb5f-4337-96be-313944043786 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1276 microversion: 2.1 time: 0.118540 Oct 12 23:02:19.598408 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2673/5455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:19 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:20.235962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:20.237742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:20.252076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:20.265073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:20.265259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:20.266212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:20.266888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:20.267499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:20.405928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:20.406809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:20.415055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:20.423371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:20.424228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:20.426106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:20.429961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:20.430590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:20.467979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-69f55f12-9e5a-48da-a32c-ac659974ea70 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/ips" status: 200 len: 145 microversion: 2.1 time: 0.065857 Oct 12 23:02:20.468583 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2674/5456] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:02:20 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:02:20.473805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:20.485390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:20.486866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:20.488080 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1405a180-c5a9-4ef6-abb1-75df564fa5d7 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1407 microversion: 2.20 time: 0.257988 Oct 12 23:02:20.488584 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2783/5457] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:20 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:02:20.621151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:20.621813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:20.631725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:20.632244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:20.632715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:20.633812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:20.634337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:20.634812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:21.077591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:21.085785 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-22a13c6a-77ca-4152-aa70-4d18372f135f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1324 microversion: 2.1 time: 0.468686 Oct 12 23:02:21.090476 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2675/5458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:20 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:21.300899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3d754d38-7c94-4f85-bfb4-4786ed5f81ea req-fdfae867-2cb4-4449-956c-3d82b7337b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "name": "network-vif-plugged", "status": "completed", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:21.315336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3d754d38-7c94-4f85-bfb4-4786ed5f81ea req-fdfae867-2cb4-4449-956c-3d82b7337b10 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:21.315832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3d754d38-7c94-4f85-bfb4-4786ed5f81ea req-fdfae867-2cb4-4449-956c-3d82b7337b10 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:21.316361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3d754d38-7c94-4f85-bfb4-4786ed5f81ea req-fdfae867-2cb4-4449-956c-3d82b7337b10 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:21.334644 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3d754d38-7c94-4f85-bfb4-4786ed5f81ea req-fdfae867-2cb4-4449-956c-3d82b7337b10 service nova] Creating event network-vif-plugged:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h2-860864-8 Oct 12 23:02:21.341208 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3d754d38-7c94-4f85-bfb4-4786ed5f81ea req-fdfae867-2cb4-4449-956c-3d82b7337b10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136038 Oct 12 23:02:21.342271 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2784/5459] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:21.518984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:21.520117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:21.528564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:21.535404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:21.536005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:21.536463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:21.537252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:21.537718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:21.538152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:21.866572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:21.870221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:21.879913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:21.886463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:21.889982 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3ae9783-215a-4ee1-9506-f1bf3ea87a67 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1407 microversion: 2.20 time: 0.375070 Oct 12 23:02:21.891096 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2676/5460] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:21 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:02:22.116746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:22.117468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:22.123974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:22.124476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:22.124927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:22.125645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:22.126109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:22.126548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:22.143506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:22.250516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9914d8c1-7e5b-4b0e-a52c-9b8a6e1de1e2 req-afada159-5d2a-45c1-b536-93fd7774109d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93538b92-5c3f-4f99-a711-6e2b8f874eb9", "tag": "6ba0eeb0-260d-4da4-80ce-0bde15e7c97f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:22.264889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9914d8c1-7e5b-4b0e-a52c-9b8a6e1de1e2 req-afada159-5d2a-45c1-b536-93fd7774109d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:22.265458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9914d8c1-7e5b-4b0e-a52c-9b8a6e1de1e2 req-afada159-5d2a-45c1-b536-93fd7774109d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:22.265992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9914d8c1-7e5b-4b0e-a52c-9b8a6e1de1e2 req-afada159-5d2a-45c1-b536-93fd7774109d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:22.291734 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9914d8c1-7e5b-4b0e-a52c-9b8a6e1de1e2 req-afada159-5d2a-45c1-b536-93fd7774109d service nova] Creating event network-changed:6ba0eeb0-260d-4da4-80ce-0bde15e7c97f for instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 on n-h1-860864-8 Oct 12 23:02:22.305326 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9914d8c1-7e5b-4b0e-a52c-9b8a6e1de1e2 req-afada159-5d2a-45c1-b536-93fd7774109d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059946 Oct 12 23:02:22.305956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2677/5461] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:22.319875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:22.328458 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e3bc598-f2f4-4631-ba17-bf23014b6101 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1324 microversion: 2.1 time: 0.216174 Oct 12 23:02:22.329020 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2785/5462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:22 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:22.918494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:22.919297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:22.925946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:22.926678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:22.927125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:22.927830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:22.928345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:22.928784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:23.082973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:23.108186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:23.109799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:23.111224 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b739da22-8e35-486a-b1df-6d670a2b0042 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1600 microversion: 2.20 time: 0.198262 Oct 12 23:02:23.112649 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2678/5463] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:02:22 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1600 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:02:23.142638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:23.143220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:23.153136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:23.153894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:23.154516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:23.155412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:23.156072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:23.156694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:23.183155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "731bf14a-c853-4c59-989a-fcc92f2b050e"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:23.185841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:23.193233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:23.193824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:23.194332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:23.195107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:23.195667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:23.196341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:23.256644 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10456acf-a8d9-4b05-8599-90c3ec07f9ed tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.118062 Oct 12 23:02:23.257298 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2786/5464] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 12 23:02:23 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:02:23.353937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:23.355399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:23.362930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:23.363782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:23.364525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:23.366204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:23.366891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:23.367553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:23.609654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:23.628438 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-baecd1b7-c780-45ff-bcd6-9b93c45d3d3d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1324 microversion: 2.1 time: 0.277849 Oct 12 23:02:23.644553 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2787/5465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:23 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:24.127093 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ffec74b-d336-47c6-aad3-39aa7a37a595 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.948994 Oct 12 23:02:24.145662 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2679/5466] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:02:23 2022] POST /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments => generated 194 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:24.510856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-055d692c-64d1-4ac7-a11e-7f81d11bc2e2 req-27975c74-4841-42c9-a5da-b2d963f96e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:24.528600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-055d692c-64d1-4ac7-a11e-7f81d11bc2e2 req-27975c74-4841-42c9-a5da-b2d963f96e1b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:24.529090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-055d692c-64d1-4ac7-a11e-7f81d11bc2e2 req-27975c74-4841-42c9-a5da-b2d963f96e1b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:24.529539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-055d692c-64d1-4ac7-a11e-7f81d11bc2e2 req-27975c74-4841-42c9-a5da-b2d963f96e1b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:24.552378 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-055d692c-64d1-4ac7-a11e-7f81d11bc2e2 req-27975c74-4841-42c9-a5da-b2d963f96e1b service nova] Creating event network-changed:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h2-860864-8 Oct 12 23:02:24.557890 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-055d692c-64d1-4ac7-a11e-7f81d11bc2e2 req-27975c74-4841-42c9-a5da-b2d963f96e1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050905 Oct 12 23:02:24.558711 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2788/5467] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:24.657021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:24.657747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:24.673896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:24.674396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:24.676732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:24.679327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:24.679817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:24.680286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:24.894820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:24.904554 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8aa6da17-c469-42cd-888a-5084697d24bc tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1324 microversion: 2.1 time: 0.255537 Oct 12 23:02:24.921324 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2680/5468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:24 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:25.930808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:25.931935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:25.939737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:25.940450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:25.940553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:25.941542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:25.942199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:25.942816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:26.093454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:26.101228 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ab350b0-8a36-4488-befe-622ca4b56188 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1324 microversion: 2.1 time: 0.175985 Oct 12 23:02:26.101813 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2789/5469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:25 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1324 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:27.126425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:27.127111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:27.133902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:27.134915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:27.135514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:27.136447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:27.136899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:27.137576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:27.302375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:27.313525 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-81ca7648-b26b-4c17-a47d-8c7c0413a568 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1324 microversion: 2.1 time: 0.191174 Oct 12 23:02:27.332288 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2681/5470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:27 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:28.310038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7203ef8f-8157-492c-868a-470bc4396707 req-4af72f10-8b2b-491b-a56e-9b73ba131ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93538b92-5c3f-4f99-a711-6e2b8f874eb9", "name": "network-vif-plugged", "status": "completed", "tag": "6ba0eeb0-260d-4da4-80ce-0bde15e7c97f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:28.320792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:28.322431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:28.328378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7203ef8f-8157-492c-868a-470bc4396707 req-4af72f10-8b2b-491b-a56e-9b73ba131ad0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:28.329241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7203ef8f-8157-492c-868a-470bc4396707 req-4af72f10-8b2b-491b-a56e-9b73ba131ad0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:28.329875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7203ef8f-8157-492c-868a-470bc4396707 req-4af72f10-8b2b-491b-a56e-9b73ba131ad0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:28.338034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:28.338752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:28.346239 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7203ef8f-8157-492c-868a-470bc4396707 req-4af72f10-8b2b-491b-a56e-9b73ba131ad0 service nova] Creating event network-vif-plugged:6ba0eeb0-260d-4da4-80ce-0bde15e7c97f for instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 on n-h1-860864-8 Oct 12 23:02:28.352129 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7203ef8f-8157-492c-868a-470bc4396707 req-4af72f10-8b2b-491b-a56e-9b73ba131ad0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048447 Oct 12 23:02:28.353339 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2790/5471] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:28.354159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:28.354718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:28.355223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:28.355957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:28.356411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:28.356831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:28.455959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:28.640416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:28.648492 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2df5e40f-286b-4579-99cf-132dfa89b74b tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1324 microversion: 2.1 time: 0.314990 Oct 12 23:02:28.649221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2682/5472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:28 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:02:29.672862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:29.673424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:29.679709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:29.680224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:29.681428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:29.682344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:29.682810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:29.683238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:29.844255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:29.852924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe05f695-cf67-4ec7-8d4e-669fef8dfc6f tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1522 microversion: 2.1 time: 0.185231 Oct 12 23:02:29.853879 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2791/5473] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:29 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:02:29.876645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:29.877301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:29.884925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:29.885427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:29.885856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:29.886590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:29.887044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:29.887729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:29.911855 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] HTTP exception thrown: Instance is not a member of specified network Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Request method failure captured: Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9/ips/invalid HTTP/1.1 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0d54Dpg23ykeMFjAGzi0C7EbroJDBAUGTutCY7DMivJQgNGN6zqdzOVjpwxxyEKuKOXn5Azi6BkoK8fBNHKTuO7tl4c8CfJb2gYAW_vz5ZaB7gyt8K4LqAQOkLBiYBmeNfaRkOVDXZdGWvHGwmQ-NAY9101xm0srrA7pKmN5CK3VUM Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: b309efdab68141749cb97dbaa47316b8 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b309efdab68141749cb97dbaa47316b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b309efdab68141749cb97dbaa47316b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b309efdab68141749cb97dbaa47316b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b309efdab68141749cb97dbaa47316b8"}]}] Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: b309efdab68141749cb97dbaa47316b8 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerAddressesNegativeTestJSON-62941927-project Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e7996b50c09c4888a30f58fcd068ba95 Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-62941927-project Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance is not a member of specified network Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '93538b92-5c3f-4f99-a711-6e2b8f874eb9', 'id': 'invalid'} Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 12 23:02:29.920745 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.928845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:29.928845 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7cc571c4-6d85-427c-a4bd-a530688947b1 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.049762 Oct 12 23:02:29.928845 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2683/5474] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 12 23:02:29 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9/ips/invalid => generated 91 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:02:29.932823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89d140ef-7765-4798-a501-05cf2689568d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:29.933326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89d140ef-7765-4798-a501-05cf2689568d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Failed to fetch instance by id 999 {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 23:02:29.933865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-89d140ef-7765-4798-a501-05cf2689568d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] HTTP exception thrown: Instance 999 could not be found. Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89d140ef-7765-4798-a501-05cf2689568d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Request method failure captured: Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0d54Dpg23ykeMFjAGzi0C7EbroJDBAUGTutCY7DMivJQgNGN6zqdzOVjpwxxyEKuKOXn5Azi6BkoK8fBNHKTuO7tl4c8CfJb2gYAW_vz5ZaB7gyt8K4LqAQOkLBiYBmeNfaRkOVDXZdGWvHGwmQ-NAY9101xm0srrA7pKmN5CK3VUM Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: b309efdab68141749cb97dbaa47316b8 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b309efdab68141749cb97dbaa47316b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b309efdab68141749cb97dbaa47316b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b309efdab68141749cb97dbaa47316b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b309efdab68141749cb97dbaa47316b8"}]}] Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: b309efdab68141749cb97dbaa47316b8 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerAddressesNegativeTestJSON-62941927-project Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e7996b50c09c4888a30f58fcd068ba95 Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-62941927-project Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 999 could not be found. Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': '999'} Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 12 23:02:29.935627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:02:29.944263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89d140ef-7765-4798-a501-05cf2689568d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:29.944263 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89d140ef-7765-4798-a501-05cf2689568d tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008871 Oct 12 23:02:29.944263 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2792/5475] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 23:02:29 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:02:29.947352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:29.948062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:29.954275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:29.954735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:29.955583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:29.956366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:29.956819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:29.957241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:29.984253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:02:30.067617 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b1b3760-3b6c-4d16-8905-1516bd4c386e tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 204 len: 0 microversion: 2.1 time: 0.124744 Oct 12 23:02:30.068229 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2684/5476] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:02:29 2022] DELETE /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:02:30.077430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:30.078066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:30.084109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:30.084619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:30.085073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:30.085789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:30.086260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:30.086702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:30.284620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:30.295417 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25b340c9-d1da-46de-953b-01c9bdcecf72 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1528 microversion: 2.1 time: 0.222621 Oct 12 23:02:30.296622 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2793/5477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:30 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1528 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:31.322879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:31.323596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:31.333907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:31.334596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:31.335208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:31.336113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:31.336726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:31.337358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:31.806585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7996b50c09c4888a30f58fcd068ba95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b309efdab68141749cb97dbaa47316b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:31.825065 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-838fe4f1-9016-4c46-851a-3730d660d7d8 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 200 len: 1528 microversion: 2.1 time: 0.510076 Oct 12 23:02:31.826030 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2685/5478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:31 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 1528 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:32.036938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-3c30ca5d-d38c-4abe-b459-2397159eb2cf req-2702a70a-6419-499a-a73b-e9751091da7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93538b92-5c3f-4f99-a711-6e2b8f874eb9", "name": "network-vif-deleted", "tag": "6ba0eeb0-260d-4da4-80ce-0bde15e7c97f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:32.049972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3c30ca5d-d38c-4abe-b459-2397159eb2cf req-2702a70a-6419-499a-a73b-e9751091da7e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:32.050986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3c30ca5d-d38c-4abe-b459-2397159eb2cf req-2702a70a-6419-499a-a73b-e9751091da7e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:32.051725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-3c30ca5d-d38c-4abe-b459-2397159eb2cf req-2702a70a-6419-499a-a73b-e9751091da7e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:32.067470 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-3c30ca5d-d38c-4abe-b459-2397159eb2cf req-2702a70a-6419-499a-a73b-e9751091da7e service nova] Creating event network-vif-deleted:6ba0eeb0-260d-4da4-80ce-0bde15e7c97f for instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 on n-h1-860864-8 Oct 12 23:02:32.074360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-3c30ca5d-d38c-4abe-b459-2397159eb2cf req-2702a70a-6419-499a-a73b-e9751091da7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041709 Oct 12 23:02:32.075731 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2794/5479] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:32.859959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:32.860778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] [instance: 93538b92-5c3f-4f99-a711-6e2b8f874eb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:32.869484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:32.870922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:32.871529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:32.872534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:32.873166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:32.873826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:32.889648 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] HTTP exception thrown: Instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 could not be found. Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Request method failure captured: Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 HTTP/1.1 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0d54Dpg23ykeMFjAGzi0C7EbroJDBAUGTutCY7DMivJQgNGN6zqdzOVjpwxxyEKuKOXn5Azi6BkoK8fBNHKTuO7tl4c8CfJb2gYAW_vz5ZaB7gyt8K4LqAQOkLBiYBmeNfaRkOVDXZdGWvHGwmQ-NAY9101xm0srrA7pKmN5CK3VUM Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: b309efdab68141749cb97dbaa47316b8 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b309efdab68141749cb97dbaa47316b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b309efdab68141749cb97dbaa47316b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b309efdab68141749cb97dbaa47316b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b309efdab68141749cb97dbaa47316b8"}]}] Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: b309efdab68141749cb97dbaa47316b8 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-62941927 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerAddressesNegativeTestJSON-62941927-project Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e7996b50c09c4888a30f58fcd068ba95 Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-62941927-project Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 could not be found. Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '93538b92-5c3f-4f99-a711-6e2b8f874eb9'} Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 could not be found. Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 could not be found. Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:32.891563 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 could not be found. Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] Returning 404 to user: Instance 93538b92-5c3f-4f99-a711-6e2b8f874eb9 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33e224bc-31e3-4c73-a247-fabdf65bfdb9 tempest-ServerAddressesNegativeTestJSON-62941927 tempest-ServerAddressesNegativeTestJSON-62941927-project] 10.222.0.20 "GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9" status: 404 len: 111 microversion: 2.1 time: 0.043496 Oct 12 23:02:32.895882 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2686/5480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:32 2022] GET /compute/v2.1/servers/93538b92-5c3f-4f99-a711-6e2b8f874eb9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:02:38.441590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:38.444948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:38.461356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:38.462355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:38.463325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:38.465400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:38.466040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:38.466481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:38.510888 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4f7e7b3-8ffe-40a2-b707-97ca1513d191 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072536 Oct 12 23:02:38.513558 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2795/5481] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:02:38 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:38.527742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:38.528284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:38.536469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:38.538410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:38.540413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:38.541324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:38.556774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:38.562160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:38.605569 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1009cb4e-7e31-4bdd-b6d6-f1c41475dc7f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/731bf14a-c853-4c59-989a-fcc92f2b050e" status: 200 len: 194 microversion: 2.1 time: 0.083861 Oct 12 23:02:38.606192 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2687/5482] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Oct 12 23:02:38 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/731bf14a-c853-4c59-989a-fcc92f2b050e => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:41.273104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed32f904-836a-4e87-8505-0c66db26bbeb"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:41.276011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:41.327172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:41.327820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:41.328675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:41.329530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:41.330112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:41.330679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:41.916035 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2b2e911-e227-4661-b07f-58fb1a83461f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "POST /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636971 Oct 12 23:02:41.918772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2796/5483] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:02:41 2022] POST /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:47.043565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-347884926", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:47.139471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] validate_networks() for [('552086e0-5d8d-4382-8a31-614a6ab893ab', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:02:47.965983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:02:47.978458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:02:47.978458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:02:47.978458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:02:47.978458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:02:47.990434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:47.991055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:47.991582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:47.992607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:47.993156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:47.993673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:48.050385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:48.059346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for user bfac41041e134286b73fba63b8b2883c and project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:48.080605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:02:48.083259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:02:48.173945 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5a0e00c-41b3-4e0f-bcab-e355cffebe03 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.463535 Oct 12 23:02:48.174914 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2688/5484] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:02:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:02:48.187136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-410ad672-b4b3-466b-9901-1b35ca47a7ea tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:48.188250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-410ad672-b4b3-466b-9901-1b35ca47a7ea tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:48.203420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:48.291291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-410ad672-b4b3-466b-9901-1b35ca47a7ea tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:48.301463 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-410ad672-b4b3-466b-9901-1b35ca47a7ea tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1221 microversion: 2.1 time: 0.118647 Oct 12 23:02:48.312521 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2797/5485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:48 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:48.439780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2083329977", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:48.535616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] validate_networks() for [('552086e0-5d8d-4382-8a31-614a6ab893ab', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:02:49.490900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:02:49.491734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:02:49.492030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:02:49.493010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:02:49.493569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:02:49.523728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:49.524460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:49.525005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:49.527049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:49.528137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:49.529977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:49.573724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:49.581831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for user bfac41041e134286b73fba63b8b2883c and project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:49.601047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:02:49.604433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:02:49.696359 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-063efad5-9c9c-4806-acba-234a490e460d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.269858 Oct 12 23:02:49.702912 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2689/5486] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:02:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:02:49.717368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e6d0df6-e583-426b-be0d-1353cfa4b423 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:49.718534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e6d0df6-e583-426b-be0d-1353cfa4b423 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:49.870260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e6d0df6-e583-426b-be0d-1353cfa4b423 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:49.880673 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e6d0df6-e583-426b-be0d-1353cfa4b423 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1222 microversion: 2.1 time: 0.176069 Oct 12 23:02:49.882854 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2798/5487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:49 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:50.910155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:50.912946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:50.936051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:50.938744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:50.939384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:50.941810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:50.943881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:50.946847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:51.140703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:51.149569 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36c8cc2d-a368-4c16-a955-d2ad7814ab0f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1274 microversion: 2.1 time: 0.246732 Oct 12 23:02:51.166631 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2690/5488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:50 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:52.174430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:52.176175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:52.183572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:52.211981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:52.213904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:52.215962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:52.229201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:52.231676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:52.232429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:52.373407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:52.389219 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-adc33aca-24bf-4e85-bc93-5f3030f8d744 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1280 microversion: 2.1 time: 0.216600 Oct 12 23:02:52.390212 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2799/5489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:52 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:53.136827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5ff693e2-79b6-4d52-8b3e-fdee02516be8 req-fe08d124-f24e-473e-857c-91be2b7b61a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2e452a-242c-498f-8821-4186f2c4bd5d", "tag": "0f3b6d35-d3b8-42cf-afe8-4c3bd4ff5bce"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:53.148865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:53.178191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5ff693e2-79b6-4d52-8b3e-fdee02516be8 req-fe08d124-f24e-473e-857c-91be2b7b61a1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:53.184539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5ff693e2-79b6-4d52-8b3e-fdee02516be8 req-fe08d124-f24e-473e-857c-91be2b7b61a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:53.185239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5ff693e2-79b6-4d52-8b3e-fdee02516be8 req-fe08d124-f24e-473e-857c-91be2b7b61a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:53.204701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:02:53.249945 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5ff693e2-79b6-4d52-8b3e-fdee02516be8 req-fe08d124-f24e-473e-857c-91be2b7b61a1 service nova] Creating event network-changed:0f3b6d35-d3b8-42cf-afe8-4c3bd4ff5bce for instance 4d2e452a-242c-498f-8821-4186f2c4bd5d on n-h1-860864-8 Oct 12 23:02:53.267361 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5ff693e2-79b6-4d52-8b3e-fdee02516be8 req-fe08d124-f24e-473e-857c-91be2b7b61a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134513 Oct 12 23:02:53.269272 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2691/5490] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:53.413533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:53.415557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:53.428057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:53.428057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:53.440184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:53.440980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:53.441474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:53.441924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:53.849553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:53.862532 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c86b00d-e33a-4658-a2bd-6c6b026c83d4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1322 microversion: 2.1 time: 0.453200 Oct 12 23:02:53.875994 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2800/5491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:53 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:54.728017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-245d97c6-7f15-405f-9511-c0258224fff2 req-919271dd-4f03-4da6-b935-5b2dbee1e43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44272fc-2656-447f-80f5-68ab02fe46b0", "tag": "d14480b6-5cd3-4185-9786-4822ef5604b1"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:54.741778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-245d97c6-7f15-405f-9511-c0258224fff2 req-919271dd-4f03-4da6-b935-5b2dbee1e43b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:54.742363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-245d97c6-7f15-405f-9511-c0258224fff2 req-919271dd-4f03-4da6-b935-5b2dbee1e43b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:54.742882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-245d97c6-7f15-405f-9511-c0258224fff2 req-919271dd-4f03-4da6-b935-5b2dbee1e43b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:54.754581 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-245d97c6-7f15-405f-9511-c0258224fff2 req-919271dd-4f03-4da6-b935-5b2dbee1e43b service nova] Creating event network-changed:d14480b6-5cd3-4185-9786-4822ef5604b1 for instance c44272fc-2656-447f-80f5-68ab02fe46b0 on n-h2-860864-8 Oct 12 23:02:54.763778 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-245d97c6-7f15-405f-9511-c0258224fff2 req-919271dd-4f03-4da6-b935-5b2dbee1e43b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150356 Oct 12 23:02:54.768637 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2692/5492] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:54.890061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:54.891246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:54.898904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:54.899660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:54.900309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:54.901212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:54.901837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:54.902436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:55.134529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:55.147340 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bb025cf-1ba6-4d20-9366-99db6fe54207 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1322 microversion: 2.1 time: 0.261279 Oct 12 23:02:55.176790 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2801/5493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:54 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:56.180602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:56.181607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:56.188645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:56.189135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:56.189569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:56.190535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:56.190991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:56.191702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:56.407139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:56.426025 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-44d5a060-a6a3-4c52-a8d1-027af6c6655c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1322 microversion: 2.1 time: 0.244420 Oct 12 23:02:56.426025 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2693/5494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:56 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:57.445145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:57.445848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:57.470134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:57.470909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:57.471364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:57.472120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:57.472745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:57.473343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:57.680756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:57.693282 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b866b359-2c5b-4b16-806a-4d1694bd9751 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1322 microversion: 2.1 time: 0.252087 Oct 12 23:02:57.696520 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2802/5495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:57 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:02:58.604922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-89a0a4ac-4791-4921-9e54-6a66c3a4e0e0 req-ccb3c931-d8c8-4987-b5b6-6063ff2fc61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2e452a-242c-498f-8821-4186f2c4bd5d", "name": "network-vif-plugged", "status": "completed", "tag": "0f3b6d35-d3b8-42cf-afe8-4c3bd4ff5bce"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:58.626647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-89a0a4ac-4791-4921-9e54-6a66c3a4e0e0 req-ccb3c931-d8c8-4987-b5b6-6063ff2fc61b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:58.627398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-89a0a4ac-4791-4921-9e54-6a66c3a4e0e0 req-ccb3c931-d8c8-4987-b5b6-6063ff2fc61b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:58.635646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-89a0a4ac-4791-4921-9e54-6a66c3a4e0e0 req-ccb3c931-d8c8-4987-b5b6-6063ff2fc61b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:58.637416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec7eeaa1-b10d-4595-8ecb-c6fca6fdbc18 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Action: 'create', calling method: .version_select at 0x7f44fec53550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-871396140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqfWilh8EeiksItpv179AiSdaSHSId0teZscXVPEPqlnR0yzu+rzSqBIE1qL6V7H+62Jic4fI+lgBvRcjiN/WN0+K2s/SHu70EzCv4AwhzDLZsR1yG/aP/nZ7xQfJMItQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:02:58.662373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-ec7eeaa1-b10d-4595-8ecb-c6fca6fdbc18 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Getting quotas for project 5afaf2366bbf4eba869e2a8eb9b0e471. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:02:58.670226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-ec7eeaa1-b10d-4595-8ecb-c6fca6fdbc18 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Getting quotas for user 4065d3f8847246e1bbd84151601311c2 and project 5afaf2366bbf4eba869e2a8eb9b0e471. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:02:58.671248 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-89a0a4ac-4791-4921-9e54-6a66c3a4e0e0 req-ccb3c931-d8c8-4987-b5b6-6063ff2fc61b service nova] Creating event network-vif-plugged:0f3b6d35-d3b8-42cf-afe8-4c3bd4ff5bce for instance 4d2e452a-242c-498f-8821-4186f2c4bd5d on n-h1-860864-8 Oct 12 23:02:58.683407 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-89a0a4ac-4791-4921-9e54-6a66c3a4e0e0 req-ccb3c931-d8c8-4987-b5b6-6063ff2fc61b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082290 Oct 12 23:02:58.684160 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2694/5496] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:58.703701 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec7eeaa1-b10d-4595-8ecb-c6fca6fdbc18 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.072644 Oct 12 23:02:58.710379 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2803/5497] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:02:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:58.725778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:58.726637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:58.744493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:58.745156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:58.749971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:58.750779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:58.751866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:58.752496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:58.950907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:58.959251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:58.967087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:58.967932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:58.968548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:58.969259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:58.969963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:58.970305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.002159 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89464bc4-2a07-49f7-b8c4-3bc74394dad4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060659 Oct 12 23:02:59.003691 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2804/5498] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:02:58 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:59.089177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:59.089995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:59.096249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.096939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.097550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.098293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.098906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.099489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.122614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:02:59.132571 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40bd504e-9c00-4774-a497-32721f84bbaf tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/ips" status: 200 len: 152 microversion: 2.20 time: 0.047857 Oct 12 23:02:59.140681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e01177eb-6cce-4cc3-8c9c-f125aec0dbbf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1322 microversion: 2.1 time: 0.414711 Oct 12 23:02:59.141520 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2805/5499] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Oct 12 23:02:59 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 23:02:59.154119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:59.154967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:59.156496 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2695/5500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:02:58 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:02:59.162324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.163387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.164476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.165345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.166235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.166564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.201238 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bc52a8d-e822-4ec8-a3dc-0edac040544c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/731bf14a-c853-4c59-989a-fcc92f2b050e" status: 200 len: 194 microversion: 2.1 time: 0.052193 Oct 12 23:02:59.207543 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2806/5501] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Oct 12 23:02:59 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/731bf14a-c853-4c59-989a-fcc92f2b050e => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:02:59.220252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:02:59.223059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:02:59.230926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.232103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.232682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.233454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:02:59.233980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:02:59.234472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:02:59.380521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lazy-loading 'services' on Instance uuid ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:02:59.515790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6b5bf470-b7aa-467a-94f3-830b731d31a9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/731bf14a-c853-4c59-989a-fcc92f2b050e" status: 202 len: 0 microversion: 2.1 time: 0.303947 Oct 12 23:02:59.520333 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2696/5502] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:02:59 2022] DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/731bf14a-c853-4c59-989a-fcc92f2b050e => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:03:00.165337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:00.166057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:00.177147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:00.178880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:00.181497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:00.182564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:00.184126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:00.185302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:00.352822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:00.353641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:00.359498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-362183301", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "04ed602c-57c5-4e7a-9e09-780167bc4e50", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-871396140", "security_groups": [{"name": "tempest-secgroup-smoke-477785300"}], "networks": [{"uuid": "2b521c90-380c-4f27-9aa1-cbc5b483be52"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:00.532206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:00.550092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] validate_networks() for [('2b521c90-380c-4f27-9aa1-cbc5b483be52', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:03:00.551226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84fafef6-1e95-4a77-a40e-d529270c0a7c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1322 microversion: 2.1 time: 0.390409 Oct 12 23:03:00.551950 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2807/5503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:00 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:01.035218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:03:01.035868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:03:01.036376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:03:01.036785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:03:01.037211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:03:01.046773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:01.047482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:01.048133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:01.048857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:01.049302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:01.049720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:01.084255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Getting quotas for project 5afaf2366bbf4eba869e2a8eb9b0e471. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:03:01.093838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Getting quotas for user 4065d3f8847246e1bbd84151601311c2 and project 5afaf2366bbf4eba869e2a8eb9b0e471. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:03:01.165187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:03:01.167601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04ed602c-57c5-4e7a-9e09-780167bc4e50',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:03:01.201428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-84c18324-a13e-40b3-9fb5-92f585cbe775 req-18854119-7dd8-4fea-bd33-eba45ed677d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44272fc-2656-447f-80f5-68ab02fe46b0", "name": "network-vif-plugged", "status": "completed", "tag": "d14480b6-5cd3-4185-9786-4822ef5604b1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:01.215292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-84c18324-a13e-40b3-9fb5-92f585cbe775 req-18854119-7dd8-4fea-bd33-eba45ed677d6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:01.216038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-84c18324-a13e-40b3-9fb5-92f585cbe775 req-18854119-7dd8-4fea-bd33-eba45ed677d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:01.216639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-84c18324-a13e-40b3-9fb5-92f585cbe775 req-18854119-7dd8-4fea-bd33-eba45ed677d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:01.229601 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-84c18324-a13e-40b3-9fb5-92f585cbe775 req-18854119-7dd8-4fea-bd33-eba45ed677d6 service nova] Creating event network-vif-plugged:d14480b6-5cd3-4185-9786-4822ef5604b1 for instance c44272fc-2656-447f-80f5-68ab02fe46b0 on n-h2-860864-8 Oct 12 23:03:01.235266 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-84c18324-a13e-40b3-9fb5-92f585cbe775 req-18854119-7dd8-4fea-bd33-eba45ed677d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038542 Oct 12 23:03:01.236674 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2808/5504] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:01.366701 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd64e4d1-6ac0-46b0-bce0-3dba7ff5681c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.014796 Oct 12 23:03:01.380825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2ba0b620-288a-4695-a79c-87cff0cd2d4a tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:01.381903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2ba0b620-288a-4695-a79c-87cff0cd2d4a tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:01.384296 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2697/5505] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:03:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:03:01.482686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2ba0b620-288a-4695-a79c-87cff0cd2d4a tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:01.491349 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2ba0b620-288a-4695-a79c-87cff0cd2d4a tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1097 microversion: 2.1 time: 0.115032 Oct 12 23:03:01.492490 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2809/5506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:01 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1097 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:01.578107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:01.579001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:01.586539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:01.587304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:01.587989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:01.588936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:01.589599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:01.590236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:01.752406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:01.765380 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8df2fabf-e3fd-4311-9f16-6f24120a861c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1322 microversion: 2.1 time: 0.189875 Oct 12 23:03:01.781565 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2698/5507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:01 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:02.368446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:02.369701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:02.385110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.386231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.388102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:02.390443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.391153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.392846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:02.462515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lazy-loading 'flavor' on Instance uuid 89615c20-7cde-4fae-9b4b-984f5bae1788 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:02.514635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:02.515251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:02.526978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.527808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.530556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:02.531552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.532300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.533815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:02.653199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:02.665981 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94177d6c-a157-4f63-88b9-a42db7884a14 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1195 microversion: 2.1 time: 0.155475 Oct 12 23:03:02.667641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2699/5508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:02 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1195 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:02.782464 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e41f6d4-7fdf-4a07-9c1b-57fbebb5856c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/action" status: 202 len: 0 microversion: 2.20 time: 0.418673 Oct 12 23:03:02.791441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:02.791993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:02.797625 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2810/5509] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 23:03:02 2022] POST /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:03:02.804088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:02.804829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.804981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:02.805629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.806251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:02.807290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.808140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.808919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:02.825147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.825685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.826154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:02.828155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:02.828639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:02.829089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:03.425008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:03.435744 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f88c8b4-9cda-41bb-81df-28286cc09cd8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1516 microversion: 2.1 time: 0.648425 Oct 12 23:03:03.437253 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2700/5510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:02 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1516 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:03.461207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:03.463884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:03.482795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:03.483696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:03.484426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:03.485373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:03.486056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:03.486775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:03.536299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:03.556653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lazy-loading 'flavor' on Instance uuid c44272fc-2656-447f-80f5-68ab02fe46b0 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:03.561324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:03.563132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:03.574547 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6174bff8-ca85-4f1c-90c5-d7c00474a877 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.775308 Oct 12 23:03:03.575957 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2811/5511] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:02 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:03.690761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:03.691824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:03.701787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:03.702311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:03.702773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:03.703544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:03.704021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:03.704564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:03.706190 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a2a7f14-03f5-404e-8257-623f441c9e46 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action" status: 200 len: 32 microversion: 2.1 time: 0.248665 Oct 12 23:03:03.711797 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2701/5512] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:03:03 2022] POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 23:03:03.718432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:03.719569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:03.732971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:03.733841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:03.734911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:03.735926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:03.736696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:03.738701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:03.901503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:03.910682 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe199694-177b-4c9e-9f67-8af8f1cea215 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.197247 Oct 12 23:03:03.924768 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2702/5513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:03 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:04.000106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:04.014664 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-361dff25-22d2-417f-8371-d8407fb422c2 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1213 microversion: 2.1 time: 0.327861 Oct 12 23:03:04.031104 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2812/5514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:03 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1213 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:04.601833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:04.602456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:04.609866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:04.610425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:04.611405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:04.612367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:04.612829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:04.613265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:04.790075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:04.799573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:04.801149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:04.802407 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-220dce40-09cf-46bd-8f71-a2c225810881 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.205117 Oct 12 23:03:04.803054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2703/5515] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:04 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:04.936448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:04.938334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:04.946102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:04.946602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:04.947269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:04.948017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:04.948608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:04.949053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:05.042945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:05.043778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:05.050545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:05.051265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:05.051770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:05.052552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:05.053075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:05.055013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:05.285028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:05.293918 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1671dfd8-7f0b-428c-bc89-823217191b8c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.255338 Oct 12 23:03:05.315043 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2704/5516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:05 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:05.332368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:05.348949 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b55a9725-abcc-4158-923f-df3eaa2e7248 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.416303 Oct 12 23:03:05.367135 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2813/5517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:04 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:05.779279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:05.780424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:05.803148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:05.803650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:05.804148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:05.805091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:05.805777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:05.806397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:05.829272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:05.830242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:05.842997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:05.843701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:05.844253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:05.845518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:05.847530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:05.848138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:05.880509 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b022d26c-7478-4b95-abe5-09d82dd1f47f tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/ed32f904-836a-4e87-8505-0c66db26bbeb" status: 200 len: 194 microversion: 2.1 time: 0.098365 Oct 12 23:03:05.881535 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2705/5518] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Oct 12 23:03:05 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/ed32f904-836a-4e87-8505-0c66db26bbeb => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:06.136810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:06.137486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:06.148884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.151806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.153802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.155535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.159531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.160064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.173743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:06.185387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:06.186908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:06.191722 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-516e34ef-7b20-403c-9b97-41212d9e92c8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.363643 Oct 12 23:03:06.205297 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2814/5519] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:05 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:06.331152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:06.331809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:06.349905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.350314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.351411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.352174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.352502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lazy-loading 'services' on Instance uuid ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:06.352636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.353081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.485297 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-17ed9a95-58b8-4973-8d2e-6f0611b534c8 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/ed32f904-836a-4e87-8505-0c66db26bbeb" status: 202 len: 0 microversion: 2.1 time: 0.596263 Oct 12 23:03:06.489278 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2706/5520] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:03:05 2022] DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments/ed32f904-836a-4e87-8505-0c66db26bbeb => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:03:06.500802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:06.501878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:06.513016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.514498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.519492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.521416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.522603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.523410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.557754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:06.778451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:06.794039 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41f94040-b4a9-41bb-8b6f-c89237077dca tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.475277 Oct 12 23:03:06.801006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:06.812594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29a29f1c-c481-4ced-84a5-fd60bf45c40d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.317724 Oct 12 23:03:06.812979 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2815/5521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:06 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:06.821852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:06.822503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:06.828131 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2707/5522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:06 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:06.833047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-25d0b3e9-c62d-4599-bc19-41dda3fd7e99 req-20be400e-2e1c-4082-9504-cf6e7af36567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129b6224-3f85-4236-a2f4-fc5ab57dc9a7", "tag": "52f67987-c33e-4aff-b35e-a1dba10ffda4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:06.838951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.839782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.840475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.841388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.842022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.842652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.849867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-25d0b3e9-c62d-4599-bc19-41dda3fd7e99 req-20be400e-2e1c-4082-9504-cf6e7af36567 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:06.852110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-25d0b3e9-c62d-4599-bc19-41dda3fd7e99 req-20be400e-2e1c-4082-9504-cf6e7af36567 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:06.852734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-25d0b3e9-c62d-4599-bc19-41dda3fd7e99 req-20be400e-2e1c-4082-9504-cf6e7af36567 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:06.874534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-25d0b3e9-c62d-4599-bc19-41dda3fd7e99 req-20be400e-2e1c-4082-9504-cf6e7af36567 service nova] Creating event network-changed:52f67987-c33e-4aff-b35e-a1dba10ffda4 for instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 on n-h2-860864-8 Oct 12 23:03:06.882260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:06.884116 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-25d0b3e9-c62d-4599-bc19-41dda3fd7e99 req-20be400e-2e1c-4082-9504-cf6e7af36567 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054644 Oct 12 23:03:06.892887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:03:06.893867 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2708/5523] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:07.016014 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be16c9e2-df1f-491a-bae0-fffef033bc3e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 204 len: 0 microversion: 2.1 time: 0.201232 Oct 12 23:03:07.017714 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2816/5524] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:03:06 2022] DELETE /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:03:07.026969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:07.028082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:07.036383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.037233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.037896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:07.039654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.040609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.041296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:07.223694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:07.225003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:07.248283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.249846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.255095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:07.256074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.256771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.258116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:07.314448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:07.322430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-045f793d-4e3e-4e44-b064-477cc85968ad tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1577 microversion: 2.1 time: 0.300329 Oct 12 23:03:07.329854 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2709/5525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:07 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1577 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:07.534501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:07.545574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:07.547489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:07.551353 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c7d6e0de-e200-4572-a68a-fb8d721f2b26 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.332328 Oct 12 23:03:07.552532 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2817/5526] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:07 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:07.820500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:07.821075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:07.833360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.834957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.836028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:07.836646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:07.837155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:07.838003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.840289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.840816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:07.843550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.844067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.844521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:07.845228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:07.845694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:07.846131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:08.021765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:08.032604 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0edf3ef7-2b27-47b4-8554-4b427ad51bd3 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.216505 Oct 12 23:03:08.033449 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2710/5527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:07 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:08.061309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:08.069023 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0a46a3f3-3bcb-4ea8-b9e5-a162fc141f28 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.238364 Oct 12 23:03:08.070159 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2818/5528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:07 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:08.356866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:08.357463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:08.365343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:08.365805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:08.366856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:08.367575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:08.368075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:08.368657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:08.561746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:08.576499 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35835926-4b7d-47d9-8407-e7bd0264b3ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1577 microversion: 2.1 time: 0.222262 Oct 12 23:03:08.578284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:08.578917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:08.591621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:08.592257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:08.592660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:08.593386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:08.593848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:08.594286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:08.594657 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2711/5529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:08 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:08.892420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:08.905950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:08.908764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:08.911786 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef278103-2b1f-40bd-801e-e911a47d0341 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.336779 Oct 12 23:03:08.914185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2819/5530] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:08 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:09.056208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:09.057533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:09.063876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.065231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.065897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.066836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.067523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.068191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.092976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:09.093868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:09.102701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.109820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.110640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.111686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.112417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.113023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.287749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:09.296891 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d532d49-3016-4f1e-9cd1-f62dc800958d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.208056 Oct 12 23:03:09.297811 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2820/5531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:09 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:09.352167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:09.370565 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1f26b65f-ff1a-4197-a88a-ba35e37567c5 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.318102 Oct 12 23:03:09.372142 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2712/5532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:09 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:09.604002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:09.605379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:09.616689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.617219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.617670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.618648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.618847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.620805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.643131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8ee7d146-0912-455e-9d9c-855c895d9362 req-5b77aeb5-12a3-4e5d-8702-7c199d3587f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b34a38-c58d-42c0-a992-e4a1ee820eb0", "name": "network-vif-deleted", "tag": "7283bdc3-025f-4e97-9a34-9cba12a31575"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:09.675680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8ee7d146-0912-455e-9d9c-855c895d9362 req-5b77aeb5-12a3-4e5d-8702-7c199d3587f8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.677925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8ee7d146-0912-455e-9d9c-855c895d9362 req-5b77aeb5-12a3-4e5d-8702-7c199d3587f8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.680797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8ee7d146-0912-455e-9d9c-855c895d9362 req-5b77aeb5-12a3-4e5d-8702-7c199d3587f8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.699723 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8ee7d146-0912-455e-9d9c-855c895d9362 req-5b77aeb5-12a3-4e5d-8702-7c199d3587f8 service nova] Creating event network-vif-deleted:7283bdc3-025f-4e97-9a34-9cba12a31575 for instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 on n-h1-860864-8 Oct 12 23:03:09.710571 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8ee7d146-0912-455e-9d9c-855c895d9362 req-5b77aeb5-12a3-4e5d-8702-7c199d3587f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078654 Oct 12 23:03:09.714931 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2713/5533] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:09.738785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:09.749090 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd17824c-c66f-4f55-a29f-5a946d6fbbb7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1510 microversion: 2.1 time: 0.149338 Oct 12 23:03:09.753761 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2821/5534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:09 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:09.945312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:09.947635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:09.961249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.962225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.963262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:09.965533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:09.966323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:09.967086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.153695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:10.176665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:10.179057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:10.180712 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-000659e8-0938-4d73-a6f6-43ca955b6ee2 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.244500 Oct 12 23:03:10.184843 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2714/5535] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:09 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:10.323258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:10.324146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:10.339245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.340515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.341553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.344324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.347621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.348236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.394562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:10.395312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:10.403617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.426469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.429946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.437820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.438501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.439128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.706603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:10.716341 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d8da0a3-be2d-4d82-9ee4-df2654429164 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.325261 Oct 12 23:03:10.717480 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2715/5536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:10 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:10.726899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:10.735288 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-53726de1-4a24-414c-b511-c7d191522ff5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.417652 Oct 12 23:03:10.735880 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2822/5537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:10 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:10.786352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:10.788787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:10.796830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.797595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.798754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.799476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:10.799981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:10.800414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:10.892065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:10.901427 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f1e81edb-8cdd-4acd-927c-bd565ed01226 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.119161 Oct 12 23:03:10.917257 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2716/5538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:10 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:11.208909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:11.209535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:11.216333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.217059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.217879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.218898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.219591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.220297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.394621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:11.406583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:11.409069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:11.410599 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dfd15eed-2c94-44e8-aea7-b7d173722866 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.206292 Oct 12 23:03:11.411701 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2823/5539] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:11 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:11.742738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:11.743346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:11.751466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:11.752503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:11.767179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:11.768202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.768955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.769644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.770938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.771061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:11.771829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.773038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.773198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:11.784855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.785371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.789092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.791088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.793723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.794592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.941257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:11.964453 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8afe9ed7-fe34-4089-8dba-247467816145 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.223994 Oct 12 23:03:11.965139 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2717/5540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:11 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:11.971017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:11.971969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:11.978957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.979708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.980394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:11.981319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:11.982057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:11.982957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:12.051984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:12.060840 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d6f57ab-ea77-4e90-b6fd-a5074656eeaa tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.094445 Oct 12 23:03:12.061424 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2718/5541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:11 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:12.076205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:12.084266 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b99144c-78de-47f7-a85e-eab7d31ea5e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.322802 Oct 12 23:03:12.085373 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2824/5542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:11 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:12.435871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:12.436723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:12.442978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:12.443470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:12.443992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:12.445354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:12.445818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:12.446247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:12.645263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:12.675883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:12.679005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:12.680296 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-501f8ed3-228f-465c-a2e2-83e3f76ca536 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.248559 Oct 12 23:03:12.680871 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2719/5543] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:12 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:12.988902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:12.989616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:12.997232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:12.997830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:12.998374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:12.999329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:12.999984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.000417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.084321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:13.086530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:13.093559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.094051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.094933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.095820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.102729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.103460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.155267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:13.166861 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac146953-80d7-43d1-b415-08e09982ab99 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.181755 Oct 12 23:03:13.182152 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2825/5544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:12 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:13.188037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:13.188679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:13.196962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.197435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.198046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.198950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.199449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.199882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.200402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:13.209443 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25c488fe-dd52-4c9e-9789-42fb4c2a9d8a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.128998 Oct 12 23:03:13.211087 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2720/5545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:13 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:13.359512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:13.369795 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b212ec90-d73d-46e0-8b9c-3f024a08bbfe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.185825 Oct 12 23:03:13.371814 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2826/5546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:13 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:13.707282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:13.707920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:13.713960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.714449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.714893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.715588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:13.716074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:13.716506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:13.981498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:13.990481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:13.992195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:13.993433 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ecc594fd-a890-4980-b735-56968a50ddd9 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1745 microversion: 2.20 time: 0.290200 Oct 12 23:03:13.994196 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2721/5547] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:13 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1745 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:14.190130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:14.191057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:14.198378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.198984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.199524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:14.200373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.201070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.201633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:14.234688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:14.236290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:14.245208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.250002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.250990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:14.252587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.253229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.254502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:14.345417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:14.347111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:14.355083 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-204ed277-5a0d-4bec-967f-60abb2f54a55 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.124288 Oct 12 23:03:14.358825 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2722/5548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:14 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:14.360039 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d7eb114-e166-4695-be51-fb0e8edfddac tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.173966 Oct 12 23:03:14.360775 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2827/5549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:14 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:14.397013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:14.398125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:14.404489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.405051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.405558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:14.406320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:14.406842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:14.407335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:14.616760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:14.625170 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d1821ac-9972-4d0d-8244-5537390ee3b8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.232010 Oct 12 23:03:14.626184 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2723/5550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:14 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:15.020853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:15.021940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:15.049032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.051262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.051740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.056297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.056808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.057264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.254132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:15.261175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:15.279474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.280342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.281014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.284164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.284981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.286491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.348628 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94c5106d-b00d-413c-bc03-075457da1758 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100973 Oct 12 23:03:15.349645 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2724/5551] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:15 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 23:03:15.373107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:15.385231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:15.386920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:15.395018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.395813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:15.396333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.398128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.399155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.399956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.400648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.401401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:15.403029 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f7a892ff-8d52-41fd-89c2-1eeef152192d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1745 microversion: 2.20 time: 0.386831 Oct 12 23:03:15.406012 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2828/5552] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:15 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1745 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:15.411613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:15.413227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:15.422805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:15.424045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.424690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.425150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.432885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.435650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.438241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.569765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:15.585534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c79a434b-6f29-4447-a575-4c2baddba3fd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.210750 Oct 12 23:03:15.600935 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2725/5553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:15 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:15.612443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:15.616726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:15.624097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.625053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.626299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.627234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.628679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.629424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.694557 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd1d67d4-1201-4812-b72d-3d7ba64a5290 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091237 Oct 12 23:03:15.696612 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2726/5554] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:03:15 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:03:15.724989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:15.730706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:15.749400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:15.752875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.753510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.755748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.758366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-813615f7-52fe-4cd2-9dfc-67c3aa734abb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1280 microversion: 2.1 time: 0.351235 Oct 12 23:03:15.758769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.759607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.760253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.763177 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2829/5555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:15 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1280 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:15.831585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:15.832138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:15.838675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.839190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.839645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.840383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:15.840845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:15.841741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:15.874895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:03:15.909532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:16.010829 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-358a3a03-0be3-4d9c-9b0d-c2d793beb99a tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 204 len: 0 microversion: 2.1 time: 0.183771 Oct 12 23:03:16.011918 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2830/5556] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:03:15 2022] DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:03:16.028098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:16.029257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:16.034579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:16.037108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.038625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.040335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.041436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.042068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.042693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.045658 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0198380e-e00e-4ec0-8ce0-84bd36010760 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.346208 Oct 12 23:03:16.046335 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2727/5557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:15 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:16.246733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:16.256781 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fcacbeb9-c041-4836-984d-2ced735401b1 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1673 microversion: 2.1 time: 0.238126 Oct 12 23:03:16.257715 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2831/5558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:16 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:16.433929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:16.435308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:16.462662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.470242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.471067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.472100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.472783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.474494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.621998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:16.622645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:16.637055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.638438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.638921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.639671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.644821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.646391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.724424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:16.740996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:16.746617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:16.754577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-45140bfc-56a0-4098-a342-dfbf731d4239 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.326930 Oct 12 23:03:16.758173 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2728/5559] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:16 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:16.787869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:16.789269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:16.804191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.807144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.807857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.808768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:16.812716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:16.813410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:16.839185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:16.851944 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d47a6197-3728-4888-bdfb-b010e631f999 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.239823 Oct 12 23:03:16.855266 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2832/5560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:16 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:17.068562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:17.076886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:17.077518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:17.085626 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c6070f8-553a-40f9-bce6-e7eb3619ab7d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.302744 Oct 12 23:03:17.086225 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2729/5561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:16 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:17.097021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:17.098700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.099368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.100180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.101143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.101834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.102440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.281537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:17.286729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:17.306316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.306821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.307261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.308021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.311698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.313994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.415493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:17.447802 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a5c0a5e-bf10-404f-83d3-db3acf7dbb52 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.374561 Oct 12 23:03:17.465747 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2833/5562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:17 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:17.476196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-17b72325-8a9e-4c6d-9831-f8465b38b19f req-9f08a476-d9e8-4632-9002-58a85ac7bf50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "name": "network-vif-plugged", "status": "completed", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:17.506168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-17b72325-8a9e-4c6d-9831-f8465b38b19f req-9f08a476-d9e8-4632-9002-58a85ac7bf50 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.506925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-17b72325-8a9e-4c6d-9831-f8465b38b19f req-9f08a476-d9e8-4632-9002-58a85ac7bf50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.507577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-17b72325-8a9e-4c6d-9831-f8465b38b19f req-9f08a476-d9e8-4632-9002-58a85ac7bf50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.539721 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-17b72325-8a9e-4c6d-9831-f8465b38b19f req-9f08a476-d9e8-4632-9002-58a85ac7bf50 service nova] Creating event network-vif-plugged:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h2-860864-8 Oct 12 23:03:17.554365 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-17b72325-8a9e-4c6d-9831-f8465b38b19f req-9f08a476-d9e8-4632-9002-58a85ac7bf50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086675 Oct 12 23:03:17.555248 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2834/5563] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:17.796099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:17.796625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:17.797380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:17.821563 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bda6687d-0b5b-44f7-a754-641d82ea9867 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1673 microversion: 2.1 time: 0.526769 Oct 12 23:03:17.821563 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2730/5564] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:17 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1673 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:17.835226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.836292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.836971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.837935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.838639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.839948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.876919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:17.877319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:17.892230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.893317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.894546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:17.895278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:17.895741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:17.896225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:18.013805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:18.023456 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87a544ec-7b53-4b10-8294-8d8c92b4d169 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.150503 Oct 12 23:03:18.024333 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2731/5565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:17 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:18.051066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:18.059824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:18.061532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:18.062903 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f57d7442-54bc-4d2d-8408-73dc2e319149 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.279487 Oct 12 23:03:18.063971 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2835/5566] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:17 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:18.112511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:18.113375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:18.119869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:18.120596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:18.121194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:18.122395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:18.123014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:18.123610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:18.471448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:18.473931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:18.483722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:18.484513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:18.485155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:18.486065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:18.486705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:18.487309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:18.525875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:18.537590 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-589fd53e-9539-408d-a364-cf224f5f668d tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.429101 Oct 12 23:03:18.547936 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2732/5567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:18 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:18.694476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:18.704166 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-edb28124-726c-40b1-9a5f-f6fb0191babe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.237115 Oct 12 23:03:18.719488 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2836/5568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:18 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:18.837557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:18.838181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:18.841282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:18.852027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:18.852533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:18.852976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:18.853700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:18.854157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:18.854586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:18.982908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:18.998892 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cef97185-2d84-48dc-aeb7-bfe43a1d0567 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1605 microversion: 2.1 time: 0.163230 Oct 12 23:03:19.001425 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2733/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:18 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:19.047174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:19.048590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:19.058876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.059701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.064532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.066766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.067448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.068303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.088916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:19.089681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:19.098555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.099050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.108401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.109240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.109865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.110315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.181161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:19.194281 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bdc52b19-e57c-4daf-ac09-3057febe4024 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.151186 Oct 12 23:03:19.195080 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2837/5570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:19 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:19.465738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:19.481362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:19.487550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:19.490429 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e5bd32d3-4374-4fab-abfe-2383d7cced63 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.405122 Oct 12 23:03:19.504840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2734/5571] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:19 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:19.563571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:19.564473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:19.577857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.578364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.578819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.579611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.580036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.580471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.729596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:19.730217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:19.743784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.744302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.744737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.745450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.745895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.746324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:19.957451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:19.970499 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-caf5c76d-4da4-4ac7-9ab3-ec25b0e4bdde tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.412220 Oct 12 23:03:19.973363 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2838/5572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:19 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:19.978461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6e7d99e8-26b7-4f91-83e0-25a9a4d04746 req-393f088b-5844-4983-8ce3-f8d5b469b88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48", "name": "network-vif-deleted", "tag": "fd3e2f53-ada2-43d4-ae8a-9b563fcdd394"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:19.989564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6e7d99e8-26b7-4f91-83e0-25a9a4d04746 req-393f088b-5844-4983-8ce3-f8d5b469b88b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:19.990875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6e7d99e8-26b7-4f91-83e0-25a9a4d04746 req-393f088b-5844-4983-8ce3-f8d5b469b88b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:19.991575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6e7d99e8-26b7-4f91-83e0-25a9a4d04746 req-393f088b-5844-4983-8ce3-f8d5b469b88b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.028850 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6e7d99e8-26b7-4f91-83e0-25a9a4d04746 req-393f088b-5844-4983-8ce3-f8d5b469b88b service nova] Creating event network-vif-deleted:fd3e2f53-ada2-43d4-ae8a-9b563fcdd394 for instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 on n-h1-860864-8 Oct 12 23:03:20.044120 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6e7d99e8-26b7-4f91-83e0-25a9a4d04746 req-393f088b-5844-4983-8ce3-f8d5b469b88b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069184 Oct 12 23:03:20.050626 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2839/5573] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:20.056975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:20.057703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:20.075242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:20.075661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:20.080378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.081569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:20.082090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:20.082558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.192116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:20.192627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:20.194809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.195291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lazy-loading 'fault' on Instance uuid ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:20.632357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d226b490c4451a6b7653a7cdb3737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b22748cb7457b94c17fe298e1b760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:20.644413 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17e56ea1-de5f-4ee5-9e64-4bd1b8f90ff4 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 200 len: 1327 microversion: 2.1 time: 0.592121 Oct 12 23:03:20.647484 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2840/5574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:20 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 1327 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:20.663264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:20.664243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:20.675563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:20.676576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:20.677207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.678700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:20.679144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:20.683273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:20.684143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.692990 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16f9edc7-96ef-4588-bdda-9b2d3996b033 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.967067 Oct 12 23:03:20.713124 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2735/5575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:19 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:20.722828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:20.725394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:20.741885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:20.743158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:20.744190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.745533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:20.747353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:20.747974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:20.880998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:20.896793 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0d45703a-3e8f-4561-89c5-47a984f797c7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1226 microversion: 2.1 time: 0.247878 Oct 12 23:03:20.897722 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2841/5576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:20 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1226 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:21.001789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:21.002015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:21.002593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:21.011127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:21.012608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:21.012746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.013159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.013615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.013780 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-20fbb062-2cd6-43f4-b35f-3d2d788ab4af tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.302053 Oct 12 23:03:21.014342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.014809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.015263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.016788 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2736/5577] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:20 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:21.234018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:21.242498 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e554470-2382-4d3e-bbeb-a86fbe128c45 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.247408 Oct 12 23:03:21.243088 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2842/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:20 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:21.673947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:21.674638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:21.689445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.690747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.691406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.692310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.700004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.705311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.720824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:21.721450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:21.732925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.733186 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] HTTP exception thrown: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Request method failure captured: Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 HTTP/1.1 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Z9WGmlm91FejbP4P3Wz7eNhvalElqdvyffB_g9yNupHRr1WnJIYsgCSTocYGT_X0eqTlHAR-CUx0W776stv0vutMMSXBL-CIzuQALQbl0RYHMJ1047nl1facYEfND1_cN491dmpRBvlDUYAxDtVJHeX-8ghxMny_Zj0tZeLr_KLt8 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}] Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7e4d226b490c4451a6b7653a7cdb3737 Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48'} Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:21.734826 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:21.739458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:21.739458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:21.739458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:21.739458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:21.739458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:21.739458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:21.739458 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:21.740102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.740102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.740851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.741347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.741768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.752035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Returning 404 to user: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:21.753300 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9152fbbb-8b5b-410b-8b55-5e74193f9127 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 404 len: 111 microversion: 2.1 time: 0.083375 Oct 12 23:03:21.754455 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2737/5579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:21 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:21.764027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6bb0ef12-64fb-4371-a3f5-1f5822351d74 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '.version_select at 0x7f44ff468310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:21.813209 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6bb0ef12-64fb-4371-a3f5-1f5822351d74 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300799630" status: 202 len: 0 microversion: 2.1 time: 0.053653 Oct 12 23:03:21.814517 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2738/5580] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 23:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300799630 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:03:21.920230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:21.921176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:21.937549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.938401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.939044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:21.939978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:21.940607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:21.941235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.024279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.025421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.028300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:22.029119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.030007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lazy-loading 'fault' on Instance uuid 05b34a38-c58d-42c0-a992-e4a1ee820eb0 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:22.040369 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a8717fb-ca57-41af-9004-cded6f1ac3f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.323315 Oct 12 23:03:22.041291 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2843/5581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:21 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:22.062331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:22.063280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:22.071311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.072019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.072660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.073578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.074222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.074859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.211210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:22.225475 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5ed2d9b-9260-4cea-856c-e1059e6ff029 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 200 len: 1231 microversion: 2.1 time: 0.309314 Oct 12 23:03:22.248269 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2739/5582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:21 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 1231 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:22.269639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:22.270735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:22.277926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.280009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.280687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.281913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:22.282537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:22.283139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:22.321480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:22.353955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:22.355744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:22.357237 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3d0d1c3-0710-42df-bab9-b72b68a440dd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.299475 Oct 12 23:03:22.368866 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2844/5583] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:22 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:22.660983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:22.673256 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93d7ec76-6bfd-41aa-bbe1-072ad9d71697 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.408804 Oct 12 23:03:22.688363 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2740/5584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:22 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:23.069639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:23.070771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:23.085422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.086826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.087866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.089190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.091104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.093985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.251813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:23.252468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:23.270422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.270936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.271438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.273030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.274063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.274504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.301395 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 HTTP/1.1 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '05b34a38-c58d-42c0-a992-e4a1ee820eb0'} Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:23.310369 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7cd2091-1547-4b97-ad3a-a23dc77b2275 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 404 len: 111 microversion: 2.1 time: 0.064543 Oct 12 23:03:23.319920 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2741/5585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:23 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:03:23.383357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:23.394891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:23.395289 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-28cf6f89-1cef-4272-afc4-e0bf90d210ee tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.329716 Oct 12 23:03:23.395515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:23.411593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.412155 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2845/5586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:23 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:23.413459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.414466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.418175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.418845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.419460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.517695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-341923855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695750862", "security_groups": [{"name": "tempest-secgroup-smoke-566887922"}], "block_device_mapping_v2": [{"uuid": "07341337-282f-4478-aa8b-e6d1dc375db3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:23.696199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:03:23.728440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:23.740059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:23.745459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:23.747840 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a86424d9-23e1-4102-81d6-297d43a8ead0 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.356677 Oct 12 23:03:23.752662 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2742/5587] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:23 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:23.761430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:23.765112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:23.779043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.783834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.784592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:23.785541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:23.788569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:23.789025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:24.091611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:24.098492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:24.111204 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e1c21a8-c00b-43bf-b832-dceb4c772b87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.350309 Oct 12 23:03:24.112570 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2743/5588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:23 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:24.357882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:03:24.359093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:03:24.360020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:03:24.360916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:03:24.361570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:03:24.373374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:24.374213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:24.374928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:24.375921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:24.376627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:24.377291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:24.404118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:03:24.417011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:03:24.419460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:24.420116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:24.432805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:24.435372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:24.436136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:24.437182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:24.439017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:24.441388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:24.499098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:03:24.503355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07341337-282f-4478-aa8b-e6d1dc375db3',volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:03:24.719810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:24.732354 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5dd9160-6ff2-47e6-9992-6fdef2d72ad7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.315360 Oct 12 23:03:24.733227 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2744/5589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:24 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:24.782385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:24.783281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:24.791289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:24.792052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:24.793114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:24.794858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:24.795479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:24.796097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:24.808582 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-05b3df6f-c740-4f55-a40c-963e3e9dcfc2 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.296761 Oct 12 23:03:24.816505 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2846/5590] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:03:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 23:03:24.822082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19dccd2a-6116-4b59-9ef4-7e98ca5941ca tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:24.822719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19dccd2a-6116-4b59-9ef4-7e98ca5941ca tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:24.936975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19dccd2a-6116-4b59-9ef4-7e98ca5941ca tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:24.954905 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19dccd2a-6116-4b59-9ef4-7e98ca5941ca tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1094 microversion: 2.1 time: 0.137167 Oct 12 23:03:24.956626 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2847/5591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:24 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1094 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:25.136430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:25.137070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:25.151717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:25.160541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:25.166932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:25.170185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:25.171647 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03d716fe-ecb5-4fc2-83de-24a4ec6d1bd4 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.393231 Oct 12 23:03:25.172550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:25.173264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:25.174926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:25.175403 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2745/5592] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:24 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:25.176127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:25.178126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:25.482401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:25.498775 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86112104-2890-4089-a1f1-534f40d06f0e tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.366917 Oct 12 23:03:25.499902 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2848/5593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:25 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:25.766562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:25.767805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:25.779186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:25.779966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:25.781910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:25.782852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:25.783422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:25.784185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:25.986207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:25.986908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:25.997848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:25.999449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:25.999933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.002518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.003011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.003468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.050199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:26.074594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:26.104441 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d31da2c-7dd9-46c4-9c0d-d4236bb76434 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.342332 Oct 12 23:03:26.107502 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2746/5594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:25 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:26.152269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:26.161033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-182ec524-d526-411c-bcbd-9ca34190b5e0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1136 microversion: 2.1 time: 0.179202 Oct 12 23:03:26.163780 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2849/5595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:25 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1136 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:26.200759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:26.201457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:26.222076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.223131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.223752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.224723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.225331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.225908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.531281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:26.532615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:26.550623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.555609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.556317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.560123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:26.560847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:26.561497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:26.654525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:26.663184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:26.664666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:26.676464 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f18340d1-7e44-4684-8847-d2328dad5470 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.469509 Oct 12 23:03:26.677141 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2747/5596] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:26 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:26.832929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:26.841660 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb1f07a6-cae5-433f-ba00-acd41bd25534 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.323128 Oct 12 23:03:26.842901 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2850/5597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:26 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:27.130762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:27.131390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:27.141312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.142121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.142593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.143313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.152774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.172631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.185866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:27.186849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:27.193817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.202517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.204804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.207428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.209527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.212407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.410804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:27.431037 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-68446f11-5c88-453b-9ae2-43fb4e44b2a7 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1210 microversion: 2.1 time: 0.247993 Oct 12 23:03:27.433452 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2851/5598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:27 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1210 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:27.537789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c4e07d38-e163-462b-b846-848daee9fc53 req-8bab587e-1fc2-4f41-bd8c-99e4866f99f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129b6224-3f85-4236-a2f4-fc5ab57dc9a7", "name": "network-vif-plugged", "status": "completed", "tag": "52f67987-c33e-4aff-b35e-a1dba10ffda4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:27.562806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c4e07d38-e163-462b-b846-848daee9fc53 req-8bab587e-1fc2-4f41-bd8c-99e4866f99f7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.564497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c4e07d38-e163-462b-b846-848daee9fc53 req-8bab587e-1fc2-4f41-bd8c-99e4866f99f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.564955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c4e07d38-e163-462b-b846-848daee9fc53 req-8bab587e-1fc2-4f41-bd8c-99e4866f99f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.604330 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c4e07d38-e163-462b-b846-848daee9fc53 req-8bab587e-1fc2-4f41-bd8c-99e4866f99f7 service nova] Creating event network-vif-plugged:52f67987-c33e-4aff-b35e-a1dba10ffda4 for instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 on n-h2-860864-8 Oct 12 23:03:27.619642 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c4e07d38-e163-462b-b846-848daee9fc53 req-8bab587e-1fc2-4f41-bd8c-99e4866f99f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087324 Oct 12 23:03:27.620248 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2852/5599] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:03:27.713175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:27.714054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:27.725841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.729066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.731953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.733480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.734216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.735334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.798956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:27.820392 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c85a03cb-dc61-4d87-bc42-9442afd57c37 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.693402 Oct 12 23:03:27.824454 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2748/5600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:27 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:27.869154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:27.870214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:27.883189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.884013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.884621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:27.885778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:27.886397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:27.886989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:28.442632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:28.443622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:28.444352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:28.445962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:28.447469 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2dab5115-52c5-43f5-ab53-b56174239550 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.740712 Oct 12 23:03:28.448801 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2853/5601] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:27 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:28.461786 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-84a903bb-c3db-427c-9610-d9133932d39c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1268 microversion: 2.1 time: 0.594084 Oct 12 23:03:28.465552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:28.466440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:28.478522 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2749/5602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:27 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1268 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:28.481634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:28.483671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:28.484971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:28.488487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:28.489235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:28.489990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:28.858344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:28.859029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:28.873323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:28.885043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:28.885734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:28.894844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:28.895353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:28.897248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:29.047131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:29.060215 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d02ad13-75ec-48f8-841e-368f6b1686c5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1277 microversion: 2.1 time: 0.600077 Oct 12 23:03:29.077903 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2854/5603] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:28 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1277 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:29.486963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:29.489492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:29.524553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:29.526386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:29.529105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:29.531250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:29.532662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:29.534253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:29.871284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:29.889977 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-268831d5-c2ad-4a75-975d-7f1725352a41 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 1.042648 Oct 12 23:03:29.911219 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2750/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:28 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:29.919248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:29.920821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:29.932392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:29.933976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:29.935104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:29.936029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:29.937708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:29.939042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:30.358199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:30.373217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:30.374928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:30.376330 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-94cf050f-3e7c-41c2-a302-00dcb3914ee3 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.896979 Oct 12 23:03:30.406465 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2855/5605] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:29 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:30.412535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:30.413199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:30.419506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:30.420037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:30.420913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:30.421803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:30.422432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:30.423020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:30.542090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:30.552927 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae23c1b7-1600-4616-b0dc-358552676a87 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1457 microversion: 2.1 time: 0.639779 Oct 12 23:03:30.573305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2751/5606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:29 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1457 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:30.589100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:30.592902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:30.605274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:30.611782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:30.612638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:30.613718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:30.614582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:30.616025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:30.971457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:30.981609 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6ab2ecd-5bfe-4822-8c3d-a167e9505b64 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1457 microversion: 2.1 time: 0.401798 Oct 12 23:03:30.987002 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2752/5607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:30 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1457 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:31.014362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:31.014991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:31.022049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:31.022551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:31.022990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:31.023939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:31.024628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:31.025223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:31.461723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:31.473555 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87be9abf-f8e2-4be3-b116-83d7f81dfffe tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.465439 Oct 12 23:03:31.476817 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2753/5608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:31 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:31.488733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7d1db061-305f-43cc-8381-605ae43bd4f2 req-4f219c39-bd3c-4608-b70f-44cf5f3aa510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36501652-9871-4a81-ae04-fbba85935cae", "tag": "c945f530-339d-4514-a5f3-d0142a9ba074"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:31.498421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:31.516863 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db496b08-c565-4911-8cef-cd9ce92f5e7d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1277 microversion: 2.1 time: 1.110160 Oct 12 23:03:31.522955 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2856/5609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:30 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1277 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:31.543129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:31.544218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:31.544487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d1db061-305f-43cc-8381-605ae43bd4f2 req-4f219c39-bd3c-4608-b70f-44cf5f3aa510 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:31.545210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d1db061-305f-43cc-8381-605ae43bd4f2 req-4f219c39-bd3c-4608-b70f-44cf5f3aa510 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:31.545877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d1db061-305f-43cc-8381-605ae43bd4f2 req-4f219c39-bd3c-4608-b70f-44cf5f3aa510 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:31.594349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:31.598529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:31.599670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:31.604417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:31.604919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:31.605369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:31.607783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7d1db061-305f-43cc-8381-605ae43bd4f2 req-4f219c39-bd3c-4608-b70f-44cf5f3aa510 service nova] Creating event network-changed:c945f530-339d-4514-a5f3-d0142a9ba074 for instance 36501652-9871-4a81-ae04-fbba85935cae on n-h1-860864-8 Oct 12 23:03:31.620975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7d1db061-305f-43cc-8381-605ae43bd4f2 req-4f219c39-bd3c-4608-b70f-44cf5f3aa510 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138705 Oct 12 23:03:31.623764 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2754/5610] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:32.161131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:32.184388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:32.189055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:32.196260 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d52c9cd-1398-4a93-86a2-91cfe877765a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.667751 Oct 12 23:03:32.199983 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2857/5611] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:31 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:32.508025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:32.508780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:32.528693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:32.529239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:32.529691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:32.530424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:32.530889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:32.531321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:32.550344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:32.551170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:32.570049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:32.570565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:32.571019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:32.576810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:32.577511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:32.578142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:33.156642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:33.166028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f3075a9-358c-4dfb-95c2-3fd36b5dc095 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.664448 Oct 12 23:03:33.173123 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2755/5612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:32 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:33.234306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:33.240840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:33.259615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:33.261289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:33.264470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:33.268215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:33.270373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:33.271767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:33.279966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:33.287772 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54588ac5-7a17-415f-a54a-4f2a80acffa9 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1277 microversion: 2.1 time: 0.741123 Oct 12 23:03:33.288534 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2858/5613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:32 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1277 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:33.662798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:33.672862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:33.674519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:33.675923 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03fa8c0b-b7e2-4d2c-b108-1f14fa17ec33 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.454207 Oct 12 23:03:33.691305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2756/5614] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:33 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:34.199124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:34.199724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:34.216475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.218587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.220793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.225562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.229616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.230586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.314653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:34.315661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:34.329127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.331730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.334861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.337316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.340545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.343744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.393222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:34.571435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:34.581888 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1214e420-b507-408e-890f-2d26d9314cb9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.386850 Oct 12 23:03:34.595916 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2859/5615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:34 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:34.601462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:34.602011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:34.643926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.648520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.652832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.653832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.654325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.654770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.678084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:34.691813 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c89f54d5-1433-4cd1-96a4-cf0e7cf2cc34 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1277 microversion: 2.1 time: 0.381852 Oct 12 23:03:34.704715 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2757/5616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:34 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1277 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:34.718842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] HTTP exception thrown: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.720684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:34.727791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Request method failure captured: Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 HTTP/1.1 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Z9WGmlm91FejbP4P3Wz7eNhvalElqdvyffB_g9yNupHRr1WnJIYsgCSTocYGT_X0eqTlHAR-CUx0W776stv0vutMMSXBL-CIzuQALQbl0RYHMJ1047nl1facYEfND1_cN491dmpRBvlDUYAxDtVJHeX-8ghxMny_Zj0tZeLr_KLt8 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}] Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7e4d226b490c4451a6b7653a7cdb3737 Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48'} Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:34.735589 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.741048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Returning 404 to user: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:34.744635 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c6a44d4-1c65-4ea7-93f7-dd8904712639 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 404 len: 111 microversion: 2.1 time: 0.155248 Oct 12 23:03:34.748672 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2860/5617] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:03:34 2022] DELETE /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:34.752217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.752476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.752928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.762255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.762680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.763121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.770183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:34.771124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:34.793195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.793837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.794528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.796374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:34.796797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:34.797242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:34.836862 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] HTTP exception thrown: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Request method failure captured: Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 HTTP/1.1 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Z9WGmlm91FejbP4P3Wz7eNhvalElqdvyffB_g9yNupHRr1WnJIYsgCSTocYGT_X0eqTlHAR-CUx0W776stv0vutMMSXBL-CIzuQALQbl0RYHMJ1047nl1facYEfND1_cN491dmpRBvlDUYAxDtVJHeX-8ghxMny_Zj0tZeLr_KLt8 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}] Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7e4d226b490c4451a6b7653a7cdb3737 Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48'} Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:34.839284 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:34.843392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Returning 404 to user: Instance ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:34.845777 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9914a166-c93c-4ea1-8b1e-d169ac726f1c tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48" status: 404 len: 111 microversion: 2.1 time: 0.090614 Oct 12 23:03:34.849819 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2861/5618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:34 2022] GET /compute/v2.1/servers/ed5a3b5f-4ab0-4fff-befc-7b18e1c29c48 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:35.074997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:35.085308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:35.087022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:35.088402 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-218e5b5c-97cb-4a40-8134-df7ce690bf62 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.379249 Oct 12 23:03:35.090014 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2758/5619] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:34 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:35.609875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:35.611162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:35.618785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:35.622635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.623629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.625451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:35.625451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.625826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.626440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:35.721780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:35.723175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:35.738721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.740575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.741691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:35.742929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:35.743639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:35.744269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:36.061593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:36.072029 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3fa61533-363b-4148-8302-51f2223bf624 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1277 microversion: 2.1 time: 0.354869 Oct 12 23:03:36.072971 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2759/5620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:35 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1277 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:36.118713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:36.119343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:36.132082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:36.132567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:36.133012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:36.133731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:36.134186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:36.134616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:36.382452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:36.392334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:36.397514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:36.399767 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2dd9b33e-8248-49e4-8ac3-4b665a3a9e45 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.288023 Oct 12 23:03:36.403839 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2760/5621] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:36 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:36.474790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:36.482998 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70bcdf2e-ca3e-46fa-addf-72174ccbd039 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.877697 Oct 12 23:03:36.495924 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2862/5622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:35 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:37.097554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:37.099399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:37.107535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.112388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.113258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.114244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.115471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.116300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.120535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:37.450753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:37.452472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:37.467966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.469774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.470454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.475643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.476462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.477138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.505886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:37.519377 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d83ea44-2182-4a2e-9a0b-7f40a844bcbf tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1277 microversion: 2.1 time: 0.422886 Oct 12 23:03:37.524615 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2761/5623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:37 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1277 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:37.535117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:37.538993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:37.553439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.554989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.556422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.559077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:37.560803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:37.561460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:37.828546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:37.837208 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5781ae50-820b-4ba1-aba1-67964374dbc3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1522 microversion: 2.1 time: 0.310924 Oct 12 23:03:37.837799 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2762/5624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:37 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:37.851878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:37.875175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:37.884360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:37.893694 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7fee25e1-f9fd-4845-b4b1-d4dd5a4a2725 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1740 microversion: 2.20 time: 0.460137 Oct 12 23:03:37.896527 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2863/5625] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:37 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:38.408161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-eec11c29-7abc-4a8e-9a0f-4636c2b92f36 req-f356b8d0-9acb-4932-b385-552a892f68d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129b6224-3f85-4236-a2f4-fc5ab57dc9a7", "tag": "52f67987-c33e-4aff-b35e-a1dba10ffda4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:38.441475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-eec11c29-7abc-4a8e-9a0f-4636c2b92f36 req-f356b8d0-9acb-4932-b385-552a892f68d6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:38.441475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-eec11c29-7abc-4a8e-9a0f-4636c2b92f36 req-f356b8d0-9acb-4932-b385-552a892f68d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:38.441960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-eec11c29-7abc-4a8e-9a0f-4636c2b92f36 req-f356b8d0-9acb-4932-b385-552a892f68d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:38.469024 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-eec11c29-7abc-4a8e-9a0f-4636c2b92f36 req-f356b8d0-9acb-4932-b385-552a892f68d6 service nova] Creating event network-changed:52f67987-c33e-4aff-b35e-a1dba10ffda4 for instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 on n-h2-860864-8 Oct 12 23:03:38.478360 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-eec11c29-7abc-4a8e-9a0f-4636c2b92f36 req-f356b8d0-9acb-4932-b385-552a892f68d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073499 Oct 12 23:03:38.479882 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2763/5626] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:38.549096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:38.549788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:38.561697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:38.562531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:38.563156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:38.564093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:38.565317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:38.566499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:38.865491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:38.866260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:38.880275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:38.880769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:38.883649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:38.885871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:38.888081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:38.888679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:38.984107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:38.995398 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9fb59943-7a88-4042-8cd4-a40f0d92c474 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.450696 Oct 12 23:03:38.996028 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2864/5627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:38 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:39.033100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:39.033862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:39.041129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:39.045219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:39.045698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:39.046446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:39.047068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:39.047512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:39.614858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:39.627986 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-da1ee108-9479-42ab-af1a-a55f7ebf140d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1502 microversion: 2.1 time: 0.768602 Oct 12 23:03:39.628841 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2764/5628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:38 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1502 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:39.655129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:39.656077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:39.667558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:39.668113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:39.668575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:39.669604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:39.674798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:39.678231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:39.787972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:39.809260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:39.813778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:39.821589 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb9f9dbe-603e-4850-9df1-af6b90b9f60c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1722 microversion: 2.20 time: 0.800066 Oct 12 23:03:39.822557 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2865/5629] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:38 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1722 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:40.022570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:40.023523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:40.024292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:40.031662 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-97f9ce3a-9e57-40fd-bbc6-1d8f287687cb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1515 microversion: 2.1 time: 0.380666 Oct 12 23:03:40.032295 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2765/5630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:39 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:40.033599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.036983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.039383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.040747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.043584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.044305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.059327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99bb83f7-eeb0-4c49-a197-6812ae7b6703 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:40.062057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99bb83f7-eeb0-4c49-a197-6812ae7b6703 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 27c5c507-00bf-43d8-ac30-3229b2c5fc8a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:40.071725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-99bb83f7-eeb0-4c49-a197-6812ae7b6703 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Instance 27c5c507-00bf-43d8-ac30-3229b2c5fc8a could not be found. Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99bb83f7-eeb0-4c49-a197-6812ae7b6703 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/27c5c507-00bf-43d8-ac30-3229b2c5fc8a/action HTTP/1.1 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 14 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: {"rescue": {}} Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 27c5c507-00bf-43d8-ac30-3229b2c5fc8a could not be found. Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '27c5c507-00bf-43d8-ac30-3229b2c5fc8a', 'body': {'rescue': {}}} Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c5c507-00bf-43d8-ac30-3229b2c5fc8a could not be found. Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c5c507-00bf-43d8-ac30-3229b2c5fc8a could not be found. Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:40.084969 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c5c507-00bf-43d8-ac30-3229b2c5fc8a could not be found. Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99bb83f7-eeb0-4c49-a197-6812ae7b6703 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 404 to user: Instance 27c5c507-00bf-43d8-ac30-3229b2c5fc8a could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99bb83f7-eeb0-4c49-a197-6812ae7b6703 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/27c5c507-00bf-43d8-ac30-3229b2c5fc8a/action" status: 404 len: 111 microversion: 2.1 time: 0.031857 Oct 12 23:03:40.096054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2766/5631] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:03:40 2022] POST /compute/v2.1/servers/27c5c507-00bf-43d8-ac30-3229b2c5fc8a/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:03:40.097915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:40.098533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:40.109105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.110613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.111075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.111808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.112522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.113169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.267466 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53fd639a-4ef9-4abe-ba0e-a673af5a5f8d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action" status: 202 len: 0 microversion: 2.1 time: 0.171261 Oct 12 23:03:40.279431 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2767/5632] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:03:40 2022] POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:03:40.303491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:40.304263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:40.321818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.322331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.322776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.323690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.330973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.331618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.537464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:40.550144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b8e58c8a-593f-41a8-a6a5-8b2a170f1ef4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1520 microversion: 2.1 time: 0.257231 Oct 12 23:03:40.551201 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2768/5633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:40 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:40.556834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1ab15b19-e37a-4b80-b67b-b21b44c36680 req-af22212a-de2a-4c4d-9eae-063264dd6762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129b6224-3f85-4236-a2f4-fc5ab57dc9a7", "tag": "52f67987-c33e-4aff-b35e-a1dba10ffda4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:40.567404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1ab15b19-e37a-4b80-b67b-b21b44c36680 req-af22212a-de2a-4c4d-9eae-063264dd6762 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.568196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1ab15b19-e37a-4b80-b67b-b21b44c36680 req-af22212a-de2a-4c4d-9eae-063264dd6762 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.568780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1ab15b19-e37a-4b80-b67b-b21b44c36680 req-af22212a-de2a-4c4d-9eae-063264dd6762 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.583251 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1ab15b19-e37a-4b80-b67b-b21b44c36680 req-af22212a-de2a-4c4d-9eae-063264dd6762 service nova] Creating event network-changed:52f67987-c33e-4aff-b35e-a1dba10ffda4 for instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 on n-h2-860864-8 Oct 12 23:03:40.596475 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1ab15b19-e37a-4b80-b67b-b21b44c36680 req-af22212a-de2a-4c4d-9eae-063264dd6762 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041853 Oct 12 23:03:40.600274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:40.603470 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2769/5634] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:40.613657 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-420cede1-1b6c-4149-ba5e-a8bdcf1ce937 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.594098 Oct 12 23:03:40.621175 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2866/5635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:40 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:40.850156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:40.851741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:40.864200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.865346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.866452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:40.867593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:40.868367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:40.868905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:41.053802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:41.063002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:41.066887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:41.068705 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7b66df45-b0a1-4eb3-84ee-902752adc361 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1722 microversion: 2.20 time: 0.225216 Oct 12 23:03:41.070503 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2770/5636] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:40 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:41.594201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:41.595058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:41.614986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:41.633045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:41.634722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:41.639324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:41.643438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:41.649982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:41.650887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:41.655140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:41.668622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:41.676193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:41.677606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:41.681367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:41.683835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:41.685732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:41.890351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:41.900393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:41.917320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a78f14d5-4d1b-4b3d-a9bf-35c2c1566689 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1500 microversion: 2.1 time: 0.326471 Oct 12 23:03:41.918048 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2867/5637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:41 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1500 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:41.944840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:41.948675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:41.956752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:41.957674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:41.958388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:41.959321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:41.960247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:41.960952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:41.991182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lazy-loading 'flavor' on Instance uuid 4d2e452a-242c-498f-8821-4186f2c4bd5d {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:42.010562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Cannot 'rescue' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state paused Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action HTTP/1.1 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 14 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: {"rescue": {}} Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'rescue' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state paused Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4d2e452a-242c-498f-8821-4186f2c4bd5d', 'body': {'rescue': {}}} Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d in vm_state paused. Cannot rescue while the instance is in this state. Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state paused Oct 12 23:03:42.013197 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state paused Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 409 to user: Cannot 'rescue' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state paused {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b9ff4cf1-101a-4021-a7af-8deac6744b33 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action" status: 409 len: 144 microversion: 2.1 time: 0.079251 Oct 12 23:03:42.020185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2868/5638] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:03:41 2022] POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action => generated 144 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:03:42.033808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:42.034366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:42.044359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.044799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.045383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.046309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.047001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.047597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.108665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:42.120927 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2092c4f6-8abc-4664-b9cf-cb0d266ad040 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.475447 Oct 12 23:03:42.121996 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2771/5639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:41 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:42.174033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6640b73-7a0e-47fd-9819-cfff5b5cb01f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action" status: 202 len: 0 microversion: 2.1 time: 0.148381 Oct 12 23:03:42.177948 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2869/5640] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:03:42 2022] POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:03:42.190844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:42.193069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:42.208033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.209583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.209996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.212941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.213253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.216028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.504604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:42.506947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:42.517891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.518404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.518850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.519570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.520066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.520730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:42.521442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.530399 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b9fa7dc6-d690-4ad3-b4b0-b2c47ff7e68f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1507 microversion: 2.1 time: 0.348832 Oct 12 23:03:42.536861 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2870/5641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:42 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:42.621101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9ef55a3a-cf05-46c7-9086-431c9c660969 req-fe1aa4e9-df46-4e87-b3f5-4bb04478c0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129b6224-3f85-4236-a2f4-fc5ab57dc9a7", "tag": "52f67987-c33e-4aff-b35e-a1dba10ffda4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:42.632277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9ef55a3a-cf05-46c7-9086-431c9c660969 req-fe1aa4e9-df46-4e87-b3f5-4bb04478c0cc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.633126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9ef55a3a-cf05-46c7-9086-431c9c660969 req-fe1aa4e9-df46-4e87-b3f5-4bb04478c0cc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.633630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9ef55a3a-cf05-46c7-9086-431c9c660969 req-fe1aa4e9-df46-4e87-b3f5-4bb04478c0cc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.646245 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9ef55a3a-cf05-46c7-9086-431c9c660969 req-fe1aa4e9-df46-4e87-b3f5-4bb04478c0cc service nova] Creating event network-changed:52f67987-c33e-4aff-b35e-a1dba10ffda4 for instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 on n-h2-860864-8 Oct 12 23:03:42.651489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9ef55a3a-cf05-46c7-9086-431c9c660969 req-fe1aa4e9-df46-4e87-b3f5-4bb04478c0cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033999 Oct 12 23:03:42.652133 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2871/5642] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:03:42.822720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:42.831100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:42.833372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:42.834750 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-983f9824-9421-4aa7-a41a-8c4d989262fc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1722 microversion: 2.20 time: 0.711572 Oct 12 23:03:42.835321 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2772/5643] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:42 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1722 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:42.866514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:42.867147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:42.874686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.875464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.876332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.877258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.878255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.879222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.898833 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] HTTP exception thrown: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Request method failure captured: Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 HTTP/1.1 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Z9WGmlm91FejbP4P3Wz7eNhvalElqdvyffB_g9yNupHRr1WnJIYsgCSTocYGT_X0eqTlHAR-CUx0W776stv0vutMMSXBL-CIzuQALQbl0RYHMJ1047nl1facYEfND1_cN491dmpRBvlDUYAxDtVJHeX-8ghxMny_Zj0tZeLr_KLt8 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}] Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7e4d226b490c4451a6b7653a7cdb3737 Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4df8e9d9-29a8-46d7-9df4-cfcdaceaf167'} Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:42.901063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Returning 404 to user: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5270eae8-6f4f-4d00-89be-15acffcd9fc9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 404 len: 111 microversion: 2.1 time: 0.040661 Oct 12 23:03:42.905404 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2872/5644] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:03:42 2022] DELETE /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:42.911178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:42.912100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] [instance: 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:42.918668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.919420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.920358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.921274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:42.922097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:42.922721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:42.942011 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] HTTP exception thrown: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Request method failure captured: Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 HTTP/1.1 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Z9WGmlm91FejbP4P3Wz7eNhvalElqdvyffB_g9yNupHRr1WnJIYsgCSTocYGT_X0eqTlHAR-CUx0W776stv0vutMMSXBL-CIzuQALQbl0RYHMJ1047nl1facYEfND1_cN491dmpRBvlDUYAxDtVJHeX-8ghxMny_Zj0tZeLr_KLt8 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2a9b22748cb7457b94c17fe298e1b760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2a9b22748cb7457b94c17fe298e1b760"}]}] Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 2a9b22748cb7457b94c17fe298e1b760 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1626599330 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7e4d226b490c4451a6b7653a7cdb3737 Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeTestJSON-1626599330-project Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '4df8e9d9-29a8-46d7-9df4-cfcdaceaf167'} Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:03:42.946130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] Returning 404 to user: Instance 4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78308081-2bae-49be-9a67-27d5c8aeb0e9 tempest-AttachVolumeTestJSON-1626599330 tempest-AttachVolumeTestJSON-1626599330-project] 10.222.0.20 "GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167" status: 404 len: 111 microversion: 2.1 time: 0.044007 Oct 12 23:03:42.958832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2773/5645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:42 2022] GET /compute/v2.1/servers/4df8e9d9-29a8-46d7-9df4-cfcdaceaf167 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:03:43.146873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:43.147649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:43.150927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:43.155520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:43.156422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:43.157447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:43.158838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:43.159518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:43.160453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:43.395028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a879e910-7c46-4a33-a9a3-fc3c4110e580 req-5273f825-de15-4b09-a497-aa5691d39474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "name": "network-vif-unplugged", "status": "completed", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:43.423147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a879e910-7c46-4a33-a9a3-fc3c4110e580 req-5273f825-de15-4b09-a497-aa5691d39474 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:43.423632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a879e910-7c46-4a33-a9a3-fc3c4110e580 req-5273f825-de15-4b09-a497-aa5691d39474 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:43.429003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a879e910-7c46-4a33-a9a3-fc3c4110e580 req-5273f825-de15-4b09-a497-aa5691d39474 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:43.482938 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a879e910-7c46-4a33-a9a3-fc3c4110e580 req-5273f825-de15-4b09-a497-aa5691d39474 service nova] Creating event network-vif-unplugged:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h2-860864-8 Oct 12 23:03:43.491431 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a879e910-7c46-4a33-a9a3-fc3c4110e580 req-5273f825-de15-4b09-a497-aa5691d39474 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100008 Oct 12 23:03:43.494383 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2774/5646] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:43.560578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:43.561194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:43.577801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:43.578623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:43.579274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:43.580205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:43.582886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:43.585332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:43.721655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:43.733787 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99d3f023-502d-4de1-a752-8643cf4db2f0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.590855 Oct 12 23:03:43.735454 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2873/5647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:43 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:43.861158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:43.862002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:43.870472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:43.870988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:43.871463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:43.872188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:43.872833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:43.873422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:44.001615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:44.014523 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4d19460-640e-4c04-a111-d0c906159ed6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1515 microversion: 2.1 time: 0.459324 Oct 12 23:03:44.016158 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2775/5648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:43 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:44.212934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:44.222435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:44.225135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:44.226753 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e868c98-109b-4447-acec-e621a69bf45c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1665 microversion: 2.20 time: 0.370024 Oct 12 23:03:44.228162 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2874/5649] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:43 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1665 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:44.257100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca708ca2-097d-4b69-afc8-50b164920269"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:44.261304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:44.268971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:44.269811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:44.270999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:44.272250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:44.272874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:44.273461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:44.787378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:44.790879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:44.811998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:44.814908 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f0039a67-5102-4edc-b0b3-c85d39c7c54a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.564624 Oct 12 23:03:44.838433 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2776/5650] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Oct 12 23:03:44 2022] POST /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-volume_attachments => generated 188 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:03:44.839607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:44.841060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:44.842410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:44.843217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:44.844013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:45.047712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:45.048818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:45.057837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:45.058340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:45.058822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:45.062362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:45.062913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:45.065379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:45.259876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:45.326543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:45.341270 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56ddb27a-493e-4d0c-9ecc-7d42d26bb352 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.586621 Oct 12 23:03:45.344952 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2875/5651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:44 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:45.683473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-26652c01-9bef-4eb7-b35d-d72ad8e153a8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-volume_attachments/ca708ca2-097d-4b69-afc8-50b164920269" status: 202 len: 0 microversion: 2.20 time: 0.641145 Oct 12 23:03:45.685166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2777/5652] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Oct 12 23:03:45 2022] DELETE /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-volume_attachments/ca708ca2-097d-4b69-afc8-50b164920269 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:03:45.793133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:45.793763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:45.815708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:45.817254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:45.817976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:45.818939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:45.819726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:45.820232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.140774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 23:03:46.254110 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-599e500a-8cf5-4337-81cb-85b78d87e0bd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "POST /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/action" status: 202 len: 0 microversion: 2.20 time: 0.464588 Oct 12 23:03:46.255411 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2876/5653] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 12 23:03:45 2022] POST /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:03:46.263459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:46.264114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:46.273550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.274046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.277334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.278310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.278943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.279532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.372534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:46.373093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:46.381189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.385523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.386211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.387688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.388367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.388974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.574395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:46.586458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:46.588894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:46.590676 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76417054-fd62-4555-a8ef-0a07acb90989 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1673 microversion: 2.20 time: 0.331338 Oct 12 23:03:46.591735 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2778/5654] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:46 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1673 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:46.683874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:46.697981 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8fcfb4d5-27ff-4e5c-b3aa-fcbafd1f2be4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.331113 Oct 12 23:03:46.702288 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2877/5655] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:46 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:46.761206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:46.764107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:46.782704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.783554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.784059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.784811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.785266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.785733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.833768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lazy-loading 'flavor' on Instance uuid 4d2e452a-242c-498f-8821-4186f2c4bd5d {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:03:46.965918 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b355489-bfb3-4427-b55a-695f771ee832 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action" status: 200 len: 32 microversion: 2.1 time: 0.208693 Oct 12 23:03:46.971277 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2779/5656] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:03:46 2022] POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:03:46.977733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:46.979063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:46.987337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.988110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.989397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:46.990345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:46.990973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:46.991624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:47.417769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:47.432060 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7df80823-7090-4dab-a507-52293e4279f7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.455756 Oct 12 23:03:47.434728 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2878/5657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:46 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:47.617064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:47.618618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:47.635417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:47.636350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:47.639224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:47.640260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:47.641600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:47.643596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:47.729205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:47.731968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:47.739353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:47.739995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:47.740694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:47.741965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:47.742751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:47.744510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:47.969365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:47.980341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:47.985604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:47.987190 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8f1ef06-9d32-4147-8dca-ff6a1ba63256 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1673 microversion: 2.20 time: 0.374711 Oct 12 23:03:47.987773 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2780/5658] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:47 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1673 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:48.100636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:48.119374 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-720add30-76ac-4796-8543-dd8dc0175ea1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.396871 Oct 12 23:03:48.120833 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2879/5659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:47 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:48.459447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:48.460695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:48.463115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:48.477033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:48.480763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:48.481392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:48.484767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:48.485290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:48.486125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:48.745295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ac0c744d-4437-460d-950d-adf976d0faa2 req-699b3829-aa76-44a7-b6ba-7cb1b2b9cfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36501652-9871-4a81-ae04-fbba85935cae", "name": "network-vif-plugged", "status": "completed", "tag": "c945f530-339d-4514-a5f3-d0142a9ba074"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:48.765730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ac0c744d-4437-460d-950d-adf976d0faa2 req-699b3829-aa76-44a7-b6ba-7cb1b2b9cfd7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:48.769251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ac0c744d-4437-460d-950d-adf976d0faa2 req-699b3829-aa76-44a7-b6ba-7cb1b2b9cfd7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:48.770022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ac0c744d-4437-460d-950d-adf976d0faa2 req-699b3829-aa76-44a7-b6ba-7cb1b2b9cfd7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:48.794789 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ac0c744d-4437-460d-950d-adf976d0faa2 req-699b3829-aa76-44a7-b6ba-7cb1b2b9cfd7 service nova] Creating event network-vif-plugged:c945f530-339d-4514-a5f3-d0142a9ba074 for instance 36501652-9871-4a81-ae04-fbba85935cae on n-h1-860864-8 Oct 12 23:03:48.802720 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ac0c744d-4437-460d-950d-adf976d0faa2 req-699b3829-aa76-44a7-b6ba-7cb1b2b9cfd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063614 Oct 12 23:03:48.803529 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2880/5660] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:49.006024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:49.017001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:49.018018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:49.020638 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18e685b0-12e0-411e-bb85-bbffa3778126 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.566419 Oct 12 23:03:49.027008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:49.027721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:49.028387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:49.029370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:49.030629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:49.031381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:49.036202 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2781/5661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:48 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:49.146782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:49.147581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:49.154100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:49.154828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:49.155743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:49.156640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:49.157258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:49.157921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:49.304986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:49.314919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:49.316502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:49.318025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-606ff3b4-a1b7-4ae1-97a1-fc576bf91e43 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.307886 Oct 12 23:03:49.319245 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2881/5662] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:49 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:49.472949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:49.482062 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7bf3da59-a8a9-4c42-b921-14fd51a113b4 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1265 microversion: 2.1 time: 0.341360 Oct 12 23:03:49.482930 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2782/5663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:49 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1265 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:50.044648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:50.045455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:50.053487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.054613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.055268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.056635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.057378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.058053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.073188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c15b1e28-474c-4f0c-a6eb-acb3c0d3fcaa req-0979483b-c2ad-43df-832c-bf775f8689a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:50.096482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c15b1e28-474c-4f0c-a6eb-acb3c0d3fcaa req-0979483b-c2ad-43df-832c-bf775f8689a9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.116459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c15b1e28-474c-4f0c-a6eb-acb3c0d3fcaa req-0979483b-c2ad-43df-832c-bf775f8689a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.117475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c15b1e28-474c-4f0c-a6eb-acb3c0d3fcaa req-0979483b-c2ad-43df-832c-bf775f8689a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.152149 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c15b1e28-474c-4f0c-a6eb-acb3c0d3fcaa req-0979483b-c2ad-43df-832c-bf775f8689a9 service nova] Creating event network-changed:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h1-860864-8 Oct 12 23:03:50.162575 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c15b1e28-474c-4f0c-a6eb-acb3c0d3fcaa req-0979483b-c2ad-43df-832c-bf775f8689a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093274 Oct 12 23:03:50.166604 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2783/5664] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:03:50.346723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:50.349073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:50.356631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.357294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.357738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.358457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.358909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.359336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.838139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:50.849019 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38c320ac-8052-4ced-99db-607667534728 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.807224 Oct 12 23:03:50.851108 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2882/5665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:50 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:50.858519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:50.860795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:50.871339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.872489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.873749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.875207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:50.875835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:50.876621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:50.982996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:51.000602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:51.002633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:51.005443 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0387ad59-2d20-460a-8a5d-9802ea4aa24e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.663365 Oct 12 23:03:51.015293 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2784/5666] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:50 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:51.205907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:51.229869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32125e88-3340-421d-ad5e-9012aa8b3ed5 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1451 microversion: 2.1 time: 0.376555 Oct 12 23:03:51.230579 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2883/5667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:50 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1451 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:51.254604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:51.255413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:51.262605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:51.263110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:51.263720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:51.264614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:51.265237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:51.265831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:51.685941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:51.695082 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2da7c714-cf23-4ac1-8315-876e4c84e02a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1451 microversion: 2.1 time: 0.445831 Oct 12 23:03:51.700592 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2785/5668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:51 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1451 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:51.877459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:51.878343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:51.901064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:51.901725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:51.907105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:51.908141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:51.909513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:51.910088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:52.000715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:52.035646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:52.036406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:52.058337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:52.061774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:52.064456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:52.066427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:52.076158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:52.078191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:52.336764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:52.347408 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-629537ee-a822-4353-8e04-3b5d07010831 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.476663 Oct 12 23:03:52.354825 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2884/5669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:51 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:52.836402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:52.854503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:52.863036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:52.864683 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c506729-7bbf-4fad-aa3e-ccc7dd1db2fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.833669 Oct 12 23:03:52.880577 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2786/5670] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:52 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:03:53.353078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d7dd82d-3832-4984-9522-5c9b8a6240c2 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ff57ae50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:53.374696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:53.377343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:53.405140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:53.406047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:53.406759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:53.407710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:53.408427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:53.409087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:53.466194 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d7dd82d-3832-4984-9522-5c9b8a6240c2 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8db84247-9b01-46ab-b0b5-31e5be6c853b" status: 200 len: 351 microversion: 2.1 time: 0.116839 Oct 12 23:03:53.467944 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2885/5671] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:03:53 2022] GET /compute/v2.1/os-volumes/8db84247-9b01-46ab-b0b5-31e5be6c853b => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:03:53.841950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:53.856236 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1621f981-5424-4911-9fa4-281f16e792c7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.485324 Oct 12 23:03:53.856892 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2787/5672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:53 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:53.896003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:53.896639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:53.910701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:53.911226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:53.912273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:53.914106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:53.914591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:53.918172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:54.207664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:54.219387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:54.252810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:54.257090 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-691acfda-f6a8-4247-ae41-2a54972c2cbe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.366196 Oct 12 23:03:54.275917 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2886/5673] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:53 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:54.880712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:54.881661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:54.894470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:54.897538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:54.898108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:54.899096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:54.900229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:54.902339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:55.323537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:55.327248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:55.327902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:55.385525 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7fdd338d-f148-455e-9e9a-a67b6d8bfd5a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.508493 Oct 12 23:03:55.403003 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2788/5674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:54 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:55.411280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:55.415407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:55.416178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:55.418849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:55.420148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:55.423144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:55.838775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:55.866702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:55.872133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:55.875028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-247a8b66-28a7-4612-8b8e-2c0702cf6023 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.571401 Oct 12 23:03:55.881247 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2887/5675] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:55 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:55.943445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-464d5a36-6cb3-4911-a693-f1eef983c154 req-0e0d0ffa-8215-4ad3-96e5-79ef6a0717cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36501652-9871-4a81-ae04-fbba85935cae", "tag": "c945f530-339d-4514-a5f3-d0142a9ba074"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:03:55.984952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-464d5a36-6cb3-4911-a693-f1eef983c154 req-0e0d0ffa-8215-4ad3-96e5-79ef6a0717cf service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:55.989427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-464d5a36-6cb3-4911-a693-f1eef983c154 req-0e0d0ffa-8215-4ad3-96e5-79ef6a0717cf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:55.992677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-464d5a36-6cb3-4911-a693-f1eef983c154 req-0e0d0ffa-8215-4ad3-96e5-79ef6a0717cf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:56.032767 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-464d5a36-6cb3-4911-a693-f1eef983c154 req-0e0d0ffa-8215-4ad3-96e5-79ef6a0717cf service nova] Creating event network-changed:c945f530-339d-4514-a5f3-d0142a9ba074 for instance 36501652-9871-4a81-ae04-fbba85935cae on n-h1-860864-8 Oct 12 23:03:56.050031 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-464d5a36-6cb3-4911-a693-f1eef983c154 req-0e0d0ffa-8215-4ad3-96e5-79ef6a0717cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109479 Oct 12 23:03:56.063500 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2789/5676] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:03:56.322838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ab5cc92-f656-4e6c-b6eb-1442da680cd7 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ffbaec10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:56.419815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:56.420860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:56.430456 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ab5cc92-f656-4e6c-b6eb-1442da680cd7 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a63f2763-2662-4e6a-9e36-68d3e403712f" status: 200 len: 351 microversion: 2.1 time: 0.111624 Oct 12 23:03:56.431480 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2888/5677] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:03:56 2022] GET /compute/v2.1/os-volumes/a63f2763-2662-4e6a-9e36-68d3e403712f => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:56.433742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:56.437363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:56.438106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:56.441194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:56.442469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:56.443144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:56.728369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:56.754291 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a0f2aa5-9d6d-4e03-b96b-31d0059f4dff tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.336811 Oct 12 23:03:56.768211 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2790/5678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:56 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:56.929071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:56.930308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:56.943582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:56.944398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:56.945288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:56.946385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:56.947072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:56.947811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:57.290998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:57.306031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:57.310102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:57.313382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-93868b09-275d-4d67-8b49-b43b82da0e7e tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.391063 Oct 12 23:03:57.324622 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2889/5679] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:56 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:57.797150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:57.799191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:57.822494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:57.823423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:57.824207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:57.827950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:57.828804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:57.831304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:57.885090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:03:58.223360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:58.238244 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c3cc0a4-29cc-4a4d-b1fc-bac8ad900041 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.455340 Oct 12 23:03:58.239032 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2791/5680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:57 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:58.358034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:58.360081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:58.379004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:58.387654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:58.390469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:58.391970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:58.392682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:58.393525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:58.831010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:58.844226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:58.852389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:58.854024 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb7ac229-2f3c-4b5c-b694-7d0eb42a4d2a tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.502026 Oct 12 23:03:58.854856 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2890/5681] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:58 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:03:59.248913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5de42843-be2b-45f8-bfc8-2503f15e7c13 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ff54f9d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.270590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.271412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:59.291096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:59.291756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:59.292160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:59.293108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:59.293681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:59.294139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:59.383511 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5de42843-be2b-45f8-bfc8-2503f15e7c13 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b3e00758-d116-4c3d-92dc-0a952c5437b5" status: 200 len: 351 microversion: 2.1 time: 0.139161 Oct 12 23:03:59.384329 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2792/5682] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/os-volumes/b3e00758-d116-4c3d-92dc-0a952c5437b5 => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:59.399388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cf168c6c-0e5f-4bc0-a6ea-72a8ce1d1e0c tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ff8ac9d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.533965 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cf168c6c-0e5f-4bc0-a6ea-72a8ce1d1e0c tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.139685 Oct 12 23:03:59.534583 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2793/5683] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:59.552613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-634ed5bb-5e41-48d7-a576-26d5f63ce51f tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ff3e5ee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.705375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:03:59.718690 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00acc39d-1b6c-4b7b-a7ad-463ff396cc38 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.456028 Oct 12 23:03:59.720554 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-634ed5bb-5e41-48d7-a576-26d5f63ce51f tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.171720 Oct 12 23:03:59.721228 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2891/5684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:03:59.731186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2794/5685] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:03:59.736519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70bced83-d594-4726-98db-a0f4b6026c81 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ff564790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.843538 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70bced83-d594-4726-98db-a0f4b6026c81 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.111326 Oct 12 23:03:59.844672 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2892/5686] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:03:59.866128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d166f561-4470-4e23-9fa4-33116da3b92d tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ffe4fca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.884261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:03:59.885375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:03:59.909194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:59.910836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:59.912666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:03:59.915165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:03:59.915849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:03:59.917185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:00.044387 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d166f561-4470-4e23-9fa4-33116da3b92d tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.189649 Oct 12 23:04:00.045625 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2795/5687] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:00.060642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a048706-9f9e-429a-878a-7132aa70209b tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ff455b80>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:00.220957 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a048706-9f9e-429a-878a-7132aa70209b tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.164377 Oct 12 23:04:00.222084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2796/5688] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 12 23:04:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:04:00.241624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-800a1528-a0ab-4f8a-9f7d-ad4b35c13b2a tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f44ffdf8af0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:00.408187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:00.430346 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-800a1528-a0ab-4f8a-9f7d-ad4b35c13b2a tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.192632 Oct 12 23:04:00.440815 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2797/5689] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 23:04:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:00.447016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08eb9d98-b074-4911-bbde-c7ac1ec8950d tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f4507ab11f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:00.466840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:00.470286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:00.473911 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bc1f0df9-7b7e-47cf-a979-7203c73ebebe tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.594129 Oct 12 23:04:00.476357 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2893/5690] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:03:59 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:00.751488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:00.753572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:00.764947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:00.765745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:00.766459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:00.767436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:00.768117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:00.769046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:00.811606 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08eb9d98-b074-4911-bbde-c7ac1ec8950d tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.368813 Oct 12 23:04:00.812418 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2798/5691] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Oct 12 23:04:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:00.827272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d12b7d2-04da-4abb-aea7-4ebf00d510a2 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] Calling method '.version_select at 0x7f4504609820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:00.924625 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d12b7d2-04da-4abb-aea7-4ebf00d510a2 tempest-VolumesTestJSON-47281145 tempest-VolumesTestJSON-47281145-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.101131 Oct 12 23:04:00.940164 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2799/5692] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 23:04:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:04:00.975477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:00.986149 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30edf5e0-8bd4-4ee2-82e2-30a857d3f486 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.238984 Oct 12 23:04:00.986933 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2894/5693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:00 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:01.502710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:01.503243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:01.514648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:01.515065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:01.515519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:01.516271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:01.518970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:01.520230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:01.681154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:01.693355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:01.694964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:01.696410 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4db7c653-cac1-40c6-a736-70cdb317336c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.199210 Oct 12 23:04:01.697282 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2800/5694] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:01 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 23:04:02.013162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:02.014077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:02.021838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:02.022624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:02.023150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:02.024016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:02.024556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:02.025218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:02.329066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:02.338776 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e7b5f01-47f5-4c62-b54a-cc1565b55bb4 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.330594 Oct 12 23:04:02.339805 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2895/5695] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:02 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:02.724907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:02.725668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:02.733697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:02.734696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:02.735185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:02.736685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:02.737270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:02.738497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:02.890297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:02.900454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:02.902301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:02.903669 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4fcb07e0-c4f0-4cec-b2f7-4bef218a81ce tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.183686 Oct 12 23:04:02.904742 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2801/5696] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:02 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:03.367389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:03.368188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:03.390527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:03.391054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:03.391510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:03.392394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:03.393208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:03.393955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:03.607608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:03.617025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a685dab7-c572-4b26-bc94-27f18e70de66 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.255342 Oct 12 23:04:03.618286 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2896/5697] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:03 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:03.934399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:03.936394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:03.944309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:03.944934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:03.945960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:03.946773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:03.947350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:03.947880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:04.120954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:04.129714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:04.131510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:04.132992 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a5e03c1-01f7-4971-a899-cdc3b455e533 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.205613 Oct 12 23:04:04.145015 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2802/5698] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:03 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:04.643465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:04.646253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:04.655148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:04.656071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:04.656725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:04.657642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:04.658289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:04.659964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:05.060780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:05.071630 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4daecb91-e857-40a5-a54b-cb55cf616a16 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.433864 Oct 12 23:04:05.085228 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2897/5699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:04 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:05.161279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:05.161893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:05.169573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:05.170735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:05.171368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:05.172263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:05.172887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:05.173961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:05.434321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:05.454686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:05.458132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:05.460827 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-68369e83-7da1-48fe-a94e-a220cda3cb74 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.303795 Oct 12 23:04:05.464211 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2803/5700] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:05 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:06.098844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:06.099379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:06.106570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:06.107080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:06.107540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:06.108618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:06.108972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:06.109606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:06.255177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:06.264350 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e17aa70e-46df-4fda-9bfc-c9ac80b2c557 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.170101 Oct 12 23:04:06.265681 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2898/5701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:06 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:06.498730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:06.499539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:06.506659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:06.507360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:06.507861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:06.508813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:06.509795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:06.510225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:06.717014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:06.750092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:06.766825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:06.768156 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f10bec3c-603f-4f1f-bf86-18c3ce15fcdd tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.273436 Oct 12 23:04:06.777998 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2804/5702] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:06 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:06.890093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c048d989-ab12-4d0d-ac04-bc13ece9af07 req-69a54c35-8112-47cc-af5c-c85ed899acfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "name": "network-vif-plugged", "status": "completed", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:06.911201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c048d989-ab12-4d0d-ac04-bc13ece9af07 req-69a54c35-8112-47cc-af5c-c85ed899acfc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:06.912118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c048d989-ab12-4d0d-ac04-bc13ece9af07 req-69a54c35-8112-47cc-af5c-c85ed899acfc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:06.912784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c048d989-ab12-4d0d-ac04-bc13ece9af07 req-69a54c35-8112-47cc-af5c-c85ed899acfc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:06.935393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c048d989-ab12-4d0d-ac04-bc13ece9af07 req-69a54c35-8112-47cc-af5c-c85ed899acfc service nova] Creating event network-vif-plugged:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h1-860864-8 Oct 12 23:04:06.949949 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c048d989-ab12-4d0d-ac04-bc13ece9af07 req-69a54c35-8112-47cc-af5c-c85ed899acfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065048 Oct 12 23:04:06.950875 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2899/5703] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:07.288824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:07.289446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:07.295815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:07.296595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:07.297278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:07.298165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:07.299176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:07.299685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:07.454593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:07.463418 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c7d2a2f-7221-4b47-8579-aaa8b795d303 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.178522 Oct 12 23:04:07.464234 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2805/5704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:07 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:07.795166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:07.795882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:07.803408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:07.803915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:07.804371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:07.805079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:07.805543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:07.805980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:08.041695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:08.050375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:08.052116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:08.053441 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-593f2f0c-78a9-49b5-aac2-dde7a9cd3d66 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.262638 Oct 12 23:04:08.054127 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2900/5705] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:07 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:08.496491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:08.497291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:08.515472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:08.516198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:08.517961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:08.521640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:08.525833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:08.527759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:08.852540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:08.862078 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c458a88-9fad-4b5f-bb12-0db467e2c1b1 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.376838 Oct 12 23:04:08.863269 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2806/5706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:08 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:09.079973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:09.079973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:09.088112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:09.088753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:09.089884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:09.091012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:09.091754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:09.092699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:09.371957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:09.385058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:09.387127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:09.388576 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b528e45-9554-4776-90fb-054078eae3cc tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1731 microversion: 2.20 time: 0.313840 Oct 12 23:04:09.389439 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2901/5707] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:09 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1731 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:09.893380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:09.894576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:09.908174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:09.908708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:09.909425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:09.912334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:09.912984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:09.913623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:10.418612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:10.419222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:10.436668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:10.439459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:10.442085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:10.445022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:10.446195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:10.446986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:10.762551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:10.778919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:10.780901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:10.782591 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-88654ddb-5a71-4b76-b637-185cef9b460f tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1718 microversion: 2.20 time: 0.371611 Oct 12 23:04:10.783513 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2902/5708] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:10 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1718 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:10.853407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:10.862085 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3758da6d-1135-48df-ac9d-5435445e64e5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.972815 Oct 12 23:04:10.867231 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2807/5709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:09 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:11.290651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:11.291942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:11.293312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c0acc216-52de-4314-a44b-ed71b45237dc req-ba3983bf-2a07-4382-ac37-2ad55da98df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129b6224-3f85-4236-a2f4-fc5ab57dc9a7", "tag": "52f67987-c33e-4aff-b35e-a1dba10ffda4"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:11.306929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.307731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.310994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.313428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.317651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c0acc216-52de-4314-a44b-ed71b45237dc req-ba3983bf-2a07-4382-ac37-2ad55da98df0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.318135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c0acc216-52de-4314-a44b-ed71b45237dc req-ba3983bf-2a07-4382-ac37-2ad55da98df0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.321444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.322690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.326675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c0acc216-52de-4314-a44b-ed71b45237dc req-ba3983bf-2a07-4382-ac37-2ad55da98df0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.389444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c0acc216-52de-4314-a44b-ed71b45237dc req-ba3983bf-2a07-4382-ac37-2ad55da98df0 service nova] Creating event network-changed:52f67987-c33e-4aff-b35e-a1dba10ffda4 for instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 on n-h2-860864-8 Oct 12 23:04:11.401614 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c0acc216-52de-4314-a44b-ed71b45237dc req-ba3983bf-2a07-4382-ac37-2ad55da98df0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108667 Oct 12 23:04:11.405879 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2808/5710] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:11.447022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:04:11.538115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:11.661247 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d93996ad-60cd-4852-ad37-6a67217e09eb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 204 len: 0 microversion: 2.1 time: 0.375287 Oct 12 23:04:11.663114 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2903/5711] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:04:11 2022] DELETE /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:04:11.675433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:11.675433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:11.686956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.687460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.688003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.692559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.693112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.693715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.896607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:11.898360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:11.913595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.915081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.915973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.918078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:11.918733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:11.919703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:11.955147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:11.967330 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4101d71f-6f6f-40bd-a673-e3ed756cbb61 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1582 microversion: 2.1 time: 0.299433 Oct 12 23:04:11.968439 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2809/5712] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:11 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1582 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:12.177090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:12.187202 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f8e34195-af93-4815-a549-6067bfc47464 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1501 microversion: 2.1 time: 0.298984 Oct 12 23:04:12.188342 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2904/5713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:11 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:12.214283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cdd9cab-7e68-47af-ae34-05357429799e"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:12.217297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:12.226022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.226919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.228313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.229298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.230179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.231259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.265350 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Cannot 'attach_volume' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state rescued Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/os-volume_attachments HTTP/1.1 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 74 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: {"volumeAttachment": {"volumeId": "8cdd9cab-7e68-47af-ae34-05357429799e"}} Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: exception: Cannot 'attach_volume' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state rescued Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '4d2e452a-242c-498f-8821-4186f2c4bd5d', 'body': {'volumeAttachment': {'volumeId': '8cdd9cab-7e68-47af-ae34-05357429799e'}}} Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 12 23:04:12.269729 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state rescued Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state rescued Oct 12 23:04:12.277280 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:12.278928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 409 to user: Cannot 'attach_volume' instance 4d2e452a-242c-498f-8821-4186f2c4bd5d while it is in vm_state rescued {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:12.281220 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6095ed25-232b-41a1-a9a1-0f9e966574d2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071898 Oct 12 23:04:12.282901 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2810/5714] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:04:12 2022] POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 23:04:12.294003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:12.294956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:12.307332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.308335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.309589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.313141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.316299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.317820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.447725 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8afe7f52-7371-4426-bb0a-fbfbbcdf1670 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action" status: 202 len: 0 microversion: 2.1 time: 0.158668 Oct 12 23:04:12.449623 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2905/5715] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:04:12 2022] POST /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:04:12.460362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:12.462294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:12.481872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.482596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.483050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.488687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:12.490205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:12.491123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:12.745008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:12.779198 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-14f5fb26-3e88-4f12-8ea2-04956d2d3648 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1509 microversion: 2.1 time: 0.324712 Oct 12 23:04:12.787266 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2811/5716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:12 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:12.997663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:12.999060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:13.013884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:13.014400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:13.014857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:13.015583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:13.016102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:13.016502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:13.347861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:13.359054 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8bb74398-5027-4b08-adc8-d22133ef32c8 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1582 microversion: 2.1 time: 0.368136 Oct 12 23:04:13.364077 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2906/5717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:12 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1582 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:13.813782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:13.815009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:13.823185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:13.823564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:13.824104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:13.824751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:13.825399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:13.826018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:13.994366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:14.005440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-612a603c-8fb3-404a-9799-2c73ffa30092 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1509 microversion: 2.1 time: 0.196474 Oct 12 23:04:14.006141 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2812/5718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:13 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:14.116340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7c3af821-6a78-45ba-94f3-002d977e61b9 req-cef495a0-d314-4176-92b4-b427bf98cd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129b6224-3f85-4236-a2f4-fc5ab57dc9a7", "name": "network-vif-deleted", "tag": "52f67987-c33e-4aff-b35e-a1dba10ffda4"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:14.124546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:14.139530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7c3af821-6a78-45ba-94f3-002d977e61b9 req-cef495a0-d314-4176-92b4-b427bf98cd9c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:14.140045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7c3af821-6a78-45ba-94f3-002d977e61b9 req-cef495a0-d314-4176-92b4-b427bf98cd9c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:14.140492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7c3af821-6a78-45ba-94f3-002d977e61b9 req-cef495a0-d314-4176-92b4-b427bf98cd9c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:14.156051 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7c3af821-6a78-45ba-94f3-002d977e61b9 req-cef495a0-d314-4176-92b4-b427bf98cd9c service nova] Creating event network-vif-deleted:52f67987-c33e-4aff-b35e-a1dba10ffda4 for instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 on n-h2-860864-8 Oct 12 23:04:14.161912 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7c3af821-6a78-45ba-94f3-002d977e61b9 req-cef495a0-d314-4176-92b4-b427bf98cd9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049683 Oct 12 23:04:14.162523 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2907/5719] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:14.387362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:14.388320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:14.399004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:14.400163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:14.402032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:14.403145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:14.403882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:14.410191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:14.607663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:14.616595 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d71fb57-81b8-4189-9914-b3652b621b9c tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1228 microversion: 2.1 time: 0.235146 Oct 12 23:04:14.619643 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2813/5720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:14 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1228 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:15.042268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:15.043432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:15.079185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:15.080358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:15.081573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:15.082815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:15.083288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:15.083735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:15.305465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:15.317444 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4746e31a-e556-4b85-adf1-15a50c1f591b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1515 microversion: 2.1 time: 0.285464 Oct 12 23:04:15.319022 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2908/5721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:15 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:15.650251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:15.651582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:15.661713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:15.662702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:15.663416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:15.664526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:15.665364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:15.666052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:15.778040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:15.788803 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a75a2fbf-1953-47ce-9361-185f6eb204f6 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1228 microversion: 2.1 time: 0.149485 Oct 12 23:04:15.789803 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2814/5722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:15 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:16.813253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:16.814826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:16.828691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:16.830480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:16.831654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:16.834009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:16.835063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:16.837454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:16.970478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:16.981990 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-757c191a-80bf-4057-90c1-717d34b7fef7 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1228 microversion: 2.1 time: 0.173468 Oct 12 23:04:16.984097 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2909/5723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:16 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1228 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:17.902168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ef2ccbc-8e60-4c38-b8f1-86c9f6733198 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'create', calling method: .version_select at 0x7f44ff34ad30>, body: {"keypair": {"name": "tempest-keypair-1547724111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDykGkjLdqW4hQViAXyIK99oMv3FjwTwJMpTgu2gGllgh9QF+e2PvZhXYnWHPkUmCPaLOsk7rNYlr38P3sunc9xviZVUVnpvuVbvofhz0DCIwncztUum8SvXtauqzj1xLA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:17.938009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1ef2ccbc-8e60-4c38-b8f1-86c9f6733198 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:04:17.946806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1ef2ccbc-8e60-4c38-b8f1-86c9f6733198 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for user bfac41041e134286b73fba63b8b2883c and project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:04:17.978898 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ef2ccbc-8e60-4c38-b8f1-86c9f6733198 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080548 Oct 12 23:04:17.988080 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2815/5724] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:04:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:18.006980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:18.008093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:18.021705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:18.022575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:18.025555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:18.026523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:18.027178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:18.029388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:18.148109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:18.162322 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b02e76d6-af8e-46c0-8aae-12c3a86c6902 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1228 microversion: 2.1 time: 0.159235 Oct 12 23:04:18.184622 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2910/5725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:18 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1228 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:19.188249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:19.189475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:19.197000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:19.199125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:19.199781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:19.200423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:19.201374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:19.202196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:19.202813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:19.311810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4065d3f8847246e1bbd84151601311c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afaf2366bbf4eba869e2a8eb9b0e471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:19.320934 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2f0d4225-f9cd-4d1c-b574-105aab81f3cb tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 200 len: 1228 microversion: 2.1 time: 0.136678 Oct 12 23:04:19.326580 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2816/5726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:19 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 1228 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:20.056054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2021265084", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "552086e0-5d8d-4382-8a31-614a6ab893ab"}], "security_groups": [{"name": "tempest-securitygroup--189763362"}], "key_name": "tempest-keypair-1547724111", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:20.193081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] validate_networks() for [('552086e0-5d8d-4382-8a31-614a6ab893ab', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:04:20.349982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:20.351238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] [instance: 129b6224-3f85-4236-a2f4-fc5ab57dc9a7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:20.361472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:20.362463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:20.363184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:20.364135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:20.364752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:20.365342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:20.385074 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] HTTP exception thrown: Instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 could not be found. Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Request method failure captured: Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 HTTP/1.1 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0b1TMl1K-wdGn1lxsIJCOkRRvXFgzjLxiHKnkZKDL_6MOPn5pHy9gLzLqju9KnbWldsOqT5Gaipnd2GY2wptDuL4uyCVLShbD_AehDulk2EDTtk7Hd-VoVs8nGhXMHJGNaD15xIhMD-_BFNXy7DIEMy3hXXmBOTHkzJgxTfoEHuwms Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 5afaf2366bbf4eba869e2a8eb9b0e471 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBackupRestore-409783383 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5afaf2366bbf4eba869e2a8eb9b0e471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5afaf2366bbf4eba869e2a8eb9b0e471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5afaf2366bbf4eba869e2a8eb9b0e471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5afaf2366bbf4eba869e2a8eb9b0e471"}]}] Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBackupRestore-409783383 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 5afaf2366bbf4eba869e2a8eb9b0e471 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBackupRestore-409783383 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBackupRestore-409783383-project Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4065d3f8847246e1bbd84151601311c2 Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBackupRestore-409783383-project Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 could not be found. Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '129b6224-3f85-4236-a2f4-fc5ab57dc9a7'} Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 could not be found. Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 could not be found. Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:20.386776 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 could not be found. Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Returning 404 to user: Instance 129b6224-3f85-4236-a2f4-fc5ab57dc9a7 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b17cc5fb-5fea-4d91-93c7-7f75e6742693 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7" status: 404 len: 111 microversion: 2.1 time: 0.042789 Oct 12 23:04:20.392023 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2817/5727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:20 2022] GET /compute/v2.1/servers/129b6224-3f85-4236-a2f4-fc5ab57dc9a7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:04:20.699785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:04:20.700290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:04:20.702847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:04:20.703296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:04:20.703729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:04:20.720445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:20.721018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:20.722018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:20.722821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:20.725721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3654408-b51d-47ee-b0b1-20ed9974bf91 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] Calling method '.version_select at 0x7f44ff34a430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:20.727762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:20.728315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:20.772528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:04:20.773282 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3654408-b51d-47ee-b0b1-20ed9974bf91 tempest-TestVolumeBackupRestore-409783383 tempest-TestVolumeBackupRestore-409783383-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-871396140" status: 202 len: 0 microversion: 2.1 time: 0.052225 Oct 12 23:04:20.774488 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2818/5728] 10.222.0.20 () {58 vars in 1266 bytes} [Wed Oct 12 23:04:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-871396140 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:04:20.779886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Getting quotas for user bfac41041e134286b73fba63b8b2883c and project a0839a558cdf44b9a829f915aaf1e3a7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:04:20.816324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:04:20.819338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:04:20.906241 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bda40f9a-a640-486f-8920-aebc9c1f7949 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.854594 Oct 12 23:04:20.906917 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2911/5729] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:04:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:04:20.919112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3289b5b0-3150-4900-b2a9-4010cd9e5f17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:20.919758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3289b5b0-3150-4900-b2a9-4010cd9e5f17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:21.039551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3289b5b0-3150-4900-b2a9-4010cd9e5f17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:21.048608 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3289b5b0-3150-4900-b2a9-4010cd9e5f17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1246 microversion: 2.1 time: 0.134355 Oct 12 23:04:21.065937 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2819/5730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:20 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1246 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:04:22.077745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:22.078550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:22.093473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:22.093977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:22.094378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:22.095074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:22.095542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:22.096110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:22.281542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:22.291034 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f77f1e74-812d-4667-bb9e-353c01273980 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1250 microversion: 2.1 time: 0.219248 Oct 12 23:04:22.291631 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2912/5731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:22 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1250 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:23.318118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:23.319557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:23.350903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:23.351399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:23.351835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:23.352556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:23.353004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:23.353425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:23.445292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:23.668956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:23.678171 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36abfba1-c814-497e-993e-f019194f1c04 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1304 microversion: 2.1 time: 0.364857 Oct 12 23:04:23.694575 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2820/5732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:23 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1304 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:24.703136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:24.703844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:24.729031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:24.733659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:24.734270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:24.736268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:24.738279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:24.740803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:25.220778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:25.292250 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a6a3db0-30da-4def-a3ef-2c9c17e86f3b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.561451 Oct 12 23:04:25.295314 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2913/5733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:24 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:26.321873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:26.322507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:26.341312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:26.351757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:26.353073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:26.353868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:26.354559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:26.354756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:26.569775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:26.592942 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cfb595e4-6acd-41bc-a716-3e3c05c5aaaf tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.274980 Oct 12 23:04:26.601488 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2821/5734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:26 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:26.682942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-05112e9e-38cd-43d4-a5b6-6b079b9c344f req-db3c5af9-156e-43d7-87ea-ff24c39aed90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1544c-381f-44a6-8d7d-8e620e1af9de", "tag": "0ce2370e-5b84-4ca0-8605-fa2625cad68c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:26.704853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-05112e9e-38cd-43d4-a5b6-6b079b9c344f req-db3c5af9-156e-43d7-87ea-ff24c39aed90 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:26.710446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-05112e9e-38cd-43d4-a5b6-6b079b9c344f req-db3c5af9-156e-43d7-87ea-ff24c39aed90 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:26.711127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-05112e9e-38cd-43d4-a5b6-6b079b9c344f req-db3c5af9-156e-43d7-87ea-ff24c39aed90 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:26.739550 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-05112e9e-38cd-43d4-a5b6-6b079b9c344f req-db3c5af9-156e-43d7-87ea-ff24c39aed90 service nova] Creating event network-changed:0ce2370e-5b84-4ca0-8605-fa2625cad68c for instance 06c1544c-381f-44a6-8d7d-8e620e1af9de on n-h2-860864-8 Oct 12 23:04:26.764500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-05112e9e-38cd-43d4-a5b6-6b079b9c344f req-db3c5af9-156e-43d7-87ea-ff24c39aed90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091361 Oct 12 23:04:26.769336 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2914/5735] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:27.629111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:27.630909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:27.644528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:27.646205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:27.647608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:27.648622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:27.650079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:27.650889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:27.925698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:27.933698 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc763361-7ac4-4d69-bfea-353f56543c44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.311659 Oct 12 23:04:27.944347 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2822/5736] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:27 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:28.960840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:28.961561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:28.979858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:28.980373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:28.981016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:28.981912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:28.982543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:28.982976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:29.376088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:29.386203 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd74d440-ee3e-4676-809a-c36773346853 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.429439 Oct 12 23:04:29.400154 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2915/5737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:28 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:30.417145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:30.419640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:30.454177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:30.455809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:30.456310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:30.458768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:30.459883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:30.460560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:30.878147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:30.888535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ca2f0ac-2f71-4106-a9de-54fcbeabfbc9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.476886 Oct 12 23:04:30.901469 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2823/5738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:30 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:31.925720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:31.926839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:31.937906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:31.940934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:31.945282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:31.949291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:31.951548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:31.953638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:31.954120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:31.954575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:32.198787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:32.216738 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95b6ed4b-69c8-4175-96c9-3b32133c5d08 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.295865 Oct 12 23:04:32.218531 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2916/5739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:31 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:33.241821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:33.242445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:33.253410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:33.256635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:33.257123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:33.261781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:33.262770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:33.263408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:33.264040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:33.512178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:33.521973 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-68e1c3fb-7064-46af-b384-6e0eca94e27f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.283892 Oct 12 23:04:33.524326 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2824/5740] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:33 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:04:34.233528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4b90949e-9c62-45c7-972c-0a9604c7d431 req-ad60828b-7332-4922-a1a3-2d5a3f41bd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c1544c-381f-44a6-8d7d-8e620e1af9de", "name": "network-vif-plugged", "status": "completed", "tag": "0ce2370e-5b84-4ca0-8605-fa2625cad68c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:34.255000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4b90949e-9c62-45c7-972c-0a9604c7d431 req-ad60828b-7332-4922-a1a3-2d5a3f41bd4f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:34.255749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4b90949e-9c62-45c7-972c-0a9604c7d431 req-ad60828b-7332-4922-a1a3-2d5a3f41bd4f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:34.256497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4b90949e-9c62-45c7-972c-0a9604c7d431 req-ad60828b-7332-4922-a1a3-2d5a3f41bd4f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:34.271556 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4b90949e-9c62-45c7-972c-0a9604c7d431 req-ad60828b-7332-4922-a1a3-2d5a3f41bd4f service nova] Creating event network-vif-plugged:0ce2370e-5b84-4ca0-8605-fa2625cad68c for instance 06c1544c-381f-44a6-8d7d-8e620e1af9de on n-h2-860864-8 Oct 12 23:04:34.277422 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4b90949e-9c62-45c7-972c-0a9604c7d431 req-ad60828b-7332-4922-a1a3-2d5a3f41bd4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051698 Oct 12 23:04:34.279283 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2917/5741] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:34.558092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:34.558744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:34.577625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:34.578505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:34.581975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:34.583066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:34.586918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:34.589103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:34.985246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:34.997121 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89a97df4-b516-4b98-90fb-38abf1a3fe73 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1371 microversion: 2.1 time: 0.446082 Oct 12 23:04:35.012248 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2825/5742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:34 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:36.024526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:36.026762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:36.040386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.040951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.041740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.042681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.043163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.043602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.265354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:36.276424 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f3a10a7-3bc3-42bc-91fe-32d443198793 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1566 microversion: 2.1 time: 0.257642 Oct 12 23:04:36.276990 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2918/5743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:04:36 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:36.307233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:36.308436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:36.319406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.320189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.320942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.321833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:36.322463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:36.323141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:36.507875 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0c98f56c-a52c-4ce5-8a8e-edabea460890 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.210734 Oct 12 23:04:36.516521 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2826/5744] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:04:36 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:38.725311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a6ddbff9-08c3-4990-96c9-e6d158d2537d req-270fc959-db56-41c5-b9ab-abc785603a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1544c-381f-44a6-8d7d-8e620e1af9de", "tag": "0ce2370e-5b84-4ca0-8605-fa2625cad68c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:38.761128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a6ddbff9-08c3-4990-96c9-e6d158d2537d req-270fc959-db56-41c5-b9ab-abc785603a08 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:38.777343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a6ddbff9-08c3-4990-96c9-e6d158d2537d req-270fc959-db56-41c5-b9ab-abc785603a08 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:38.780210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a6ddbff9-08c3-4990-96c9-e6d158d2537d req-270fc959-db56-41c5-b9ab-abc785603a08 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:38.812830 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a6ddbff9-08c3-4990-96c9-e6d158d2537d req-270fc959-db56-41c5-b9ab-abc785603a08 service nova] Creating event network-changed:0ce2370e-5b84-4ca0-8605-fa2625cad68c for instance 06c1544c-381f-44a6-8d7d-8e620e1af9de on n-h2-860864-8 Oct 12 23:04:38.827882 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a6ddbff9-08c3-4990-96c9-e6d158d2537d req-270fc959-db56-41c5-b9ab-abc785603a08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108838 Oct 12 23:04:38.831170 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2919/5745] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:42.940949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:42.944072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:42.958383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:42.965862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:42.969358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:42.972413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:42.973336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:42.973980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:43.030612 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f46bbd67-dc99-44ff-8afa-93556d86c08c tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.094777 Oct 12 23:04:43.031951 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2827/5746] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 12 23:04:42 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:04:43.178772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:43.179763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:43.192937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:43.198473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:43.199225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:43.200338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:43.203470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:43.204550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:43.220973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:43.271562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:04:43.459709 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b1ae55a1-7d7e-428b-b488-0dfa3ebecb24 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 204 len: 0 microversion: 2.20 time: 0.285857 Oct 12 23:04:43.464011 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2920/5747] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 23:04:43 2022] DELETE /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:04:43.470274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:43.470979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:43.489409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:43.489928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:43.494383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:43.495448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:43.495968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:43.497729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:43.789465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:43.801040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:43.802598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:43.804132 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5818af7-f98c-426a-806f-474cc7a6855d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.338444 Oct 12 23:04:43.821070 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2828/5748] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:43 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:44.832128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:44.833740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:44.837048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:44.842690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:44.843490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:44.844064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:44.845454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:44.846165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:44.846672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:45.049997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:45.077631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:45.080848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:45.083550 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54c04fc5-2436-474e-bed6-9615f30aa830 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1724 microversion: 2.20 time: 0.256184 Oct 12 23:04:45.084463 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2921/5749] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:44 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:46.111113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:46.112594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:46.119637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:46.120292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:46.120758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:46.121660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:46.122472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:46.123114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:46.235780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:46.249134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:46.251641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fdc00d99b344f69a42a4b60ceaed051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8523b5fafc5447e8b3b370133590195e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:04:46.253175 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ee59e00b-a9aa-41cf-a0ca-e12ff42786fa tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 200 len: 1656 microversion: 2.20 time: 0.147015 Oct 12 23:04:46.254384 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2829/5750] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:46 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 23:04:46.915054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9e44e559-148c-4fac-a8bc-c7e6f030c37d req-aa567121-db70-4f56-be49-0ddea995eba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89615c20-7cde-4fae-9b4b-984f5bae1788", "name": "network-vif-deleted", "tag": "58300aea-c7cd-417b-ac2d-9013afbc9bd9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:04:46.962030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9e44e559-148c-4fac-a8bc-c7e6f030c37d req-aa567121-db70-4f56-be49-0ddea995eba8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:46.962964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9e44e559-148c-4fac-a8bc-c7e6f030c37d req-aa567121-db70-4f56-be49-0ddea995eba8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:46.963659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9e44e559-148c-4fac-a8bc-c7e6f030c37d req-aa567121-db70-4f56-be49-0ddea995eba8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:46.993229 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9e44e559-148c-4fac-a8bc-c7e6f030c37d req-aa567121-db70-4f56-be49-0ddea995eba8 service nova] Creating event network-vif-deleted:58300aea-c7cd-417b-ac2d-9013afbc9bd9 for instance 89615c20-7cde-4fae-9b4b-984f5bae1788 on n-h1-860864-8 Oct 12 23:04:47.012155 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9e44e559-148c-4fac-a8bc-c7e6f030c37d req-aa567121-db70-4f56-be49-0ddea995eba8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097372 Oct 12 23:04:47.024659 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2922/5751] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:04:47.284950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:47.285651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:47.298972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:47.305622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:47.306332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:47.307210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:47.307991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:47.309959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:47.360842 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] HTTP exception thrown: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Request method failure captured: Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 HTTP/1.1 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ah-lDf01bNKmlyBb1kW833quo_mhiDILphOsWNn0uAtE7ST3NZrhwytqx61fpWLFsC4fXa6ocHrRkcO8iPJpjcXLbwq7bylP1MwHPYXO0c0PEiSwtvTbTTI_XpMIbJsoIFtKQytF6v7d9vbFa0uvehGq_wngolEixDrSgIg2_TxoY Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8523b5fafc5447e8b3b370133590195e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}] Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4fdc00d99b344f69a42a4b60ceaed051 Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '89615c20-7cde-4fae-9b4b-984f5bae1788'} Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:47.367204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:47.375429 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:47.377611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Returning 404 to user: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:47.379264 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d238984b-fefc-4f50-aeba-5ead402fac03 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 404 len: 111 microversion: 2.20 time: 0.099373 Oct 12 23:04:47.383910 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2830/5752] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:47 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:04:47.389915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-499e8c48-bbc2-4637-a699-cde4ef6a6017 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '.version_select at 0x7f4507a68550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:47.445963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-499e8c48-bbc2-4637-a699-cde4ef6a6017 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080828481" status: 204 len: 0 microversion: 2.20 time: 0.060018 Oct 12 23:04:47.446938 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2923/5753] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 12 23:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080828481 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 23:04:52.239051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:52.239568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:52.242332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:52.248457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:52.249214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:52.249858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:52.251512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:52.252201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:52.252973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:52.279599 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] HTTP exception thrown: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Request method failure captured: Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 HTTP/1.1 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ah-lDf01bNKmlyBb1kW833quo_mhiDILphOsWNn0uAtE7ST3NZrhwytqx61fpWLFsC4fXa6ocHrRkcO8iPJpjcXLbwq7bylP1MwHPYXO0c0PEiSwtvTbTTI_XpMIbJsoIFtKQytF6v7d9vbFa0uvehGq_wngolEixDrSgIg2_TxoY Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8523b5fafc5447e8b3b370133590195e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}] Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4fdc00d99b344f69a42a4b60ceaed051 Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '89615c20-7cde-4fae-9b4b-984f5bae1788'} Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:52.281240 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Returning 404 to user: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1062615a-34ca-41e4-8ff5-419c82ab8357 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 404 len: 111 microversion: 2.20 time: 0.048138 Oct 12 23:04:52.285749 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2831/5754] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 23:04:52 2022] DELETE /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:04:52.292615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:52.293380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 89615c20-7cde-4fae-9b4b-984f5bae1788] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:52.302269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:52.303090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:52.304558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:52.306245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:52.307134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:52.307656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:52.327173 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] HTTP exception thrown: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Request method failure captured: Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 HTTP/1.1 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ah-lDf01bNKmlyBb1kW833quo_mhiDILphOsWNn0uAtE7ST3NZrhwytqx61fpWLFsC4fXa6ocHrRkcO8iPJpjcXLbwq7bylP1MwHPYXO0c0PEiSwtvTbTTI_XpMIbJsoIFtKQytF6v7d9vbFa0uvehGq_wngolEixDrSgIg2_TxoY Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8523b5fafc5447e8b3b370133590195e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}] Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4fdc00d99b344f69a42a4b60ceaed051 Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '89615c20-7cde-4fae-9b4b-984f5bae1788'} Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.329090 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Returning 404 to user: Instance 89615c20-7cde-4fae-9b4b-984f5bae1788 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:52.334830 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fab95980-739c-4f2c-8aa6-6de744b043d8 tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788" status: 404 len: 111 microversion: 2.20 time: 0.045274 Oct 12 23:04:52.351272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2924/5755] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:52 2022] GET /compute/v2.1/servers/89615c20-7cde-4fae-9b4b-984f5bae1788 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:04:56.834523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:56.835597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:56.843215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:56.844632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:56.845252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:56.846291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:56.846934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:56.847532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:56.852386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=59 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:04:56.863445 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] HTTP exception thrown: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Request method failure captured: Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 HTTP/1.1 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0ah-lDf01bNKmlyBb1kW833quo_mhiDILphOsWNn0uAtE7ST3NZrhwytqx61fpWLFsC4fXa6ocHrRkcO8iPJpjcXLbwq7bylP1MwHPYXO0c0PEiSwtvTbTTI_XpMIbJsoIFtKQytF6v7d9vbFa0uvehGq_wngolEixDrSgIg2_TxoY Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8523b5fafc5447e8b3b370133590195e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}] Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4fdc00d99b344f69a42a4b60ceaed051 Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '69b3e3aa-ae92-4854-981d-68a9796316f5'} Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:56.865375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.870509 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.872857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Returning 404 to user: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:56.874113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-605a408d-9532-4feb-86eb-690394e41c5d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "DELETE /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 404 len: 111 microversion: 2.20 time: 0.043481 Oct 12 23:04:56.875269 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2832/5756] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 12 23:04:56 2022] DELETE /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:04:56.883877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:04:56.885364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] [instance: 69b3e3aa-ae92-4854-981d-68a9796316f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:04:56.895698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:56.896465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:56.897319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:56.913436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:04:56.914256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:04:56.915883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:04:56.952455 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] HTTP exception thrown: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Request method failure captured: Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 HTTP/1.1 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0ah-lDf01bNKmlyBb1kW833quo_mhiDILphOsWNn0uAtE7ST3NZrhwytqx61fpWLFsC4fXa6ocHrRkcO8iPJpjcXLbwq7bylP1MwHPYXO0c0PEiSwtvTbTTI_XpMIbJsoIFtKQytF6v7d9vbFa0uvehGq_wngolEixDrSgIg2_TxoY Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8523b5fafc5447e8b3b370133590195e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8523b5fafc5447e8b3b370133590195e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8523b5fafc5447e8b3b370133590195e"}]}] Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 8523b5fafc5447e8b3b370133590195e Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-812427508 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4fdc00d99b344f69a42a4b60ceaed051 Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-812427508-project Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '69b3e3aa-ae92-4854-981d-68a9796316f5'} Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.956585 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] Returning 404 to user: Instance 69b3e3aa-ae92-4854-981d-68a9796316f5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:04:56.965990 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-977533ba-35df-481e-a1bb-f40bef94ac1d tempest-AttachVolumeShelveTestJSON-812427508 tempest-AttachVolumeShelveTestJSON-812427508-project] 10.222.0.20 "GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5" status: 404 len: 111 microversion: 2.20 time: 0.080008 Oct 12 23:04:56.970100 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2925/5757] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 12 23:04:56 2022] GET /compute/v2.1/servers/69b3e3aa-ae92-4854-981d-68a9796316f5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:05:05.158078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75a4f7db-eeea-4f45-9004-2a62615fdf62 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Action: 'create', calling method: .version_select at 0x7f44ff87f310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1014493460"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:05.586179 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75a4f7db-eeea-4f45-9004-2a62615fdf62 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.594365 Oct 12 23:05:05.586810 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2833/5758] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Oct 12 23:05:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 23:05:05.601263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-135b11a2-290c-4532-bc7d-9602867cf62d tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f45040990d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:05.683763 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-135b11a2-290c-4532-bc7d-9602867cf62d tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 200 len: 345 microversion: 2.1 time: 0.086254 Oct 12 23:05:05.688038 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2926/5759] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:05 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:06.710537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-447aebcc-e78c-478d-92bc-7e27297eb25a tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff547ee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:06.801936 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-447aebcc-e78c-478d-92bc-7e27297eb25a tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 200 len: 345 microversion: 2.1 time: 0.106254 Oct 12 23:05:06.809482 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2834/5760] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:06 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:07.814584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:07.815245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:07.820829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-06174470-16a2-4226-b6cd-a53e83065d1f tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff73e820>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:07.906676 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-06174470-16a2-4226-b6cd-a53e83065d1f tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 200 len: 346 microversion: 2.1 time: 0.094478 Oct 12 23:05:07.907279 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2927/5761] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:07 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:07.917830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:07.919455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:07.927727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd0bf5a4-1872-4be3-8d8d-09042f973a86 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Action: 'create', calling method: .version_select at 0x7f4507c03a60>, body: {"snapshot": {"volume_id": "833c59e5-3bda-440d-8287-b8a25051a939", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1434495974"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:08.162835 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd0bf5a4-1872-4be3-8d8d-09042f973a86 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.245654 Oct 12 23:05:08.163908 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2835/5762] 10.222.0.20 () {60 vars in 1162 bytes} [Wed Oct 12 23:05:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:08.175596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50fd9a3b-ba09-4f62-b4c5-116691929fac tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff564ca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:08.210100 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50fd9a3b-ba09-4f62-b4c5-116691929fac tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 200 len: 287 microversion: 2.1 time: 0.038768 Oct 12 23:05:08.210768 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2928/5763] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 23:05:08 2022] GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:08.223043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dacbe3de-c6d8-4b6e-867a-e8a363951411 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff5ada60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:08.270633 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dacbe3de-c6d8-4b6e-867a-e8a363951411 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.052541 Oct 12 23:05:08.271386 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2836/5764] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Oct 12 23:05:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:08.283198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-896f76b1-3840-4c06-ab62-36cb195957d2 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ffcab430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:08.326322 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-896f76b1-3840-4c06-ab62-36cb195957d2 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 200 len: 287 microversion: 2.1 time: 0.047724 Oct 12 23:05:08.327024 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2929/5765] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 23:05:08 2022] GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:09.343060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46efa792-505e-4bc3-8825-cd47fda62193 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f45044ac820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:09.400825 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46efa792-505e-4bc3-8825-cd47fda62193 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 200 len: 287 microversion: 2.1 time: 0.064838 Oct 12 23:05:09.402085 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2837/5766] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 23:05:09 2022] GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:10.415624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8dc262f-fb4c-49dc-bd92-e70f3d8a9101 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f4507c3fb80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:10.460280 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8dc262f-fb4c-49dc-bd92-e70f3d8a9101 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 200 len: 288 microversion: 2.1 time: 0.049743 Oct 12 23:05:10.461484 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2930/5767] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 23:05:10 2022] GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 288 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:10.473526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dedcd3d-8275-4c5d-8c6a-16cbdc15fc26 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f4507acf0d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:10.588776 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dedcd3d-8275-4c5d-8c6a-16cbdc15fc26 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 202 len: 0 microversion: 2.1 time: 0.120072 Oct 12 23:05:10.589372 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2838/5768] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Oct 12 23:05:10 2022] DELETE /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:05:10.601886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-115454e5-294e-45a6-9701-9cd182a2d0af tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f4507c3fdc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:10.671545 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-115454e5-294e-45a6-9701-9cd182a2d0af tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 200 len: 287 microversion: 2.1 time: 0.077388 Oct 12 23:05:10.672659 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2931/5769] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 23:05:10 2022] GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:05:11.686281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fda2bda6-ad99-4ec3-b234-458f80d886c2 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff7745e0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:11.746633 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fda2bda6-ad99-4ec3-b234-458f80d886c2 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 200 len: 287 microversion: 2.1 time: 0.065442 Oct 12 23:05:11.747631 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2839/5770] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 23:05:11 2022] GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:12.541325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f7c83b0-e323-4278-a2ce-fcfba990e94b"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:12.544581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:12.554890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:12.555725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:12.556478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:12.557409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:12.558067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:12.558664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:12.761696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b030202-4185-43b5-94a2-547e5437b916 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f45044ac790>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:12.805839 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9b030202-4185-43b5-94a2-547e5437b916 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] HTTP exception thrown: Snapshot aeb5c9f2-b745-4763-bc39-98e937e52671 could not be found. Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b030202-4185-43b5-94a2-547e5437b916 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Request method failure captured: Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 HTTP/1.1 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0gg6w717A27k3L4BW5NSfYOkfSHE4ZdGuTAKETdz6k0-vjrFKAA_OG04ci7ObmKfmZGSIYLzQeZh7hFXpbgrGyU2B2Lr4qPYyCEU853etGSQ123NOr6XPLMrl1SgHhUR8Ww6WgnzmBanCTPBo41Yte3qMj3GDi6tMv2Xc6WFk_N3i8 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a95025f73ec741328a95281733b01251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a95025f73ec741328a95281733b01251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}] Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 005682a40afb49ecbc226c1ee49486e8 Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: exception: Snapshot aeb5c9f2-b745-4763-bc39-98e937e52671 could not be found. Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'aeb5c9f2-b745-4763-bc39-98e937e52671'} Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot aeb5c9f2-b745-4763-bc39-98e937e52671 could not be found. (HTTP 404) (Request-ID: req-cc475ce5-309e-4c3f-b4e0-c873587a89c6) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 23:05:12.822077 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot aeb5c9f2-b745-4763-bc39-98e937e52671 could not be found. Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot aeb5c9f2-b745-4763-bc39-98e937e52671 could not be found. Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot aeb5c9f2-b745-4763-bc39-98e937e52671 could not be found. Oct 12 23:05:12.828318 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:12.832967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b030202-4185-43b5-94a2-547e5437b916 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Returning 404 to user: Snapshot aeb5c9f2-b745-4763-bc39-98e937e52671 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:12.834373 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b030202-4185-43b5-94a2-547e5437b916 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671" status: 404 len: 111 microversion: 2.1 time: 0.078639 Oct 12 23:05:12.840237 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2840/5771] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 12 23:05:12 2022] GET /compute/v2.1/os-snapshots/aeb5c9f2-b745-4763-bc39-98e937e52671 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:05:12.846883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-acc90cbd-c159-4bfd-a3ef-33d3307b9a44 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff5adf70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:12.882028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-97204c10-2178-4c4b-9538-956fefbfbf70 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344910 Oct 12 23:05:12.883785 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2932/5772] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:05:12 2022] POST /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:12.976165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-acc90cbd-c159-4bfd-a3ef-33d3307b9a44 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 202 len: 0 microversion: 2.1 time: 0.132225 Oct 12 23:05:12.977830 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2841/5773] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:05:12 2022] DELETE /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:05:12.987118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-318b7c84-c663-4771-b8cc-1638a2dfd0f1 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f4507a35940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:13.070169 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-318b7c84-c663-4771-b8cc-1638a2dfd0f1 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 200 len: 345 microversion: 2.1 time: 0.088012 Oct 12 23:05:13.073218 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2933/5774] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:12 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:14.089231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ee7ba81-19d1-43dd-b15d-08d49448b2fc tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff7c78b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:14.149294 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ee7ba81-19d1-43dd-b15d-08d49448b2fc tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 200 len: 345 microversion: 2.1 time: 0.066740 Oct 12 23:05:14.150910 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2842/5775] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:14 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:15.164303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9cf06470-7c5e-4db3-ae27-c94ca2d9985a tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f4507a38700>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:15.225519 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9cf06470-7c5e-4db3-ae27-c94ca2d9985a tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 200 len: 345 microversion: 2.1 time: 0.065016 Oct 12 23:05:15.226110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2934/5776] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:15 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:16.255314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d25689e-866f-46ed-98ea-ec2ff9d5ab7e tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff7744c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:16.302721 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-3d25689e-866f-46ed-98ea-ec2ff9d5ab7e tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] HTTP exception thrown: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d25689e-866f-46ed-98ea-ec2ff9d5ab7e tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Request method failure captured: Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 HTTP/1.1 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0gg6w717A27k3L4BW5NSfYOkfSHE4ZdGuTAKETdz6k0-vjrFKAA_OG04ci7ObmKfmZGSIYLzQeZh7hFXpbgrGyU2B2Lr4qPYyCEU853etGSQ123NOr6XPLMrl1SgHhUR8Ww6WgnzmBanCTPBo41Yte3qMj3GDi6tMv2Xc6WFk_N3i8 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a95025f73ec741328a95281733b01251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a95025f73ec741328a95281733b01251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}] Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 005682a40afb49ecbc226c1ee49486e8 Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: exception: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '833c59e5-3bda-440d-8287-b8a25051a939'} Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. (HTTP 404) (Request-ID: req-86285c1a-fb96-4914-a7af-cd4f08d82115) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 23:05:16.305522 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.310801 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.319781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d25689e-866f-46ed-98ea-ec2ff9d5ab7e tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Returning 404 to user: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:16.319781 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d25689e-866f-46ed-98ea-ec2ff9d5ab7e tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 404 len: 109 microversion: 2.1 time: 0.082506 Oct 12 23:05:16.320960 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2843/5777] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:16 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:05:16.331272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef2e051b-7021-4dd6-8f6c-ffddf66d9659 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f44ff57aca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:16.375078 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ef2e051b-7021-4dd6-8f6c-ffddf66d9659 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] HTTP exception thrown: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef2e051b-7021-4dd6-8f6c-ffddf66d9659 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Request method failure captured: Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 HTTP/1.1 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0gg6w717A27k3L4BW5NSfYOkfSHE4ZdGuTAKETdz6k0-vjrFKAA_OG04ci7ObmKfmZGSIYLzQeZh7hFXpbgrGyU2B2Lr4qPYyCEU853etGSQ123NOr6XPLMrl1SgHhUR8Ww6WgnzmBanCTPBo41Yte3qMj3GDi6tMv2Xc6WFk_N3i8 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a95025f73ec741328a95281733b01251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a95025f73ec741328a95281733b01251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}] Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 005682a40afb49ecbc226c1ee49486e8 Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: exception: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '833c59e5-3bda-440d-8287-b8a25051a939'} Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. (HTTP 404) (Request-ID: req-c72a61c9-51ea-4b9b-a9bb-5c0aab378be8) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 23:05:16.377211 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef2e051b-7021-4dd6-8f6c-ffddf66d9659 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Returning 404 to user: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:16.382750 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef2e051b-7021-4dd6-8f6c-ffddf66d9659 tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 404 len: 109 microversion: 2.1 time: 0.052935 Oct 12 23:05:16.388756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b41e83a1-ed77-4c82-8b97-b1c40b82036c tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Calling method '.version_select at 0x7f4507a7d310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:16.395432 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2935/5778] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:05:16 2022] DELETE /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:05:16.432195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b41e83a1-ed77-4c82-8b97-b1c40b82036c tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] HTTP exception thrown: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b41e83a1-ed77-4c82-8b97-b1c40b82036c tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Request method failure captured: Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 HTTP/1.1 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0gg6w717A27k3L4BW5NSfYOkfSHE4ZdGuTAKETdz6k0-vjrFKAA_OG04ci7ObmKfmZGSIYLzQeZh7hFXpbgrGyU2B2Lr4qPYyCEU853etGSQ123NOr6XPLMrl1SgHhUR8Ww6WgnzmBanCTPBo41Yte3qMj3GDi6tMv2Xc6WFk_N3i8 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a95025f73ec741328a95281733b01251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a95025f73ec741328a95281733b01251"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a95025f73ec741328a95281733b01251"}]}] Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a95025f73ec741328a95281733b01251 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-266882068 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 005682a40afb49ecbc226c1ee49486e8 Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-266882068-project Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: exception: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '833c59e5-3bda-440d-8287-b8a25051a939'} Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. (HTTP 404) (Request-ID: req-574fcb3e-2559-485f-9a16-4a2b088f2f90) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 23:05:16.434370 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b41e83a1-ed77-4c82-8b97-b1c40b82036c tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] Returning 404 to user: Volume 833c59e5-3bda-440d-8287-b8a25051a939 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:16.440212 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b41e83a1-ed77-4c82-8b97-b1c40b82036c tempest-VolumesSnapshotsTestJSON-266882068 tempest-VolumesSnapshotsTestJSON-266882068-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939" status: 404 len: 109 microversion: 2.1 time: 0.052190 Oct 12 23:05:16.446146 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2844/5779] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:16 2022] GET /compute/v2.1/os-volumes/833c59e5-3bda-440d-8287-b8a25051a939 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:05:18.849689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d9ff1c1d-d531-4c38-97d4-eb5069783708 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Action: 'create', calling method: .version_select at 0x7f44ff470670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-259312247", "metadata": {"Type": "work"}}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d9ff1c1d-d531-4c38-97d4-eb5069783708 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Request method failure captured: Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 121 Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0guCdXSPkoKyfROuT5zycq1m8YtpBBznD9T3Fs5INyU8CvbZOXOG60EzS4IHNmVqdXPGTjjQczuDNl0XNIszpPvgUVNOqhxrz-YMDJWuWCPed143r7FxLY-Ep2le3DG648GnxCBid3Xc0oSWtraR9fHAeRqJpCAEBquyST1AKA-ahQ Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}] Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7b4b68da10aa4568a092adc2d2836eca Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-259312247", "metadata": {"Type": "work"}}} Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-259312247', 'metadata': {'Type': 'work'}}}} Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi '#$%' Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:05:18.854841 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d9ff1c1d-d531-4c38-97d4-eb5069783708 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:18.861390 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d9ff1c1d-d531-4c38-97d4-eb5069783708 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.172052 Oct 12 23:05:18.872041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35dc8a27-a4c4-4c63-a061-ae95a58a4694 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Action: 'create', calling method: .version_select at 0x7f4507a7daf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1889335352", "metadata": {"Type": "work"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:18.875904 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2936/5780] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 12 23:05:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35dc8a27-a4c4-4c63-a061-ae95a58a4694 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Request method failure captured: Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 120 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0guCdXSPkoKyfROuT5zycq1m8YtpBBznD9T3Fs5INyU8CvbZOXOG60EzS4IHNmVqdXPGTjjQczuDNl0XNIszpPvgUVNOqhxrz-YMDJWuWCPed143r7FxLY-Ep2le3DG648GnxCBid3Xc0oSWtraR9fHAeRqJpCAEBquyST1AKA-ahQ Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}] Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7b4b68da10aa4568a092adc2d2836eca Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1889335352", "metadata": {"Type": "work"}}} Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1889335352', 'metadata': {'Type': 'work'}}}} Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '0' Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:05:18.877593 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35dc8a27-a4c4-4c63-a061-ae95a58a4694 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35dc8a27-a4c4-4c63-a061-ae95a58a4694 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013836 Oct 12 23:05:18.884109 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2845/5781] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 12 23:05:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:05:18.892678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad69aa59-8752-46bd-b674-503351875cef tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Action: 'create', calling method: .version_select at 0x7f44fee40430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-893156249", "metadata": {"Type": "work"}}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad69aa59-8752-46bd-b674-503351875cef tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Request method failure captured: Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 118 Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0guCdXSPkoKyfROuT5zycq1m8YtpBBznD9T3Fs5INyU8CvbZOXOG60EzS4IHNmVqdXPGTjjQczuDNl0XNIszpPvgUVNOqhxrz-YMDJWuWCPed143r7FxLY-Ep2le3DG648GnxCBid3Xc0oSWtraR9fHAeRqJpCAEBquyST1AKA-ahQ Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}] Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7b4b68da10aa4568a092adc2d2836eca Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-893156249", "metadata": {"Type": "work"}}} Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-893156249', 'metadata': {'Type': 'work'}}}} Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi '' Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:05:18.897255 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad69aa59-8752-46bd-b674-503351875cef tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad69aa59-8752-46bd-b674-503351875cef tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010984 Oct 12 23:05:18.902782 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2937/5782] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 12 23:05:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:05:18.911386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25d55989-c84d-4a32-b5b8-00f86da6dce2 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Calling method '.version_select at 0x7f44ff6841f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:18.949493 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-25d55989-c84d-4a32-b5b8-00f86da6dce2 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] HTTP exception thrown: Volume tempest-invalid-980140050 could not be found. Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25d55989-c84d-4a32-b5b8-00f86da6dce2 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Request method failure captured: Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-980140050 HTTP/1.1 Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0guCdXSPkoKyfROuT5zycq1m8YtpBBznD9T3Fs5INyU8CvbZOXOG60EzS4IHNmVqdXPGTjjQczuDNl0XNIszpPvgUVNOqhxrz-YMDJWuWCPed143r7FxLY-Ep2le3DG648GnxCBid3Xc0oSWtraR9fHAeRqJpCAEBquyST1AKA-ahQ Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}] Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7b4b68da10aa4568a092adc2d2836eca Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: exception: Volume tempest-invalid-980140050 could not be found. Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'tempest-invalid-980140050'} Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-980140050 could not be found. (HTTP 404) (Request-ID: req-45d05f0f-cde2-459e-89ae-c984873edf8f) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:18.951867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-980140050 could not be found. Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-980140050 could not be found. Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-980140050 could not be found. Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25d55989-c84d-4a32-b5b8-00f86da6dce2 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Returning 404 to user: Volume tempest-invalid-980140050 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25d55989-c84d-4a32-b5b8-00f86da6dce2 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-980140050" status: 404 len: 98 microversion: 2.1 time: 0.046194 Oct 12 23:05:18.956886 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2846/5783] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 12 23:05:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-980140050 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:05:18.965285 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-da8f31ff-0a86-464b-953f-e3fd890f714b tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003762 Oct 12 23:05:18.966139 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2938/5784] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Oct 12 23:05:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 23:05:18.976937 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-297eb526-f0a4-4ab2-86bf-46777e1be79b tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005144 Oct 12 23:05:18.977494 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2847/5785] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 23:05:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 23:05:18.988047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b5c2462-942a-4f06-82d7-9667d498ef00 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Calling method '.version_select at 0x7f44ff73e4c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:19.032206 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1b5c2462-942a-4f06-82d7-9667d498ef00 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] HTTP exception thrown: Volume ed5d4738-125a-4ae6-a6c2-571097d428ca could not be found. Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b5c2462-942a-4f06-82d7-9667d498ef00 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Request method failure captured: Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-volumes/ed5d4738-125a-4ae6-a6c2-571097d428ca HTTP/1.1 Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0guCdXSPkoKyfROuT5zycq1m8YtpBBznD9T3Fs5INyU8CvbZOXOG60EzS4IHNmVqdXPGTjjQczuDNl0XNIszpPvgUVNOqhxrz-YMDJWuWCPed143r7FxLY-Ep2le3DG648GnxCBid3Xc0oSWtraR9fHAeRqJpCAEBquyST1AKA-ahQ Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}] Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 7b4b68da10aa4568a092adc2d2836eca Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: method: Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: exception: Volume ed5d4738-125a-4ae6-a6c2-571097d428ca could not be found. Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ed5d4738-125a-4ae6-a6c2-571097d428ca'} Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed5d4738-125a-4ae6-a6c2-571097d428ca could not be found. (HTTP 404) (Request-ID: req-638410f3-4f4e-413a-8895-71554398c9f4) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 23:05:19.034681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed5d4738-125a-4ae6-a6c2-571097d428ca could not be found. Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed5d4738-125a-4ae6-a6c2-571097d428ca could not be found. Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed5d4738-125a-4ae6-a6c2-571097d428ca could not be found. Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b5c2462-942a-4f06-82d7-9667d498ef00 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Returning 404 to user: Volume ed5d4738-125a-4ae6-a6c2-571097d428ca could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b5c2462-942a-4f06-82d7-9667d498ef00 tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/ed5d4738-125a-4ae6-a6c2-571097d428ca" status: 404 len: 109 microversion: 2.1 time: 0.053643 Oct 12 23:05:19.040553 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2939/5786] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:05:18 2022] DELETE /compute/v2.1/os-volumes/ed5d4738-125a-4ae6-a6c2-571097d428ca => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:05:19.051986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3cf870bd-9363-43de-b046-84020780404e tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Calling method '.version_select at 0x7f44ff7c74c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:19.090093 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-3cf870bd-9363-43de-b046-84020780404e tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] HTTP exception thrown: Volume a074d53f-b695-407a-ab96-239c34baa7c7 could not be found. Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3cf870bd-9363-43de-b046-84020780404e tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Request method failure captured: Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/os-volumes/a074d53f-b695-407a-ab96-239c34baa7c7 HTTP/1.1 Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0guCdXSPkoKyfROuT5zycq1m8YtpBBznD9T3Fs5INyU8CvbZOXOG60EzS4IHNmVqdXPGTjjQczuDNl0XNIszpPvgUVNOqhxrz-YMDJWuWCPed143r7FxLY-Ep2le3DG648GnxCBid3Xc0oSWtraR9fHAeRqJpCAEBquyST1AKA-ahQ Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45daa0e24aca4441a24d2e53d0acefdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45daa0e24aca4441a24d2e53d0acefdd"}]}] Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 45daa0e24aca4441a24d2e53d0acefdd Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-16626834 Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 7b4b68da10aa4568a092adc2d2836eca Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-16626834-project Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: method: Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: exception: Volume a074d53f-b695-407a-ab96-239c34baa7c7 could not be found. Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a074d53f-b695-407a-ab96-239c34baa7c7'} Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a074d53f-b695-407a-ab96-239c34baa7c7 could not be found. (HTTP 404) (Request-ID: req-04f147a9-e3b4-452d-a9de-749e83d31b0a) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 23:05:19.092121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a074d53f-b695-407a-ab96-239c34baa7c7 could not be found. Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a074d53f-b695-407a-ab96-239c34baa7c7 could not be found. Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a074d53f-b695-407a-ab96-239c34baa7c7 could not be found. Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3cf870bd-9363-43de-b046-84020780404e tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] Returning 404 to user: Volume a074d53f-b695-407a-ab96-239c34baa7c7 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3cf870bd-9363-43de-b046-84020780404e tempest-VolumesNegativeTest-16626834 tempest-VolumesNegativeTest-16626834-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a074d53f-b695-407a-ab96-239c34baa7c7" status: 404 len: 109 microversion: 2.1 time: 0.048386 Oct 12 23:05:19.098247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2848/5787] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 12 23:05:19 2022] GET /compute/v2.1/os-volumes/a074d53f-b695-407a-ab96-239c34baa7c7 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:05:25.042809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:25.045236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:25.051424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:25.053818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:25.098872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:25.103138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:25.105356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:25.110192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:25.110884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:25.111509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:25.165999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lazy-loading 'flavor' on Instance uuid 06c1544c-381f-44a6-8d7d-8e620e1af9de {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:05:25.368738 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1fa3c69-db78-4db4-9356-5e091ac86a77 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/action" status: 200 len: 32 microversion: 2.1 time: 0.352611 Oct 12 23:05:25.369372 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2940/5788] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:05:25 2022] POST /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/action => generated 32 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:05:25.379823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:25.381147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:25.390912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:25.391402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:25.391844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:25.392568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:25.393191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:25.393772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:25.654261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:25.672733 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5832724f-c67c-4075-98fd-fba24476648c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.297580 Oct 12 23:05:25.675037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2849/5789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:25 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:26.700354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:26.701733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:26.709450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:26.710205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:26.711789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:26.713972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:26.716234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:26.716708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:26.926832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:26.953325 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1c667020-fba7-4278-83e6-00c9f3d816a8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.257993 Oct 12 23:05:26.954730 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2941/5790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:26 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:27.982103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:27.983079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:27.992350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:27.993075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:27.993538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:27.994415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:27.994867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:27.995290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:28.171626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:28.181804 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4e4afe8e-2ff9-42f6-99bd-b7f6b462b58b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.205784 Oct 12 23:05:28.182790 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2850/5791] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:27 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:29.207241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:29.208579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:29.215874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:29.216622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:29.217307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:29.218333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:29.218976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:29.219589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:29.397086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:29.407097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d6f1dc3-e508-4cce-bee8-8147a07c34c8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.203509 Oct 12 23:05:29.407731 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2942/5792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:29 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:30.432611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:30.433314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:30.440170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:30.440861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:30.441505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:30.442393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:30.443014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:30.443653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:30.626278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:30.645684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2824617e-f241-4326-ac5b-9c23a3acebbd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.216842 Oct 12 23:05:30.646358 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2851/5793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:30 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:31.672206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:31.673186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:31.688241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:31.688774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:31.690907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:31.693066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:31.695414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:31.696124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:32.005448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:32.018045 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6231fabe-07bc-4c73-a560-a3ce17812dbb tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.351200 Oct 12 23:05:32.019609 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2943/5794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:31 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:33.046237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:33.046870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:33.070734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:33.072459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:33.073365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:33.078348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:33.079003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:33.079301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:33.401988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:33.414146 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19094431-2579-4053-b0f4-be4d87fbdfe5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.373574 Oct 12 23:05:33.414747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2852/5795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:33 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:34.145193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-658831136", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "baaad898-eac9-4e7d-800a-5008f34beb3c"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:34.211927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] validate_networks() for [('baaad898-eac9-4e7d-800a-5008f34beb3c', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:05:34.437808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:34.440008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:34.453306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:34.455121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:34.455567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:34.456308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:34.456763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:34.457191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:34.633116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:34.643580 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce22660c-097b-4799-9966-a1dc03adf456 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.210434 Oct 12 23:05:34.645653 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2853/5796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:34 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:34.764512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:05:34.765042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:05:34.765777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:05:34.766626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:05:34.767260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:05:34.781242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:34.781959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:34.782591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:34.783991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:34.784632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:34.785229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:34.805806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Getting quotas for project 95d394e8cec342c682cb275c35c7b3ef. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:05:34.811279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Getting quotas for user f254bbc431934cd6be87afb421a1c37d and project 95d394e8cec342c682cb275c35c7b3ef. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:05:34.824687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:05:34.827568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:05:34.876758 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04462997-9923-45e2-9958-1cf4f1e05d4a tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053152 Oct 12 23:05:34.877580 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2944/5797] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:05:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:05:34.889944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c06bb3b5-e3b3-4c20-a4db-dcbc2b11646f tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:34.890826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c06bb3b5-e3b3-4c20-a4db-dcbc2b11646f tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:34.895486 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:05:34.895760 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:05:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac (ip 10.222.0.20) !!! Oct 12 23:05:34.988028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c06bb3b5-e3b3-4c20-a4db-dcbc2b11646f tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:35.089281 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c06bb3b5-e3b3-4c20-a4db-dcbc2b11646f tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1213 microversion: 2.1 time: 0.162848 Oct 12 23:05:35.093592 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2854/5798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:34 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:35.669176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:35.671002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:35.678336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:35.681024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:35.681561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:35.686372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:35.688210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:35.688682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:35.910757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:35.926937 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b04c11ca-2608-4d06-ab57-a55b305a8cab tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.261682 Oct 12 23:05:35.931289 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2945/5799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:35 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:05:36.113888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:36.114727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:36.124193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:36.124559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:36.124961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:36.125844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:36.126768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:36.127297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:36.204706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:36.214792 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d4f0b65-10cc-49b5-baf8-1f7981a2033d tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1265 microversion: 2.1 time: 0.105367 Oct 12 23:05:36.215366 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2855/5800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:36 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:36.958216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:36.959634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:36.967643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:36.968555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:36.969254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:36.970232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:36.970930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:36.971596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:37.176332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:37.191262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5255ee35-ab49-487a-b3b0-8f0e18f8dabd tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.238176 Oct 12 23:05:37.191801 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2946/5801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:36 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:37.239088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:37.239815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:37.253478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:37.254586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:37.257593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:37.258656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:37.260355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:37.260974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:37.406286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:37.424018 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fce267b9-8216-415c-aa38-dbadf1fc7704 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1271 microversion: 2.1 time: 0.188752 Oct 12 23:05:37.428516 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2856/5802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:37 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:38.214411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:38.215062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:38.221711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:38.222210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:38.222661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:38.223373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:38.223837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:38.224301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:38.437782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:38.447065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:38.447799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:38.461625 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c99e8149-2b3d-4371-aa90-73d355e3184e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.251099 Oct 12 23:05:38.461861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:38.462413 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2947/5803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:38 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:38.462547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:38.463331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:38.466555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:38.467176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:38.467712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:38.737138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:38.746023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2470108e-e3ce-4cd8-a0c5-5b0b29a1065b tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1313 microversion: 2.1 time: 0.302979 Oct 12 23:05:38.749220 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2857/5804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:38 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:38.881369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9ce79c7e-31e2-4ac6-af8d-32a96c95fcaf req-5bdcc7a8-065c-44dd-a7d0-a35f7ae95b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0418ed27-5efa-469b-a78a-073caa4707ac", "tag": "95d82d7b-2327-4656-a13f-fcd41df26323"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:38.905534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9ce79c7e-31e2-4ac6-af8d-32a96c95fcaf req-5bdcc7a8-065c-44dd-a7d0-a35f7ae95b40 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:38.906332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9ce79c7e-31e2-4ac6-af8d-32a96c95fcaf req-5bdcc7a8-065c-44dd-a7d0-a35f7ae95b40 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:38.907490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9ce79c7e-31e2-4ac6-af8d-32a96c95fcaf req-5bdcc7a8-065c-44dd-a7d0-a35f7ae95b40 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:38.933631 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9ce79c7e-31e2-4ac6-af8d-32a96c95fcaf req-5bdcc7a8-065c-44dd-a7d0-a35f7ae95b40 service nova] Creating event network-changed:95d82d7b-2327-4656-a13f-fcd41df26323 for instance 0418ed27-5efa-469b-a78a-073caa4707ac on n-h1-860864-8 Oct 12 23:05:38.949346 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9ce79c7e-31e2-4ac6-af8d-32a96c95fcaf req-5bdcc7a8-065c-44dd-a7d0-a35f7ae95b40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072489 Oct 12 23:05:38.955357 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2948/5805] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:39.490490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:39.491120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:39.501589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:39.502135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:39.502593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:39.503366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:39.503824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:39.504280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:39.653376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:39.664554 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a71bfbe7-9a85-4c53-b975-0d90942b7cce tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.178540 Oct 12 23:05:39.665902 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2858/5806] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:39 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:39.780482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:39.781199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:39.790175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:39.791019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:39.791707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:39.792682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:39.793137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:39.794120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:40.182313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:40.192542 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-649630fe-0750-4a23-8f3d-2e37c004292c tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1313 microversion: 2.1 time: 0.417445 Oct 12 23:05:40.193885 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2949/5807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:39 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:40.699011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:40.699826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:40.714793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:40.717813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:40.718644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:40.720383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:40.722164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:40.722814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:41.016080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:41.056420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60db2b6f-6609-4f8f-a5da-3cf712064150 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.366488 Oct 12 23:05:41.062789 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2859/5808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:40 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:41.222275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:41.224505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:41.245568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:41.248688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:41.249650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:41.253095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:41.257979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:41.259017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:41.479314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:41.491736 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eedcc27a-d320-46fa-b3ef-4959cc104061 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1313 microversion: 2.1 time: 0.274063 Oct 12 23:05:41.493583 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2950/5809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:41 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:42.088319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:42.089161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:42.122741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:42.123817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:42.124624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:42.125734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:42.126427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:42.127103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:42.377987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:42.392173 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1eac451d-ef39-4474-bdae-1a40fc78f5a2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1736 microversion: 2.1 time: 0.309349 Oct 12 23:05:42.392812 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2860/5810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:42 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:42.521738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:42.524276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:42.530753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:42.531373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:42.532335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:42.532738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:42.533415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:42.534058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:42.864101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:42.876562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c246d42-32aa-4bfd-b6b3-1fc36a6eece3 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1313 microversion: 2.1 time: 0.359408 Oct 12 23:05:42.893312 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2951/5811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:42 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:43.241318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4415cbba-decc-4187-8b48-6678ed4122ec req-5ef8ad5a-0231-48cc-bdea-48a0b0c1ac2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0418ed27-5efa-469b-a78a-073caa4707ac", "name": "network-vif-plugged", "status": "completed", "tag": "95d82d7b-2327-4656-a13f-fcd41df26323"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:43.257341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4415cbba-decc-4187-8b48-6678ed4122ec req-5ef8ad5a-0231-48cc-bdea-48a0b0c1ac2b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:43.258039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4415cbba-decc-4187-8b48-6678ed4122ec req-5ef8ad5a-0231-48cc-bdea-48a0b0c1ac2b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:43.258647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4415cbba-decc-4187-8b48-6678ed4122ec req-5ef8ad5a-0231-48cc-bdea-48a0b0c1ac2b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:43.272362 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4415cbba-decc-4187-8b48-6678ed4122ec req-5ef8ad5a-0231-48cc-bdea-48a0b0c1ac2b service nova] Creating event network-vif-plugged:95d82d7b-2327-4656-a13f-fcd41df26323 for instance 0418ed27-5efa-469b-a78a-073caa4707ac on n-h1-860864-8 Oct 12 23:05:43.278342 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4415cbba-decc-4187-8b48-6678ed4122ec req-5ef8ad5a-0231-48cc-bdea-48a0b0c1ac2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041406 Oct 12 23:05:43.279566 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2861/5812] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:43.422938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:43.423674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:43.434203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:43.434990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:43.435639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:43.436561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:43.437211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:43.437803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:43.793252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:43.806347 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8eeae394-1bc5-4f66-b843-24ea0ddb8814 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1716 microversion: 2.1 time: 0.388291 Oct 12 23:05:43.807546 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2952/5813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:43 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1716 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:43.907531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:43.910194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:43.925134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:43.926215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:43.927111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:43.928907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:43.929586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:43.930218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.044429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:44.045192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:44.053774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:44.054265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:44.055708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.058225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:44.061017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:44.064795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.316770 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Cannot 'detach_volume' instance 06c1544c-381f-44a6-8d7d-8e620e1af9de while it is in vm_state rescued Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments/4f7c83b0-e323-4278-a2ce-fcfba990e94b HTTP/1.1 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'detach_volume' instance 06c1544c-381f-44a6-8d7d-8e620e1af9de while it is in vm_state rescued Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': '06c1544c-381f-44a6-8d7d-8e620e1af9de', 'id': '4f7c83b0-e323-4278-a2ce-fcfba990e94b'} Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06c1544c-381f-44a6-8d7d-8e620e1af9de in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 06c1544c-381f-44a6-8d7d-8e620e1af9de while it is in vm_state rescued Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:44.322636 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:44.334086 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:44.334086 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:44.334086 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:44.334086 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:44.334086 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 06c1544c-381f-44a6-8d7d-8e620e1af9de while it is in vm_state rescued Oct 12 23:05:44.334086 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:05:44.337080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 409 to user: Cannot 'detach_volume' instance 06c1544c-381f-44a6-8d7d-8e620e1af9de while it is in vm_state rescued {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:44.338574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36b9dc21-3d24-4257-a0db-e179b21be594 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments/4f7c83b0-e323-4278-a2ce-fcfba990e94b" status: 409 len: 152 microversion: 2.1 time: 0.298655 Oct 12 23:05:44.340682 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2953/5814] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:05:44 2022] DELETE /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments/4f7c83b0-e323-4278-a2ce-fcfba990e94b => generated 152 bytes in 301 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:05:44.353365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:44.354896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:44.374532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:44.375342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:44.375793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.377039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:44.377965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:44.378419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.462756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:44.477050 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-447146c8-9d57-433d-bbca-b50a22d22fd0 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/action" status: 202 len: 0 microversion: 2.1 time: 0.131170 Oct 12 23:05:44.478657 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2954/5815] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:05:44 2022] POST /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:05:44.502907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:44.504638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:44.530459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:44.531557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:44.532260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.533187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:44.533977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:44.534603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:44.687510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:44.695915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2a4032d-9dc5-4fc1-ad2b-c95e3b323e0e tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1313 microversion: 2.1 time: 0.797954 Oct 12 23:05:44.703756 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2862/5816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:43 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:44.801098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:44.819770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:44.953101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:44.969913 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-895c15b0-c4d3-45e8-bbe5-8a1e09c62878 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1724 microversion: 2.1 time: 0.480000 Oct 12 23:05:44.971944 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2955/5817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:44 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:45.729927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:45.731240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:45.734498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:45.743576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:45.746087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:45.748248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:45.749525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:45.751375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:45.752117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:46.001894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:46.003580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:46.016755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:46.025003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:46.034129 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-961e5e11-1b0b-4197-a586-107774921979 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1498 microversion: 2.1 time: 0.308401 Oct 12 23:05:46.037530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:46.037981 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2863/5818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:45 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1498 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:46.038620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:46.039538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:46.040196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:46.040895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:46.249465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:46.262386 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bbdae50b-c14b-4d68-920a-29ca9b6f9ab5 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1724 microversion: 2.1 time: 0.269445 Oct 12 23:05:46.268051 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2956/5819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:45 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:47.295156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:47.296009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:47.319287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:47.322053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:47.323230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:47.324165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:47.324786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:47.325957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:47.531995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:47.541287 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36bd57fb-7e76-4faf-a8e5-06b963451dd7 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1730 microversion: 2.1 time: 0.254346 Oct 12 23:05:47.544652 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2864/5820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:47 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:47.570925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:47.571980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:47.589023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:47.590170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:47.591944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:47.595555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:47.597010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:47.597604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:47.720922 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b10f7e91-60fc-4cf0-a9ac-ccd970933867 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158133 Oct 12 23:05:47.721539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2957/5821] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:05:47 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:48.509373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-184976397", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695750862", "security_groups": [{"name": "tempest-secgroup-smoke-566887922"}], "block_device_mapping_v2": [{"uuid": "15611c15-4bc3-4e84-af03-0aa885650b98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9675ed5d-ab50-4e8a-98de-751bd4ac9f70"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:48.944501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] validate_networks() for [('9675ed5d-ab50-4e8a-98de-751bd4ac9f70', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:05:49.366120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=37 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:49.701098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0dd2c851-4818-43a9-8e7b-5a2641a1681e req-fd4c3617-d743-42a8-99a4-0e0698e385ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1544c-381f-44a6-8d7d-8e620e1af9de", "tag": "0ce2370e-5b84-4ca0-8605-fa2625cad68c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:49.761485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0dd2c851-4818-43a9-8e7b-5a2641a1681e req-fd4c3617-d743-42a8-99a4-0e0698e385ba service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:49.761485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0dd2c851-4818-43a9-8e7b-5a2641a1681e req-fd4c3617-d743-42a8-99a4-0e0698e385ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:49.761485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0dd2c851-4818-43a9-8e7b-5a2641a1681e req-fd4c3617-d743-42a8-99a4-0e0698e385ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:49.787161 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0dd2c851-4818-43a9-8e7b-5a2641a1681e req-fd4c3617-d743-42a8-99a4-0e0698e385ba service nova] Creating event network-changed:0ce2370e-5b84-4ca0-8605-fa2625cad68c for instance 06c1544c-381f-44a6-8d7d-8e620e1af9de on n-h2-860864-8 Oct 12 23:05:49.799805 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0dd2c851-4818-43a9-8e7b-5a2641a1681e req-fd4c3617-d743-42a8-99a4-0e0698e385ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098729 Oct 12 23:05:49.802209 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2958/5822] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:50.303806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:05:50.304372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:05:50.304984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:05:50.305528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:05:50.306044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:05:50.353132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:50.354459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:50.355346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:50.357136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:50.357786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:50.358816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:50.372895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=87 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:50.389836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:05:50.397740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Getting quotas for user e378ccbffef84b40a4529534e9f895f7 and project 456678d4c1604b339bbe248d3e7d488d. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:05:50.570785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:50.571706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:50.586282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:05:50.590986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15611c15-4bc3-4e84-af03-0aa885650b98',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:05:50.603374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:50.604388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:50.613505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:50.614791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:50.616207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:50.616899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:50.651707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:05:50.866860 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38be2e81-a0fa-4ccd-85c4-0ba8d2c67bb0 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 204 len: 0 microversion: 2.1 time: 0.300549 Oct 12 23:05:50.877086 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2959/5823] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:05:50 2022] DELETE /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:05:50.889513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:50.892892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:50.919988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:50.921856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:50.924170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:50.925819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:50.928883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:50.931239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:51.031191 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-717a186c-074f-43fd-a031-85367327d2e3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.521485 Oct 12 23:05:51.037334 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2865/5824] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:05:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:05:51.070174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16ddc3ec-ffe9-4f84-90fa-42f2683d357e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:51.077201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16ddc3ec-ffe9-4f84-90fa-42f2683d357e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:51.187172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16ddc3ec-ffe9-4f84-90fa-42f2683d357e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:51.197234 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16ddc3ec-ffe9-4f84-90fa-42f2683d357e tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1094 microversion: 2.1 time: 0.154682 Oct 12 23:05:51.198379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2866/5825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:51 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1094 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:51.267850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:51.282698 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0624923-b90c-4d60-82f2-0e13fe287c25 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1504 microversion: 2.1 time: 0.403044 Oct 12 23:05:51.292994 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2960/5826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:50 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:51.822413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-50814c62-74e4-456c-91c9-b1fd8dae7da7 req-07c8c537-ef4f-4c74-888d-ea656306ab15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1544c-381f-44a6-8d7d-8e620e1af9de", "tag": "0ce2370e-5b84-4ca0-8605-fa2625cad68c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:51.834403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-50814c62-74e4-456c-91c9-b1fd8dae7da7 req-07c8c537-ef4f-4c74-888d-ea656306ab15 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:51.835495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-50814c62-74e4-456c-91c9-b1fd8dae7da7 req-07c8c537-ef4f-4c74-888d-ea656306ab15 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:51.835660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-50814c62-74e4-456c-91c9-b1fd8dae7da7 req-07c8c537-ef4f-4c74-888d-ea656306ab15 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:51.849074 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-50814c62-74e4-456c-91c9-b1fd8dae7da7 req-07c8c537-ef4f-4c74-888d-ea656306ab15 service nova] Creating event network-changed:0ce2370e-5b84-4ca0-8605-fa2625cad68c for instance 06c1544c-381f-44a6-8d7d-8e620e1af9de on n-h2-860864-8 Oct 12 23:05:51.857916 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-50814c62-74e4-456c-91c9-b1fd8dae7da7 req-07c8c537-ef4f-4c74-888d-ea656306ab15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039388 Oct 12 23:05:51.859756 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2867/5827] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:52.223862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:52.225739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:52.238687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:52.239480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:52.240380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:52.241515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:52.242173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:52.243094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:52.310597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:52.312754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:52.323022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:52.323340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:52.324114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:52.324271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:52.324984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:52.326095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:52.327006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:52.332231 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-453869fd-28f9-4ea1-b51e-d49f2ecf5db0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1192 microversion: 2.1 time: 0.113149 Oct 12 23:05:52.333101 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2961/5828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:52 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:52.814311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:52.828511 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7bb3e7f5-7464-4555-8e06-03ff042da276 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1504 microversion: 2.1 time: 0.524405 Oct 12 23:05:52.830950 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2868/5829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:52 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:05:53.365384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:53.366630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:53.378855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:53.379524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:53.380146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:53.380883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:53.381618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:53.382060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:53.626187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:53.642286 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db7e66a0-e286-4714-8e35-9bdca2e528de tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1210 microversion: 2.1 time: 0.285843 Oct 12 23:05:53.642835 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2962/5830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:53 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1210 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:53.855801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:53.856930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:53.869438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:53.869931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:53.870371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:53.871084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:53.871594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:53.875169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:53.885084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-676b2363-86b3-4fac-90fd-26ae10112d9a req-5a1b09b0-70d9-45ec-a532-4f800b8ddab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0418ed27-5efa-469b-a78a-073caa4707ac", "name": "network-vif-deleted", "tag": "95d82d7b-2327-4656-a13f-fcd41df26323"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:53.908618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-676b2363-86b3-4fac-90fd-26ae10112d9a req-5a1b09b0-70d9-45ec-a532-4f800b8ddab6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:53.910864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-676b2363-86b3-4fac-90fd-26ae10112d9a req-5a1b09b0-70d9-45ec-a532-4f800b8ddab6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:53.925481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-676b2363-86b3-4fac-90fd-26ae10112d9a req-5a1b09b0-70d9-45ec-a532-4f800b8ddab6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:53.943800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:53.945435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:53.948269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:53.948937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lazy-loading 'fault' on Instance uuid 0418ed27-5efa-469b-a78a-073caa4707ac {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:05:53.971947 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-676b2363-86b3-4fac-90fd-26ae10112d9a req-5a1b09b0-70d9-45ec-a532-4f800b8ddab6 service nova] Creating event network-vif-deleted:95d82d7b-2327-4656-a13f-fcd41df26323 for instance 0418ed27-5efa-469b-a78a-073caa4707ac on n-h1-860864-8 Oct 12 23:05:53.994891 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-676b2363-86b3-4fac-90fd-26ae10112d9a req-5a1b09b0-70d9-45ec-a532-4f800b8ddab6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115850 Oct 12 23:05:53.995952 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2963/5831] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:05:54.036521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254bbc431934cd6be87afb421a1c37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d394e8cec342c682cb275c35c7b3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:54.052076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5cc7a85b-f1e2-44d5-832e-ab85d0d11917 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 200 len: 1303 microversion: 2.1 time: 0.198809 Oct 12 23:05:54.053038 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2869/5832] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:53 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:54.674332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:54.675236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:54.693120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:54.693910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:54.694104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:54.695047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:54.696965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:54.698837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:55.081539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:55.082901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] [instance: 0418ed27-5efa-469b-a78a-073caa4707ac] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:55.094042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:55.105257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:55.106577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:55.111390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:55.112594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:55.114871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:55.136835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:55.141915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] HTTP exception thrown: Instance 0418ed27-5efa-469b-a78a-073caa4707ac could not be found. Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Request method failure captured: Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac HTTP/1.1 Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0g7MCkB4WzgZLm5MaSDx9RjNtyFA3WZL64_iTgZ4j5oUxp5Eu1mVwb62tv4JrIn15MPD8wS_gyIP-SpMsrnF8efv0KAPGe-mGbeuYXEFzxpTFS249fH0hjzod-9VemqlXQAoG96sxMjgRlWjbEjnSv-XnDoJs3LdpvVswST-1aXy6c Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 95d394e8cec342c682cb275c35c7b3ef Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesActionsTest-1471590507 Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d394e8cec342c682cb275c35c7b3ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95d394e8cec342c682cb275c35c7b3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95d394e8cec342c682cb275c35c7b3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d394e8cec342c682cb275c35c7b3ef"}]}] Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesActionsTest-1471590507 Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 95d394e8cec342c682cb275c35c7b3ef Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesActionsTest-1471590507 Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesActionsTest-1471590507-project Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: f254bbc431934cd6be87afb421a1c37d Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesActionsTest-1471590507-project Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 0418ed27-5efa-469b-a78a-073caa4707ac could not be found. Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '0418ed27-5efa-469b-a78a-073caa4707ac'} Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0418ed27-5efa-469b-a78a-073caa4707ac could not be found. Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0418ed27-5efa-469b-a78a-073caa4707ac could not be found. Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:05:55.144887 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:55.151787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:05:55.151787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:05:55.151787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:05:55.151787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:05:55.151787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:05:55.151787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0418ed27-5efa-469b-a78a-073caa4707ac could not be found. Oct 12 23:05:55.151787 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:05:55.153866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] Returning 404 to user: Instance 0418ed27-5efa-469b-a78a-073caa4707ac could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:05:55.154150 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b510338-fe12-4396-bcdc-4c1b0d2597ba tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1277 microversion: 2.1 time: 0.487245 Oct 12 23:05:55.156087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-72759335-8c33-4ebd-92b8-635627c25756 tempest-VolumesActionsTest-1471590507 tempest-VolumesActionsTest-1471590507-project] 10.222.0.20 "GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac" status: 404 len: 111 microversion: 2.1 time: 0.077976 Oct 12 23:05:55.157116 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2870/5833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:55 2022] GET /compute/v2.1/servers/0418ed27-5efa-469b-a78a-073caa4707ac => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:05:55.169766 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2964/5834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:54 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1277 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:55.719928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-81e9fa17-cba6-4a10-98da-caf15c0530cb req-b3d89238-beb6-401b-aad0-60a721c2cf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482edca1-2a48-4238-ac84-bc6cce4b5ca6", "tag": "452f9320-7067-4bd7-baae-a87bd54ea0c9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:05:55.739443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-81e9fa17-cba6-4a10-98da-caf15c0530cb req-b3d89238-beb6-401b-aad0-60a721c2cf66 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:55.742226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-81e9fa17-cba6-4a10-98da-caf15c0530cb req-b3d89238-beb6-401b-aad0-60a721c2cf66 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:55.743397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-81e9fa17-cba6-4a10-98da-caf15c0530cb req-b3d89238-beb6-401b-aad0-60a721c2cf66 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:55.771843 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-81e9fa17-cba6-4a10-98da-caf15c0530cb req-b3d89238-beb6-401b-aad0-60a721c2cf66 service nova] Creating event network-changed:452f9320-7067-4bd7-baae-a87bd54ea0c9 for instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 on n-h2-860864-8 Oct 12 23:05:55.787532 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-81e9fa17-cba6-4a10-98da-caf15c0530cb req-b3d89238-beb6-401b-aad0-60a721c2cf66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073730 Oct 12 23:05:55.788441 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2871/5835] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:05:56.180976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:56.181693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:56.186112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:05:56.202744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:56.203366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:56.203760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:56.208280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:56.209133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:56.215164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:56.626611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:56.641352 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a85433de-54bc-4469-9b0b-b198b75320a0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1277 microversion: 2.1 time: 0.462759 Oct 12 23:05:56.645198 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2965/5836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:56 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1277 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:57.672570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:57.673496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:57.686468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:57.687248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:57.688501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:57.690431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:57.691194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:57.691839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:57.872655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:57.894770 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-174e6180-260d-4ae0-8ae9-8d03c13363d6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1277 microversion: 2.1 time: 0.227735 Oct 12 23:05:57.896023 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2872/5837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:57 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:05:58.922872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:05:58.922872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:05:58.942050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:58.943008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:58.949663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:58.950988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:05:58.951632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:05:58.952316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:05:59.263009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:05:59.286359 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90669e8e-61c2-4d16-9414-961235cf7827 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1277 microversion: 2.1 time: 0.365776 Oct 12 23:05:59.287468 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2966/5838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:05:58 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1277 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:00.311036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:00.311651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:00.321782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:00.330988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:00.331781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:00.332841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:00.333485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:00.334638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:00.389194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:00.615490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:00.626383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53a8aea0-2543-4f5c-bae9-026bf727365f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.319272 Oct 12 23:06:00.642502 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2873/5839] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:00 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:01.656561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:01.657188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:01.671545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:01.674514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:01.675662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:01.676630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:01.681809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:01.682290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:01.932807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:01.952577 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4dbda4d7-dd33-4ae7-b438-3875790f6aac tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.293874 Oct 12 23:06:01.965303 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2967/5840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:01 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:02.977622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:02.978892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:02.982447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:02.987283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:02.988043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:02.988487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:02.989188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:02.989845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:02.990432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:03.201415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:03.212568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2333e740-3017-4695-8541-6ee355ff6ec0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.238435 Oct 12 23:06:03.212995 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2874/5841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:02 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:04.236932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:04.238548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:04.247757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:04.248663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:04.249397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:04.250922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:04.252033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:04.252767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:04.460201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:04.470945 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e9034b5-5943-49a9-837d-bd960a6d2a9c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.238619 Oct 12 23:06:04.472150 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2968/5842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:04 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:05.495265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:05.496630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:05.504085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:05.504589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:05.505028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:05.505744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:05.506483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:05.511555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:05.698387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:05.709128 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd9edd2e-86b0-4739-830f-de7dffe031dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.218053 Oct 12 23:06:05.721835 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2875/5843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:05 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:06.737088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:06.738406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:06.752557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:06.753784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:06.755123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:06.761539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:06.764933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:06.767231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:07.022459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:07.038784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb3ab8fb-be13-4055-8b87-034485a1947f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.307420 Oct 12 23:06:07.039390 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2969/5844] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:06 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:08.066261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:08.067095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:08.092326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:08.092326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:08.092326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:08.092326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:08.092326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:08.092326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:08.307577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:08.319539 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3ecdd7c1-319c-4d10-853f-08d82175701f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.260315 Oct 12 23:06:08.320347 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2876/5845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:08 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:09.348090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:09.349389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:09.359454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:09.360329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:09.361599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:09.362992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:09.364233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:09.365526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:09.556106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:09.565930 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54153d38-5dc8-41a9-b0a6-f27098c1d6e8 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.222882 Oct 12 23:06:09.567256 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2970/5846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:09 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:09.963773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8cce4811-4b6b-42e4-b22a-76fa52e163c5 req-8473fdcf-dcf2-4e5c-840d-36b63a744009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482edca1-2a48-4238-ac84-bc6cce4b5ca6", "name": "network-vif-plugged", "status": "completed", "tag": "452f9320-7067-4bd7-baae-a87bd54ea0c9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:06:09.982552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8cce4811-4b6b-42e4-b22a-76fa52e163c5 req-8473fdcf-dcf2-4e5c-840d-36b63a744009 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:09.985285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8cce4811-4b6b-42e4-b22a-76fa52e163c5 req-8473fdcf-dcf2-4e5c-840d-36b63a744009 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:09.985960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8cce4811-4b6b-42e4-b22a-76fa52e163c5 req-8473fdcf-dcf2-4e5c-840d-36b63a744009 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:10.014722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8cce4811-4b6b-42e4-b22a-76fa52e163c5 req-8473fdcf-dcf2-4e5c-840d-36b63a744009 service nova] Creating event network-vif-plugged:452f9320-7067-4bd7-baae-a87bd54ea0c9 for instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 on n-h2-860864-8 Oct 12 23:06:10.030092 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8cce4811-4b6b-42e4-b22a-76fa52e163c5 req-8473fdcf-dcf2-4e5c-840d-36b63a744009 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067907 Oct 12 23:06:10.032229 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2877/5847] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:10.590524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:10.592175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:10.601040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:10.601803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:10.602480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:10.603448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:10.604221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:10.604972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:10.632143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:10.806781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:10.817139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d037a575-2406-44c8-a0a9-d0e6db9d2dc3 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1265 microversion: 2.1 time: 0.230767 Oct 12 23:06:10.828415 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2971/5848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:10 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:11.845629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:11.847729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:11.858137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:11.859148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:11.859861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:11.861276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:11.861967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:11.862763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:12.135368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:12.147706 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d185205-5512-4d4d-b21c-85c4e4b56def tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1452 microversion: 2.1 time: 0.308692 Oct 12 23:06:12.150018 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2878/5849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:11 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1452 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:12.173622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:12.174274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:12.182431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:12.183804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:12.184333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:12.185365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:12.186096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:12.186879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:12.597515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:12.606601 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1be75e7-a103-440d-aeb8-6c3c95f93ae6 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1452 microversion: 2.1 time: 0.436800 Oct 12 23:06:12.608371 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2972/5850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:12 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1452 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:15.285394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c5c6b9c7-1f37-45a9-b338-3ec4fca70025 req-0ae17883-ea07-4234-8b93-094e8b3cfbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482edca1-2a48-4238-ac84-bc6cce4b5ca6", "tag": "452f9320-7067-4bd7-baae-a87bd54ea0c9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:06:15.309860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5c6b9c7-1f37-45a9-b338-3ec4fca70025 req-0ae17883-ea07-4234-8b93-094e8b3cfbcb service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:15.311519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5c6b9c7-1f37-45a9-b338-3ec4fca70025 req-0ae17883-ea07-4234-8b93-094e8b3cfbcb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:15.313444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5c6b9c7-1f37-45a9-b338-3ec4fca70025 req-0ae17883-ea07-4234-8b93-094e8b3cfbcb service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:15.327786 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c5c6b9c7-1f37-45a9-b338-3ec4fca70025 req-0ae17883-ea07-4234-8b93-094e8b3cfbcb service nova] Creating event network-changed:452f9320-7067-4bd7-baae-a87bd54ea0c9 for instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 on n-h2-860864-8 Oct 12 23:06:15.333457 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c5c6b9c7-1f37-45a9-b338-3ec4fca70025 req-0ae17883-ea07-4234-8b93-094e8b3cfbcb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051772 Oct 12 23:06:15.334262 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2879/5851] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:17.478854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:17.479363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:17.494270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:17.496500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:17.496931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:17.497673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:17.498432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:17.499089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:17.642721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lazy-loading 'services' on Instance uuid 06c1544c-381f-44a6-8d7d-8e620e1af9de {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:06:17.739434 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41cdb59b-75ed-43e1-82c1-6eac78230071 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments/4f7c83b0-e323-4278-a2ce-fcfba990e94b" status: 202 len: 0 microversion: 2.1 time: 0.264541 Oct 12 23:06:17.741110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2973/5852] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:06:17 2022] DELETE /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments/4f7c83b0-e323-4278-a2ce-fcfba990e94b => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:06:17.753265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:17.756328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:17.778840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:17.779557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:17.780246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:17.781174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:17.781888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:17.782550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:17.865873 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8850c84-47c5-40d9-bcb6-7b84706c2cba tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075780 Oct 12 23:06:17.865873 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2880/5853] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:17 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:18.841464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:18.845764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:18.857706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:18.859231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:18.860270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:18.861472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:18.862563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:18.863307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:18.916779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0af30c4b-1e7d-4057-83b8-37e2c9487505 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082840 Oct 12 23:06:18.918308 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2974/5854] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:18 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:19.930345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:19.933762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:19.946987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:19.970357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:19.971348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:19.973954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:19.976389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:19.977282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:19.978724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:20.071265 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5bc24012-ee2b-4f9e-825a-47146dcdc2e2 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145310 Oct 12 23:06:20.076909 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2881/5855] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:19 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:21.083638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:21.086079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:21.104178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:21.105234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:21.105681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:21.106391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:21.106857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:21.107293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:21.243143 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d9f0281c-3b54-440d-9475-5cc30078156a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159405 Oct 12 23:06:21.246870 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2975/5856] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:21 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:22.257523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:22.262689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:22.281944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:22.282653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:22.283370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:22.285138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:22.286067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:22.288436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:22.344655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=74 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:22.379304 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4a91461-6a33-4d03-a462-74b2305f918d tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123367 Oct 12 23:06:22.381340 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2882/5857] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:22 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:23.393091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:23.396154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:23.409288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:23.411242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:23.413967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:23.414906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:23.417028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:23.418293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:23.551413 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-529b8d8f-a0d6-47b0-ab8d-9f758764405c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162109 Oct 12 23:06:23.561000 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2976/5858] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:23 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:24.565680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:24.569764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:24.588687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:24.593857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:24.594633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:24.595669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:24.597928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:24.598731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:24.675411 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-035095e3-2764-4920-a346-f96a1881abf6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114237 Oct 12 23:06:24.678146 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2883/5859] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:24 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:25.691381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:25.694513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:25.714611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:25.720530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:25.723169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:25.725397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:25.731774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:25.732670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:25.832988 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-777aade6-933c-43c7-b55d-4d0345b5aa0c tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146397 Oct 12 23:06:25.836743 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2977/5860] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:25 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:26.847307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:26.849577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:26.861577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:26.862490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:26.863176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:26.864226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:26.865071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:26.867075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:26.994058 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7147650-a00a-4b83-9c9f-0c26067ef90e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151024 Oct 12 23:06:26.995420 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2884/5861] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:06:26 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:06:27.114164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:06:27.116426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:27.125016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=26 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:27.126466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.127574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.128164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.128895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.129383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.130005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.163382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Cannot 'reboot' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action HTTP/1.1 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 28 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: {"reboot": {"type": "HARD"}} Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'reboot' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'c44272fc-2656-447f-80f5-68ab02fe46b0', 'body': {'reboot': {'type': 'HARD'}}} Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:06:27.165210 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 409 to user: Cannot 'reboot' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-515df61e-075a-41c6-ab8b-9ef8abed233a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action" status: 409 len: 145 microversion: 2.1 time: 0.056761 Oct 12 23:06:27.169660 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2978/5862] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:06:27 2022] POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:06:27.179251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:06:27.182488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:27.188989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.189654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.190100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.190821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.191563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.192572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.224482 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Cannot 'rebuild' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action HTTP/1.1 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 65 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: exception: Cannot 'rebuild' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'c44272fc-2656-447f-80f5-68ab02fe46b0', 'body': {'rebuild': {'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50'}}} Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:06:27.227602 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued Oct 12 23:06:27.231422 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:27.234828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 409 to user: Cannot 'rebuild' instance c44272fc-2656-447f-80f5-68ab02fe46b0 while it is in vm_state rescued {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:06:27.235728 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77350bfc-071b-417c-98f9-d1894d672e65 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action" status: 409 len: 146 microversion: 2.1 time: 0.061648 Oct 12 23:06:27.237313 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2885/5863] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:06:27 2022] POST /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:06:27.246019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:27.246611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:27.257270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.258008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.258619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.259595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.260515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.262512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.302347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:06:27.452153 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f7d2283-6776-4e5c-9c20-6e8d0d735db6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 204 len: 0 microversion: 2.1 time: 0.209825 Oct 12 23:06:27.452753 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2979/5864] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:06:27 2022] DELETE /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:06:27.462046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:27.463161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:27.501218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.504534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.506760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.509177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:27.511808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:27.513201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:27.740426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:27.751588 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ea0cd469-223a-47f2-bdf3-7be15be59a2a tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1690 microversion: 2.1 time: 0.293779 Oct 12 23:06:27.753679 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2886/5865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:27 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1690 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:28.781784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:28.783011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:28.789829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:28.790324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:28.790942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:28.792532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:28.793005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:28.793455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:29.106045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:29.114741 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2523d054-af3f-4494-83d9-0f56310165b9 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1690 microversion: 2.1 time: 0.340528 Oct 12 23:06:29.131552 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2980/5866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:28 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1690 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:30.142388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:30.142388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:30.150311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:30.151266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:30.151944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:30.152871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:30.153671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:30.154351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:30.451789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:30.465168 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1fd6235-2522-40b2-9e58-398ecf1d0217 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1690 microversion: 2.1 time: 0.329342 Oct 12 23:06:30.465913 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2887/5867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:30 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1690 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:31.491745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:31.492699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:31.501213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:31.501718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:31.502357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:31.503225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:31.503764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:31.504187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:31.995913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:32.015789 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a3be88b-c6f5-45e8-ac4c-0c0e6db7dbb3 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1690 microversion: 2.1 time: 0.528279 Oct 12 23:06:32.017278 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2981/5868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:31 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1690 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:33.043994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:33.044767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:33.056244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:33.057004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:33.057791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:33.058678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:33.059398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:33.060125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:33.161273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:33.171606 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc88be63-9513-4e1d-baa6-8e897c69af5e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1623 microversion: 2.1 time: 0.132573 Oct 12 23:06:33.172567 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2888/5869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:33 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1623 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:33.357286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d473010c-cdd3-4519-9f8f-373458031765 req-9c3ea5a5-00b6-418e-873c-477b04e7e96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c1544c-381f-44a6-8d7d-8e620e1af9de", "name": "network-vif-deleted", "tag": "0ce2370e-5b84-4ca0-8605-fa2625cad68c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:06:33.446637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d473010c-cdd3-4519-9f8f-373458031765 req-9c3ea5a5-00b6-418e-873c-477b04e7e96b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:33.447168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d473010c-cdd3-4519-9f8f-373458031765 req-9c3ea5a5-00b6-418e-873c-477b04e7e96b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:33.456416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d473010c-cdd3-4519-9f8f-373458031765 req-9c3ea5a5-00b6-418e-873c-477b04e7e96b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:33.549052 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d473010c-cdd3-4519-9f8f-373458031765 req-9c3ea5a5-00b6-418e-873c-477b04e7e96b service nova] Creating event network-vif-deleted:0ce2370e-5b84-4ca0-8605-fa2625cad68c for instance 06c1544c-381f-44a6-8d7d-8e620e1af9de on n-h2-860864-8 Oct 12 23:06:33.569614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d473010c-cdd3-4519-9f8f-373458031765 req-9c3ea5a5-00b6-418e-873c-477b04e7e96b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220938 Oct 12 23:06:33.575516 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2982/5870] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:34.202718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:34.203353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:34.222415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:34.223715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:34.224994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:34.226822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:34.227470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:34.228407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:34.308938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:34.311359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:34.311831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:34.314913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lazy-loading 'fault' on Instance uuid 06c1544c-381f-44a6-8d7d-8e620e1af9de {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:06:34.397427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:34.406978 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2aefcf36-7285-48b8-a37d-1ce52208e69b tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 200 len: 1336 microversion: 2.1 time: 0.212967 Oct 12 23:06:34.410013 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2889/5871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:34 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 1336 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:35.435529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:35.436292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 06c1544c-381f-44a6-8d7d-8e620e1af9de] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:35.458167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:35.458541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:35.458971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:35.459800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:35.460303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:35.460843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:35.485408 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Instance 06c1544c-381f-44a6-8d7d-8e620e1af9de could not be found. Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de HTTP/1.1 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 06c1544c-381f-44a6-8d7d-8e620e1af9de could not be found. Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '06c1544c-381f-44a6-8d7d-8e620e1af9de'} Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c1544c-381f-44a6-8d7d-8e620e1af9de could not be found. Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c1544c-381f-44a6-8d7d-8e620e1af9de could not be found. Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:35.487373 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c1544c-381f-44a6-8d7d-8e620e1af9de could not be found. Oct 12 23:06:35.490618 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:35.492198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 404 to user: Instance 06c1544c-381f-44a6-8d7d-8e620e1af9de could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:06:35.493370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e00bac6a-2edb-4278-9569-e357a73a4079 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de" status: 404 len: 111 microversion: 2.1 time: 0.064468 Oct 12 23:06:35.494750 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2983/5872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:35 2022] GET /compute/v2.1/servers/06c1544c-381f-44a6-8d7d-8e620e1af9de => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:06:35.504765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-728d63bb-70b9-4d74-aba6-5ce1ea72116e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '.version_select at 0x7f44fe95a430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:35.553568 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-728d63bb-70b9-4d74-aba6-5ce1ea72116e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547724111" status: 202 len: 0 microversion: 2.1 time: 0.054036 Oct 12 23:06:35.554716 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2890/5873] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 23:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547724111 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:06:44.811785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:44.812336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:44.823078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:44.824372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:44.825212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:44.826142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:44.826795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:44.827466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:44.834311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:44.866287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:06:44.971116 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4fc02061-2e9f-4ebf-93f8-6ff9b003c586 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 204 len: 0 microversion: 2.1 time: 0.164770 Oct 12 23:06:44.971732 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2984/5874] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:06:44 2022] DELETE /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:06:44.978544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=47 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:44.983761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:44.984583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:44.998309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:44.999392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:45.000127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:45.002629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:45.003393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:45.004164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:45.214643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:45.223847 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a2b458d-65e1-4adf-b65f-0a62ac8e496f tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1508 microversion: 2.1 time: 0.247620 Oct 12 23:06:45.229240 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2891/5875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:44 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:46.252442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:46.253153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:46.262456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:46.263596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:46.264092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:46.265053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:46.265527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:46.265963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:46.418544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:46.427244 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eaaa8675-27eb-4a84-9c26-ff26e4a7898e tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1508 microversion: 2.1 time: 0.179196 Oct 12 23:06:46.442743 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2985/5876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:46 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:47.452119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:47.452843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:47.472652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:47.473358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:47.474062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:47.474970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:47.475517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:47.476092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:47.791031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:47.807921 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fef4afb0-6932-40b9-bb28-150b44e524a6 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 200 len: 1508 microversion: 2.1 time: 0.360223 Oct 12 23:06:47.814947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2cde6f37-9901-4591-8538-07cd7d418bfa req-6c600f29-7175-4239-be0b-9f22f4e41169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44272fc-2656-447f-80f5-68ab02fe46b0", "name": "network-vif-deleted", "tag": "d14480b6-5cd3-4185-9786-4822ef5604b1"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:06:47.826637 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2892/5877] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:47 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:47.833463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2cde6f37-9901-4591-8538-07cd7d418bfa req-6c600f29-7175-4239-be0b-9f22f4e41169 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:47.834771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2cde6f37-9901-4591-8538-07cd7d418bfa req-6c600f29-7175-4239-be0b-9f22f4e41169 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:47.835356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2cde6f37-9901-4591-8538-07cd7d418bfa req-6c600f29-7175-4239-be0b-9f22f4e41169 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:47.866798 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2cde6f37-9901-4591-8538-07cd7d418bfa req-6c600f29-7175-4239-be0b-9f22f4e41169 service nova] Creating event network-vif-deleted:d14480b6-5cd3-4185-9786-4822ef5604b1 for instance c44272fc-2656-447f-80f5-68ab02fe46b0 on n-h2-860864-8 Oct 12 23:06:47.873454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2cde6f37-9901-4591-8538-07cd7d418bfa req-6c600f29-7175-4239-be0b-9f22f4e41169 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062608 Oct 12 23:06:47.874625 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2986/5878] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:06:48.853858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:48.854466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: c44272fc-2656-447f-80f5-68ab02fe46b0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:48.861707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:48.862466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:48.862900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:48.863594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:48.864064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:48.873197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:48.890763 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 could not be found. Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 HTTP/1.1 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 could not be found. Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'c44272fc-2656-447f-80f5-68ab02fe46b0'} Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 could not be found. Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 could not be found. Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:48.892797 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 could not be found. Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 404 to user: Instance c44272fc-2656-447f-80f5-68ab02fe46b0 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:06:48.896762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f716ad8-25b0-411a-a7a2-cf60240d4a17 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0" status: 404 len: 111 microversion: 2.1 time: 0.044352 Oct 12 23:06:48.907810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:48.908458 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2893/5879] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:48 2022] GET /compute/v2.1/servers/c44272fc-2656-447f-80f5-68ab02fe46b0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:06:48.908778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:48.915456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:48.915974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:48.916426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:48.917132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:48.917592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:48.918024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:48.947668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:06:49.056143 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dad998d4-2375-4b36-9822-d9f784fbc726 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 204 len: 0 microversion: 2.1 time: 0.154023 Oct 12 23:06:49.057772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2987/5880] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:06:48 2022] DELETE /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:06:49.064973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:49.065804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:49.074251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:49.074728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:49.075524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:49.076250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:49.078058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:49.078485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:49.266979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:49.284222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60e71d45-ab34-401c-be95-957d9308ce47 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.223042 Oct 12 23:06:49.284805 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2894/5881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:49 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:50.309201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:50.310166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:50.317613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:50.318243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:50.319049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:50.320016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:50.320971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:50.322006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:50.593498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:50.601303 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb5c28a3-72c5-4e37-aa07-534e188a0327 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.296962 Oct 12 23:06:50.609086 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2988/5882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:50 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:51.626412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:51.627646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:51.631323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:06:51.638964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:51.639876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:51.641375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:51.642317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:51.642985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:51.647908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:51.877362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:51.889503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c74e0223-444d-41b0-8563-dcdb3cc04bc8 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1521 microversion: 2.1 time: 0.267924 Oct 12 23:06:51.892033 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2895/5883] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:51 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:52.916266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:52.918119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:52.933951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:52.935101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:52.935710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:52.937236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:52.944386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:52.945952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:53.054178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac41041e134286b73fba63b8b2883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0839a558cdf44b9a829f915aaf1e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:06:53.074643 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-da782b1f-63fe-4832-a915-52df10293f44 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 200 len: 1479 microversion: 2.1 time: 0.158677 Oct 12 23:06:53.075445 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2989/5884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:52 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 1479 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:06:53.329351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c5fc9fe7-3011-4177-a2fb-feded1d11c17 req-00105410-4404-4b56-adef-914d531313f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2e452a-242c-498f-8821-4186f2c4bd5d", "name": "network-vif-deleted", "tag": "0f3b6d35-d3b8-42cf-afe8-4c3bd4ff5bce"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:06:53.341149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5fc9fe7-3011-4177-a2fb-feded1d11c17 req-00105410-4404-4b56-adef-914d531313f5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:53.341629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5fc9fe7-3011-4177-a2fb-feded1d11c17 req-00105410-4404-4b56-adef-914d531313f5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:53.342226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5fc9fe7-3011-4177-a2fb-feded1d11c17 req-00105410-4404-4b56-adef-914d531313f5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:53.380336 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c5fc9fe7-3011-4177-a2fb-feded1d11c17 req-00105410-4404-4b56-adef-914d531313f5 service nova] Creating event network-vif-deleted:0f3b6d35-d3b8-42cf-afe8-4c3bd4ff5bce for instance 4d2e452a-242c-498f-8821-4186f2c4bd5d on n-h1-860864-8 Oct 12 23:06:53.395238 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c5fc9fe7-3011-4177-a2fb-feded1d11c17 req-00105410-4404-4b56-adef-914d531313f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415945 Oct 12 23:06:53.402527 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2896/5885] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:06:54.101826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:06:54.104380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] [instance: 4d2e452a-242c-498f-8821-4186f2c4bd5d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:06:54.119487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:54.120033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:54.120491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:54.121225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:06:54.121695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:06:54.122137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:06:54.138988 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] HTTP exception thrown: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d could not be found. Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Request method failure captured: Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d HTTP/1.1 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0eWy1zhEjciyznT7tqwzchowvMRtq5BMxGbiW8qo1yjxPVvOB2rm6bjuaWNgDycrHjUaF1W8iWjF6j4mNPw0KHgdPZn6Y89ZRqNWhdzwDXvAIANwREEh_UfSUaB9qgWX4GXXBPp4oUYXzEnblk29l5O2iRU9DY6xI7dX7qyLudlBdc Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0839a558cdf44b9a829f915aaf1e3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0839a558cdf44b9a829f915aaf1e3a7"}]}] Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: a0839a558cdf44b9a829f915aaf1e3a7 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1906900218 Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: bfac41041e134286b73fba63b8b2883c Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1906900218-project Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d could not be found. Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4d2e452a-242c-498f-8821-4186f2c4bd5d'} Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d could not be found. Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d could not be found. Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:54.140877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d could not be found. Oct 12 23:06:54.145607 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:06:54.148697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] Returning 404 to user: Instance 4d2e452a-242c-498f-8821-4186f2c4bd5d could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:06:54.150365 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f1a3460-0a2f-4472-ad29-7d07c603cc15 tempest-ServerRescueNegativeTestJSON-1906900218 tempest-ServerRescueNegativeTestJSON-1906900218-project] 10.222.0.20 "GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d" status: 404 len: 111 microversion: 2.1 time: 0.052839 Oct 12 23:06:54.151508 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2990/5886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:06:54 2022] GET /compute/v2.1/servers/4d2e452a-242c-498f-8821-4186f2c4bd5d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:07:09.038663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:09.041103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=28 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:09.286147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-698281189", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:09.369550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] validate_networks() for [('4e0b4b1b-4869-4d31-9a4a-81621b0947fb', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:07:10.197990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:07:10.198708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:07:10.198999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:07:10.199482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:07:10.199943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:07:10.218956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:10.219540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:10.220183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:10.221858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:10.222542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:10.223178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:10.257479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Getting quotas for project 6be22a05172f4fcd88208aa1882db9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:07:10.265637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Getting quotas for user 3630aae639ad4eb59bc97ebfc9cf37c4 and project 6be22a05172f4fcd88208aa1882db9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:07:10.280870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:07:10.283568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:07:10.418931 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-763962ff-abe1-41b8-b370-e46f4e7355cd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384623 Oct 12 23:07:10.420982 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2897/5887] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 23:07:10.432894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4869351d-7de1-44de-8cbb-e5c149ddc4aa tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:10.433616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4869351d-7de1-44de-8cbb-e5c149ddc4aa tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:10.456501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:10.461924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:10.655328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4869351d-7de1-44de-8cbb-e5c149ddc4aa tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:10.667195 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4869351d-7de1-44de-8cbb-e5c149ddc4aa tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1216 microversion: 2.1 time: 0.239759 Oct 12 23:07:10.674322 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2991/5888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:10 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1216 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:11.696381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:11.697013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:11.703816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:11.704701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:11.716585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:11.717526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:11.718044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:11.718496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:11.868290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:11.876864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77f65da4-709c-4e1f-bee1-54539f302f37 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1268 microversion: 2.1 time: 0.185956 Oct 12 23:07:11.877878 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2898/5889] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:11 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:12.901917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:12.902553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:12.925134 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:07:12.925233 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:07:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 (ip 10.222.0.20) !!! Oct 12 23:07:12.927616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:12.928154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:12.928621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:12.929384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:12.929856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:12.930298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:13.081352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:13.093070 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90795863-8b43-4e17-a361-0cd0d5bb8e73 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1274 microversion: 2.1 time: 0.195632 Oct 12 23:07:13.093918 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2992/5890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:12 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:14.118635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:14.119807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:14.129015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:14.132521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:14.133852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:14.135837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:14.145908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:14.146596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:14.587214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:14.598092 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a9e62cc7-fde5-4fce-94d2-4d8a05d68627 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1316 microversion: 2.1 time: 0.484252 Oct 12 23:07:14.600818 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2899/5891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:14 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:15.492161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-59f0ff47-4058-4b96-bab4-8a4aff19d267 req-3c6c33aa-97f2-4317-948f-9be05dcc8ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e73501-56e3-467d-bc6c-7d3cc8b2fdb9", "tag": "df38ff8b-1402-4b70-898d-1d22b23f3563"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:15.510771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f0ff47-4058-4b96-bab4-8a4aff19d267 req-3c6c33aa-97f2-4317-948f-9be05dcc8ee9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:15.511492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f0ff47-4058-4b96-bab4-8a4aff19d267 req-3c6c33aa-97f2-4317-948f-9be05dcc8ee9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:15.512148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f0ff47-4058-4b96-bab4-8a4aff19d267 req-3c6c33aa-97f2-4317-948f-9be05dcc8ee9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:15.541163 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-59f0ff47-4058-4b96-bab4-8a4aff19d267 req-3c6c33aa-97f2-4317-948f-9be05dcc8ee9 service nova] Creating event network-changed:df38ff8b-1402-4b70-898d-1d22b23f3563 for instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 on n-h1-860864-8 Oct 12 23:07:15.553235 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-59f0ff47-4058-4b96-bab4-8a4aff19d267 req-3c6c33aa-97f2-4317-948f-9be05dcc8ee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064886 Oct 12 23:07:15.557262 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2993/5892] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:07:15.622192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:15.629336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:15.654515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:15.657175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:15.657846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:15.659936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:15.662474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:15.669973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:16.118911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:16.129638 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04c29f41-4bdd-4002-84be-08d3a29391e9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1316 microversion: 2.1 time: 0.512754 Oct 12 23:07:16.138000 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2900/5893] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:15 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:17.153947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:17.154750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:17.162109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:17.162715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:17.163772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:17.165147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:17.165682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:17.166196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:17.323190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:17.332260 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef641797-0955-46e4-81d8-8d89d784972b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1316 microversion: 2.1 time: 0.182599 Oct 12 23:07:17.333155 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2994/5894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:17 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:18.356566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:18.357738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:18.370568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:18.371336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:18.371938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:18.372785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:18.374715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:18.375394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:18.658673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:18.681094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6aff20e-704b-4f26-a0c5-67eacb03de48 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1316 microversion: 2.1 time: 0.330033 Oct 12 23:07:18.682431 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2901/5895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:18 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:19.614336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-b11153e9-99f3-4a5e-9a0b-e17e2431f308 req-7b41680b-ddf8-41ff-abd4-97f25e1734c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e73501-56e3-467d-bc6c-7d3cc8b2fdb9", "name": "network-vif-plugged", "status": "completed", "tag": "df38ff8b-1402-4b70-898d-1d22b23f3563"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:19.633754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b11153e9-99f3-4a5e-9a0b-e17e2431f308 req-7b41680b-ddf8-41ff-abd4-97f25e1734c5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:19.634489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b11153e9-99f3-4a5e-9a0b-e17e2431f308 req-7b41680b-ddf8-41ff-abd4-97f25e1734c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:19.635186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b11153e9-99f3-4a5e-9a0b-e17e2431f308 req-7b41680b-ddf8-41ff-abd4-97f25e1734c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:19.660063 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-b11153e9-99f3-4a5e-9a0b-e17e2431f308 req-7b41680b-ddf8-41ff-abd4-97f25e1734c5 service nova] Creating event network-vif-plugged:df38ff8b-1402-4b70-898d-1d22b23f3563 for instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 on n-h1-860864-8 Oct 12 23:07:19.677634 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-b11153e9-99f3-4a5e-9a0b-e17e2431f308 req-7b41680b-ddf8-41ff-abd4-97f25e1734c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067165 Oct 12 23:07:19.678363 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2995/5896] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:07:19.709735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:19.711078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:19.740736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:19.742651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:19.745703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:19.747962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:19.749199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:19.750066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:20.084868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:20.093420 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fed132ef-20e2-4e79-99aa-34c1555fd5c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1316 microversion: 2.1 time: 0.388394 Oct 12 23:07:20.100496 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2902/5897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:19 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:21.122731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:21.123454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:21.126865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:21.134792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:21.135460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:21.136147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:21.137138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:21.137756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:21.138343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:21.333384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:21.347250 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5abe248a-f68a-47d7-bdfa-d7f8345c3355 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.229060 Oct 12 23:07:21.376106 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2996/5898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:21 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:21.549326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-422495624", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:21.562200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:21.563424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:21.625927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] validate_networks() for [('4e0b4b1b-4869-4d31-9a4a-81621b0947fb', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:07:22.184742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:07:22.185170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:07:22.185647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:07:22.186056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:07:22.186480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:07:22.203367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:22.205453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:22.206893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:22.207943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:22.209491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:22.212518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:22.244666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Getting quotas for project 6be22a05172f4fcd88208aa1882db9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:07:22.260628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Getting quotas for user 3630aae639ad4eb59bc97ebfc9cf37c4 and project 6be22a05172f4fcd88208aa1882db9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:07:22.290064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:07:22.293604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:07:22.348419 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-738e2658-45e1-46a8-a03a-012c2feb880d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805399 Oct 12 23:07:22.349707 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2903/5899] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:07:22.362414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f41153c-01b5-4371-9c9e-98446f2938bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:22.364079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f41153c-01b5-4371-9c9e-98446f2938bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:22.445569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f41153c-01b5-4371-9c9e-98446f2938bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:22.464829 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f41153c-01b5-4371-9c9e-98446f2938bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1216 microversion: 2.1 time: 0.105874 Oct 12 23:07:22.466792 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2997/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:22 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:07:23.502558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:23.504412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:23.517219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:23.517990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:23.528631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:23.529749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:23.530447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:23.531038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:23.617670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:23.634195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18a24fae-a668-4204-a0b5-f49fa0a0b0f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1268 microversion: 2.1 time: 0.136321 Oct 12 23:07:23.636849 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2904/5901] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:23 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1268 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:24.664880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:24.666129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:24.679153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:24.681080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:24.681708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:24.682459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:24.682929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:24.683375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:24.974747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:24.985479 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-319587b1-740f-4935-a6de-40f542e7809b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.324637 Oct 12 23:07:24.992925 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2998/5902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:24 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:26.012067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:26.012662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:26.031365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:26.031857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:26.032315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:26.033022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:26.033475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:26.033896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:26.096176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a1fd8c88-d746-4143-9d24-fdc4f17dd510 req-c9b00616-76e0-454b-974f-b205a949abae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349a37c0-4f44-4ee7-9eae-f70a3283a153", "tag": "197868ab-fc17-4566-b4e7-b5b06cae6eea"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:26.120008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a1fd8c88-d746-4143-9d24-fdc4f17dd510 req-c9b00616-76e0-454b-974f-b205a949abae service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:26.125067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a1fd8c88-d746-4143-9d24-fdc4f17dd510 req-c9b00616-76e0-454b-974f-b205a949abae service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:26.125698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a1fd8c88-d746-4143-9d24-fdc4f17dd510 req-c9b00616-76e0-454b-974f-b205a949abae service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:26.175521 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a1fd8c88-d746-4143-9d24-fdc4f17dd510 req-c9b00616-76e0-454b-974f-b205a949abae service nova] Creating event network-changed:197868ab-fc17-4566-b4e7-b5b06cae6eea for instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 on n-h2-860864-8 Oct 12 23:07:26.187318 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a1fd8c88-d746-4143-9d24-fdc4f17dd510 req-c9b00616-76e0-454b-974f-b205a949abae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104501 Oct 12 23:07:26.187970 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2999/5903] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:07:26.271677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:26.281693 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-007f1f04-dfc9-45e8-9c48-990f2de320e6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.274863 Oct 12 23:07:26.283404 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2905/5904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:26 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:27.308877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:27.309653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:27.316778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:27.317305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:27.317738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:27.318471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:27.319506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:27.319970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:27.585143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:27.596731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb34e40d-c427-45ad-a462-b14338cb316e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.293560 Oct 12 23:07:27.601639 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3000/5905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:27 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:28.623339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:28.624572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:28.632879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:28.633557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:28.634515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:28.635935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:28.636900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:28.637810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:28.866471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:28.882972 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-14fb66de-729d-4bc5-a1bd-9560d2ee0330 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.263746 Oct 12 23:07:28.886646 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2906/5906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:28 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:29.909751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:29.910966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:29.926686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:29.927424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:29.928663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:29.929608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:29.930271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:29.930728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:30.134307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:30.146034 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8642b1d-853d-42e7-9156-16bb6d3e293c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.238144 Oct 12 23:07:30.148904 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3001/5907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:29 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:31.174257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:31.175501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:31.184000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:31.184795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:31.185406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:31.186286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:31.187018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:31.187733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:31.374117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:31.384944 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c50840aa-3c2f-4a6d-8789-1862e461edd8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.213232 Oct 12 23:07:31.386176 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2907/5908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:31 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:32.406325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:32.407004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:32.413080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:32.413992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:32.434334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:32.434905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:32.435373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:32.439108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:32.440015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:32.442349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:32.450606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:32.571390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-12e46360-0952-40c2-9a47-3431c37b00b7 req-71ca75d1-75b7-4c2a-92db-42ebdea14d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349a37c0-4f44-4ee7-9eae-f70a3283a153", "name": "network-vif-plugged", "status": "completed", "tag": "197868ab-fc17-4566-b4e7-b5b06cae6eea"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:32.589703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-12e46360-0952-40c2-9a47-3431c37b00b7 req-71ca75d1-75b7-4c2a-92db-42ebdea14d1c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:32.593327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-12e46360-0952-40c2-9a47-3431c37b00b7 req-71ca75d1-75b7-4c2a-92db-42ebdea14d1c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:32.594253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-12e46360-0952-40c2-9a47-3431c37b00b7 req-71ca75d1-75b7-4c2a-92db-42ebdea14d1c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:32.619776 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-12e46360-0952-40c2-9a47-3431c37b00b7 req-71ca75d1-75b7-4c2a-92db-42ebdea14d1c service nova] Creating event network-vif-plugged:197868ab-fc17-4566-b4e7-b5b06cae6eea for instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 on n-h2-860864-8 Oct 12 23:07:32.629401 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-12e46360-0952-40c2-9a47-3431c37b00b7 req-71ca75d1-75b7-4c2a-92db-42ebdea14d1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304902 Oct 12 23:07:32.633208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3002/5909] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:07:32.657225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:32.677618 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78f474d7-32ee-44cb-abac-39139d037b88 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.272906 Oct 12 23:07:32.680537 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2908/5910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:32 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:07:33.707139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:33.707938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:33.714780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:33.715274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:33.715725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:33.716461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:33.716927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:33.717415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:33.904543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:33.913840 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-de5530cb-66d2-46e7-a273-139994658440 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1316 microversion: 2.1 time: 0.211981 Oct 12 23:07:33.914593 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3003/5911] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:33 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:34.937190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:34.938031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:34.945756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:34.946309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:34.946966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:34.947859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:34.948334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:34.948766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:35.110049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:35.123145 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-464df961-8f86-4fd1-b4a8-04900b5f46e1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1506 microversion: 2.1 time: 0.188554 Oct 12 23:07:35.123738 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2909/5912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:34 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:35.146815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:35.148505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:35.159837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:35.160740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:35.161541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:35.162908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:35.163385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:35.163825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:35.195968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:07:35.306115 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-374b655d-70c0-4964-8dc8-dbee8bc5fc6e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 204 len: 0 microversion: 2.1 time: 0.162883 Oct 12 23:07:35.316222 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3004/5913] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:07:35 2022] DELETE /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:07:35.316667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:35.317482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:35.333594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:35.334770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:35.337849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:35.339743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:35.340351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:35.340884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:35.511287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:35.522654 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb66f067-0a73-46fc-a641-db4a1c486107 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1512 microversion: 2.1 time: 0.211002 Oct 12 23:07:35.533863 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2910/5914] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:35 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:07:36.548867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:36.549598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:36.563508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:36.564110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:36.564563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:36.568015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:36.569560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:36.572912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:36.910900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:36.921421 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ecb57d08-4a32-4f52-94f0-97d91758a9ab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1512 microversion: 2.1 time: 0.376696 Oct 12 23:07:36.922155 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3005/5915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:36 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:37.351946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-eaf0f9d6-ac49-4e5c-91ad-9a789e4d4166 req-13e8dfdb-2136-4893-976b-958c884dbd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349a37c0-4f44-4ee7-9eae-f70a3283a153", "name": "network-vif-deleted", "tag": "197868ab-fc17-4566-b4e7-b5b06cae6eea"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:37.413982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-eaf0f9d6-ac49-4e5c-91ad-9a789e4d4166 req-13e8dfdb-2136-4893-976b-958c884dbd43 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:37.415754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-eaf0f9d6-ac49-4e5c-91ad-9a789e4d4166 req-13e8dfdb-2136-4893-976b-958c884dbd43 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:37.417834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-eaf0f9d6-ac49-4e5c-91ad-9a789e4d4166 req-13e8dfdb-2136-4893-976b-958c884dbd43 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:37.486769 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-eaf0f9d6-ac49-4e5c-91ad-9a789e4d4166 req-13e8dfdb-2136-4893-976b-958c884dbd43 service nova] Creating event network-vif-deleted:197868ab-fc17-4566-b4e7-b5b06cae6eea for instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 on n-h2-860864-8 Oct 12 23:07:37.508799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-eaf0f9d6-ac49-4e5c-91ad-9a789e4d4166 req-13e8dfdb-2136-4893-976b-958c884dbd43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175921 Oct 12 23:07:37.514485 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2911/5916] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:07:37.946292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:37.947000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:37.954294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:37.955103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:37.955772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:37.956798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:37.957481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:37.958130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:38.033181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:38.033832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:38.034419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:38.035023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lazy-loading 'fault' on Instance uuid 349a37c0-4f44-4ee7-9eae-f70a3283a153 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:07:38.094695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:38.103256 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-98017f67-7820-44fd-9cb2-c529f3112c9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 200 len: 1306 microversion: 2.1 time: 0.161368 Oct 12 23:07:38.103849 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3006/5917] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:37 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:39.128855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:39.130122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:39.134719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:39.141534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.142629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.143260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.143987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.144452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.144882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.148370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=79 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:39.162684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 HTTP/1.1 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '349a37c0-4f44-4ee7-9eae-f70a3283a153'} Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:39.164890 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.168803 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:39.168803 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:39.168803 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:39.168803 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:39.168803 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:39.168803 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:07:39.168803 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.171017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:39.172302 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac26ca61-1105-4e88-b7c8-af076ed27854 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 404 len: 111 microversion: 2.1 time: 0.048331 Oct 12 23:07:39.173070 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2912/5918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:39 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:07:39.182428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:39.183200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:39.192669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.193825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.194286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.195002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.195469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.195923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.349201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:39.360057 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8228b6ac-b68a-47f0-9327-9368867247ed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.181986 Oct 12 23:07:39.365891 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3007/5919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:39 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:39.491267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a8d4750-bd7f-4d64-a284-f633e70ed9ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a8d4750-bd7f-4d64-a284-f633e70ed9ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 163 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": 12345, "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 12345 Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:07:39.494974 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 23:07:39.499162 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:39.502290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a8d4750-bd7f-4d64-a284-f633e70ed9ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:39.503562 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a8d4750-bd7f-4d64-a284-f633e70ed9ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.016507 Oct 12 23:07:39.507541 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2913/5920] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:39 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:39.513415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:39.514229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:39.521071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.521697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.522238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.523180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.523744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.524308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.671908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:39.680330 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c45afc4-a2da-46ac-9397-5f6c55cd046d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.171552 Oct 12 23:07:39.683956 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3008/5921] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:39 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:39.703242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:39.704010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:39.712366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.713071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.714002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.714864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:39.715325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:39.715749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:39.882760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:39.915434 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dbfb5660-9c63-4786-88b4-eacfd050e886 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.215885 Oct 12 23:07:39.933469 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2914/5922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:39 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:42.629105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-390baab5-ebb3-4c35-85d2-a9f8b4090b87 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-148049613", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6625c2fd-495f-4a66-89f3-28ea0ad95d72", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:42.641015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:42.694444 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-390baab5-ebb3-4c35-85d2-a9f8b4090b87 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Block Device 6625c2fd-495f-4a66-89f3-28ea0ad95d72 is not bootable. Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-390baab5-ebb3-4c35-85d2-a9f8b4090b87 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 357 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-148049613", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6625c2fd-495f-4a66-89f3-28ea0ad95d72", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: exception: Block Device 6625c2fd-495f-4a66-89f3-28ea0ad95d72 is not bootable. Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-148049613', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6625c2fd-495f-4a66-89f3-28ea0ad95d72'}], 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6625c2fd-495f-4a66-89f3-28ea0ad95d72 is not bootable. Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:42.705714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6625c2fd-495f-4a66-89f3-28ea0ad95d72 is not bootable. Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6625c2fd-495f-4a66-89f3-28ea0ad95d72 is not bootable. Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-390baab5-ebb3-4c35-85d2-a9f8b4090b87 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Block Device 6625c2fd-495f-4a66-89f3-28ea0ad95d72 is not bootable. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-390baab5-ebb3-4c35-85d2-a9f8b4090b87 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.082301 Oct 12 23:07:42.709714 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3009/5923] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:42 2022] POST /compute/v2.1/servers => generated 110 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:42.716379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:42.717068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:42.724066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:42.724643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:42.725146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:42.725898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:42.726431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:42.726919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:42.860512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:42.869202 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c402825-f1eb-4207-b4db-842331319473 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.156700 Oct 12 23:07:42.869801 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2915/5924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:42 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:07:42.894157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:42.894814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:42.901254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:42.902224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:42.902708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:42.903432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:42.903951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:42.904420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:42.908952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:43.058108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:43.066215 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-888469c3-45f5-480b-9462-3d7cbdb3eee4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.176180 Oct 12 23:07:43.066805 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3010/5925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:42 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:45.622895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-789c0aaf-b357-4c2d-8c77-0e33b59f186f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1960610478", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "destination_type": "local"}, {"source_type": "volume", "uuid": "7b64428d-2937-47e5-bfd6-7e5b8dad4fde", "destination_type": "invalid"}], "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-789c0aaf-b357-4c2d-8c77-0e33b59f186f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 495 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1960610478", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "destination_type": "local"}, {"source_type": "volume", "uuid": "7b64428d-2937-47e5-bfd6-7e5b8dad4fde", "destination_type": "invalid"}], "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1960610478', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7b64428d-2937-47e5-bfd6-7e5b8dad4fde', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:45.627770 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:45.632497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-789c0aaf-b357-4c2d-8c77-0e33b59f186f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:45.634946 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-789c0aaf-b357-4c2d-8c77-0e33b59f186f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.014761 Oct 12 23:07:45.634946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2916/5926] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:45 2022] POST /compute/v2.1/servers => generated 155 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:45.644872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:45.646823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:45.661383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:45.662228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:45.662842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:45.663750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:45.664651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:45.665313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:45.909834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:45.917708 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d4ba376-4706-49b7-a73d-260abe7eebf9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.277824 Oct 12 23:07:45.918790 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3011/5927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:45 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:45.945355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:45.946324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:45.956758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:45.957732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:45.958450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:45.959621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:45.960317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:45.960936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:46.159342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:46.172710 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d00c979-cb5e-415b-9cc6-cc8bb695bd1b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.232892 Oct 12 23:07:46.173285 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2917/5928] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:45 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:46.245218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dfa4485e-e8d7-473a-8372-6a5005963156 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2141961334", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dfa4485e-e8d7-473a-8372-6a5005963156 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 492 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2141961334", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2141961334', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.251194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 23:07:46.254054 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.256730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dfa4485e-e8d7-473a-8372-6a5005963156 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:46.257813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dfa4485e-e8d7-473a-8372-6a5005963156 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016974 Oct 12 23:07:46.258687 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3012/5929] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:46 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:46.271135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:46.272144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:46.278720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:46.279584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:46.280066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:46.280788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:46.281249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:46.281682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:46.481586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:46.495722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7536fb5a-70e9-4327-bfad-17eae1aa5264 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.231543 Oct 12 23:07:46.496868 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2918/5930] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:46 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:46.523522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:46.524178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:46.531882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:46.532582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:46.533022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:46.533877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:46.534590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:46.535169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:46.764023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:46.776001 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78a0d265-a16b-465b-bdf4-4e2b0d5a4e42 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.256553 Oct 12 23:07:46.777072 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3013/5931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:46 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:46.852633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b705bcb1-217d-4e3c-8569-1df0728d9b5c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b705bcb1-217d-4e3c-8569-1df0728d9b5c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 416 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.858436 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:07:46.861967 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:46.864835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b705bcb1-217d-4e3c-8569-1df0728d9b5c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:46.866345 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b705bcb1-217d-4e3c-8569-1df0728d9b5c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.020444 Oct 12 23:07:46.867876 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2919/5932] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:46 2022] POST /compute/v2.1/servers => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:46.875772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:46.876528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:46.885131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:46.885639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:46.886092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:46.886812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:46.887290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:46.887766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:47.242554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:47.276322 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70521bb1-597b-4a35-8ac6-a28872b94d81 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.403904 Oct 12 23:07:47.278181 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3014/5933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:46 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:07:47.340319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:47.344410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:47.353860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:47.354671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:47.355616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:47.356148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:47.356955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:47.357352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:47.549599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:47.565089 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb07351e-c90e-4ec9-a36b-bc8e98d3440f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.240521 Oct 12 23:07:47.567211 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2920/5934] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:47 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:47.647373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b541ca1b-3f63-4ad1-9f00-062c723fb00f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-996486797", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": -1, "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:47.663986 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b541ca1b-3f63-4ad1-9f00-062c723fb00f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Flavor -1 could not be found. Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b541ca1b-3f63-4ad1-9f00-062c723fb00f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 205 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-996486797", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": -1, "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: exception: Flavor -1 could not be found. Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-996486797', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': -1, 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:47.676805 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b541ca1b-3f63-4ad1-9f00-062c723fb00f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:47.681298 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b541ca1b-3f63-4ad1-9f00-062c723fb00f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.044562 Oct 12 23:07:47.683101 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3015/5935] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:47 2022] POST /compute/v2.1/servers => generated 73 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 23:07:47.690179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:47.690738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:47.696929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:47.697422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:47.697877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:47.698566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:47.699016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:47.699443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:47.865729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:47.874468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d809c94f-5be0-42c1-af1a-43a8ca0e137b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.188282 Oct 12 23:07:47.876877 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2921/5936] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:47 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:47.901464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:47.902090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:47.909242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:47.909736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:47.910342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:47.911203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:47.911714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:47.912200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:48.093734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:48.104604 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-02e9d8cd-5ef9-40ad-8279-55587a61553b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.208894 Oct 12 23:07:48.105211 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3016/5937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:47 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:48.207558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb2083a9-3a81-4387-b442-faa141adb187 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1230434181", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb2083a9-3a81-4387-b442-faa141adb187 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 173 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1230434181", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1230434181', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi -1 Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:07:48.212046 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb2083a9-3a81-4387-b442-faa141adb187 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb2083a9-3a81-4387-b442-faa141adb187 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018333 Oct 12 23:07:48.219748 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2922/5938] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:48 2022] POST /compute/v2.1/servers => generated 145 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:48.237485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:48.238159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:48.269077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:48.269588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:48.270021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:48.270742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:48.271206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:48.271641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:48.480591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:48.489275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41270cdb-2a47-468b-8d2b-39155f92e81e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.265649 Oct 12 23:07:48.490684 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3017/5939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:48 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:48.517682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:48.521430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:48.531134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:48.531636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:48.532219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:48.533096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:48.533558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:48.533988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:48.716949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:48.726510 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e5110812-a9bc-4499-b425-1c51e18866f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.215864 Oct 12 23:07:48.727630 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2923/5940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:48 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:48.817081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66c76257-83d5-4e5c-886b-081b872fe3f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-672754764", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:48.822490 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-66c76257-83d5-4e5c-886b-081b872fe3f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66c76257-83d5-4e5c-886b-081b872fe3f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 215 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-672754764", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-672754764', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:48.824353 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.829167 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:48.829167 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:48.829167 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:48.829167 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:48.829167 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:48.829167 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 23:07:48.829167 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:48.831413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66c76257-83d5-4e5c-886b-081b872fe3f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:48.832389 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-66c76257-83d5-4e5c-886b-081b872fe3f0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.019286 Oct 12 23:07:48.833047 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3018/5941] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:48 2022] POST /compute/v2.1/servers => generated 123 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:48.843577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:48.844870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:48.853163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:48.853654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:48.854088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:48.854786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:48.855234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:48.855776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:49.087005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:49.097052 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-caa09442-57e4-44db-b344-62d03499f1d0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.257814 Oct 12 23:07:49.108923 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2924/5942] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:48 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:49.120259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:49.120991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:49.129244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:49.130534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:49.131057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:49.131859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:49.132430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:49.132933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:49.295575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:49.304143 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49cab2de-0efa-4c7c-a1cc-32a418801e79 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.187713 Oct 12 23:07:49.304724 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3019/5943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:49 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:49.379169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7947ab1-9a07-4459-a710-56fde4457d31 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1157777571", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-key-1573270182", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:49.453356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-d7947ab1-9a07-4459-a710-56fde4457d31 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] validate_networks() for [('4e0b4b1b-4869-4d31-9a4a-81621b0947fb', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:07:49.751969 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d7947ab1-9a07-4459-a710-56fde4457d31 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Invalid key_name provided. Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7947ab1-9a07-4459-a710-56fde4457d31 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 247 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1157777571", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-key-1573270182", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid key_name provided. Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1157777571', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'key_name': 'tempest-key-1573270182', 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1573270182 not found for user 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:49.754484 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 12 23:07:49.760515 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:49.763162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7947ab1-9a07-4459-a710-56fde4457d31 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid key_name provided. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:49.764091 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7947ab1-9a07-4459-a710-56fde4457d31 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.389172 Oct 12 23:07:49.764880 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2925/5944] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:49 2022] POST /compute/v2.1/servers => generated 70 bytes in 391 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 23:07:49.773927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:49.774498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:49.783076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:49.783580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:49.784059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:49.784885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:49.785525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:49.785964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:49.960233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:49.969073 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89a1b69f-0af2-4151-a5c5-7a9185aebaab tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.199337 Oct 12 23:07:49.970008 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3020/5945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:49 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:50.012475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:50.013354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:50.023740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.024768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.025809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:50.026571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.027166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.027932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:50.214462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:50.228653 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91f4663a-0505-431f-9832-246998a3dd80 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.221926 Oct 12 23:07:50.240409 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2926/5946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:50 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:50.310662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8aa3f03d-6eeb-4f60-9964-1b07150c1518 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1889816224", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:50.427563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.security_group_api [None req-8aa3f03d-6eeb-4f60-9964-1b07150c1518 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Neutron security group does_not_exist not found {{(pid=120542) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 12 23:07:50.428114 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-8aa3f03d-6eeb-4f60-9964-1b07150c1518 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8aa3f03d-6eeb-4f60-9964-1b07150c1518 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 258 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1889816224", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1889816224', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 12 23:07:50.460001 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 12 23:07:50.463282 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.468793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8aa3f03d-6eeb-4f60-9964-1b07150c1518 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:50.470190 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8aa3f03d-6eeb-4f60-9964-1b07150c1518 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.164084 Oct 12 23:07:50.471016 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3021/5947] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:50.480085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:50.480695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:50.490234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.490737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.491176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:50.491983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.492384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.492809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:50.664856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:50.682032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29671d50-5aa7-41db-9900-8e8a9d61b8c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.205836 Oct 12 23:07:50.690824 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2927/5948] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:50 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:50.720633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:50.721954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:50.730053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.730674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.731193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:50.732630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.733378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.733983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:50.904219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:50.913585 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-035e711a-c5c9-4935-9669-6ed990a0c342 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.198272 Oct 12 23:07:50.914459 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3022/5949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:50 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:50.937955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6166c0d1-0472-4386-84bc-17b11f16d19b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:50.938477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6166c0d1-0472-4386-84bc-17b11f16d19b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: e34eb1cd-4475-436a-81ba-a33ce74b5a81] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:50.954191 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6166c0d1-0472-4386-84bc-17b11f16d19b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance e34eb1cd-4475-436a-81ba-a33ce74b5a81 could not be found. Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6166c0d1-0472-4386-84bc-17b11f16d19b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/e34eb1cd-4475-436a-81ba-a33ce74b5a81 HTTP/1.1 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance e34eb1cd-4475-436a-81ba-a33ce74b5a81 could not be found. Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'e34eb1cd-4475-436a-81ba-a33ce74b5a81'} Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34eb1cd-4475-436a-81ba-a33ce74b5a81 could not be found. Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34eb1cd-4475-436a-81ba-a33ce74b5a81 could not be found. Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.955927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34eb1cd-4475-436a-81ba-a33ce74b5a81 could not be found. Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6166c0d1-0472-4386-84bc-17b11f16d19b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance e34eb1cd-4475-436a-81ba-a33ce74b5a81 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6166c0d1-0472-4386-84bc-17b11f16d19b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e34eb1cd-4475-436a-81ba-a33ce74b5a81" status: 404 len: 111 microversion: 2.1 time: 0.023238 Oct 12 23:07:50.963717 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2928/5950] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:07:50 2022] DELETE /compute/v2.1/servers/e34eb1cd-4475-436a-81ba-a33ce74b5a81 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:07:50.966330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:50.966938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:50.973373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.974078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.974952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:50.976489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:50.977117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:50.977712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:51.173311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:51.187827 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89a1b7fa-ab11-40d6-a863-5a9802703316 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.224955 Oct 12 23:07:51.206693 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3023/5951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:50 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:51.212896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:51.213588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:51.221291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:51.221905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:51.222337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:51.223148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:51.223708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:51.224230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:51.433605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:51.444177 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-64daa736-c7b5-497d-be6d-a785b12781e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.235563 Oct 12 23:07:51.444893 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2929/5952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:51 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:07:51.467704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9d4d938-2867-44b4-8d74-d211c1bb57f2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:51.468277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9d4d938-2867-44b4-8d74-d211c1bb57f2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 23:07:51.469207 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c9d4d938-2867-44b4-8d74-d211c1bb57f2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9d4d938-2867-44b4-8d74-d211c1bb57f2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 9223372036854775808 could not be found. Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '9223372036854775808'} Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:51.470970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:51.476253 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:51.476253 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:51.476253 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:51.476253 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 12 23:07:51.476253 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.476253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9d4d938-2867-44b4-8d74-d211c1bb57f2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:51.476253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9d4d938-2867-44b4-8d74-d211c1bb57f2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009742 Oct 12 23:07:51.477099 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3024/5953] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Oct 12 23:07:51 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:07:51.483249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:51.484085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:51.493974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:51.494762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:51.495592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:51.496553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:51.497240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:51.497888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:51.686243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:51.696638 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f48063e2-ea0c-4c9a-bc9a-1e20b451a996 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.218269 Oct 12 23:07:51.698061 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2930/5954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:51 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:51.721563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:51.722707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:51.732901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:51.733875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:51.734612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:51.735646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:51.736360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:51.737063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:51.955762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:51.968198 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-769384c1-3288-4ef7-87f8-b46efa35bd5e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.250216 Oct 12 23:07:51.968847 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3025/5955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:51 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:51.991995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4338ff4b-6047-4315-8d97-db4420cd5b0f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:51.992754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4338ff4b-6047-4315-8d97-db4420cd5b0f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Failed to fetch instance by id -1 {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 23:07:51.993271 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-4338ff4b-6047-4315-8d97-db4420cd5b0f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance -1 could not be found. Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4338ff4b-6047-4315-8d97-db4420cd5b0f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance -1 could not be found. Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '-1'} Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:51.994898 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:51.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:51.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:51.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 12 23:07:51.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:52.000428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4338ff4b-6047-4315-8d97-db4420cd5b0f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:52.001254 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4338ff4b-6047-4315-8d97-db4420cd5b0f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.013771 Oct 12 23:07:52.001785 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2931/5956] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 12 23:07:51 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:07:52.011358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:52.012061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:52.020329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.021006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.021448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.022172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.022645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.023089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.175798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:52.184826 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-222a16f6-9831-4322-8da5-9cbb2a7efd1c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.177592 Oct 12 23:07:52.185528 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3026/5957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:52 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:52.209890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:52.211291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:52.225504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.226087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.226735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.227540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.228423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.229108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.400212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:52.410889 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7595ab3-c094-47f0-b503-455ad30dc864 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.205142 Oct 12 23:07:52.412024 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2932/5958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:52 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:52.436744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18d18c97-43ca-480e-883f-b65fac1359c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:52.437307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18d18c97-43ca-480e-883f-b65fac1359c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 4009d4b5-b150-4ebe-aa40-780a36c94f4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:52.445457 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-18d18c97-43ca-480e-883f-b65fac1359c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 4009d4b5-b150-4ebe-aa40-780a36c94f4e could not be found. Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18d18c97-43ca-480e-883f-b65fac1359c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/4009d4b5-b150-4ebe-aa40-780a36c94f4e/action HTTP/1.1 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 19 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: {"forceDelete": {}} Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 4009d4b5-b150-4ebe-aa40-780a36c94f4e could not be found. Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '4009d4b5-b150-4ebe-aa40-780a36c94f4e', 'body': {'forceDelete': {}}} Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4009d4b5-b150-4ebe-aa40-780a36c94f4e could not be found. Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4009d4b5-b150-4ebe-aa40-780a36c94f4e could not be found. Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:52.454064 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:52.458271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:52.458271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:52.458271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4009d4b5-b150-4ebe-aa40-780a36c94f4e could not be found. Oct 12 23:07:52.458271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:52.458271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18d18c97-43ca-480e-883f-b65fac1359c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 4009d4b5-b150-4ebe-aa40-780a36c94f4e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:52.458271 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-18d18c97-43ca-480e-883f-b65fac1359c0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/4009d4b5-b150-4ebe-aa40-780a36c94f4e/action" status: 404 len: 111 microversion: 2.1 time: 0.024005 Oct 12 23:07:52.458271 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3027/5959] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:07:52 2022] POST /compute/v2.1/servers/4009d4b5-b150-4ebe-aa40-780a36c94f4e/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:07:52.470889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:52.472648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:52.480791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.481278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.481888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.482794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.483389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.484033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.667843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:52.680487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd9cb1f5-45b3-44c5-bc60-edffb280e83f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.215079 Oct 12 23:07:52.696407 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2933/5960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:52 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:52.704592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:52.705231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:52.716441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.716947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.723101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.724536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:52.725019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:52.725463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:52.974072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:52.992072 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-909499cf-d02e-4081-838b-e348e92231f4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.292153 Oct 12 23:07:52.993838 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3028/5961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:52 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:53.016901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63a7046a-d27b-444a-a5ad-a4b61b80cb7f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:53.020050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63a7046a-d27b-444a-a5ad-a4b61b80cb7f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 95943589-289b-4191-b90f-2c4f97a077a1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:53.025975 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-63a7046a-d27b-444a-a5ad-a4b61b80cb7f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 95943589-289b-4191-b90f-2c4f97a077a1 could not be found. Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63a7046a-d27b-444a-a5ad-a4b61b80cb7f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/95943589-289b-4191-b90f-2c4f97a077a1/action HTTP/1.1 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 39 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: {"os-getConsoleOutput": {"length": 10}} Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 95943589-289b-4191-b90f-2c4f97a077a1 could not be found. Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '95943589-289b-4191-b90f-2c4f97a077a1', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95943589-289b-4191-b90f-2c4f97a077a1 could not be found. Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95943589-289b-4191-b90f-2c4f97a077a1 could not be found. Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.031501 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:53.035841 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:53.035841 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:53.035841 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:53.035841 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:53.035841 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95943589-289b-4191-b90f-2c4f97a077a1 could not be found. Oct 12 23:07:53.035841 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.038070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63a7046a-d27b-444a-a5ad-a4b61b80cb7f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 95943589-289b-4191-b90f-2c4f97a077a1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:53.039644 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63a7046a-d27b-444a-a5ad-a4b61b80cb7f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/95943589-289b-4191-b90f-2c4f97a077a1/action" status: 404 len: 111 microversion: 2.1 time: 0.026349 Oct 12 23:07:53.040439 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2934/5962] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:07:53 2022] POST /compute/v2.1/servers/95943589-289b-4191-b90f-2c4f97a077a1/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:07:53.049732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:53.050078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:53.060028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.061009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.061476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:53.063488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.068502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.069980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:53.369628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:53.383870 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f38f785a-4e4b-438b-9ef5-5b1824d6b6a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.338075 Oct 12 23:07:53.388221 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3029/5963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:53 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:53.415314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:53.416076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:53.425384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.426014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.426705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:53.427696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.428403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.429061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:53.620821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:53.639054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-834ed1b0-0fe7-455a-8439-b231fb0d8db2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.228468 Oct 12 23:07:53.640578 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2935/5964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:53 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:53.665503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95101579-41ba-4d07-9734-0ef92a44db7a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:53.666056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95101579-41ba-4d07-9734-0ef92a44db7a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 39e86710-9ab3-4a90-832b-f88ee29e331b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:53.673279 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-95101579-41ba-4d07-9734-0ef92a44db7a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 39e86710-9ab3-4a90-832b-f88ee29e331b could not be found. Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95101579-41ba-4d07-9734-0ef92a44db7a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/39e86710-9ab3-4a90-832b-f88ee29e331b HTTP/1.1 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 39e86710-9ab3-4a90-832b-f88ee29e331b could not be found. Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '39e86710-9ab3-4a90-832b-f88ee29e331b'} Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e86710-9ab3-4a90-832b-f88ee29e331b could not be found. Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e86710-9ab3-4a90-832b-f88ee29e331b could not be found. Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:53.674950 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:53.679189 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:53.679189 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:53.679189 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:53.679189 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e86710-9ab3-4a90-832b-f88ee29e331b could not be found. Oct 12 23:07:53.679189 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:53.681448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95101579-41ba-4d07-9734-0ef92a44db7a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 39e86710-9ab3-4a90-832b-f88ee29e331b could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:53.682561 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95101579-41ba-4d07-9734-0ef92a44db7a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/39e86710-9ab3-4a90-832b-f88ee29e331b" status: 404 len: 111 microversion: 2.1 time: 0.022585 Oct 12 23:07:53.684013 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3030/5965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:53 2022] GET /compute/v2.1/servers/39e86710-9ab3-4a90-832b-f88ee29e331b => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:07:53.693826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:53.693826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:53.704241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.705248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.705713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:53.706511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.706978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.707544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:53.888186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:53.896548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f507bc04-378b-4940-8758-d2a6c5bd0412 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.208193 Oct 12 23:07:53.897878 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2936/5966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:53 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:53.928600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:53.929159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:53.939346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.939859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.952464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:53.954798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:53.956023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:53.962957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:54.173742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:54.182803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c251cd80-81cd-4f08-875c-e2b00743df4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.263573 Oct 12 23:07:54.184055 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3031/5967] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:53 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:54.383220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1eb8d5ea-420b-4281-8dc5-3340da60c9dd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-699907099", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1eb8d5ea-420b-4281-8dc5-3340da60c9dd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 237 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-699907099", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-699907099', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.416025 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1eb8d5ea-420b-4281-8dc5-3340da60c9dd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:54.421182 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1eb8d5ea-420b-4281-8dc5-3340da60c9dd tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042574 Oct 12 23:07:54.426291 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2937/5968] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:54.431139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:54.432158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:54.439089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:54.439911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:54.440576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:54.441776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:54.443214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:54.444021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:54.690843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:54.705370 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-45e8ccfe-fd02-46fe-a17c-fe8361955c4b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.278121 Oct 12 23:07:54.716970 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3032/5969] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:54 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:54.732485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:54.734502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:54.759473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:54.760260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:54.760885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:54.761861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:54.762523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:54.763107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:54.797583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:55.182377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:55.197471 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5015c164-0cfe-43a8-a2a5-3acd810618d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.469054 Oct 12 23:07:55.198702 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2938/5970] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:54 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:55.343664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4211936-3e1f-4dee-bf92-b38236866941 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1338970481", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4211936-3e1f-4dee-bf92-b38236866941 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 235 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1338970481", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1338970481', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.360015 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4211936-3e1f-4dee-bf92-b38236866941 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b4211936-3e1f-4dee-bf92-b38236866941 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.023591 Oct 12 23:07:55.365924 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3033/5971] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:07:55 2022] POST /compute/v2.1/servers => generated 133 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:07:55.371566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:55.372213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:55.392093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:55.396316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:55.396676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:55.397428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:55.397887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:55.398310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:56.070635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:56.089839 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29753c55-b0c4-4c1b-90ec-90735c69dc35 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.721699 Oct 12 23:07:56.090762 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2939/5972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:55 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:56.130410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:56.131218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:56.142745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:56.143350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:56.143866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:56.145872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:56.146574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:56.147140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:56.363428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:56.366515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:07:56.378731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8cbfbc92-37d5-423f-8e83-9f0c471e20c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.254289 Oct 12 23:07:56.382416 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3034/5973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:56 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:56.403773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8181393b-f025-4ace-b32f-2b2696ceb0bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:56.404489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8181393b-f025-4ace-b32f-2b2696ceb0bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 5d6f5ad8-8881-450d-b68a-4f78514423da] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:56.412699 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8181393b-f025-4ace-b32f-2b2696ceb0bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 5d6f5ad8-8881-450d-b68a-4f78514423da could not be found. Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8181393b-f025-4ace-b32f-2b2696ceb0bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/5d6f5ad8-8881-450d-b68a-4f78514423da/action HTTP/1.1 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 13 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: {"pause": {}} Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 5d6f5ad8-8881-450d-b68a-4f78514423da could not be found. Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5d6f5ad8-8881-450d-b68a-4f78514423da', 'body': {'pause': {}}} Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6f5ad8-8881-450d-b68a-4f78514423da could not be found. Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6f5ad8-8881-450d-b68a-4f78514423da could not be found. Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:56.418121 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:56.421732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:56.421732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:56.421732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6f5ad8-8881-450d-b68a-4f78514423da could not be found. Oct 12 23:07:56.421732 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:07:56.423740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8181393b-f025-4ace-b32f-2b2696ceb0bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 5d6f5ad8-8881-450d-b68a-4f78514423da could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:56.425132 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8181393b-f025-4ace-b32f-2b2696ceb0bf tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/5d6f5ad8-8881-450d-b68a-4f78514423da/action" status: 404 len: 111 microversion: 2.1 time: 0.027006 Oct 12 23:07:56.426248 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2940/5974] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:07:56 2022] POST /compute/v2.1/servers/5d6f5ad8-8881-450d-b68a-4f78514423da/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:07:56.435305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:56.436042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:56.443691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:56.444734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:56.445431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:56.446411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:56.447030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:56.447629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:56.667744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:56.687000 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-91bbc2d6-719e-4234-aa99-d133589b3289 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.255870 Oct 12 23:07:56.689230 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3035/5975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:56 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:56.714559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:56.715214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:56.725767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:56.726282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:56.727003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:56.728026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:56.729570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:56.730169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:56.993306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:57.008500 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f000f86-9108-4b6d-bb66-a1e9dfbb9f21 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.298399 Oct 12 23:07:57.009614 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2941/5976] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:56 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:57.036853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:57.037659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:57.049633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.050147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.050597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.051317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.051813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.052278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.144520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:57.145076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:57.158409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.159393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.166500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.168425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.169055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.169641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.206086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:07:57.221148 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c219794-4954-4e87-9221-d97f3a5bf71c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 202 len: 0 microversion: 2.1 time: 0.191690 Oct 12 23:07:57.222349 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3036/5977] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:07:57 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:07:57.264026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d67c6559-16c9-44dd-8f01-0087c8cf77de req-1c2abbb7-c684-4f1c-aa44-9453141bd96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482edca1-2a48-4238-ac84-bc6cce4b5ca6", "tag": "452f9320-7067-4bd7-baae-a87bd54ea0c9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:57.305101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d67c6559-16c9-44dd-8f01-0087c8cf77de req-1c2abbb7-c684-4f1c-aa44-9453141bd96f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.305807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d67c6559-16c9-44dd-8f01-0087c8cf77de req-1c2abbb7-c684-4f1c-aa44-9453141bd96f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.306269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d67c6559-16c9-44dd-8f01-0087c8cf77de req-1c2abbb7-c684-4f1c-aa44-9453141bd96f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.338677 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d67c6559-16c9-44dd-8f01-0087c8cf77de req-1c2abbb7-c684-4f1c-aa44-9453141bd96f service nova] Creating event network-changed:452f9320-7067-4bd7-baae-a87bd54ea0c9 for instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 on n-h2-860864-8 Oct 12 23:07:57.388845 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d67c6559-16c9-44dd-8f01-0087c8cf77de req-1c2abbb7-c684-4f1c-aa44-9453141bd96f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163612 Oct 12 23:07:57.389796 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3037/5978] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:07:57.405173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:57.405949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:57.411835 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-234e7c86-4a9d-4b00-a20f-16a79dc21494 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 204 len: 0 microversion: 2.1 time: 0.279594 Oct 12 23:07:57.414116 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2942/5979] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:07:57 2022] DELETE /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:07:57.430100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.430613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.433677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:57.434054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.435301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:57.439194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.439996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.442564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.450414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.452444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.455615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.459224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:57.459918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:57.461434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:57.686767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:57.695368 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0a8870d1-0765-4c61-b5d9-1e44bd9846e8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1511 microversion: 2.1 time: 0.304362 Oct 12 23:07:57.708499 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3038/5980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:57 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:57.820404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:57.846477 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1265a261-e64e-4200-a87b-0e2974e2775a tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1577 microversion: 2.1 time: 0.427562 Oct 12 23:07:57.848331 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2943/5981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:57 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1577 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:58.721618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:58.722260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:58.730579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:58.731442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:58.732424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:58.734271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:58.735292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:58.735981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:58.871587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:58.872233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:58.878657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:58.879311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:58.880537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:58.881268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:58.881737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:58.882157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:59.191239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:59.205227 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d44df037-21f2-470a-9757-301936086020 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1491 microversion: 2.1 time: 0.487318 Oct 12 23:07:59.208205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:07:59.208970 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3039/5982] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:58 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1491 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:07:59.220208 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27f0e1d7-f07e-4b74-b29b-84554e4b787b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1577 microversion: 2.1 time: 0.352793 Oct 12 23:07:59.234617 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2944/5983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:58 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1577 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:07:59.241406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:59.242168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:59.262126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:59.262872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:59.263510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:59.266481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:59.267140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:59.268299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:59.335079 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Cannot 'pause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state paused Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action HTTP/1.1 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 13 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: {"pause": {}} Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'pause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state paused Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'pause': {}}} Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 in vm_state paused. Cannot pause while the instance is in this state. Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state paused Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:07:59.347783 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:07:59.352381 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:07:59.352381 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:07:59.352381 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:07:59.352381 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state paused Oct 12 23:07:59.352381 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:07:59.354466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 409 to user: Cannot 'pause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state paused {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:07:59.355530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db7cf357-4568-42f5-816c-902ecea5f51a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 409 len: 143 microversion: 2.1 time: 0.119281 Oct 12 23:07:59.365634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:07:59.366150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:59.372240 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3040/5984] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:07:59 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 143 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:07:59.380919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:59.381430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:59.381875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:59.382653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:59.383477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:59.392402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:59.539462 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f22318c6-3ff9-495d-9552-d3550854c368 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 202 len: 0 microversion: 2.1 time: 0.178129 Oct 12 23:07:59.544512 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2945/5985] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:07:59 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:07:59.550656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:07:59.551851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:07:59.564883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:59.565405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:59.565860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:07:59.566637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:07:59.568699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:07:59.569163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:00.058366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:00.074036 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-68e18e29-1ab3-4e93-992b-f868613edda6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1498 microversion: 2.1 time: 0.527446 Oct 12 23:08:00.077132 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3041/5986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:07:59 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1498 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:00.248581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:00.249951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:00.271843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:00.272615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:00.276205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:00.277930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:00.278413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:00.280020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:00.388641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:00.411031 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91d8d9fc-eefe-457c-a198-27a50be913cb tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1391 microversion: 2.1 time: 0.167052 Oct 12 23:08:00.416186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2946/5987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:00 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:00.575417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ebcf69ad-3913-442b-86c1-3f5300f34033 req-8004f757-b015-4c01-9c87-06339395a990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482edca1-2a48-4238-ac84-bc6cce4b5ca6", "name": "network-vif-deleted", "tag": "452f9320-7067-4bd7-baae-a87bd54ea0c9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:00.589233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ebcf69ad-3913-442b-86c1-3f5300f34033 req-8004f757-b015-4c01-9c87-06339395a990 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:00.590758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ebcf69ad-3913-442b-86c1-3f5300f34033 req-8004f757-b015-4c01-9c87-06339395a990 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:00.592690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ebcf69ad-3913-442b-86c1-3f5300f34033 req-8004f757-b015-4c01-9c87-06339395a990 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:00.614644 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ebcf69ad-3913-442b-86c1-3f5300f34033 req-8004f757-b015-4c01-9c87-06339395a990 service nova] Creating event network-vif-deleted:452f9320-7067-4bd7-baae-a87bd54ea0c9 for instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 on n-h2-860864-8 Oct 12 23:08:00.629016 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ebcf69ad-3913-442b-86c1-3f5300f34033 req-8004f757-b015-4c01-9c87-06339395a990 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334426 Oct 12 23:08:00.640260 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3042/5988] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:08:01.099201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:01.100187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:01.107199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.107827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.108506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.109343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.110058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.110674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.303883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:01.312589 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a69efe20-2a27-4bab-928f-e0561c130ba4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.217584 Oct 12 23:08:01.327942 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2947/5989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:01 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:01.339717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:01.341072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:01.349476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.350495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.351138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.352055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.352667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.353279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.438570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:01.439501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:01.451029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.451908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.452359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.453081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.453810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.454251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.598523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:01.598761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:01.607746 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e04ba6c2-bc59-44ad-86cf-4ddb7907a79d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.272408 Oct 12 23:08:01.615988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3043/5990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:01 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:01.616160 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f135394d-eb67-4390-a3a6-307b65dec85d tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1225 microversion: 2.1 time: 0.174086 Oct 12 23:08:01.616160 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2948/5991] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:01 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:01.639503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:01.642303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:01.650631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.651390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.652090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.652867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.653515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.654134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.672228 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153/action HTTP/1.1 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 28 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: {"reboot": {"type": "SOFT"}} Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '349a37c0-4f44-4ee7-9eae-f70a3283a153', 'body': {'reboot': {'type': 'SOFT'}}} Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:01.674444 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:01.679070 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:01.680822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:01.681718 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ddcb603b-8312-4547-86a9-a30160b0d63d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153/action" status: 404 len: 111 microversion: 2.1 time: 0.047454 Oct 12 23:08:01.685616 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3044/5992] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:01 2022] POST /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:01.692879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:01.693917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:01.703310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.703803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.704293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.704999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.705445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.705869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.896989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:01.905278 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56000f70-6c0d-45a8-8878-734ad41125c6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.218301 Oct 12 23:08:01.905846 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2949/5993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:01 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:01.930068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:01.930748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:01.937002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.937502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.937954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:01.938672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:01.940917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:01.940917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.099170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:02.113185 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f9b46819-545d-466d-9a6d-3717984ff2a1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.187760 Oct 12 23:08:02.115882 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3045/5994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:01 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:02.138820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f47f8e1-b6da-4ec2-8252-3ada24ccd8b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:02.142665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f47f8e1-b6da-4ec2-8252-3ada24ccd8b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: f3821290-bd4f-4f4b-a069-ab14d47ac867] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:02.149792 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6f47f8e1-b6da-4ec2-8252-3ada24ccd8b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance f3821290-bd4f-4f4b-a069-ab14d47ac867 could not be found. Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f47f8e1-b6da-4ec2-8252-3ada24ccd8b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/f3821290-bd4f-4f4b-a069-ab14d47ac867/action HTTP/1.1 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 28 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: {"reboot": {"type": "SOFT"}} Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance f3821290-bd4f-4f4b-a069-ab14d47ac867 could not be found. Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'f3821290-bd4f-4f4b-a069-ab14d47ac867', 'body': {'reboot': {'type': 'SOFT'}}} Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3821290-bd4f-4f4b-a069-ab14d47ac867 could not be found. Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3821290-bd4f-4f4b-a069-ab14d47ac867 could not be found. Oct 12 23:08:02.151793 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3821290-bd4f-4f4b-a069-ab14d47ac867 could not be found. Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f47f8e1-b6da-4ec2-8252-3ada24ccd8b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance f3821290-bd4f-4f4b-a069-ab14d47ac867 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f47f8e1-b6da-4ec2-8252-3ada24ccd8b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/f3821290-bd4f-4f4b-a069-ab14d47ac867/action" status: 404 len: 111 microversion: 2.1 time: 0.020234 Oct 12 23:08:02.157308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2950/5995] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:02 2022] POST /compute/v2.1/servers/f3821290-bd4f-4f4b-a069-ab14d47ac867/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:02.163773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:02.164503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:02.171933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.172780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.173445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.174353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.175019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.175679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.357142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:02.365803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b92db9d-3b86-4b15-af37-d877e19cb1f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.206479 Oct 12 23:08:02.366936 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3046/5996] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:02 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:02.395981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:02.398009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:02.429482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.433616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.434264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.436360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.436989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.439754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.614632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:02.626245 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7c96bbb-d9b9-446a-a048-918d47de8af1 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.239197 Oct 12 23:08:02.627724 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2951/5997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:02 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:02.632719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:02.633807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:02.647804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.648594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.649208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.650082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.650694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.651266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.652290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:02.655728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:02.668574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.670419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.670869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.671588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.676829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.677528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.698600 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153/action HTTP/1.1 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 65 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '349a37c0-4f44-4ee7-9eae-f70a3283a153', 'body': {'rebuild': {'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50'}}} Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 23:08:02.701336 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:08:02.705648 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:02.708524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:02.709647 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd4b2874-1ef7-4902-8cbe-e980e61e97cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153/action" status: 404 len: 111 microversion: 2.1 time: 0.062719 Oct 12 23:08:02.710365 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2952/5998] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:02 2022] POST /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:08:02.724687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:02.726365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:02.741279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.744676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.745953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.748735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.749410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.752023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.752151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:02.771287 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b37c036-a35b-4954-bcff-bb84b2c286dd tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1225 microversion: 2.1 time: 0.142770 Oct 12 23:08:02.771876 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3047/5999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:02 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:02.934609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:02.943330 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3da631f5-924c-4101-9a33-67385eb210b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.228688 Oct 12 23:08:02.964086 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2953/6000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:02 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:02.982367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:02.983215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:02.992624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.993480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.994144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:02.995099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:02.996026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:02.996866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.170622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:03.181255 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dbe4d6a7-f50f-4ce7-a8ca-345af0d5d765 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.203367 Oct 12 23:08:03.182511 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3048/6001] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:02 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:03.204120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c126dd81-980f-45a5-9ff7-ce395e1dc8da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:03.208277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c126dd81-980f-45a5-9ff7-ce395e1dc8da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 48c6c1bc-e49b-411f-9f9c-a142ff52d855] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:03.216182 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c126dd81-980f-45a5-9ff7-ce395e1dc8da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 48c6c1bc-e49b-411f-9f9c-a142ff52d855 could not be found. Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c126dd81-980f-45a5-9ff7-ce395e1dc8da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/48c6c1bc-e49b-411f-9f9c-a142ff52d855/action HTTP/1.1 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 65 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 48c6c1bc-e49b-411f-9f9c-a142ff52d855 could not be found. Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '48c6c1bc-e49b-411f-9f9c-a142ff52d855', 'body': {'rebuild': {'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50'}}} Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c6c1bc-e49b-411f-9f9c-a142ff52d855 could not be found. Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 23:08:03.218583 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c6c1bc-e49b-411f-9f9c-a142ff52d855 could not be found. Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c6c1bc-e49b-411f-9f9c-a142ff52d855 could not be found. Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c126dd81-980f-45a5-9ff7-ce395e1dc8da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 48c6c1bc-e49b-411f-9f9c-a142ff52d855 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:03.222753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c126dd81-980f-45a5-9ff7-ce395e1dc8da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/48c6c1bc-e49b-411f-9f9c-a142ff52d855/action" status: 404 len: 111 microversion: 2.1 time: 0.020094 Oct 12 23:08:03.229670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:03.230303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:03.233533 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2954/6002] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:03 2022] POST /compute/v2.1/servers/48c6c1bc-e49b-411f-9f9c-a142ff52d855/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:03.236884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.237383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.237827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.238700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.239169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.239606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.394514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:03.404810 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72cad24a-39d3-4f42-89f9-43a613517af9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.178974 Oct 12 23:08:03.407753 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3049/6003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:03 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:03.430806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:03.432127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:03.441529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.442817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.443496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.444627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.445435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.446074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.624871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:03.636962 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9305432e-c614-4745-89d4-80851808269b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.209868 Oct 12 23:08:03.651742 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2955/6004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:03 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:03.662193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4f70386-1adc-4bd7-828e-d752f8aa0de9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:03.663041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b4f70386-1adc-4bd7-828e-d752f8aa0de9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: c1615a01-6a4a-4183-bdda-0e743f062e35] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:03.669176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b4f70386-1adc-4bd7-828e-d752f8aa0de9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance c1615a01-6a4a-4183-bdda-0e743f062e35 could not be found. Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4f70386-1adc-4bd7-828e-d752f8aa0de9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/c1615a01-6a4a-4183-bdda-0e743f062e35/action HTTP/1.1 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 15 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: {"restore": {}} Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance c1615a01-6a4a-4183-bdda-0e743f062e35 could not be found. Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'c1615a01-6a4a-4183-bdda-0e743f062e35', 'body': {'restore': {}}} Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1615a01-6a4a-4183-bdda-0e743f062e35 could not be found. Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1615a01-6a4a-4183-bdda-0e743f062e35 could not be found. Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:03.671848 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:03.675524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:03.675524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:03.675524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1615a01-6a4a-4183-bdda-0e743f062e35 could not be found. Oct 12 23:08:03.675524 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:03.677767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4f70386-1adc-4bd7-828e-d752f8aa0de9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance c1615a01-6a4a-4183-bdda-0e743f062e35 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:03.679169 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b4f70386-1adc-4bd7-828e-d752f8aa0de9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/c1615a01-6a4a-4183-bdda-0e743f062e35/action" status: 404 len: 111 microversion: 2.1 time: 0.021548 Oct 12 23:08:03.689996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:03.690995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:03.693819 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3050/6005] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:03 2022] POST /compute/v2.1/servers/c1615a01-6a4a-4183-bdda-0e743f062e35/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:03.699574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.700329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.701264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.702210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.702876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.704098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.708829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:03.795245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:03.796188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:03.805413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.806309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.806808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.807824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.808434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.808879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.921681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:03.933755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:03.934344 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2dc5c46b-d5c1-4687-a871-432afb893677 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.249282 Oct 12 23:08:03.947226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79dac2b1-6454-431f-bca1-d5a1e7960212 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1225 microversion: 2.1 time: 0.156299 Oct 12 23:08:03.948557 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3051/6006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:03 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1225 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:03.966510 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2956/6007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:03 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:03.975935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:03.977271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:03.983695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.984496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.985117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:03.986011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:03.986625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:03.987213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.187609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:04.199879 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7282f1f5-4910-45ba-83da-13b084e3957e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.228569 Oct 12 23:08:04.212452 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3052/6008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:03 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:04.223768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:04.224600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:04.231986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.232474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.233101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.233807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.234255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.234686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.264925 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Cannot 'restore' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action HTTP/1.1 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 15 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: {"restore": {}} Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: exception: Cannot 'restore' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'restore': {}}} Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 in vm_state active. Cannot restore while the instance is in this state. Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:04.267094 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:04.271613 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:04.271613 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:04.271613 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:04.271613 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:04.271613 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.272734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 409 to user: Cannot 'restore' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:04.273824 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c62f5dad-7cfc-4e0f-a7ae-cae07048faea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 409 len: 145 microversion: 2.1 time: 0.054623 Oct 12 23:08:04.274411 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2957/6009] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:04 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 145 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:08:04.283008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:04.283972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:04.291459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.292165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.292862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.293947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.294724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.295206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.444173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:04.446480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:04.455848 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d25f2d4d-ca35-4cbf-a6c1-1f899bee1ad0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.176641 Oct 12 23:08:04.468873 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3053/6010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:04 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:04.483169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:04.484790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:04.493972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.494736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.495384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.497201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.497974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.498610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.672272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:04.682849 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6df32a7e-b8fb-4d02-973d-0e170b7dabdb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.203163 Oct 12 23:08:04.683924 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2958/6011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:04 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:04.708395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d0cfe53-b7f3-42e1-b2b2-589de5f94359 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:04.708867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3d0cfe53-b7f3-42e1-b2b2-589de5f94359 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: deb3ef6a-42d9-4434-976f-3e11406a59b3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:04.714772 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-3d0cfe53-b7f3-42e1-b2b2-589de5f94359 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance deb3ef6a-42d9-4434-976f-3e11406a59b3 could not be found. Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d0cfe53-b7f3-42e1-b2b2-589de5f94359 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/deb3ef6a-42d9-4434-976f-3e11406a59b3/action HTTP/1.1 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 14 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: {"resume": {}} Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance deb3ef6a-42d9-4434-976f-3e11406a59b3 could not be found. Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'deb3ef6a-42d9-4434-976f-3e11406a59b3', 'body': {'resume': {}}} Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb3ef6a-42d9-4434-976f-3e11406a59b3 could not be found. Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb3ef6a-42d9-4434-976f-3e11406a59b3 could not be found. Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:04.723670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:04.728922 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:04.728922 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:04.728922 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb3ef6a-42d9-4434-976f-3e11406a59b3 could not be found. Oct 12 23:08:04.728922 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:04.728922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d0cfe53-b7f3-42e1-b2b2-589de5f94359 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance deb3ef6a-42d9-4434-976f-3e11406a59b3 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:04.728922 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3d0cfe53-b7f3-42e1-b2b2-589de5f94359 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/deb3ef6a-42d9-4434-976f-3e11406a59b3/action" status: 404 len: 111 microversion: 2.1 time: 0.021700 Oct 12 23:08:04.728922 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3054/6012] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:04 2022] POST /compute/v2.1/servers/deb3ef6a-42d9-4434-976f-3e11406a59b3/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:04.735220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:04.735840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:04.743308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.743842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.744511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.745431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.746084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.746794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.964623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:04.972761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:04.976007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:04.986979 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7720ae2f-b655-4e3b-9e6b-fc52cb06739b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.255668 Oct 12 23:08:04.988199 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2959/6013] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:04 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:04.994351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:04.994882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:04.995343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:04.996137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.002670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.003355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.016429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:05.022330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:05.029920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.030414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.032635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.033566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.034193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.034797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.128426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:05.138818 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c86f18e-edc3-407c-a79b-c357f7f8ac28 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1225 microversion: 2.1 time: 0.171966 Oct 12 23:08:05.139614 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3055/6014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:04 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:05.236289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:05.249856 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e99a1dd3-db62-4706-92fb-a192a726c8a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.238523 Oct 12 23:08:05.251235 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2960/6015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:05 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:05.274460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:05.275683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:05.283390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.286298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.286972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.287874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.288514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.289112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.321190 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Cannot 'resume' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action HTTP/1.1 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 14 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: {"resume": {}} Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'resume' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'resume': {}}} Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 in vm_state active. Cannot resume while the instance is in this state. Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:05.323329 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.327787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:05.327787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:05.327787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:05.327787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:05.327787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:05.327787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:08:05.327787 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.329946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 409 to user: Cannot 'resume' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:05.331747 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57a8f03e-ef59-44fc-9490-a1c0b7747e74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 409 len: 144 microversion: 2.1 time: 0.061530 Oct 12 23:08:05.333120 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3056/6016] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:05 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 144 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:08:05.341135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:05.341911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:05.348276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.349229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.349846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.350544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.351236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.351838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.506103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:05.515218 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-514b624a-6276-4185-a4b2-4f41696f9e1d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.177848 Oct 12 23:08:05.534178 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2961/6017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:05 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:05.541952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:05.542816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:05.553926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.554497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.554950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.555661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:05.556151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:05.556583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:05.709095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:05.722244 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dd122240-40f5-487e-8343-39758fc02f5f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.186131 Oct 12 23:08:05.724075 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3057/6018] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:05 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:05.990770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb1aa50c-497f-4572-9950-d1bc18818a94 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb1aa50c-497f-4572-9950-d1bc18818a94 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 160 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "4e0b4b1b-4869-4d31-9a4a-81621b0947fb"}]}} Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd8a76847-f2a3-4e2c-96d3-13bb62ec0d50', 'flavorRef': '452', 'networks': [{'uuid': '4e0b4b1b-4869-4d31-9a4a-81621b0947fb'}]}}} Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '' Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:08:05.994743 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:05.999389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb1aa50c-497f-4572-9950-d1bc18818a94 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:06.000969 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb1aa50c-497f-4572-9950-d1bc18818a94 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.014965 Oct 12 23:08:06.002066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2962/6019] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:08:05 2022] POST /compute/v2.1/servers => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:08:06.010234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:06.011118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:06.018280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.019051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.020344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.021500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.022036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.022669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.163711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:06.164715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:06.180129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.181019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.181909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.183236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.183922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.184568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.220141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:06.230842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-222c58ac-b204-43a4-be36-948b8ab1c045 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.224298 Oct 12 23:08:06.232055 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3058/6020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:06 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:06.258018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:06.258961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:06.271785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.272779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.273420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.274321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.274969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.275611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.279952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:06.290376 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5ce8243-f0a2-4ddf-859e-a4265786208f tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 200 len: 1225 microversion: 2.1 time: 0.131543 Oct 12 23:08:06.291026 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2963/6021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:06 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:06.501693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:06.511682 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-97315423-9f97-4e86-aa5c-4f2eb87545a0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.257722 Oct 12 23:08:06.533295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3059/6022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:06 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:06.538839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37ad591e-3d4c-4242-83e1-154e52aa4480 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:06.539391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37ad591e-3d4c-4242-83e1-154e52aa4480 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 5a516f80-977a-49fd-b643-e5980eaa0b14] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:06.548783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-37ad591e-3d4c-4242-83e1-154e52aa4480 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 5a516f80-977a-49fd-b643-e5980eaa0b14 could not be found. Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37ad591e-3d4c-4242-83e1-154e52aa4480 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/5a516f80-977a-49fd-b643-e5980eaa0b14/action HTTP/1.1 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 14 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: {"shelve": {}} Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 5a516f80-977a-49fd-b643-e5980eaa0b14 could not be found. Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5a516f80-977a-49fd-b643-e5980eaa0b14', 'body': {'shelve': {}}} Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a516f80-977a-49fd-b643-e5980eaa0b14 could not be found. Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a516f80-977a-49fd-b643-e5980eaa0b14 could not be found. Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:06.553231 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:06.557043 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:06.557043 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:06.557043 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a516f80-977a-49fd-b643-e5980eaa0b14 could not be found. Oct 12 23:08:06.557043 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:06.558286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37ad591e-3d4c-4242-83e1-154e52aa4480 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 5a516f80-977a-49fd-b643-e5980eaa0b14 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:06.559863 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37ad591e-3d4c-4242-83e1-154e52aa4480 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/5a516f80-977a-49fd-b643-e5980eaa0b14/action" status: 404 len: 111 microversion: 2.1 time: 0.025836 Oct 12 23:08:06.563261 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2964/6023] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:06 2022] POST /compute/v2.1/servers/5a516f80-977a-49fd-b643-e5980eaa0b14/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:06.572183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:06.572831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:06.581361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.581851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.582436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.583437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.584159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.584738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.735376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:06.744975 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-095f6f72-bc55-43a8-a275-1e12f7d18186 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.178355 Oct 12 23:08:06.745556 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3060/6024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:06 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:06.774143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:06.774915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:06.782976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:06.785054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.786078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.786763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.787674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.788372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.789011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.939500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:06.951160 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4939c0f5-49bf-417d-a156-94cef12b10b9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.180495 Oct 12 23:08:06.952568 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2965/6025] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:06 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:06.977937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:06.978715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:06.985379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.986104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.986760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:06.987999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:06.988698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:06.989313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:07.014367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lazy-loading 'flavor' on Instance uuid 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:08:07.305279 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f6642d3-a7f9-4813-9b74-5b633288e299 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 202 len: 0 microversion: 2.1 time: 0.332756 Oct 12 23:08:07.310577 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3061/6026] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:06 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:08:07.317731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:07.318490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:07.330270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:07.331011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:07.331620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:07.333306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:07.333936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:07.334572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:07.334815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:07.336787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 482edca1-2a48-4238-ac84-bc6cce4b5ca6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:07.364045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:07.364739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:07.365562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:07.366398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:07.367249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:07.368552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:07.388155 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 could not be found. Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 HTTP/1.1 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 could not be found. Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '482edca1-2a48-4238-ac84-bc6cce4b5ca6'} Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 could not be found. Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 could not be found. Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:07.390355 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:07.395319 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:07.395319 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:07.395319 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:07.395319 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:07.395319 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:07.395319 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 could not be found. Oct 12 23:08:07.395319 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:07.396074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 482edca1-2a48-4238-ac84-bc6cce4b5ca6 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:07.397522 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f446ce6-06ca-4f37-b2a9-a79cde68a066 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6" status: 404 len: 111 microversion: 2.1 time: 0.075142 Oct 12 23:08:07.398733 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3062/6027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:07 2022] GET /compute/v2.1/servers/482edca1-2a48-4238-ac84-bc6cce4b5ca6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:07.555143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:07.565373 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c06d1b2-5d31-4521-aa54-6835d26149c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.253087 Oct 12 23:08:07.565956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2966/6028] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:07 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:08.591657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:08.592682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:08.596521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:08.607053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:08.612188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:08.613878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:08.615965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:08.617493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:08.621221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:08.847041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:08.860633 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c31d7d6d-044a-4d96-a34b-5becd608a8d3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.274141 Oct 12 23:08:08.871933 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3063/6029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:08 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:09.886272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:09.887678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:09.901186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:09.901867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:09.906471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:09.906471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:09.906471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:09.906471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:10.123815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:10.140035 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bf6fabb3-cc3a-4f3c-9908-e317a1cba02d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.257823 Oct 12 23:08:10.141293 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2967/6030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:09 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:11.164718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:11.167404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:11.186993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:11.190929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:11.193196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:11.195185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:11.198696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:11.201468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:11.566889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:11.575775 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb5faef9-5c98-429c-9b7d-591ceff01af8 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.415627 Oct 12 23:08:11.591376 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3064/6031] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:11 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:12.600386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:12.601270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:12.615749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:12.616514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:12.620536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:12.621911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:12.622556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:12.625195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:12.882786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:12.891510 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23abe897-5c02-4ce0-9d3f-b00a7ceb9de6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.294970 Oct 12 23:08:12.892691 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2968/6032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:12 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:13.916055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:13.917342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:13.942889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:13.943690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:13.945701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:13.949128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:13.950523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:13.952423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:14.197944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:14.211091 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a68d447d-b1e7-4ef4-bdf9-93dd55c0a717 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.299651 Oct 12 23:08:14.213974 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3065/6033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:13 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:15.258815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:15.260904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:15.271247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:15.271958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:15.272561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:15.273780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:15.274389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:15.275126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:15.485771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:15.496904 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a957e64b-1dcf-490e-93d1-a2d5422cd845 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.255756 Oct 12 23:08:15.514828 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2969/6034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:15 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:16.523602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:16.524803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:16.535589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:16.536791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:16.537190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:16.538203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:16.539091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:16.539799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:16.710479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:16.719435 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d00284e-ec46-4367-8d67-1189cd7700e4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.200418 Oct 12 23:08:16.721277 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3066/6035] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:16 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:17.745927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:17.746713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:17.759623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:17.760514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:17.761204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:17.762151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:17.765072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:17.765895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:17.995387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:18.007624 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e60873b4-2459-4b7a-b83b-10ec70d49b6d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1533 microversion: 2.1 time: 0.266224 Oct 12 23:08:18.020597 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2970/6036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:17 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1533 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:19.020738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:19.021325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:19.033011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:19.034283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:19.045889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:19.046532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:19.047184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:19.048551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:19.049175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:19.049789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:19.051217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:19.052142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:19.052866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:19.053456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:19.060609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:19.061068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:19.113386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:08:19.209866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:19.225212 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18cbaa7a-0ccf-4322-9f8e-b26688885dc2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1533 microversion: 2.1 time: 0.195848 Oct 12 23:08:19.240417 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2971/6037] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:19 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1533 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:19.250087 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-429843fe-a31b-43db-ab76-fe4045829d32 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 204 len: 0 microversion: 2.1 time: 0.233421 Oct 12 23:08:19.253917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c5b1034b-a18b-42b2-b7f1-c322113df1ab req-05b1666b-c6df-4193-adc5-680903227c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36501652-9871-4a81-ae04-fbba85935cae", "tag": "c945f530-339d-4514-a5f3-d0142a9ba074"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:19.256761 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3067/6038] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:08:19 2022] DELETE /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:08:19.264000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:19.264961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:19.271960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5b1034b-a18b-42b2-b7f1-c322113df1ab req-05b1666b-c6df-4193-adc5-680903227c30 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:19.272759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5b1034b-a18b-42b2-b7f1-c322113df1ab req-05b1666b-c6df-4193-adc5-680903227c30 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:19.272883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:19.273379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:19.273606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c5b1034b-a18b-42b2-b7f1-c322113df1ab req-05b1666b-c6df-4193-adc5-680903227c30 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:19.274645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:19.275706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:19.276414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:19.277531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:19.286886 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c5b1034b-a18b-42b2-b7f1-c322113df1ab req-05b1666b-c6df-4193-adc5-680903227c30 service nova] Creating event network-changed:c945f530-339d-4514-a5f3-d0142a9ba074 for instance 36501652-9871-4a81-ae04-fbba85935cae on n-h1-860864-8 Oct 12 23:08:19.292279 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c5b1034b-a18b-42b2-b7f1-c322113df1ab req-05b1666b-c6df-4193-adc5-680903227c30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042233 Oct 12 23:08:19.293218 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2972/6039] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:08:19.476767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:19.480945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:19.488310 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92c037bf-b808-4ef6-be92-dca57e169f51 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1576 microversion: 2.1 time: 0.230078 Oct 12 23:08:19.489021 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3068/6040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:19 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:20.255340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:20.256880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:20.263639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:20.264457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:20.265360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:20.266495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:20.267160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:20.268151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:20.516493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:20.517058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:20.524724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:20.525507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:20.529087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:20.530012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:20.531772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:20.533269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:20.627284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:20.636706 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a849b89-242b-4ab0-aa4a-0cd3d53382ea tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1533 microversion: 2.1 time: 0.387256 Oct 12 23:08:20.641069 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2973/6041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:20 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1533 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:20.774052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:20.783565 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4392039-f3db-4a33-a548-1b51e833cec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1576 microversion: 2.1 time: 0.272837 Oct 12 23:08:20.785018 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3069/6042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:20 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1576 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:21.668282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:21.669849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:21.692511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:21.695346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:21.704621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-03548f9b-5b84-46dd-a0ec-f1fe75d1687d req-c820a36f-0de5-450b-a921-3caf59368f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36501652-9871-4a81-ae04-fbba85935cae", "name": "network-vif-deleted", "tag": "c945f530-339d-4514-a5f3-d0142a9ba074"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:21.709573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:21.711678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:21.717321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:21.717948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:21.727979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-03548f9b-5b84-46dd-a0ec-f1fe75d1687d req-c820a36f-0de5-450b-a921-3caf59368f30 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:21.728497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-03548f9b-5b84-46dd-a0ec-f1fe75d1687d req-c820a36f-0de5-450b-a921-3caf59368f30 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:21.728964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-03548f9b-5b84-46dd-a0ec-f1fe75d1687d req-c820a36f-0de5-450b-a921-3caf59368f30 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:21.763024 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-03548f9b-5b84-46dd-a0ec-f1fe75d1687d req-c820a36f-0de5-450b-a921-3caf59368f30 service nova] Creating event network-vif-deleted:c945f530-339d-4514-a5f3-d0142a9ba074 for instance 36501652-9871-4a81-ae04-fbba85935cae on n-h1-860864-8 Oct 12 23:08:21.784224 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-03548f9b-5b84-46dd-a0ec-f1fe75d1687d req-c820a36f-0de5-450b-a921-3caf59368f30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083198 Oct 12 23:08:21.786411 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3070/6043] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:08:21.810323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:21.811592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:21.821035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:21.821726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:21.822422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:21.823336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:21.824116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:21.824714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:21.970607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:21.983458 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-caad1998-3e8a-4da4-9811-621c03aae145 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1225 microversion: 2.1 time: 0.175668 Oct 12 23:08:22.001641 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3071/6044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:21 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1225 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:22.077458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:22.084817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f4908a1a-33f4-45f4-97ca-758d56f12273 req-3f19bb6a-fecc-497e-91b0-a202a86321e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e73501-56e3-467d-bc6c-7d3cc8b2fdb9", "name": "network-vif-plugged", "status": "completed", "tag": "df38ff8b-1402-4b70-898d-1d22b23f3563"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:22.113958 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb5de1ba-a873-4d32-b503-7de50b5ee27c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.448696 Oct 12 23:08:22.116767 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2974/6045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:21 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:22.127936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f4908a1a-33f4-45f4-97ca-758d56f12273 req-3f19bb6a-fecc-497e-91b0-a202a86321e4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:22.131602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f4908a1a-33f4-45f4-97ca-758d56f12273 req-3f19bb6a-fecc-497e-91b0-a202a86321e4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:22.133327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f4908a1a-33f4-45f4-97ca-758d56f12273 req-3f19bb6a-fecc-497e-91b0-a202a86321e4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:22.164496 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f4908a1a-33f4-45f4-97ca-758d56f12273 req-3f19bb6a-fecc-497e-91b0-a202a86321e4 service nova] Creating event network-vif-plugged:df38ff8b-1402-4b70-898d-1d22b23f3563 for instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 on n-h1-860864-8 Oct 12 23:08:22.229560 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f4908a1a-33f4-45f4-97ca-758d56f12273 req-3f19bb6a-fecc-497e-91b0-a202a86321e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149585 Oct 12 23:08:22.248184 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3072/6046] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:08:23.010124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:23.011301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:23.027576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:23.028131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:23.028575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:23.029301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:23.029736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:23.036515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:23.147203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:23.147816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:23.162317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:23.164227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:23.164833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:23.169845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:23.172449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:23.184310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:23.184960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:23.186007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:23.191514 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-85ee4a43-f4d8-48b3-b624-dd681f2a5b42 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1390 microversion: 2.1 time: 0.185268 Oct 12 23:08:23.208928 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2975/6047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:23 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1390 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:23.434568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:23.445049 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3afc870e-11da-4d1e-b63c-dc999fedec9e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.304187 Oct 12 23:08:23.464890 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3073/6048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:23 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:24.221856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:24.222913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:24.243816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:24.244428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:24.250457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:24.254649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:24.257575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:24.258280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:24.349688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:24.360056 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34d29bf5-42c9-4f58-9c70-46cc6f17161b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1390 microversion: 2.1 time: 0.143007 Oct 12 23:08:24.361411 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2976/6049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:24 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1390 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:24.473595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:24.484405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:24.518012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:24.519162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:24.525179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:24.526117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:24.528648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:24.529376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:24.774555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:24.786563 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34da1b66-662b-4ea5-8915-2b0dc8620828 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.316427 Oct 12 23:08:24.799703 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3074/6050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:24 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:25.387002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:25.388684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:25.402547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:25.406306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:25.406965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:25.407836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:25.409626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:25.414226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:25.567548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:25.580134 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b812c8a-229d-4fc6-98d3-701ce539b24b tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1390 microversion: 2.1 time: 0.196814 Oct 12 23:08:25.581832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2977/6051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:25 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1390 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:25.861067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:26.122038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:26.134921 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c27d86d-9c77-445c-ae48-958504ee8674 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.325175 Oct 12 23:08:26.137743 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3075/6052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:25 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:26.606026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:26.606670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:26.615182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:26.615685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:26.616333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:26.617073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:26.617902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:26.618371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:26.758531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:26.783698 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7407b076-8063-472c-96e4-031d80231884 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1390 microversion: 2.1 time: 0.182390 Oct 12 23:08:26.784889 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2978/6053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:26 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:27.166093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:27.166864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:27.175274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:27.177953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:27.178699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:27.184145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:27.186032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:27.200817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:27.531643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:27.557546 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d93b9de4-481d-4d19-be59-05cc03407bb0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.394842 Oct 12 23:08:27.558977 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3076/6054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:27 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:27.808539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:27.809157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:27.825076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:27.825815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:27.826568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:27.827524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:27.828159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:27.829201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:27.956083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:27.968575 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75943f5c-dc6b-47d8-aa1c-2194fa323b8c tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1390 microversion: 2.1 time: 0.162744 Oct 12 23:08:27.970547 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2979/6055] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:27 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:28.583276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:28.584772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:28.600998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:28.601972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:28.602667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:28.603998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:28.605039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:28.605868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:28.901391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:28.909803 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17463756-1e6f-41a8-b040-b23a5c945944 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.331021 Oct 12 23:08:28.929107 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3077/6056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:28 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:28.998840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:29.000701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:29.008992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:29.009768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:29.010422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:29.011351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:29.012072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:29.012730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:29.090303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:29.102851 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-935848f7-f84d-4015-9dea-973ed35c7861 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1390 microversion: 2.1 time: 0.107977 Oct 12 23:08:29.115378 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2980/6057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:28 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1390 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:29.958559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:29.959880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:29.974024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:29.976574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:29.978043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:29.982639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:29.983189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:29.983534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:30.129381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:30.130005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:30.142478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:30.143667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:30.144405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:30.147428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:30.152299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:30.152949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:30.292242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e378ccbffef84b40a4529534e9f895f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456678d4c1604b339bbe248d3e7d488d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:30.292669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:30.301836 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b039ef60-f306-4266-8ccc-6068903abec1 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 200 len: 1390 microversion: 2.1 time: 0.177511 Oct 12 23:08:30.301998 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90074a3f-4750-460c-a698-583650237c17 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.347195 Oct 12 23:08:30.303420 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3078/6058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:29 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:30.316991 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2981/6059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:30 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 1390 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:08:31.331533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:31.332128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:31.332517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:31.335265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 36501652-9871-4a81-ae04-fbba85935cae] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:31.351817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:31.352274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:31.352732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:31.353646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:31.354072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:31.362626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:31.373928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:31.378812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:31.380770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:31.384533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:31.385279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:31.387922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:31.438660 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 36501652-9871-4a81-ae04-fbba85935cae could not be found. Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae HTTP/1.1 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 36501652-9871-4a81-ae04-fbba85935cae could not be found. Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '36501652-9871-4a81-ae04-fbba85935cae'} Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36501652-9871-4a81-ae04-fbba85935cae could not be found. Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36501652-9871-4a81-ae04-fbba85935cae could not be found. Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:31.441296 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:31.445670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:31.445670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:31.445670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:31.445670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:31.445670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:31.445670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36501652-9871-4a81-ae04-fbba85935cae could not be found. Oct 12 23:08:31.445670 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:31.446714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 36501652-9871-4a81-ae04-fbba85935cae could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:31.447724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b9f47938-689f-4b58-95bb-db1a05b4cdbe tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae" status: 404 len: 111 microversion: 2.1 time: 0.124551 Oct 12 23:08:31.448797 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3079/6060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:31 2022] GET /compute/v2.1/servers/36501652-9871-4a81-ae04-fbba85935cae => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:31.628851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:31.638809 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70e2039c-39af-45f7-9ec2-84e02b3078ba tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.312448 Oct 12 23:08:31.639977 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2982/6061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:31 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:32.187912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:32.188756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:32.203687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:32.204450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:32.205076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:32.206540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:32.207174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:32.207787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:32.225467 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 HTTP/1.1 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '05b34a38-c58d-42c0-a992-e4a1ee820eb0'} Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:32.227337 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.231257 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.233518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:32.234668 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b7056358-461f-42af-8f9b-b7a9b427eaf0 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 404 len: 111 microversion: 2.1 time: 0.050781 Oct 12 23:08:32.235769 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3080/6062] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:08:32 2022] DELETE /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:32.244215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:32.245077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] [instance: 05b34a38-c58d-42c0-a992-e4a1ee820eb0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:32.254378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:32.255591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:32.256248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:32.257246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:32.260982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:32.261450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:32.298133 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] HTTP exception thrown: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Request method failure captured: Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 HTTP/1.1 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0Vs-S6aJ1Nod3V2ohxN6NEeCG-CpW99D0MAMjo-QPe_LVUAjO7mUA-28d1V_7qV3aB7c4VesMG9lSR1FiY5SiwTtl_LpXxdyPbTCcNtS-KLx7C0hZgwzP5Fv3Un_pBpk8Ae1-x0jzhCQxU0o8kDs15vs2eLh1kMVbXmJD7ZjvFHZbI Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_456678d4c1604b339bbe248d3e7d488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/456678d4c1604b339bbe248d3e7d488d"}]}] Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 456678d4c1604b339bbe248d3e7d488d Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-38433384 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e378ccbffef84b40a4529534e9f895f7 Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-38433384-project Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '05b34a38-c58d-42c0-a992-e4a1ee820eb0'} Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:32.300201 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Returning 404 to user: Instance 05b34a38-c58d-42c0-a992-e4a1ee820eb0 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:32.306330 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30f3735d-efdc-4b73-817c-aa469019e8ae tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0" status: 404 len: 111 microversion: 2.1 time: 0.061731 Oct 12 23:08:32.306962 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2983/6063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:32 2022] GET /compute/v2.1/servers/05b34a38-c58d-42c0-a992-e4a1ee820eb0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:08:32.663058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:32.663697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:32.687302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:32.688287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:32.688932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:32.690383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:32.695609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:32.696321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:33.024970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:33.035910 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca88688e-7804-4623-8385-c3a12f169678 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.377753 Oct 12 23:08:33.037080 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3081/6064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:32 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:34.062396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:34.063660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:34.075398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:34.076177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:34.076773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:34.085106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:34.085599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:34.086045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:34.340595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:34.355384 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b961743-ddc1-4f85-8be9-88513bffb1eb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.296975 Oct 12 23:08:34.365662 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2984/6065] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:34 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:35.382048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:35.382964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:35.396232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:35.403963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:35.405025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:35.406496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:35.407602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:35.408466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:35.672782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:35.682586 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bdbc7279-1544-4a40-ba9a-0f7b22b1754f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.305089 Oct 12 23:08:35.685748 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3082/6066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:35 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:36.709460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:36.710078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:36.718799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:36.721985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:36.725215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:36.726753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:36.727515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:36.728210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:37.590089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:37.605928 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-da7ae19e-2f47-4c94-8514-428f9b8e8244 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.894305 Oct 12 23:08:37.607322 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2985/6067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:36 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:38.675057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:38.676612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:38.692326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:38.693996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:38.697414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:38.698053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:38.701617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:38.702169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:38.702496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:39.020883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:39.032794 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4933c640-a1c3-4b70-81dc-4e97da0079ee tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.403937 Oct 12 23:08:39.049087 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3083/6068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:38 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:39.547746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-14feaf5e-f8c0-4252-9701-6a1d16771947 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] Calling method '.version_select at 0x7f44fe5d6af0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:39.586450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=42 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:39.652459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-14feaf5e-f8c0-4252-9701-6a1d16771947 tempest-TestVolumeBootPattern-38433384 tempest-TestVolumeBootPattern-38433384-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695750862" status: 202 len: 0 microversion: 2.1 time: 0.109250 Oct 12 23:08:39.654117 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2986/6069] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 12 23:08:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695750862 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:08:40.058860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:40.059517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:40.079806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:40.081024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:40.081546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:40.082368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:40.082904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:40.083410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:40.260702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:40.271121 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4e7db1a-e412-4eca-a9a9-0ef54d0c7c97 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.216270 Oct 12 23:08:40.284790 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3084/6070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:40 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:41.295982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:41.296606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:41.316959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:41.317653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:41.318265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:41.319144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:41.319754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:41.320358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:42.116832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:42.129532 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1be7f4cd-3551-4a12-9d50-b8ddadd496cc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1528 microversion: 2.1 time: 0.837340 Oct 12 23:08:42.144360 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2987/6071] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:41 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1528 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:43.153561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:43.154197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:43.170910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:43.171228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:43.171551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:43.181811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:43.181811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:43.182048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:43.541183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:43.550962 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d956a750-116f-49b0-a599-ed20a09b7439 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1510 microversion: 2.1 time: 0.401332 Oct 12 23:08:43.551585 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3085/6072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:43 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:44.580051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:44.581123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:44.605854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:44.609506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:44.610579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:44.613269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:44.614424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:44.616699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:44.922258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:44.945076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9906941-ccb7-4215-87ed-ceadec38c426 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1513 microversion: 2.1 time: 0.369907 Oct 12 23:08:44.946552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2988/6073] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:44 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1513 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:44.973060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:44.977168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:44.985880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:44.986803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:44.987496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:44.988734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:44.989812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:44.990619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:45.429146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:45.437868 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25476e2f-4117-49b1-bcdb-37f321c72c39 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1513 microversion: 2.1 time: 0.472436 Oct 12 23:08:45.460345 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3086/6074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:44 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1513 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:45.500671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:45.501509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:45.509372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:45.509867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:45.510299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:45.511002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:45.511451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:45.511874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:45.569189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lazy-loading 'flavor' on Instance uuid 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:08:45.608729 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Cannot 'shelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state shelved_offloaded Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action HTTP/1.1 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 14 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: {"shelve": {}} Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: exception: Cannot 'shelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state shelved_offloaded Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'shelve': {}}} Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:08:45.612638 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state shelved_offloaded Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state shelved_offloaded Oct 12 23:08:45.617073 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:08:45.620470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 409 to user: Cannot 'shelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state shelved_offloaded {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:08:45.621610 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ed9eac3-28c7-4837-b597-3ea0d8edfddc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 409 len: 155 microversion: 2.1 time: 0.124895 Oct 12 23:08:45.622432 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2989/6075] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:45 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 155 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:08:45.632136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:45.632845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:45.644072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:45.646114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:45.647480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:45.649413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:45.650509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:45.651103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:45.734371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 23:08:45.815243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:45.965404 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [6f4668ed-bdd2-44ee-a687-bcd8707cbefe] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:08:46.147592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2d6e9f8c-9480-4da3-bc03-d27ab9b2f00a req-d857c2c9-e932-43a3-9296-710122306e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e73501-56e3-467d-bc6c-7d3cc8b2fdb9", "name": "network-vif-unplugged", "status": "completed", "tag": "df38ff8b-1402-4b70-898d-1d22b23f3563"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:46.173622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2d6e9f8c-9480-4da3-bc03-d27ab9b2f00a req-d857c2c9-e932-43a3-9296-710122306e89 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:46.174377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2d6e9f8c-9480-4da3-bc03-d27ab9b2f00a req-d857c2c9-e932-43a3-9296-710122306e89 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:46.174954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2d6e9f8c-9480-4da3-bc03-d27ab9b2f00a req-d857c2c9-e932-43a3-9296-710122306e89 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:46.208025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.server_external_events [req-2d6e9f8c-9480-4da3-bc03-d27ab9b2f00a req-d857c2c9-e932-43a3-9296-710122306e89 service nova] Unable to find a host for instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9. Dropping event network-vif-unplugged {{(pid=120543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 23:08:46.208913 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2d6e9f8c-9480-4da3-bc03-d27ab9b2f00a req-d857c2c9-e932-43a3-9296-710122306e89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065210 Oct 12 23:08:46.209533 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2990/6076] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 12 23:08:46.974910 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [6f4668ed-bdd2-44ee-a687-bcd8707cbefe] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51914. Oct 12 23:08:46.979331 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62995a92-ac4d-4b7d-bbc5-f8d21f9c5e01 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 202 len: 0 microversion: 2.1 time: 1.351810 Oct 12 23:08:46.980389 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3087/6077] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:08:45 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 0 bytes in 1354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:08:46.994266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:46.994898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:47.012659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:47.013384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:47.013981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:47.014868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:47.028039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:47.028886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:47.287413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:47.299948 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33b5bf04-ee6d-4772-8d84-acfc30160d28 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1461 microversion: 2.1 time: 0.311719 Oct 12 23:08:47.309076 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2991/6078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:46 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1461 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:48.324075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:48.324842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:48.349224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:48.350323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:48.350323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:48.351258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:48.351788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:48.352968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:48.741020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:48.758724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c08953ff-1739-4ceb-8e05-8a47972645d9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1461 microversion: 2.1 time: 0.439007 Oct 12 23:08:48.769890 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3088/6079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:48 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1461 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:49.797848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:49.798517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:49.823428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:49.823949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:49.824625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:49.825291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:49.825748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:49.826160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:50.315348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:50.363870 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-07f2b7be-dd56-451c-88ef-bdc32f4df61f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.570043 Oct 12 23:08:50.365291 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2992/6080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:49 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:51.402444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:51.405360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:51.415877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:51.416459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:51.416904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:51.417885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:51.418632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:51.419214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:51.808007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:51.837661 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99b9df29-c3a3-45c8-91f9-75541b031737 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.448187 Oct 12 23:08:51.853219 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3089/6081] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:51 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:52.088569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5a90bec6-ddf4-419c-8fd8-33aca3564204 req-bc862bc4-ef60-4d46-8bcb-6e3589e6499e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e73501-56e3-467d-bc6c-7d3cc8b2fdb9", "tag": "df38ff8b-1402-4b70-898d-1d22b23f3563"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:08:52.114940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5a90bec6-ddf4-419c-8fd8-33aca3564204 req-bc862bc4-ef60-4d46-8bcb-6e3589e6499e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:52.118073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5a90bec6-ddf4-419c-8fd8-33aca3564204 req-bc862bc4-ef60-4d46-8bcb-6e3589e6499e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:52.120932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5a90bec6-ddf4-419c-8fd8-33aca3564204 req-bc862bc4-ef60-4d46-8bcb-6e3589e6499e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:52.146352 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5a90bec6-ddf4-419c-8fd8-33aca3564204 req-bc862bc4-ef60-4d46-8bcb-6e3589e6499e service nova] Creating event network-changed:df38ff8b-1402-4b70-898d-1d22b23f3563 for instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 on n-h2-860864-8 Oct 12 23:08:52.154997 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5a90bec6-ddf4-419c-8fd8-33aca3564204 req-bc862bc4-ef60-4d46-8bcb-6e3589e6499e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078626 Oct 12 23:08:52.155534 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2993/6082] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:08:52.867927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:52.868824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:52.888789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:52.889379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:52.890106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:52.890900 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:52.891355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:52.891821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:53.340489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:53.350044 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-55f948f5-c28a-4bdd-885e-810dddb6f606 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.487027 Oct 12 23:08:53.358166 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3090/6083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:52 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:54.386624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:54.387715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:54.404935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:54.406989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:54.409645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:54.413052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:54.416604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:54.417449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:54.429620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=92 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:08:54.790946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:54.807995 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-611b6a69-b312-44cc-b3ac-e13498ae46a4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.420065 Oct 12 23:08:54.813627 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2994/6084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:54 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:55.834636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:55.836936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:55.862563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:55.864983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:55.866603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:55.868830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:55.869772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:55.871059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:56.336231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:56.347993 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb048905-1dba-418e-b4c7-1b0520321a5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.518873 Oct 12 23:08:56.355814 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3091/6085] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:55 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:57.383719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:57.384935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:57.411534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:57.420206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:57.420910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:57.421680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:57.422147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:57.422598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:57.808476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:57.824551 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-080babeb-4278-4914-bec9-f1f6fbbabb9f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.437797 Oct 12 23:08:57.829517 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2995/6086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:57 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:08:58.853422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:08:58.854613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:08:58.865575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:58.868493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:58.869114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:58.871008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:08:58.873155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:08:58.873765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:08:59.246887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:08:59.272474 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22b9e420-33eb-4997-9ed3-1ced368fcfb3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.422987 Oct 12 23:08:59.278410 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3092/6087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:08:58 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:00.303265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:00.304250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:00.324340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-257269379", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:00.332227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:00.332986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:00.334187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:00.336310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:00.337764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:00.339019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:00.388686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:09:00.620468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:00.631471 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98a4359a-ffab-467d-b966-e11974b3e692 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.332878 Oct 12 23:09:00.633175 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2996/6088] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:00 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:01.017260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:09:01.017694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:09:01.018524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:09:01.019109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:09:01.019692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:09:01.043835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:01.044286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:01.044742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:01.052394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:01.053119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:01.053697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:01.099048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Getting quotas for project 6bf061fe8c094da6a43b4716a42362ad. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:09:01.105673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Getting quotas for user ac2c5ed00eaa4db3811ce45b327b282e and project 6bf061fe8c094da6a43b4716a42362ad. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:09:01.140154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:09:01.142577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:09:01.258288 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f9331c3-5b4e-47ff-9fb6-ae594dedb41e tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938683 Oct 12 23:09:01.259152 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3093/6089] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 23:09:01.275700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ffdf483-b06d-4115-8f05-98e5bf18cdb2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:01.276781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ffdf483-b06d-4115-8f05-98e5bf18cdb2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:01.405592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8ffdf483-b06d-4115-8f05-98e5bf18cdb2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:01.414960 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ffdf483-b06d-4115-8f05-98e5bf18cdb2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1214 microversion: 2.1 time: 0.145692 Oct 12 23:09:01.417217 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2997/6090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:01 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:01.661029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:01.662442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:01.684688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:01.689153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:01.689758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:01.705158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:01.705906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:01.706374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:02.006839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:02.015722 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f5e49e4-2efd-4397-a513-3ac22e30d89d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.359270 Oct 12 23:09:02.027918 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3094/6091] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:01 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:02.442548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:02.443995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:02.502993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:02.506554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:02.508318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:02.511148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:02.511633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:02.512108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:02.667115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:02.676734 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c42462b3-14b4-4dad-8118-dd7f6450242a tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1218 microversion: 2.1 time: 0.240709 Oct 12 23:09:02.682345 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2998/6092] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:02 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1218 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:03.054766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:03.056307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:03.065934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:03.066995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:03.067681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:03.068734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:03.069484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:03.071018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:03.322456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:03.333170 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef49f2d3-bce6-417f-9355-7948bb1452a2 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.281558 Oct 12 23:09:03.335529 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3095/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:03 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:03.718597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:03.720022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:03.739603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:03.748707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:03.753180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:03.756295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:03.757025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:03.764696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:03.961326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:03.978850 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01310ce8-e4c1-4337-b070-005e602b3ef2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1266 microversion: 2.1 time: 0.262434 Oct 12 23:09:03.979781 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2999/6094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:03 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:04.360698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:04.362097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:04.376635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:04.378220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:04.382605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:04.383645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:04.384373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:04.384985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:04.773686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:04.783451 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-861c77a3-3c98-4a6d-9fd6-6bdf4d928267 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.427148 Oct 12 23:09:04.788778 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3096/6095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:04 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:05.005047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:05.005832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:05.022751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:05.024561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:05.027294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:05.028376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:05.030905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:05.034165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:05.185459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:05.195795 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-22193dcc-264e-4929-9829-721054ddf9cf tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1272 microversion: 2.1 time: 0.196073 Oct 12 23:09:05.227395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3000/6096] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:04 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:05.811005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:05.811652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:05.821489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:05.821489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:05.821765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:05.836599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:05.837337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:05.837948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:06.221053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:06.221968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:06.241568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:06.242357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:06.242856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:06.243708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:06.244482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:06.244927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:06.306979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:06.320477 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f67ef770-8fff-4345-bef6-720043a276e3 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.513345 Oct 12 23:09:06.321396 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3097/6097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:05 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:06.358005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:06.384905 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-96f74a8b-fc30-4528-a04c-bd95e4ed49bd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1272 microversion: 2.1 time: 0.168592 Oct 12 23:09:06.385515 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3001/6098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:06 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:07.348891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:07.350987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:07.358633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:07.359358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:07.360640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:07.361550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:07.362200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:07.362815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:07.411167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:07.412904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:07.432259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:07.434333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:07.434966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:07.436781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:07.437964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:07.439758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:07.654603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:07.667746 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cebf9109-d389-4484-9432-15a073ce6d8d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1314 microversion: 2.1 time: 0.261937 Oct 12 23:09:07.669018 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3002/6099] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:07 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:07.817662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:07.830129 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e433f7ee-aa13-4705-83ef-a22b6230e79b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.483088 Oct 12 23:09:07.830776 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3098/6100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:07 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:08.545274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9fdbd5c8-30d5-48be-9977-244b8331790e req-21098e4f-662a-41ec-967f-e28d8b817c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d", "tag": "a0c453b6-a714-4783-b812-3b34baa2fe01"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:08.556431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9fdbd5c8-30d5-48be-9977-244b8331790e req-21098e4f-662a-41ec-967f-e28d8b817c62 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:08.557256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9fdbd5c8-30d5-48be-9977-244b8331790e req-21098e4f-662a-41ec-967f-e28d8b817c62 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:08.558068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9fdbd5c8-30d5-48be-9977-244b8331790e req-21098e4f-662a-41ec-967f-e28d8b817c62 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:08.595990 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9fdbd5c8-30d5-48be-9977-244b8331790e req-21098e4f-662a-41ec-967f-e28d8b817c62 service nova] Creating event network-changed:a0c453b6-a714-4783-b812-3b34baa2fe01 for instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d on n-h2-860864-8 Oct 12 23:09:08.605577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9fdbd5c8-30d5-48be-9977-244b8331790e req-21098e4f-662a-41ec-967f-e28d8b817c62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061495 Oct 12 23:09:08.606529 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3003/6101] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:08.690978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:08.691600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:08.702969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:08.703527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:08.703955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:08.704858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:08.705568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:08.706203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:08.854309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:08.855041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:08.874132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:08.874644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:08.875145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:08.876156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:08.876620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:08.877052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:09.033466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:09.041850 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7206484-b0cf-47a7-88b1-1b71637cd484 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.191647 Oct 12 23:09:09.062969 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3004/6102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:08 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:09.087102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:09.100956 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e82dcb3-1178-499b-8aa7-4d96be567c00 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1314 microversion: 2.1 time: 0.413828 Oct 12 23:09:09.102220 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3099/6103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:08 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:10.070050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:10.071443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:10.074748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:10.082036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:10.082918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:10.083588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:10.084627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:10.085358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:10.086265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:10.123444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:10.126583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:10.137404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:10.140274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:10.144804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:10.147120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:10.147916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:10.148410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:10.150836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:10.295189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:10.319855 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ec5f928-b3e4-458c-b625-c5d239d2af4f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.253763 Oct 12 23:09:10.320798 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3005/6104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:10 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:10.479156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:10.488573 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ba3614d4-1317-4cba-a421-e04c00a33ca1 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1314 microversion: 2.1 time: 0.368834 Oct 12 23:09:10.489169 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3100/6105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:10 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:10.990055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f002df0d-14ec-4709-901a-48ff243c41ea req-86e8aea4-3094-4d5b-a242-e0e41223609f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e73501-56e3-467d-bc6c-7d3cc8b2fdb9", "name": "network-vif-plugged", "status": "completed", "tag": "df38ff8b-1402-4b70-898d-1d22b23f3563"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:11.009781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f002df0d-14ec-4709-901a-48ff243c41ea req-86e8aea4-3094-4d5b-a242-e0e41223609f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:11.010762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f002df0d-14ec-4709-901a-48ff243c41ea req-86e8aea4-3094-4d5b-a242-e0e41223609f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:11.011375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f002df0d-14ec-4709-901a-48ff243c41ea req-86e8aea4-3094-4d5b-a242-e0e41223609f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:11.049842 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f002df0d-14ec-4709-901a-48ff243c41ea req-86e8aea4-3094-4d5b-a242-e0e41223609f service nova] Creating event network-vif-plugged:df38ff8b-1402-4b70-898d-1d22b23f3563 for instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 on n-h2-860864-8 Oct 12 23:09:11.061207 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f002df0d-14ec-4709-901a-48ff243c41ea req-86e8aea4-3094-4d5b-a242-e0e41223609f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081556 Oct 12 23:09:11.062820 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3006/6106] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:11.345170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:11.345803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:11.348763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:11.354055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:11.358632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:11.368690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:11.369374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:11.370282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:11.370913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:11.371510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:11.537548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:11.538992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:11.551024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:11.555034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:11.556484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:11.557191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:11.558209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:11.560114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:11.560818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:11.587433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:11.598268 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4fd958cc-7c76-4f4a-ba6d-4c689d0a7774 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.256760 Oct 12 23:09:11.616003 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3101/6107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:11 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:11.746933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:11.755672 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c52e0a43-13ed-4026-8e52-99cca6840ff7 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1314 microversion: 2.1 time: 0.243432 Oct 12 23:09:11.764809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3007/6108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:11 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:12.629521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:12.630229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:12.639836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:12.640386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:12.641388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:12.642108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:12.642578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:12.643136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:12.781673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:12.783632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:12.798807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:12.799201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:12.799645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:12.804454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:12.805876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:12.806471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:12.898968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:12.917018 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-900bf796-7ae8-4e14-9516-b7c98a6fb462 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1519 microversion: 2.1 time: 0.289733 Oct 12 23:09:12.918025 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3102/6109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:12 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:13.070963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:13.080779 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8bc9cda1-0950-4b8c-a3c3-540a63e47974 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1314 microversion: 2.1 time: 0.305420 Oct 12 23:09:13.082149 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3008/6110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:12 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:13.945488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:13.946087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:13.953486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:13.953982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:13.954429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:13.955136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:13.955589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:13.956053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.105626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:14.106327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:14.111088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:14.117092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.117779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.118410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.119485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.120189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.120852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.121868 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0563e4c5-a556-4e63-baf0-fdbafba37694 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.180293 Oct 12 23:09:14.122472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3103/6111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:13 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:14.145877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:14.147563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:14.154122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.154646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.155090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.155792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.156310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.156743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.188868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:14.317775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:14.326395 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3589fa3c-a83f-43fe-9376-8a14cee29114 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1314 microversion: 2.1 time: 0.225082 Oct 12 23:09:14.326985 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3009/6112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:14 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:14.354833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:14.364444 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f75da32-9cef-436c-bc87-fae6cc026869 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.222488 Oct 12 23:09:14.365324 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3104/6113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:14 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:14.397194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:14.398360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:14.413963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.414465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.415046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.416015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.416475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.417040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.570748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:14.579458 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-322f5249-050e-4b3e-b2e5-db981146182c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.186251 Oct 12 23:09:14.580161 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3010/6114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:14 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:14.601696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eab92363-da69-45dc-b851-3bda3c3da33b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:14.607724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-eab92363-da69-45dc-b851-3bda3c3da33b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance bf00ed98-a144-4a92-bc6e-6f9d8112eaaa has no mapping to a cell. Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eab92363-da69-45dc-b851-3bda3c3da33b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/bf00ed98-a144-4a92-bc6e-6f9d8112eaaa/action HTTP/1.1 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 15 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: {"os-stop": {}} Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance bf00ed98-a144-4a92-bc6e-6f9d8112eaaa has no mapping to a cell. Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'bf00ed98-a144-4a92-bc6e-6f9d8112eaaa', 'body': {'os-stop': {}}} Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance bf00ed98-a144-4a92-bc6e-6f9d8112eaaa has no mapping to a cell. Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:14.617205 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf00ed98-a144-4a92-bc6e-6f9d8112eaaa has no mapping to a cell. Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf00ed98-a144-4a92-bc6e-6f9d8112eaaa has no mapping to a cell. Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:14.622155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eab92363-da69-45dc-b851-3bda3c3da33b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance bf00ed98-a144-4a92-bc6e-6f9d8112eaaa has no mapping to a cell. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:14.623744 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eab92363-da69-45dc-b851-3bda3c3da33b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/bf00ed98-a144-4a92-bc6e-6f9d8112eaaa/action" status: 404 len: 117 microversion: 2.1 time: 0.025887 Oct 12 23:09:14.624443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3105/6115] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:14 2022] POST /compute/v2.1/servers/bf00ed98-a144-4a92-bc6e-6f9d8112eaaa/action => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:14.633331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:14.634244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:14.640323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.641418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.642105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.642838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.643390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.643930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.838601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:14.852831 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b2157ff-5e01-4c2f-bcd3-86a0b2215560 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.222991 Oct 12 23:09:14.853720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3011/6116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:14 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:14.877694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:14.878328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:14.895923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.895923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.895923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.895923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.895923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.895923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.919341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8091a0e7-a349-4699-be3c-5b4d418d0494 req-b51b0441-d2e0-4984-bde2-0d49fe1e71ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d", "name": "network-vif-plugged", "status": "completed", "tag": "a0c453b6-a714-4783-b812-3b34baa2fe01"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:14.936060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8091a0e7-a349-4699-be3c-5b4d418d0494 req-b51b0441-d2e0-4984-bde2-0d49fe1e71ce service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:14.936545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8091a0e7-a349-4699-be3c-5b4d418d0494 req-b51b0441-d2e0-4984-bde2-0d49fe1e71ce service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:14.936982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8091a0e7-a349-4699-be3c-5b4d418d0494 req-b51b0441-d2e0-4984-bde2-0d49fe1e71ce service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:14.956001 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8091a0e7-a349-4699-be3c-5b4d418d0494 req-b51b0441-d2e0-4984-bde2-0d49fe1e71ce service nova] Creating event network-vif-plugged:a0c453b6-a714-4783-b812-3b34baa2fe01 for instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d on n-h2-860864-8 Oct 12 23:09:14.967109 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8091a0e7-a349-4699-be3c-5b4d418d0494 req-b51b0441-d2e0-4984-bde2-0d49fe1e71ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052178 Oct 12 23:09:14.968710 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3012/6117] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:09:15.120472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:15.131461 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7eed4a19-da1c-4d6e-8caa-f54612f9dc9d tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.258275 Oct 12 23:09:15.132354 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3106/6118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:14 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:15.156062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56d441a5-5121-4328-8eed-a67dc30791d6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:15.157618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56d441a5-5121-4328-8eed-a67dc30791d6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 93c39e85-9201-4b65-9929-849be10e51a2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:15.163671 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-56d441a5-5121-4328-8eed-a67dc30791d6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 93c39e85-9201-4b65-9929-849be10e51a2 could not be found. Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56d441a5-5121-4328-8eed-a67dc30791d6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/93c39e85-9201-4b65-9929-849be10e51a2/action HTTP/1.1 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 15 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: {"suspend": {}} Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 93c39e85-9201-4b65-9929-849be10e51a2 could not be found. Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '93c39e85-9201-4b65-9929-849be10e51a2', 'body': {'suspend': {}}} Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c39e85-9201-4b65-9929-849be10e51a2 could not be found. Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c39e85-9201-4b65-9929-849be10e51a2 could not be found. Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:15.165587 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:15.169905 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:15.169905 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:15.169905 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c39e85-9201-4b65-9929-849be10e51a2 could not be found. Oct 12 23:09:15.169905 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:15.171277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56d441a5-5121-4328-8eed-a67dc30791d6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 93c39e85-9201-4b65-9929-849be10e51a2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:15.172921 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56d441a5-5121-4328-8eed-a67dc30791d6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/93c39e85-9201-4b65-9929-849be10e51a2/action" status: 404 len: 111 microversion: 2.1 time: 0.022325 Oct 12 23:09:15.173907 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3013/6119] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:15 2022] POST /compute/v2.1/servers/93c39e85-9201-4b65-9929-849be10e51a2/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:15.182320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:15.183035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:15.190230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.190856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.191562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.192540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.193114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.193665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.339178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:15.349693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:15.350911 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-de68488e-d309-4465-ab9c-4daf5b857f14 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.172106 Oct 12 23:09:15.351195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:15.368717 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3107/6120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:15 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:15.373321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.373849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.374454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.374811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:15.375756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:15.376043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.376666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.377249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.385480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.385994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.386458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.387181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.387662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.388463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.562680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:15.571114 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6846b95-69f7-4abd-b14c-327774b75bf6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.200076 Oct 12 23:09:15.572459 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3108/6121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:15 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:15.598205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:15.598871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:15.606017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.606765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.607463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.608314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.609545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.610187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.639210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lazy-loading 'flavor' on Instance uuid 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:09:15.754628 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d190af48-31a2-4b1e-8580-625e79a0faef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 202 len: 0 microversion: 2.1 time: 0.161065 Oct 12 23:09:15.759961 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3109/6122] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:15 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:09:15.766959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:15.767920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:15.776545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.777384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.777907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.778688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:15.779209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:15.780639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:15.916657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:15.919426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:15.929810 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bf274b5e-dd31-4d33-9063-923d278163b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1314 microversion: 2.1 time: 0.583820 Oct 12 23:09:15.930390 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3014/6123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:15 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:15.992852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:16.012842 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22ee9aa5-e204-4338-aeaf-6d373cb1d724 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1514 microversion: 2.1 time: 0.251138 Oct 12 23:09:16.013612 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3110/6124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:15 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:16.955015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:16.955824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:16.962982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:16.963462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:16.963942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:16.964624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:16.965075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:16.965487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.038085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:17.038718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:17.045870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.046393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.046863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.047935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.048205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.048653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.112751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:17.121071 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65741b41-0cfd-4a28-a93f-858f731a09b2 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1464 microversion: 2.1 time: 0.170493 Oct 12 23:09:17.121970 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3015/6125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:16 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:17.175717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:17.176248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:17.182391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.183149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.183598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.184339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.184798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.185228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.211927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:17.220726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c4b732a-2489-44f7-a820-d70f03b672c4 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1497 microversion: 2.1 time: 0.186496 Oct 12 23:09:17.221584 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3111/6126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:17 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:17.224510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:09:17.245132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:17.246000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:17.256753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.257542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.258336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.259441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.260103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.260699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.286546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lazy-loading 'flavor' on Instance uuid 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:09:17.308231 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Cannot 'suspend' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state suspended Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action HTTP/1.1 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 15 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: {"suspend": {}} Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'suspend' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state suspended Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'suspend': {}}} Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 12 23:09:17.310194 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state suspended Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state suspended Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 409 to user: Cannot 'suspend' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state suspended {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a38d5ee1-2997-4b67-bae2-8ae950b246b0 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 409 len: 148 microversion: 2.1 time: 0.071343 Oct 12 23:09:17.315112 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3112/6127] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:17 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 148 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 23:09:17.324790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:17.325734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:17.332381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.333497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.333960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.335189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.335340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.335787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.378365 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a4b7ee4a-72da-443e-aad3-e5a657316cbd tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 204 len: 0 microversion: 2.1 time: 0.202088 Oct 12 23:09:17.379033 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3016/6128] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:09:17 2022] DELETE /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:09:17.393658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:17.395764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:17.412216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.413868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.416167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.417065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.420152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.420788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.442185 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b1cc067-7098-46b0-bfe6-831a08e907f6 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 202 len: 0 microversion: 2.1 time: 0.121750 Oct 12 23:09:17.443218 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3113/6129] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:17 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:09:17.451511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:17.452525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:17.459048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.459748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.460408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.461290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:17.461923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:17.462367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:17.607965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:17.617486 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9112e130-a69d-4955-9bf9-65ab6921225a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1503 microversion: 2.1 time: 0.170073 Oct 12 23:09:17.618083 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3114/6130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:17 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:17.624315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:17.633753 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1056c78-1856-45bd-a3ec-101524a346d8 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1470 microversion: 2.1 time: 0.249806 Oct 12 23:09:17.635940 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3017/6131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:17 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:18.643700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:18.647092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:18.654711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:18.655477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:18.656088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:18.657023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:18.657595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:18.658136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:18.663168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:18.665688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:18.678993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:18.679817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:18.680427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:18.681298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:18.681914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:18.682494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:18.861228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:18.876157 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4aa3fb4e-d760-4d80-ba91-e158a8f7318d tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1470 microversion: 2.1 time: 0.222905 Oct 12 23:09:18.887703 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3018/6132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:18 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:19.035104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:19.048171 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-64cb39a6-dfa5-421a-88dc-459693f16336 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1503 microversion: 2.1 time: 0.407527 Oct 12 23:09:19.049939 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3115/6133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:18 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:19.507380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2ae79a40-506f-4ab5-b9fe-c00e331f1295 req-6c2efff7-a27a-473d-9c87-c3de4cc30e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d", "name": "network-vif-deleted", "tag": "a0c453b6-a714-4783-b812-3b34baa2fe01"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:19.519167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2ae79a40-506f-4ab5-b9fe-c00e331f1295 req-6c2efff7-a27a-473d-9c87-c3de4cc30e73 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:19.519884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2ae79a40-506f-4ab5-b9fe-c00e331f1295 req-6c2efff7-a27a-473d-9c87-c3de4cc30e73 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:19.520494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2ae79a40-506f-4ab5-b9fe-c00e331f1295 req-6c2efff7-a27a-473d-9c87-c3de4cc30e73 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:19.535523 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2ae79a40-506f-4ab5-b9fe-c00e331f1295 req-6c2efff7-a27a-473d-9c87-c3de4cc30e73 service nova] Creating event network-vif-deleted:a0c453b6-a714-4783-b812-3b34baa2fe01 for instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d on n-h2-860864-8 Oct 12 23:09:19.543944 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2ae79a40-506f-4ab5-b9fe-c00e331f1295 req-6c2efff7-a27a-473d-9c87-c3de4cc30e73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040356 Oct 12 23:09:19.544890 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3019/6134] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:19.898844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:19.899545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:19.907100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:19.907614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:19.908097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:19.908820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:19.909286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:19.909725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:19.945133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:19.945624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:19.946072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:19.946532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lazy-loading 'fault' on Instance uuid 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:09:19.995320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5ed00eaa4db3811ce45b327b282e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf061fe8c094da6a43b4716a42362ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:20.005459 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-adf83daf-2526-48e8-9475-362a9fccaf81 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 200 len: 1304 microversion: 2.1 time: 0.110450 Oct 12 23:09:20.006052 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3116/6135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:19 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:20.075373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:20.077063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:20.086620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:20.087149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:20.087593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:20.088328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:20.088795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:20.089222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:20.338687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:20.349804 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cce7b952-c457-440d-bae8-1c5930137318 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1503 microversion: 2.1 time: 0.280366 Oct 12 23:09:20.350941 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3020/6136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:20 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:21.029645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:21.030276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] [instance: 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:21.037247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.038330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.038787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:21.039496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.040031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.040429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:21.066335 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] HTTP exception thrown: Instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d could not be found. Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Request method failure captured: Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d HTTP/1.1 Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0kJ3zqMzSS7yDTgPPsCHvZkF4KoOHkvv_ych90wyzVJvfIqbrVF2WjcYT46xqQw5Lv6bUp-73AOq_MDsOTDTlDb-3rAn-Qwpjc4F0Uq2GM5vkbwe106H0eF3-Kc18yg4_LxSs_Ap1IRXFRnw7et0ffns72PV71BWNpZ9Ab2l0W6B3I Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6bf061fe8c094da6a43b4716a42362ad Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesNegativeTest-1975796226 Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bf061fe8c094da6a43b4716a42362ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6bf061fe8c094da6a43b4716a42362ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6bf061fe8c094da6a43b4716a42362ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6bf061fe8c094da6a43b4716a42362ad"}]}] Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesNegativeTest-1975796226 Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6bf061fe8c094da6a43b4716a42362ad Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesNegativeTest-1975796226 Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesNegativeTest-1975796226-project Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: ac2c5ed00eaa4db3811ce45b327b282e Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesNegativeTest-1975796226-project Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d could not be found. Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d'} Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d could not be found. Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d could not be found. Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:21.069124 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.073767 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:21.073767 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:21.073767 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:21.073767 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:21.073767 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:21.073767 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d could not be found. Oct 12 23:09:21.073767 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.075237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] Returning 404 to user: Instance 72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:21.076278 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13a1c4db-e807-4b18-9c57-818f09afa660 tempest-VolumesNegativeTest-1975796226 tempest-VolumesNegativeTest-1975796226-project] 10.222.0.20 "GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d" status: 404 len: 111 microversion: 2.1 time: 0.050533 Oct 12 23:09:21.077594 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3117/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:21 2022] GET /compute/v2.1/servers/72b3f7a8-bf55-4b49-ac5f-f2b1f50f6f8d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:21.378362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:21.381949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:21.397224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.398450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.399486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:21.400588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.401207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.401786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:21.581694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:21.602513 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eb7e31b1-b8ff-49a8-b46d-bafd8f6d8884 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.229842 Oct 12 23:09:21.603527 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3021/6138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:21 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:21.631468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:21.632141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:21.639469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.640519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.641228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:21.641958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.642465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.643289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:21.857048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:21.881149 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8159b24d-d07a-4547-912f-528c69622abc tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.252661 Oct 12 23:09:21.883165 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3118/6139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:21 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:21.905766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-609f8858-af67-4e6b-89f1-cd4b7177397e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:21.906684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-609f8858-af67-4e6b-89f1-cd4b7177397e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 54dd7944-fb01-4a47-81e1-96571246e62d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:21.914314 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-609f8858-af67-4e6b-89f1-cd4b7177397e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 54dd7944-fb01-4a47-81e1-96571246e62d could not be found. Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-609f8858-af67-4e6b-89f1-cd4b7177397e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/54dd7944-fb01-4a47-81e1-96571246e62d/action HTTP/1.1 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 15 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: {"unpause": {}} Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 54dd7944-fb01-4a47-81e1-96571246e62d could not be found. Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '54dd7944-fb01-4a47-81e1-96571246e62d', 'body': {'unpause': {}}} Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54dd7944-fb01-4a47-81e1-96571246e62d could not be found. Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54dd7944-fb01-4a47-81e1-96571246e62d could not be found. Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:21.916579 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:21.921721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:21.921721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:21.921721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54dd7944-fb01-4a47-81e1-96571246e62d could not be found. Oct 12 23:09:21.921721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:21.923129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-609f8858-af67-4e6b-89f1-cd4b7177397e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 54dd7944-fb01-4a47-81e1-96571246e62d could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:21.924351 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-609f8858-af67-4e6b-89f1-cd4b7177397e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/54dd7944-fb01-4a47-81e1-96571246e62d/action" status: 404 len: 111 microversion: 2.1 time: 0.022577 Oct 12 23:09:21.925317 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3022/6140] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:21 2022] POST /compute/v2.1/servers/54dd7944-fb01-4a47-81e1-96571246e62d/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:21.933584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:21.934231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:21.942855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.943361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.943811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:21.944562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:21.945029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:21.945471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.107387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:22.115420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:22.117704 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ae6a2f50-20fb-463a-bef3-11ba1dd51b83 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.188046 Oct 12 23:09:22.125441 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3119/6141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:21 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:22.141923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:22.142816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:22.149838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.150507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.151223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.152113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.152727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.153310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.299574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:22.309626 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7971dc86-4c6f-4b8c-b3aa-939d19fb17ec tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.171745 Oct 12 23:09:22.322379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3023/6142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:22 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:22.334785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:22.335413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:22.342266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.342839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.343938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.344718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.345245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.345743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.376123 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Cannot 'unpause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action HTTP/1.1 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 15 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: {"unpause": {}} Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'unpause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'unpause': {}}} Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 in vm_state active. Cannot unpause while the instance is in this state. Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:22.377823 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 409 to user: Cannot 'unpause' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74724a81-f429-4e71-a638-df5afae58386 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 409 len: 145 microversion: 2.1 time: 0.049986 Oct 12 23:09:22.382453 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3120/6143] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:22 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 145 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:09:22.388115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:22.388738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:22.395510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.396048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.396488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.397189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.397641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.398064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.549104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:22.557359 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e02e0f94-5ed2-4f5b-a61a-eb9d115f331a tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.173111 Oct 12 23:09:22.557932 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3024/6144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:22 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:22.582217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:22.582830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:22.588920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.589409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.589850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.590554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.591009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.591434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.737161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:22.745998 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe388268-79c2-4657-a486-35e7ee9ab80e tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.167576 Oct 12 23:09:22.748906 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3121/6145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:22 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:22.773291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5cb8c8c-664a-484c-ab1a-e22f9214babe tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:22.773818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5cb8c8c-664a-484c-ab1a-e22f9214babe tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: b207b4be-c0cc-4c09-b40e-05f224bd99cb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:22.779799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d5cb8c8c-664a-484c-ab1a-e22f9214babe tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance b207b4be-c0cc-4c09-b40e-05f224bd99cb could not be found. Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5cb8c8c-664a-484c-ab1a-e22f9214babe tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/b207b4be-c0cc-4c09-b40e-05f224bd99cb/action HTTP/1.1 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 18 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: {"unshelve": null} Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance b207b4be-c0cc-4c09-b40e-05f224bd99cb could not be found. Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'b207b4be-c0cc-4c09-b40e-05f224bd99cb', 'body': {'unshelve': None}} Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b207b4be-c0cc-4c09-b40e-05f224bd99cb could not be found. Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b207b4be-c0cc-4c09-b40e-05f224bd99cb could not be found. Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.781533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b207b4be-c0cc-4c09-b40e-05f224bd99cb could not be found. Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5cb8c8c-664a-484c-ab1a-e22f9214babe tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance b207b4be-c0cc-4c09-b40e-05f224bd99cb could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5cb8c8c-664a-484c-ab1a-e22f9214babe tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/b207b4be-c0cc-4c09-b40e-05f224bd99cb/action" status: 404 len: 111 microversion: 2.1 time: 0.013486 Oct 12 23:09:22.786597 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3025/6146] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:22 2022] POST /compute/v2.1/servers/b207b4be-c0cc-4c09-b40e-05f224bd99cb/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:22.791581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:22.792268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:22.799418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.800043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.800638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.801436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:22.801858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:22.802296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:22.967555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:22.978190 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-563babd8-4050-43be-872e-1ff75c5ebaed tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.190413 Oct 12 23:09:22.979302 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3122/6147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:22 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:23.006561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:23.007182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:23.014142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.014643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.015127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.015833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.016316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.016928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.175443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:23.185645 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2094fd95-b805-4050-9f37-eab1470b49ef tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.182933 Oct 12 23:09:23.187132 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3026/6148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:23 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:23.210455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:23.211080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:23.219834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.220596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.221267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.222177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.222838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.223690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.249507 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Cannot 'unshelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action HTTP/1.1 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 18 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: {"unshelve": null} Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: exception: Cannot 'unshelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'unshelve': None}} Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 in vm_state active. Cannot unshelve while the instance is in this state. Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 23:09:23.251817 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 409 to user: Cannot 'unshelve' instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 while it is in vm_state active {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:23.255534 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bbf6558c-3802-455f-922f-46dd4a22df5b tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action" status: 409 len: 146 microversion: 2.1 time: 0.046645 Oct 12 23:09:23.257371 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3123/6149] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:09:23 2022] POST /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9/action => generated 146 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 23:09:23.266177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:23.266177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:23.270630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.271121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.271555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.272776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.273559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.273992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.450902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:23.459377 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b765acf-b641-49ac-b143-eb0c8723c6f9 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.201292 Oct 12 23:09:23.460432 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3027/6150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:23 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:23.489410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:23.491491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:23.497237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.498178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.498825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.500402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.500586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.500989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.666177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:23.682264 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-641b7acb-e791-4ab4-9e95-f93309e8a05c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.196759 Oct 12 23:09:23.684591 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3124/6151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:23 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:23.706991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9db9a197-7cf0-4863-bf57-fbbd02b89474 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-423331705_updated"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:23.709799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9db9a197-7cf0-4863-bf57-fbbd02b89474 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: ea0143f6-e1ee-4ba0-ab32-93df70357d5a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:23.715963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9db9a197-7cf0-4863-bf57-fbbd02b89474 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance ea0143f6-e1ee-4ba0-ab32-93df70357d5a could not be found. Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9db9a197-7cf0-4863-bf57-fbbd02b89474 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/servers/ea0143f6-e1ee-4ba0-ab32-93df70357d5a HTTP/1.1 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 80 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-423331705_updated"}} Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance ea0143f6-e1ee-4ba0-ab32-93df70357d5a could not be found. Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ea0143f6-e1ee-4ba0-ab32-93df70357d5a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-423331705_updated'}}} Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0143f6-e1ee-4ba0-ab32-93df70357d5a could not be found. Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 12 23:09:23.717846 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0143f6-e1ee-4ba0-ab32-93df70357d5a could not be found. Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0143f6-e1ee-4ba0-ab32-93df70357d5a could not be found. Oct 12 23:09:23.721867 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:23.724141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9db9a197-7cf0-4863-bf57-fbbd02b89474 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance ea0143f6-e1ee-4ba0-ab32-93df70357d5a could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:23.725188 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9db9a197-7cf0-4863-bf57-fbbd02b89474 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "PUT /compute/v2.1/servers/ea0143f6-e1ee-4ba0-ab32-93df70357d5a" status: 404 len: 111 microversion: 2.1 time: 0.022759 Oct 12 23:09:23.734655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:23.735493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:23.740306 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3028/6152] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 23:09:23 2022] PUT /compute/v2.1/servers/ea0143f6-e1ee-4ba0-ab32-93df70357d5a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:23.742472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.743133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.743739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.744707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:23.745331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:23.745925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:23.951394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:23.965105 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26b62f5e-040a-43e2-a4ca-34248a78d21f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.234323 Oct 12 23:09:23.965690 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3125/6153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:23 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:23.993072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:23.993833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:24.001946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.002670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.003203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:24.004006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.004538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.005044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:24.146695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:24.156923 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aac9cbdc-1dcc-4e66-a8d2-1b7a5ceaee29 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.170455 Oct 12 23:09:24.157590 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3029/6154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:23 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:24.180623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f638ce71-fd76-4e91-b426-57e68d548c76 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f638ce71-fd76-4e91-b426-57e68d548c76 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: request: PUT /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 HTTP/1.1 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 280 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.184535 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f638ce71-fd76-4e91-b426-57e68d548c76 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f638ce71-fd76-4e91-b426-57e68d548c76 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "PUT /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 400 len: 619 microversion: 2.1 time: 0.009434 Oct 12 23:09:24.187813 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3126/6155] 10.222.0.20 () {60 vars in 1257 bytes} [Wed Oct 12 23:09:24 2022] PUT /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:09:24.198625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:24.199336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:24.206046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.206480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.206922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:24.207616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.208231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.208839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:24.360617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:24.369646 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93431b47-6e61-4022-85bb-a929211d0680 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.174973 Oct 12 23:09:24.370252 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3030/6156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:24 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:24.394220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:24.395501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:24.673946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.674454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.674917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:24.675642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.676144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.676586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:24.874656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:24.884814 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f1c1724-4b45-41d0-93ab-69adf34ba3da tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.495301 Oct 12 23:09:24.897769 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3127/6157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:24 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:24.911276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cc21f13-cf80-4324-89cc-e97b783de8c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cc21f13-cf80-4324-89cc-e97b783de8c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: request: PUT /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 HTTP/1.1 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 24 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: {"server": {"name": ""}} Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9', 'body': {'server': {'name': ''}}} Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '' Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:09:24.916185 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 23:09:24.920072 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:24.921979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cc21f13-cf80-4324-89cc-e97b783de8c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:24.924406 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8cc21f13-cf80-4324-89cc-e97b783de8c7 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "PUT /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 400 len: 108 microversion: 2.1 time: 0.016772 Oct 12 23:09:24.927923 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3031/6158] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 23:09:24 2022] PUT /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:09:24.933408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:24.934305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:24.941968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.942824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.943461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:24.944589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:24.945234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:24.945860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:25.132731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:25.143342 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b29089b-aca6-45d8-836c-afd4289ea637 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1506 microversion: 2.1 time: 0.213975 Oct 12 23:09:25.144024 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3128/6159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:24 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:31.088255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-972683f3-3702-4c85-ae87-6d39d3e0d2e4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: .version_select at 0x7f44fe5d9af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2072289255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuhSqDc6mPBQJLdQ39ul08MeL1k02hiSHqo2ve9VnMNbgFeKW75f+jKl4zW8qR8NyG/+o5a5Iv5qFRNAFgx5qr3UpuZFl0Sn1OytQQLXMGXQ7i+IBmI5ysxmSMjj88C+A=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:31.106363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-972683f3-3702-4c85-ae87-6d39d3e0d2e4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:09:31.111643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-972683f3-3702-4c85-ae87-6d39d3e0d2e4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:09:31.142130 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-972683f3-3702-4c85-ae87-6d39d3e0d2e4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.275817 Oct 12 23:09:31.143198 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3032/6160] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:09:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:32.052053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:32.053117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:32.062689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.063453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.064084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.064944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.065559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.066144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.085227 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 HTTP/1.1 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '349a37c0-4f44-4ee7-9eae-f70a3283a153'} Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:32.087367 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.091774 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.094694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:32.095858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6300ea71-855a-42af-b388-5afb90025bcb tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 404 len: 111 microversion: 2.1 time: 0.048764 Oct 12 23:09:32.097059 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3129/6161] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:09:32 2022] DELETE /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:32.106611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:32.107829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 349a37c0-4f44-4ee7-9eae-f70a3283a153] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:32.116037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.116842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.117464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.118388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.119162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.119768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.135924 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 HTTP/1.1 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '349a37c0-4f44-4ee7-9eae-f70a3283a153'} Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:32.137944 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.141771 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:32.141771 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:32.141771 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:32.141771 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:32.141771 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:32.141771 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. Oct 12 23:09:32.141771 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:32.143708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 349a37c0-4f44-4ee7-9eae-f70a3283a153 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:32.145471 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8ca37da-b25b-40ba-94c1-c4705f85cc3c tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153" status: 404 len: 111 microversion: 2.1 time: 0.044349 Oct 12 23:09:32.146228 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3033/6162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:32 2022] GET /compute/v2.1/servers/349a37c0-4f44-4ee7-9eae-f70a3283a153 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:09:32.156978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:32.157873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:32.166366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.167127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.168024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.169226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.170055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.171453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.205133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:09:32.316913 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13a77042-935b-4456-a9bb-8236e405b000 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 204 len: 0 microversion: 2.1 time: 0.165584 Oct 12 23:09:32.326384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:32.327559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:32.330670 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3130/6163] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:09:32 2022] DELETE /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:09:32.334284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.335104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.336272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.337820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:32.338455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:32.339042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:32.540895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:32.549062 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1fdff94f-32c7-488a-a7d5-c984ab81a39f tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.226877 Oct 12 23:09:32.549715 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3034/6164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:32 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:33.574322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:33.575688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:33.582885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:33.583671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:33.584387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:33.585338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:33.585997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:33.586624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:33.822793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:33.833243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e5ccaad-f593-468a-89c7-280efa72c660 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1512 microversion: 2.1 time: 0.263067 Oct 12 23:09:33.839987 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3131/6165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:33 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:34.868725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:34.869517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:34.870084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3a1b5dcd-257a-4b30-9f45-ba7348680ad1 req-efe84c0c-565f-4ce0-9ea6-81b47a9305f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e73501-56e3-467d-bc6c-7d3cc8b2fdb9", "name": "network-vif-deleted", "tag": "df38ff8b-1402-4b70-898d-1d22b23f3563"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:34.878208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:34.879929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:34.888249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:34.888958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a1b5dcd-257a-4b30-9f45-ba7348680ad1 req-efe84c0c-565f-4ce0-9ea6-81b47a9305f8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:34.890166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:34.891126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:34.891678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a1b5dcd-257a-4b30-9f45-ba7348680ad1 req-efe84c0c-565f-4ce0-9ea6-81b47a9305f8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:34.892181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:34.893177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a1b5dcd-257a-4b30-9f45-ba7348680ad1 req-efe84c0c-565f-4ce0-9ea6-81b47a9305f8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:34.922662 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3a1b5dcd-257a-4b30-9f45-ba7348680ad1 req-efe84c0c-565f-4ce0-9ea6-81b47a9305f8 service nova] Creating event network-vif-deleted:df38ff8b-1402-4b70-898d-1d22b23f3563 for instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 on n-h2-860864-8 Oct 12 23:09:34.939493 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3a1b5dcd-257a-4b30-9f45-ba7348680ad1 req-efe84c0c-565f-4ce0-9ea6-81b47a9305f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076177 Oct 12 23:09:34.943465 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3035/6166] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:35.080942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3630aae639ad4eb59bc97ebfc9cf37c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be22a05172f4fcd88208aa1882db9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:35.092984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a7f2b74-ce39-4b5e-a319-ba39120ee268 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 200 len: 1470 microversion: 2.1 time: 0.230808 Oct 12 23:09:35.094041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3132/6167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:34 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:36.120415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:36.121748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] [instance: 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:36.129172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:36.129873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:36.130487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:36.131358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:36.131984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:36.132558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:36.146553 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] HTTP exception thrown: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 could not be found. Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Request method failure captured: Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 HTTP/1.1 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0icvQzY6A8686lP_O1cGVDJUCxNCohEjB2TdaOV7ulJMnBE38iiLwuDRtwJz4HppVjM2nmZ3GYqjno7FBhxDFog9NTZ-ypiqLtEx1pkjX4D7b-jq6KR9JIG8OQWm33iutnL-ZFKxHKB3v_f5T3wV4-z09xNdyjsobh3Cs9FbKZufHI Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6be22a05172f4fcd88208aa1882db9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6be22a05172f4fcd88208aa1882db9e1"}]}] Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6be22a05172f4fcd88208aa1882db9e1 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-187512762 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 3630aae639ad4eb59bc97ebfc9cf37c4 Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-187512762-project Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 could not be found. Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '04e73501-56e3-467d-bc6c-7d3cc8b2fdb9'} Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 could not be found. Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 could not be found. Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:09:36.148546 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:36.152749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:09:36.152749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:09:36.152749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:09:36.152749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:09:36.152749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:09:36.152749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 could not be found. Oct 12 23:09:36.152749 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:09:36.154659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] Returning 404 to user: Instance 04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:09:36.155718 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1158d79d-86b2-4542-8a4c-99fe5a102b74 tempest-ServersNegativeTestJSON-187512762 tempest-ServersNegativeTestJSON-187512762-project] 10.222.0.20 "GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9" status: 404 len: 111 microversion: 2.1 time: 0.041505 Oct 12 23:09:36.168543 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3036/6168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:36 2022] GET /compute/v2.1/servers/04e73501-56e3-467d-bc6c-7d3cc8b2fdb9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:09:40.379028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1373308701", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d3db3ac8-3d8d-4405-9e24-f9228953a9a1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2072289255", "security_groups": [{"name": "tempest-secgroup-smoke-1518750558"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:40.409442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:40.637173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] validate_networks() for [('d3db3ac8-3d8d-4405-9e24-f9228953a9a1', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:09:41.408079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:09:41.412227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:09:41.413083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:09:41.415588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:09:41.419770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:09:41.447412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:41.460727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:41.461412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:41.464540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:41.465440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:41.466083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:41.512153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:09:41.526000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:09:41.555606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:09:41.559874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:09:41.628167 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4d72c6b-e11e-4570-9f58-e689f36d304d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.253417 Oct 12 23:09:41.636664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3133/6169] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:09:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:09:41.649366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-96ff9da6-4bc4-40a9-a4f6-8021987943b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:41.650121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-96ff9da6-4bc4-40a9-a4f6-8021987943b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:41.653842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:41.660076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:41.819935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-96ff9da6-4bc4-40a9-a4f6-8021987943b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:41.832196 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-96ff9da6-4bc4-40a9-a4f6-8021987943b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1267 microversion: 2.1 time: 0.184844 Oct 12 23:09:41.833274 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3037/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:41 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:42.857326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:42.858537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:42.870292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:42.872345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:42.873027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:42.874000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:42.874958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:42.875571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:42.970138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:42.979544 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c8de91ba-c3ad-4148-94c8-1f73310228f4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1319 microversion: 2.1 time: 0.125986 Oct 12 23:09:42.980673 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3134/6171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:42 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1319 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:44.003354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:44.004014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:44.011854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:44.012630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:44.013324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:44.014249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:44.014868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:44.015458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:44.047307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:44.274143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:44.285906 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2da5878e-f9f6-4483-b966-ba7bc6f5ca54 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1393 microversion: 2.1 time: 0.286606 Oct 12 23:09:44.286536 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3038/6172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:43 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1393 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:45.313851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:45.315995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:45.331137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-864d8ddf-b1fd-45ed-9dc8-db8b3ae4d361 req-9ffec725-99f6-43a5-a0c6-59528d23037d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:45.354469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:45.354698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-864d8ddf-b1fd-45ed-9dc8-db8b3ae4d361 req-9ffec725-99f6-43a5-a0c6-59528d23037d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:45.355161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-864d8ddf-b1fd-45ed-9dc8-db8b3ae4d361 req-9ffec725-99f6-43a5-a0c6-59528d23037d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:45.355596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-864d8ddf-b1fd-45ed-9dc8-db8b3ae4d361 req-9ffec725-99f6-43a5-a0c6-59528d23037d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:45.356120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:45.357153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:45.358994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:45.360104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:45.360973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:45.399666 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-864d8ddf-b1fd-45ed-9dc8-db8b3ae4d361 req-9ffec725-99f6-43a5-a0c6-59528d23037d service nova] Creating event network-changed:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h1-860864-8 Oct 12 23:09:45.409203 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-864d8ddf-b1fd-45ed-9dc8-db8b3ae4d361 req-9ffec725-99f6-43a5-a0c6-59528d23037d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081672 Oct 12 23:09:45.410170 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3039/6173] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:45.690664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:45.699128 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d8cd3347-c2ef-4296-8b09-b2dc4090e130 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1393 microversion: 2.1 time: 0.393568 Oct 12 23:09:45.699718 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3135/6174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:45 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1393 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:46.734970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:46.735688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:46.743595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:46.753000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:46.753884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:46.755368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:46.756461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:46.757407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:47.172093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:47.180801 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04bd8da4-5a1c-49d4-95a2-314b1ebeda7d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1393 microversion: 2.1 time: 0.452952 Oct 12 23:09:47.184719 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3040/6175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:46 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1393 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:48.218107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:48.219400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:48.227529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:48.233460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:48.233936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:48.234693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:48.235165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:48.235605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:48.913085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:48.940243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b03b4da-a576-4e34-9f8a-9625e813dda0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1393 microversion: 2.1 time: 0.723372 Oct 12 23:09:48.942153 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3136/6176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:48 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1393 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:49.871039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4dc0fea-689e-4af9-a9c5-cb42afc44703 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: .version_select at 0x7f44fe5c6b80>, body: {"keypair": {"name": "tempest-keypair-211674502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs3offawQUIhy9ORJ/F058cXjsKcbpgiyuFP7IJLIWjrMqXZrAkL9H/pdm8HUierlv0DINIM0K63Z8QcCPY3oaSfh922q+Vo0cZhXc4XXxZ0jymfuy06yLpDK6s+bVw0g=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:49.887945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e4dc0fea-689e-4af9-a9c5-cb42afc44703 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:09:49.895164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e4dc0fea-689e-4af9-a9c5-cb42afc44703 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:09:49.921419 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4dc0fea-689e-4af9-a9c5-cb42afc44703 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253579 Oct 12 23:09:49.922031 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3041/6177] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:09:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:49.969119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:49.969895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:49.984166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:49.987654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:49.988592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:49.989592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:49.990480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:49.991135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:50.252061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:50.254404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:50.267563 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-598772f6-765d-44f7-9414-4ba4ca72e222 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1393 microversion: 2.1 time: 0.302654 Oct 12 23:09:50.269871 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3137/6178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:49 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1393 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:50.381836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a3aaad57-2bc8-4e09-81be-361e4fd9560e req-f7dcc383-77d3-4576-8431-08ca60c17268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "name": "network-vif-plugged", "status": "completed", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:50.398733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a3aaad57-2bc8-4e09-81be-361e4fd9560e req-f7dcc383-77d3-4576-8431-08ca60c17268 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:50.399222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a3aaad57-2bc8-4e09-81be-361e4fd9560e req-f7dcc383-77d3-4576-8431-08ca60c17268 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:50.399683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a3aaad57-2bc8-4e09-81be-361e4fd9560e req-f7dcc383-77d3-4576-8431-08ca60c17268 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:50.416384 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a3aaad57-2bc8-4e09-81be-361e4fd9560e req-f7dcc383-77d3-4576-8431-08ca60c17268 service nova] Creating event network-vif-plugged:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h1-860864-8 Oct 12 23:09:50.422681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a3aaad57-2bc8-4e09-81be-361e4fd9560e req-f7dcc383-77d3-4576-8431-08ca60c17268 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044490 Oct 12 23:09:50.423717 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3042/6179] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:51.292835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:51.294099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:51.305299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:51.306163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:51.306942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:51.307883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:51.308530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:51.309333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:51.491843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:51.541567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:09:51.581807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:51.605098 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dd8e117b-e862-4f4e-848b-589bcfc84439 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1393 microversion: 2.1 time: 0.316253 Oct 12 23:09:51.627865 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3138/6180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:51 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1393 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:51.759382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1070132740", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97e12d6e-78cf-47d7-bedb-c663c72a095d"}], "security_groups": [{"name": "tempest-securitygroup--427043116"}], "key_name": "tempest-keypair-211674502", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:51.880121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] validate_networks() for [('97e12d6e-78cf-47d7-bedb-c663c72a095d', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:09:52.278152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:09:52.279113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:09:52.279591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:09:52.280026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:09:52.280441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:09:52.289271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:52.289751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:52.290191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:52.290937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:52.291372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:52.291799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:52.310735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:09:52.319109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:09:52.334651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:09:52.337226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:09:52.384703 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [f8c3a805-1bc8-4bb5-81e3-45c080c71e92] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:09:52.634439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:52.635925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:52.644077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:52.644684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:52.645222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:52.646088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:52.646669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:52.647208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:52.796128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:52.805477 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8af6e44-9181-41ff-90fc-41c9d97e6e47 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1564 microversion: 2.1 time: 0.175258 Oct 12 23:09:52.806165 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3139/6181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:52 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:52.829047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:52.829674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:52.835803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:52.836338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:52.836810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:52.837502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:52.837968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:52.838403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:52.976541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:52.985490 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44d9403e-40d7-4fff-b262-e6fdc197b3e2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1564 microversion: 2.1 time: 0.160460 Oct 12 23:09:52.986075 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3140/6182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:52 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:09:53.394069 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [f8c3a805-1bc8-4bb5-81e3-45c080c71e92] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53982. Oct 12 23:09:53.399656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd47b4f9-e297-49da-83f7-923b6ab004a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.645999 Oct 12 23:09:53.400625 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3043/6183] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:09:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:09:53.413260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-200d5690-dd18-4f68-8e3e-62267307a782 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:53.414028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-200d5690-dd18-4f68-8e3e-62267307a782 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:53.501909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-200d5690-dd18-4f68-8e3e-62267307a782 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:53.513846 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-200d5690-dd18-4f68-8e3e-62267307a782 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1241 microversion: 2.1 time: 0.104482 Oct 12 23:09:53.514515 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3141/6184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:53 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:54.539161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:54.539695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:54.561594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:54.562125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:54.562785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:54.564665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:54.565395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:54.566162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:54.658812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:54.683987 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2302ddc4-72e2-4f1f-ace7-e129ecc8f164 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1293 microversion: 2.1 time: 0.141882 Oct 12 23:09:54.683987 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3044/6185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:54 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:54.936452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:54.937065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:54.946311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-830f1423-4659-434f-bbc9-90dc5b2434f2 req-162f32e1-ad1d-4922-865e-de69a94e5d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:54.959228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:54.961601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-830f1423-4659-434f-bbc9-90dc5b2434f2 req-162f32e1-ad1d-4922-865e-de69a94e5d9e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:54.962347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:54.962983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:54.963635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-830f1423-4659-434f-bbc9-90dc5b2434f2 req-162f32e1-ad1d-4922-865e-de69a94e5d9e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:54.965602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-830f1423-4659-434f-bbc9-90dc5b2434f2 req-162f32e1-ad1d-4922-865e-de69a94e5d9e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:54.965943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:54.966603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:54.969475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:54.995506 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-830f1423-4659-434f-bbc9-90dc5b2434f2 req-162f32e1-ad1d-4922-865e-de69a94e5d9e service nova] Creating event network-changed:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h1-860864-8 Oct 12 23:09:55.012592 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-830f1423-4659-434f-bbc9-90dc5b2434f2 req-162f32e1-ad1d-4922-865e-de69a94e5d9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065555 Oct 12 23:09:55.013792 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3045/6186] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:09:55.205481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:55.219702 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5cac0a9d-5f9a-476f-8fc4-a8302f6ae50c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1564 microversion: 2.1 time: 0.283638 Oct 12 23:09:55.228579 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3142/6187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:54 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1564 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:55.702402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:55.703740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:55.720174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:55.722821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:55.724920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:55.727989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:55.728767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:55.729631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:55.869895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:55.878537 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3ded73fe-0484-43db-af0b-f57c6ff7b89a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1299 microversion: 2.1 time: 0.181238 Oct 12 23:09:55.892096 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3046/6188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:55 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:56.904787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:56.905999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:56.913148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:56.913649 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:56.914394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:56.915188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:56.915586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:56.916253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:57.053225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c08b0ddc-a3cb-40ec-ac45-57add69da787 req-fd7aa557-67a8-470b-8364-d9eba536c84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87133479-3c6e-4e0a-88bd-ff34f03cb6f2", "tag": "58ebc09a-db44-442b-8df9-9ec6b8f37f16"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:09:57.064713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c08b0ddc-a3cb-40ec-ac45-57add69da787 req-fd7aa557-67a8-470b-8364-d9eba536c84b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:57.070688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c08b0ddc-a3cb-40ec-ac45-57add69da787 req-fd7aa557-67a8-470b-8364-d9eba536c84b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:57.071339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c08b0ddc-a3cb-40ec-ac45-57add69da787 req-fd7aa557-67a8-470b-8364-d9eba536c84b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:57.084251 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c08b0ddc-a3cb-40ec-ac45-57add69da787 req-fd7aa557-67a8-470b-8364-d9eba536c84b service nova] Creating event network-changed:58ebc09a-db44-442b-8df9-9ec6b8f37f16 for instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 on n-h2-860864-8 Oct 12 23:09:57.089105 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c08b0ddc-a3cb-40ec-ac45-57add69da787 req-fd7aa557-67a8-470b-8364-d9eba536c84b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040772 Oct 12 23:09:57.090017 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3047/6189] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:09:57.188294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:57.197406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8e8e023-2f24-4f9e-9464-5667eca91112 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1366 microversion: 2.1 time: 0.297384 Oct 12 23:09:57.197988 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3143/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:56 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:58.221268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:58.222141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:58.231720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:58.232301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:58.232897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:58.233676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:58.234192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:58.234679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:58.377026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:58.385354 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e5e60777-4ae7-4dcd-881b-330ddf66d326 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1366 microversion: 2.1 time: 0.168228 Oct 12 23:09:58.386066 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3048/6191] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:58 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:09:59.409570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:09:59.410216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:09:59.417508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:59.418031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:59.418481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:59.419195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:09:59.419658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:09:59.420168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:09:59.553378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:09:59.561562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-084150c4-5b29-4afd-9eed-76981bc1a8ff tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1366 microversion: 2.1 time: 0.156043 Oct 12 23:09:59.562134 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3144/6192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:09:59 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:00.585107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:00.585755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:00.593151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:00.593633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:00.594067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:00.594744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:00.595192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:00.595618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:00.728287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:00.735978 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-417677fa-e4dd-4041-8f13-58ea9965be9f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1366 microversion: 2.1 time: 0.154737 Oct 12 23:10:00.736547 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3049/6193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:00 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:01.758703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:01.760034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:01.766965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:01.767470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:01.767948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:01.768699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:01.769135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:01.769707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:01.914929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:01.924705 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9964d003-3132-47d6-9683-6990d99ee90a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1366 microversion: 2.1 time: 0.169964 Oct 12 23:10:01.925296 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3145/6194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:01 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:02.948957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:02.950324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:02.954248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:02.955129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:02.963257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:02.964598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:02.965641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:02.966560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:02.967807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:02.968447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:03.046868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5c814379-d431-45c2-a918-6bef052783a9 req-6dec7aa2-8703-4b04-8c21-e9e999db40a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87133479-3c6e-4e0a-88bd-ff34f03cb6f2", "name": "network-vif-plugged", "status": "completed", "tag": "58ebc09a-db44-442b-8df9-9ec6b8f37f16"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:03.060664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5c814379-d431-45c2-a918-6bef052783a9 req-6dec7aa2-8703-4b04-8c21-e9e999db40a1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:03.061421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5c814379-d431-45c2-a918-6bef052783a9 req-6dec7aa2-8703-4b04-8c21-e9e999db40a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:03.062023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5c814379-d431-45c2-a918-6bef052783a9 req-6dec7aa2-8703-4b04-8c21-e9e999db40a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:03.073741 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5c814379-d431-45c2-a918-6bef052783a9 req-6dec7aa2-8703-4b04-8c21-e9e999db40a1 service nova] Creating event network-vif-plugged:58ebc09a-db44-442b-8df9-9ec6b8f37f16 for instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 on n-h2-860864-8 Oct 12 23:10:03.082041 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5c814379-d431-45c2-a918-6bef052783a9 req-6dec7aa2-8703-4b04-8c21-e9e999db40a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040164 Oct 12 23:10:03.082879 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3146/6195] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:03.146524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:03.156743 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75a549b4-7f28-45e2-89e6-d45e372b63e4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1366 microversion: 2.1 time: 0.211912 Oct 12 23:10:03.157371 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3050/6196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:02 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:04.177255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:04.182339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:04.183067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:04.190171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:04.190682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:04.191138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:04.191853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:04.192370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:04.192810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:04.339507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:04.364350 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2819ebf2-1db5-4d03-bfa5-f8e3ac3d4e66 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1366 microversion: 2.1 time: 0.187473 Oct 12 23:10:04.364982 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3147/6197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:04 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:05.388140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:05.388907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:05.396820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:05.397302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:05.397734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:05.398416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:05.399863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:05.400476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:05.889110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:05.896897 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fbb4888e-2b87-4010-a276-f4859ac8bea7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1556 microversion: 2.1 time: 0.513301 Oct 12 23:10:05.897470 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3051/6198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:05 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1556 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:05.925242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:05.926092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:05.932751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:05.933245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:05.933692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:05.934955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:05.935420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:05.935855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:06.014981 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f3d0d9d-016a-434c-8a0a-9dfb38708687 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095567 Oct 12 23:10:06.015588 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3148/6199] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:10:05 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:06.976283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-21073622-5ddf-46d8-8862-65633798a99c req-2b948564-9e72-414b-a00a-ad53e4cb9889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87133479-3c6e-4e0a-88bd-ff34f03cb6f2", "tag": "58ebc09a-db44-442b-8df9-9ec6b8f37f16"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:06.987774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-21073622-5ddf-46d8-8862-65633798a99c req-2b948564-9e72-414b-a00a-ad53e4cb9889 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:06.988288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-21073622-5ddf-46d8-8862-65633798a99c req-2b948564-9e72-414b-a00a-ad53e4cb9889 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:06.988716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-21073622-5ddf-46d8-8862-65633798a99c req-2b948564-9e72-414b-a00a-ad53e4cb9889 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:07.000667 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-21073622-5ddf-46d8-8862-65633798a99c req-2b948564-9e72-414b-a00a-ad53e4cb9889 service nova] Creating event network-changed:58ebc09a-db44-442b-8df9-9ec6b8f37f16 for instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 on n-h2-860864-8 Oct 12 23:10:07.005827 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-21073622-5ddf-46d8-8862-65633798a99c req-2b948564-9e72-414b-a00a-ad53e4cb9889 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033065 Oct 12 23:10:07.006591 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3052/6200] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:16.945153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:16.945910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=55 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:16.949902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:16.952183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:16.959541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:16.960054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:16.960497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:16.961194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:16.961658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:16.962088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:17.017653 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2dfbed1d-e152-443f-a56f-e4925955f898 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action" status: 200 len: 24567 microversion: 2.1 time: 0.074091 Oct 12 23:10:17.018297 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3149/6201] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:10:16 2022] POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:10:28.010055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:28.010831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=57 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:28.015775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:28.016505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:28.024602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.025083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.025524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.026228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.026688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.027090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.261722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4628668e-bdd3-4c01-bb13-dec935101cdc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1833 microversion: 2.1 time: 0.253438 Oct 12 23:10:28.262453 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3053/6202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:28 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1833 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:28.285656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:28.286373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:28.289078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:28.289743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:28.296509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.297007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.297454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.298152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.298624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.299056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.437373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:28.445219 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb0b9de8-775f-4844-a91b-9a2000938b3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1682 microversion: 2.1 time: 0.164120 Oct 12 23:10:28.445783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3150/6203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:28 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:28.545582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:28.547811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:28.553857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.554333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.554761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.555442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.555901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.556334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.609482 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4064d02-0968-485b-ba08-a2311d0d6215 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action" status: 200 len: 32639 microversion: 2.1 time: 0.068166 Oct 12 23:10:28.610164 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3054/6204] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:10:28 2022] POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action => generated 32639 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:10:28.773258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:28.773885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:28.781647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.782142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.782581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.783288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:28.784223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:28.784658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:28.824227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bed030a1b645490e9a3560a4e2e42791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f036844eb54e5590faab59eb8c44ce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:28.825368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] flavor_id is None. Assuming migration. {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 23:10:28.825863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:10:29.067174 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80daa1f3-86f1-41d4-bf2e-46736fba5df8 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action" status: 202 len: 0 microversion: 2.1 time: 0.297652 Oct 12 23:10:29.068192 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3151/6205] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:10:28 2022] POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:10:29.077257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:29.078083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:29.086885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:29.087638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:29.088162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:29.088900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:29.089352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:29.089779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:29.244911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:29.255658 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d101d043-611c-4295-9d47-623c168b23e1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1691 microversion: 2.1 time: 0.183373 Oct 12 23:10:29.256260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3055/6206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:29 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:10:30.281435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:30.282066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:30.288381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:30.288882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:30.289334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:30.290138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:30.290607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:30.291045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:30.438597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:30.446550 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a973142a-fad7-462d-aea7-2b7515c88156 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1691 microversion: 2.1 time: 0.170058 Oct 12 23:10:30.447439 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3152/6207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:30 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:31.470334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:31.470877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:31.477853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:31.478340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:31.478778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:31.479475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:31.479986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:31.480446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:31.617639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:31.626323 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a66e2c0f-6b85-409c-bb43-4c03cf1e0bd7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.160023 Oct 12 23:10:31.626869 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3056/6208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:31 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:32.650629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:32.651376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:32.659087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:32.659599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:32.660087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:32.660815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:32.661290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:32.661732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:32.799104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:32.807120 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9fe1008b-d4fb-4fc5-8a80-128b4d8c8b7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.160431 Oct 12 23:10:32.807695 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3153/6209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:32 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:33.831077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:33.831691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:33.838751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:33.839232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:33.839668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:33.840488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:33.840939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:33.841361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:33.974205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:33.982288 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ff4598eb-214d-4d36-aca7-ac8e7923ee14 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.155081 Oct 12 23:10:33.991920 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3057/6210] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:33 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:35.006653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:35.007293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:35.009482 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:10:35.009633 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 (ip 10.222.0.20) !!! Oct 12 23:10:35.017362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:35.018070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:35.018631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:35.019232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:35.019704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:35.020171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:35.157756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:35.165851 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-586898b3-19c2-4dea-a795-47d7651bce49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.163203 Oct 12 23:10:35.166425 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3154/6211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:35 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:36.191252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:36.192342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:36.198849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:36.199919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:36.200350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:36.201056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:36.201489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:36.201913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:36.337716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:36.346199 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79d77069-8ca0-4922-857a-654776eb84b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.159314 Oct 12 23:10:36.347126 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3058/6212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:36 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:37.371041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:37.371789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:37.379438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:37.380279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:37.380843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:37.381638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:37.382195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:37.382713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:37.521660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:37.529628 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b5d5f3da-4ed7-4e21-9634-f407a02d538a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.162677 Oct 12 23:10:37.530209 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3155/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:37 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:38.553241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:38.553858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:38.561642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:38.562126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:38.562569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:38.563259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:38.563716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:38.564174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:38.703487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:38.711514 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-22650801-9c5b-4eae-a001-d4064ce485af tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.162166 Oct 12 23:10:38.712137 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3059/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:38 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:39.735363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:39.736025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:39.743130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:39.743633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:39.744117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:39.744837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:39.745309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:39.745758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:40.079065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:40.088658 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71696422-ef33-407f-ac20-a63a05356c1b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.357149 Oct 12 23:10:40.089225 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3156/6215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:39 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:41.112350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:41.113125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:41.121506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:41.122284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:41.123446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:41.124389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:41.124937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:41.125472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:41.288204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:41.290315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:41.296513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:41.309119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:41.309839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:41.310290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:41.312638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:41.313471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:41.314103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:41.314891 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77017174-aa65-4120-8111-5daa7a04088d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.206408 Oct 12 23:10:41.315638 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3060/6216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:41 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:41.345441 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99472354-570d-414c-bde9-56fdc8f55dba tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/ips" status: 200 len: 149 microversion: 2.1 time: 0.063468 Oct 12 23:10:41.346035 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3157/6217] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:10:41 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:42.341792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:42.342424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:42.351508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:42.352770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:42.353278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:42.354228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:42.354928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:42.355495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:42.511966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:42.521007 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-301f1f55-b440-427f-b419-3bd816065de5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.183801 Oct 12 23:10:42.522013 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3061/6218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:42 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:42.734927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efed02a9-5629-403c-aec7-26d3da47ee7a"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:42.737624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:42.744834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:42.745333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:42.746286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:42.746991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:42.747742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:42.748242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:43.001519 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4cc63e4-4c4b-41bd-8eb8-dd20a2bc6981 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270408 Oct 12 23:10:43.002333 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3158/6219] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:10:42 2022] POST /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:43.545431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:43.546655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:43.553947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:43.554439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:43.554881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:43.555574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:43.556060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:43.556489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:43.694406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:43.702415 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-adfaa713-7aa2-40e1-b136-5f5c1a727572 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.161427 Oct 12 23:10:43.703079 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3062/6220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:43 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:44.729198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:44.730373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:44.749023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:44.749810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:44.750433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:44.751339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:44.753567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:44.754242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:44.927441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:44.936188 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ca008f3-43d2-4282-8e4d-e5dbd41da0a6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.212510 Oct 12 23:10:44.937028 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3159/6221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:44 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:45.958801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:45.959360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:45.968229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:45.968722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:45.969248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:45.969956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:45.970658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:45.971086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:46.307287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:46.316196 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01bc2b60-1576-4208-9958-194f800571e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.361302 Oct 12 23:10:46.316869 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3063/6222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:45 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:10:47.338527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:47.339813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:47.346896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:47.347465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:47.347997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:47.348773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:47.349311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:47.349801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:47.486806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:47.494725 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fcf8140b-39c0-4149-9c34-e7fca6c9449a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1696 microversion: 2.1 time: 0.160063 Oct 12 23:10:47.495295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3160/6223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:47 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:48.518175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:48.518831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:48.525515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:48.525991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:48.526459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:48.527158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:48.527595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:48.528071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:48.672263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:48.680126 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1cb0fb9-9901-4281-aa72-95306d82a1b5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1695 microversion: 2.1 time: 0.165688 Oct 12 23:10:48.680955 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3064/6224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:48 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:48.707397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-426c2538-dc4f-45cb-8eb9-e0edf55c2470 req-5af14e34-3eb5-4772-8b50-fb4440abdb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "name": "network-vif-unplugged", "status": "completed", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:48.718460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-426c2538-dc4f-45cb-8eb9-e0edf55c2470 req-5af14e34-3eb5-4772-8b50-fb4440abdb30 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:48.719235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-426c2538-dc4f-45cb-8eb9-e0edf55c2470 req-5af14e34-3eb5-4772-8b50-fb4440abdb30 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:48.719785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-426c2538-dc4f-45cb-8eb9-e0edf55c2470 req-5af14e34-3eb5-4772-8b50-fb4440abdb30 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:48.732341 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-426c2538-dc4f-45cb-8eb9-e0edf55c2470 req-5af14e34-3eb5-4772-8b50-fb4440abdb30 service nova] Creating event network-vif-unplugged:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h2-860864-8 Oct 12 23:10:48.737927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-426c2538-dc4f-45cb-8eb9-e0edf55c2470 req-5af14e34-3eb5-4772-8b50-fb4440abdb30 service nova] Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:10:48.749663 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-426c2538-dc4f-45cb-8eb9-e0edf55c2470 req-5af14e34-3eb5-4772-8b50-fb4440abdb30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045999 Oct 12 23:10:48.750377 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3161/6225] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:10:49.705171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:49.706030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:49.712863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:49.713353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:49.714290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:49.714980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:49.715434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:49.716016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:49.864434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:49.872738 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1363331c-8f76-47b3-9292-ed3891397886 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1695 microversion: 2.1 time: 0.171261 Oct 12 23:10:49.873550 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3065/6226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:49 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:50.816516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e177a95f-28f7-4347-b854-427f28e13462 req-05b4c062-5c12-4d61-bb60-2cd68f585c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:50.828701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e177a95f-28f7-4347-b854-427f28e13462 req-05b4c062-5c12-4d61-bb60-2cd68f585c56 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:50.829187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e177a95f-28f7-4347-b854-427f28e13462 req-05b4c062-5c12-4d61-bb60-2cd68f585c56 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:50.829635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e177a95f-28f7-4347-b854-427f28e13462 req-05b4c062-5c12-4d61-bb60-2cd68f585c56 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:50.842768 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e177a95f-28f7-4347-b854-427f28e13462 req-05b4c062-5c12-4d61-bb60-2cd68f585c56 service nova] Creating event network-changed:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h2-860864-8 Oct 12 23:10:50.849332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-e177a95f-28f7-4347-b854-427f28e13462 req-05b4c062-5c12-4d61-bb60-2cd68f585c56 service nova] Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:10:50.861416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e177a95f-28f7-4347-b854-427f28e13462 req-05b4c062-5c12-4d61-bb60-2cd68f585c56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049221 Oct 12 23:10:50.862344 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3162/6227] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:10:50.898262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:50.899645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:50.908751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:50.909699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:50.910354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:50.911248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:50.912311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:50.913073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:51.170278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:51.180089 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-48996822-f121-44de-8779-60fb4ba2c707 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1693 microversion: 2.1 time: 0.286481 Oct 12 23:10:51.193603 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3066/6228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:50 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1693 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:52.206197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:52.206817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:52.213153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:52.213657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:52.214134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:52.214823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:52.215292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:52.215926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:52.353030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:52.361372 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b68fe6e6-3674-459b-a167-1ea3cf206a7b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1690 microversion: 2.1 time: 0.160590 Oct 12 23:10:52.361948 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3163/6229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:52 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:52.386683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:52.387217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:52.393998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:52.394478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:52.394912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:52.395593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:52.396080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:52.396501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:52.452700 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f1c709b7-dcaa-4258-bbfe-65dcfe753586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action" status: 204 len: 0 microversion: 2.1 time: 0.069854 Oct 12 23:10:52.453324 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3067/6230] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:10:52 2022] POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:10:52.461588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:52.462163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:52.468769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:52.469396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:52.469952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:52.470732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:52.471231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:52.471740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:52.493693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:52.614549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:52.622874 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d58d8bd-c3e4-48ba-84af-7a0036f6422c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1690 microversion: 2.1 time: 0.165129 Oct 12 23:10:52.623318 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3164/6231] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:52 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:53.652279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:53.654683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:53.665584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:53.672794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:53.673491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:53.674263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:53.674742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:53.675234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:53.822384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a597786-617c-4107-b538-49ef7ca83892 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: .version_select at 0x7f44ff470dc0>, body: {"keypair": {"name": "tempest-keypair-409159933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+wYrARUoG9zZYgbhlxXa+L8HY2Of+GCsy7sbb2Yf48UVJh0QKElugUeUQAdeCivnrO66zwOzgaFNfATRzuUiSGkK3nXNqN6hoPqcBe51qFuFkMIcswA4Yw0X1DFTTD1w=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:53.839625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:53.842042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7a597786-617c-4107-b538-49ef7ca83892 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:10:53.843003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:53.850088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-7a597786-617c-4107-b538-49ef7ca83892 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:10:53.851206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b49e0194-06ae-44f5-8a8d-f8a056a1e6a8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1682 microversion: 2.1 time: 0.208680 Oct 12 23:10:53.851798 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3068/6232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:53 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:53.900467 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a597786-617c-4107-b538-49ef7ca83892 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081832 Oct 12 23:10:53.901815 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3165/6233] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:10:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:10:55.283933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f80de405-b2a2-469d-a474-47fca935497e req-828b6f0b-6b6e-4cb3-acb3-3047708dbe24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "name": "network-vif-plugged", "status": "completed", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:55.299983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f80de405-b2a2-469d-a474-47fca935497e req-828b6f0b-6b6e-4cb3-acb3-3047708dbe24 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:55.300706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f80de405-b2a2-469d-a474-47fca935497e req-828b6f0b-6b6e-4cb3-acb3-3047708dbe24 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:55.301312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f80de405-b2a2-469d-a474-47fca935497e req-828b6f0b-6b6e-4cb3-acb3-3047708dbe24 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:55.318064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f80de405-b2a2-469d-a474-47fca935497e req-828b6f0b-6b6e-4cb3-acb3-3047708dbe24 service nova] Creating event network-vif-plugged:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h2-860864-8 Oct 12 23:10:55.326757 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f80de405-b2a2-469d-a474-47fca935497e req-828b6f0b-6b6e-4cb3-acb3-3047708dbe24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048234 Oct 12 23:10:55.327852 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3069/6234] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:55.338006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1695609404", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97e12d6e-78cf-47d7-bedb-c663c72a095d"}], "security_groups": [{"name": "tempest-securitygroup--2132741674"}], "key_name": "tempest-keypair-409159933", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:55.447403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] validate_networks() for [('97e12d6e-78cf-47d7-bedb-c663c72a095d', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:10:55.840441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:10:55.841064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:10:55.841618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:10:55.842105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:10:55.842590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:10:55.853680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:55.855083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:55.855539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:55.856378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:55.857184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:55.857878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:55.878969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:10:55.884344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:10:55.896622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:10:55.898940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:10:55.947564 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4db8c5b0-308a-4b2d-b3f9-753dcb08dcf4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621365 Oct 12 23:10:55.948813 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3166/6235] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:10:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 23:10:55.963382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3254e0dd-2bf5-4726-b03d-a9961732117f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:55.966325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3254e0dd-2bf5-4726-b03d-a9961732117f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:56.038570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3254e0dd-2bf5-4726-b03d-a9961732117f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:56.046628 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3254e0dd-2bf5-4726-b03d-a9961732117f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1241 microversion: 2.1 time: 0.090163 Oct 12 23:10:56.047199 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3070/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:55 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:10:57.070510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:57.071231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:57.079307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:57.079871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:57.080427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:57.081216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:57.081814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:57.082334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:57.145538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:57.153256 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8052ebda-7194-4294-affa-1a3da8f9e3db tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1299 microversion: 2.1 time: 0.086891 Oct 12 23:10:57.153841 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3167/6237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:57 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:58.177973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:58.178593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:58.181515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=39 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:58.188781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:58.189269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:58.189703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:58.190389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:58.190834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:58.191248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:58.376989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:58.384812 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-462f3977-b613-449b-8d51-e95fd8f2e4b6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1367 microversion: 2.1 time: 0.212364 Oct 12 23:10:58.385514 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3071/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:58 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:10:58.460962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-047b16ed-7afe-4a28-8e25-f4e8e7042b08 req-16220072-19b2-4e13-b0ba-53cab145a24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7344a367-fdc7-4ff5-9e96-5d23e90f371e", "tag": "af0821aa-0548-46ae-bfe2-a45c8be58878"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:10:58.467878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:10:58.476052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-047b16ed-7afe-4a28-8e25-f4e8e7042b08 req-16220072-19b2-4e13-b0ba-53cab145a24d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:58.476785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-047b16ed-7afe-4a28-8e25-f4e8e7042b08 req-16220072-19b2-4e13-b0ba-53cab145a24d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:58.477398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-047b16ed-7afe-4a28-8e25-f4e8e7042b08 req-16220072-19b2-4e13-b0ba-53cab145a24d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:58.489915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-047b16ed-7afe-4a28-8e25-f4e8e7042b08 req-16220072-19b2-4e13-b0ba-53cab145a24d service nova] Creating event network-changed:af0821aa-0548-46ae-bfe2-a45c8be58878 for instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e on n-h1-860864-8 Oct 12 23:10:58.495014 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-047b16ed-7afe-4a28-8e25-f4e8e7042b08 req-16220072-19b2-4e13-b0ba-53cab145a24d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039338 Oct 12 23:10:58.495615 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3168/6239] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:10:59.407059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:10:59.407687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:10:59.414668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:59.415151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:59.415591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:59.416305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:10:59.416762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:10:59.417188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:10:59.559131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:10:59.566867 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7c2b8c1-b57d-4254-aa23-165c566e6b8f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1367 microversion: 2.1 time: 0.163697 Oct 12 23:10:59.567445 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3072/6240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:10:59 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:00.591980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:00.592706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:00.598836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:00.599331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:00.599782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:00.600507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:00.600970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:00.601408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:00.746316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:00.754516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62ea699c-2a87-405a-a647-f0cde43d570d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1367 microversion: 2.1 time: 0.167742 Oct 12 23:11:00.755933 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3169/6241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:00 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:01.778893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:01.780547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:01.790710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:01.791715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:01.792299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:01.793001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:01.793626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:01.794044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:01.944215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:01.953336 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6679f67-7deb-4985-b23d-d0dd91ab37b2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1367 microversion: 2.1 time: 0.179412 Oct 12 23:11:01.953943 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3073/6242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:01 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:02.977497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:02.978151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:02.986065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:02.986555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:02.987157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:02.987877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:02.988371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:02.988854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:03.297210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:03.305523 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e52533ef-5589-4de6-b34e-048e68f9e647 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1367 microversion: 2.1 time: 0.332045 Oct 12 23:11:03.315936 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3170/6243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:02 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:04.329198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:04.329819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:04.337089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:04.337577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:04.338052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:04.338762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:04.350339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:04.350960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:04.527208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-516874bf-9993-469d-b010-15364e8b0955 req-30b060fb-de88-40f2-bec0-9327776088e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7344a367-fdc7-4ff5-9e96-5d23e90f371e", "name": "network-vif-plugged", "status": "completed", "tag": "af0821aa-0548-46ae-bfe2-a45c8be58878"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:04.548507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-516874bf-9993-469d-b010-15364e8b0955 req-30b060fb-de88-40f2-bec0-9327776088e8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:04.549003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-516874bf-9993-469d-b010-15364e8b0955 req-30b060fb-de88-40f2-bec0-9327776088e8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:04.549451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-516874bf-9993-469d-b010-15364e8b0955 req-30b060fb-de88-40f2-bec0-9327776088e8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:04.574434 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-516874bf-9993-469d-b010-15364e8b0955 req-30b060fb-de88-40f2-bec0-9327776088e8 service nova] Creating event network-vif-plugged:af0821aa-0548-46ae-bfe2-a45c8be58878 for instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e on n-h1-860864-8 Oct 12 23:11:04.582703 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-516874bf-9993-469d-b010-15364e8b0955 req-30b060fb-de88-40f2-bec0-9327776088e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060403 Oct 12 23:11:04.583946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3171/6244] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:04.694901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:04.730609 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5fa06af4-2d3d-405a-8fee-c88ec71f999a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1367 microversion: 2.1 time: 0.404900 Oct 12 23:11:04.732842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3074/6245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:04 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:05.755812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:05.756574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:05.764666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:05.765169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:05.765773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:05.766505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:05.766975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:05.767533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:05.867542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:05.891584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:06.021789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:06.030976 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-683fe910-ec9e-4510-8c61-936ac122bd7c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1367 microversion: 2.1 time: 0.279984 Oct 12 23:11:06.032371 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3172/6246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:05 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:07.057641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:07.058305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:07.061475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:07.067628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:07.068421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:07.068854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:07.069567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:07.070015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:07.070431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:07.281845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:07.291575 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e95d4a8d-8ba2-47ed-9a73-d600b3b4453e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1558 microversion: 2.1 time: 0.238918 Oct 12 23:11:07.292190 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3075/6247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:07 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:07.315087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:07.315619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:07.322754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:07.323483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:07.324233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:07.325496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:07.326255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:07.327009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:07.457866 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0bb82807-22f0-402f-bd88-661e702ef4cd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146899 Oct 12 23:11:07.458588 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3173/6248] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:11:07 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:08.686191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e9f08ac4-3b47-4d67-b501-58844db2f968 req-4820f238-182b-42de-a787-4ce8cf0aa1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7344a367-fdc7-4ff5-9e96-5d23e90f371e", "tag": "af0821aa-0548-46ae-bfe2-a45c8be58878"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:08.704562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9f08ac4-3b47-4d67-b501-58844db2f968 req-4820f238-182b-42de-a787-4ce8cf0aa1e7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:08.705353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9f08ac4-3b47-4d67-b501-58844db2f968 req-4820f238-182b-42de-a787-4ce8cf0aa1e7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:08.706017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e9f08ac4-3b47-4d67-b501-58844db2f968 req-4820f238-182b-42de-a787-4ce8cf0aa1e7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:08.724197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e9f08ac4-3b47-4d67-b501-58844db2f968 req-4820f238-182b-42de-a787-4ce8cf0aa1e7 service nova] Creating event network-changed:af0821aa-0548-46ae-bfe2-a45c8be58878 for instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e on n-h1-860864-8 Oct 12 23:11:08.734428 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e9f08ac4-3b47-4d67-b501-58844db2f968 req-4820f238-182b-42de-a787-4ce8cf0aa1e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053016 Oct 12 23:11:08.735719 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3076/6249] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:11.671456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d1524d2d-6905-4047-8af1-bf33e01a42b1 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-218425456", "availability_zone": "foo_zone"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:11.676107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.aggregate [None req-d1524d2d-6905-4047-8af1-bf33e01a42b1 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Generated uuid a9f19d68-3252-4a17-bff3-55f7d0790efa for aggregate {{(pid=120542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 23:11:11.710057 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d1524d2d-6905-4047-8af1-bf33e01a42b1 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.185010 Oct 12 23:11:11.710657 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3174/6250] 10.222.0.20 () {60 vars in 1164 bytes} [Wed Oct 12 23:11:11 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:11.722601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca7330c6-98b6-4d0c-b8a1-441f7a98ef36 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:11.759613 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca7330c6-98b6-4d0c-b8a1-441f7a98ef36 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.041211 Oct 12 23:11:11.761049 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3077/6251] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 23:11:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:11.776820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:11.781552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:11.783083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:11.783546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:11.784344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:11.785000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:11.785738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:11.813348 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8cac64f-75d8-4802-9a1a-453e1114dc86 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041750 Oct 12 23:11:11.813983 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3175/6252] 10.222.0.20 () {58 vars in 1176 bytes} [Wed Oct 12 23:11:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:11.825839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8635592c-c00f-4066-b051-f834057e95cf tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:11.837031 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8635592c-c00f-4066-b051-f834057e95cf tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.015341 Oct 12 23:11:11.837655 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3078/6253] 10.222.0.20 () {58 vars in 1143 bytes} [Wed Oct 12 23:11:11 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:11.849597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f7921d2-ba25-4bf7-bd2d-2c200c18de2c tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-8"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:11.861372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f7921d2-ba25-4bf7-bd2d-2c200c18de2c tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:11.861869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f7921d2-ba25-4bf7-bd2d-2c200c18de2c tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:11.862501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f7921d2-ba25-4bf7-bd2d-2c200c18de2c tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:12.007366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3f7921d2-ba25-4bf7-bd2d-2c200c18de2c tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.161689 Oct 12 23:11:12.008208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3176/6254] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 23:11:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:12.019385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35102b08-f306-45fc-b966-69ba29fa3d39 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:12.028138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35102b08-f306-45fc-b966-69ba29fa3d39 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.012486 Oct 12 23:11:12.028683 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3079/6255] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 23:11:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:12.040044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9530157b-a884-49a8-8ae7-57d278ea1c8b tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1747165297", "availability_zone": "foo_zone"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:12.088795 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9530157b-a884-49a8-8ae7-57d278ea1c8b tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.052372 Oct 12 23:11:12.089436 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3177/6256] 10.222.0.20 () {60 vars in 1173 bytes} [Wed Oct 12 23:11:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:12.100893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2aff1b5-5dfd-49eb-aefd-5dce654efbe7 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:12.126121 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2aff1b5-5dfd-49eb-aefd-5dce654efbe7 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.028966 Oct 12 23:11:12.126825 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3080/6257] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 23:11:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:12.138264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f4c93f1-5a94-4dfb-a968-b716bdcb55d4 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:12.146483 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f4c93f1-5a94-4dfb-a968-b716bdcb55d4 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.012202 Oct 12 23:11:12.147359 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3178/6258] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Oct 12 23:11:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:12.159325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8626ad7c-ae1b-4b86-a8a1-eee802c2808a tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-8"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:12.171356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8626ad7c-ae1b-4b86-a8a1-eee802c2808a tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:12.171842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8626ad7c-ae1b-4b86-a8a1-eee802c2808a tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:12.172304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8626ad7c-ae1b-4b86-a8a1-eee802c2808a tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:12.454050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8626ad7c-ae1b-4b86-a8a1-eee802c2808a tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.298507 Oct 12 23:11:12.454802 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3081/6259] 10.222.0.20 () {60 vars in 1194 bytes} [Wed Oct 12 23:11:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:12.468347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d9db0db-edd6-4705-a5b6-2cae7e3e4716 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:12.494887 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d9db0db-edd6-4705-a5b6-2cae7e3e4716 tempest-TestAggregatesBasicOps-1010270930 tempest-TestAggregatesBasicOps-1010270930-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.031579 Oct 12 23:11:12.495481 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3179/6260] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 12 23:11:12 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 23:11:16.252371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:16.260360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:16.268743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:16.269557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:16.269974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:16.270686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:16.271178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:16.271655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:16.333426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2859f41-f7b6-4187-a883-ec4148ca157c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action" status: 200 len: 24577 microversion: 2.1 time: 0.085128 Oct 12 23:11:16.334695 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3082/6261] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:11:16 2022] POST /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44/action => generated 24577 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:11:22.743772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:22.744505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=42 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:22.745170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:22.749123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:22.749738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:22.757769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:22.758260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:22.759366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:22.760098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:22.760561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:22.760992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:22.892380 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36018c42-eb52-4d45-a10a-1822648a6dbc tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1833 microversion: 2.1 time: 0.150918 Oct 12 23:11:22.892946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3180/6262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:22 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1833 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:23.717502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c83c1f6d-e26f-4bc7-a8f7-85074382d533 req-0fd69fee-1ccd-46ee-91cd-bf60e234de85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:23.720653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:23.727346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:23.737140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.739370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c83c1f6d-e26f-4bc7-a8f7-85074382d533 req-0fd69fee-1ccd-46ee-91cd-bf60e234de85 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.739957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c83c1f6d-e26f-4bc7-a8f7-85074382d533 req-0fd69fee-1ccd-46ee-91cd-bf60e234de85 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.740127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.740535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c83c1f6d-e26f-4bc7-a8f7-85074382d533 req-0fd69fee-1ccd-46ee-91cd-bf60e234de85 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:23.740645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:23.741348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.741807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.742244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:23.754236 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c83c1f6d-e26f-4bc7-a8f7-85074382d533 req-0fd69fee-1ccd-46ee-91cd-bf60e234de85 service nova] Creating event network-changed:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h2-860864-8 Oct 12 23:11:23.759790 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c83c1f6d-e26f-4bc7-a8f7-85074382d533 req-0fd69fee-1ccd-46ee-91cd-bf60e234de85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046439 Oct 12 23:11:23.761408 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3181/6263] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:23.777388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:11:23.868047 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d72885c-0c04-4cf0-91ef-f1c84be8ec6f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 204 len: 0 microversion: 2.1 time: 0.157312 Oct 12 23:11:23.868634 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3083/6264] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:11:23 2022] DELETE /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:11:23.878609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:23.879312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:23.887086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.888191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.888894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:23.889966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:23.890633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:23.891284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:24.041656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:24.050095 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03692ed3-fa8a-48e8-bf73-39bbba309025 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1688 microversion: 2.1 time: 0.175807 Oct 12 23:11:24.050681 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3182/6265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:23 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:11:25.075001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:25.075730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:25.082518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:25.082992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:25.083430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:25.084162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:25.084639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:25.085058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:25.222250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:25.230175 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90f11390-8309-4817-909a-43f8c838a9df tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 200 len: 1688 microversion: 2.1 time: 0.159870 Oct 12 23:11:25.230756 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3084/6266] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:25 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:25.776932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-29cc0cc2-a884-4d09-9f33-4fa629dcf774 req-5d398df2-0344-4a51-8d6f-9d3a8c45cf4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff521609-22c0-4b75-80c4-94c5fe2b2f44", "name": "network-vif-deleted", "tag": "e6cfab79-0b41-4a25-8c9b-059e7164db04"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:25.789245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-29cc0cc2-a884-4d09-9f33-4fa629dcf774 req-5d398df2-0344-4a51-8d6f-9d3a8c45cf4c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:25.789728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-29cc0cc2-a884-4d09-9f33-4fa629dcf774 req-5d398df2-0344-4a51-8d6f-9d3a8c45cf4c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:25.790168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-29cc0cc2-a884-4d09-9f33-4fa629dcf774 req-5d398df2-0344-4a51-8d6f-9d3a8c45cf4c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:25.802190 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-29cc0cc2-a884-4d09-9f33-4fa629dcf774 req-5d398df2-0344-4a51-8d6f-9d3a8c45cf4c service nova] Creating event network-vif-deleted:e6cfab79-0b41-4a25-8c9b-059e7164db04 for instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 on n-h2-860864-8 Oct 12 23:11:25.808597 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-29cc0cc2-a884-4d09-9f33-4fa629dcf774 req-5d398df2-0344-4a51-8d6f-9d3a8c45cf4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035534 Oct 12 23:11:25.809365 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3183/6267] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:26.254653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:26.255223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: ff521609-22c0-4b75-80c4-94c5fe2b2f44] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:26.262098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:26.262576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:26.263011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:26.263699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:26.264173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:26.264601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:26.268586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:26.279466 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] HTTP exception thrown: Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 could not be found. Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Request method failure captured: Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 HTTP/1.1 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0kqmkCckov03ZauIpTDCUZIKTY8Kyp9KOUZNrMzfjEP3qvbaSMWm6I1lMqhBkVkPG05W5JF8FFbYD_Tf2FC3COWkpm1EoMphALrInRN521AzvHylU0eCmOG8Um2UpJ19k754WPIlTPAVplVV32LqXsh--BGtnXiT-J11_CaxsWWCvM Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1440ecf02574c5f8355519787af4360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1440ecf02574c5f8355519787af4360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}] Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: dcfdaa332f374558a08e972c2487dbea Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 could not be found. Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ff521609-22c0-4b75-80c4-94c5fe2b2f44'} Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 could not be found. Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 could not be found. Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:26.281199 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 could not be found. Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Returning 404 to user: Instance ff521609-22c0-4b75-80c4-94c5fe2b2f44 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c1434658-ddff-45f2-af96-f333306dd586 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44" status: 404 len: 111 microversion: 2.1 time: 0.031929 Oct 12 23:11:26.286139 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3085/6268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:26 2022] GET /compute/v2.1/servers/ff521609-22c0-4b75-80c4-94c5fe2b2f44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:11:29.586367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff0e5ebc-32e9-41bc-87d5-8a718073425d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '.version_select at 0x7f44fec7dd30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:29.607814 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff0e5ebc-32e9-41bc-87d5-8a718073425d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2072289255" status: 202 len: 0 microversion: 2.1 time: 0.025583 Oct 12 23:11:29.608673 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3184/6269] 10.222.0.20 () {58 vars in 1284 bytes} [Wed Oct 12 23:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2072289255 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:11:29.633828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ab81df9c-1f94-4bbc-af9e-3484c0aa33e7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: .version_select at 0x7f44fe5ac670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-202536976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpRhlh8bwFHHIVXz8tJEwc3HSIhPNHLw6Ec3HKVcDssCoTY7pXUf9rEvpbtl+v06+pL7/Zu0j6J7pUZvOalQI40K4oJ4brMDCvqZsH4obQF8yfMpKxDnRs30dMFbTYZHA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:29.641506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:29.658875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ab81df9c-1f94-4bbc-af9e-3484c0aa33e7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:11:29.664769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-ab81df9c-1f94-4bbc-af9e-3484c0aa33e7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:11:29.691126 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ab81df9c-1f94-4bbc-af9e-3484c0aa33e7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.061613 Oct 12 23:11:29.691728 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3086/6270] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:11:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:35.302333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1008352924", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "8c16ac57-3b96-4e54-926c-c3a0455f2b8c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-202536976", "security_groups": [{"name": "tempest-secgroup-smoke-657515416"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:35.419108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] validate_networks() for [('8c16ac57-3b96-4e54-926c-c3a0455f2b8c', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:11:35.795835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:35.870384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:11:35.873937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:11:35.874751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:11:35.875375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:11:35.875882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:11:35.890471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:35.891070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:35.891583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:35.892477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:35.893044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:35.893534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:35.919683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:11:35.928265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:11:35.948665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:11:35.951952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:11:36.029232 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e7fa38b-53c8-4512-bcd6-c8840b037bcc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732187 Oct 12 23:11:36.030284 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3185/6271] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:11:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:11:36.042947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7153046-740c-4578-ade0-52ebbdce91f6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:36.043574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7153046-740c-4578-ade0-52ebbdce91f6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:36.143026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7153046-740c-4578-ade0-52ebbdce91f6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:36.152383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7153046-740c-4578-ade0-52ebbdce91f6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1266 microversion: 2.1 time: 0.114268 Oct 12 23:11:36.168892 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3087/6272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:36 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:37.180994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:37.181656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:37.190737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:37.191236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:37.191692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:37.192430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:37.192896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:37.193331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:37.268638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:37.277414 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9695b90-afeb-463b-8939-029eadc0d754 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1318 microversion: 2.1 time: 0.100396 Oct 12 23:11:37.278359 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3186/6273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:37 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:38.307460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:38.309559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:38.324530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:38.325398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:38.326097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:38.327294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:38.329474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:38.330178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:38.536242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:38.544682 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-99da47cc-9b3c-47a7-a0b7-177cdcea9f94 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1391 microversion: 2.1 time: 0.245326 Oct 12 23:11:38.545260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3088/6274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:38 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:38.845134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4355bf04-757c-43d5-9f1b-479b934d1b1d req-9b336e83-6bc1-4af7-b899-2a2edea3922b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:38.858902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4355bf04-757c-43d5-9f1b-479b934d1b1d req-9b336e83-6bc1-4af7-b899-2a2edea3922b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:38.859780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4355bf04-757c-43d5-9f1b-479b934d1b1d req-9b336e83-6bc1-4af7-b899-2a2edea3922b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:38.860526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4355bf04-757c-43d5-9f1b-479b934d1b1d req-9b336e83-6bc1-4af7-b899-2a2edea3922b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:38.873933 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4355bf04-757c-43d5-9f1b-479b934d1b1d req-9b336e83-6bc1-4af7-b899-2a2edea3922b service nova] Creating event network-changed:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:11:38.879126 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4355bf04-757c-43d5-9f1b-479b934d1b1d req-9b336e83-6bc1-4af7-b899-2a2edea3922b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038223 Oct 12 23:11:38.879874 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3187/6275] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:39.568442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:39.569039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:39.576015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:39.576502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:39.576937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:39.577626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:39.578076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:39.578499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:39.711234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:39.719343 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5166f05a-183f-4c17-af56-4403dbeeb6bf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1391 microversion: 2.1 time: 0.154906 Oct 12 23:11:39.719931 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3089/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:39 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:40.744414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:40.745121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:40.751492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:40.752014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:40.752469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:40.753165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:40.753624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:40.754056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:40.884761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:40.892426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2eb3d749-ca68-4196-8cf0-a9ad44c26a2f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1391 microversion: 2.1 time: 0.153727 Oct 12 23:11:40.892917 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3188/6277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:40 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:41.915048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:41.916278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:41.923085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:41.923569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:41.924037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:41.924731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:41.925196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:41.925625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.062034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:42.069718 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a43b39f-2458-4fd8-92c1-5b6dfc243893 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1391 microversion: 2.1 time: 0.158614 Oct 12 23:11:42.070296 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3090/6278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:41 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:42.121347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:42.121876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:42.128710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.129203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.129650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.130345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.130806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.131243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.154366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f04b80d2-27e8-4adb-92b8-8b1d85eb37ec tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e/ips" status: 200 len: 151 microversion: 2.1 time: 0.037205 Oct 12 23:11:42.154931 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3189/6279] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:11:42 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:42.166960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efed02a9-5629-403c-aec7-26d3da47ee7a"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:42.169340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:42.175197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.175675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.176147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.176831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.177282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.177731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.255538 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Invalid volume: volume efed02a9-5629-403c-aec7-26d3da47ee7a is already attached to instances: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e/os-volume_attachments HTTP/1.1 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 74 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: {"volumeAttachment": {"volumeId": "efed02a9-5629-403c-aec7-26d3da47ee7a"}} Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid volume: volume efed02a9-5629-403c-aec7-26d3da47ee7a is already attached to instances: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '7344a367-fdc7-4ff5-9e96-5d23e90f371e', 'body': {'volumeAttachment': {'volumeId': 'efed02a9-5629-403c-aec7-26d3da47ee7a'}}} Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume efed02a9-5629-403c-aec7-26d3da47ee7a is already attached to instances: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:11:42.257211 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume efed02a9-5629-403c-aec7-26d3da47ee7a is already attached to instances: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume efed02a9-5629-403c-aec7-26d3da47ee7a is already attached to instances: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 400 to user: Invalid volume: volume efed02a9-5629-403c-aec7-26d3da47ee7a is already attached to instances: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16f30c5a-36d5-4622-bdab-6405f1691826 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096333 Oct 12 23:11:42.262920 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3091/6280] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:11:42 2022] POST /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:11:42.268092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:42.268604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:42.275159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.275650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.276129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.276822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.277281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.277715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.301723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:11:42.375076 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe573de7-5ff1-4175-87c7-b5f71998c44a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 204 len: 0 microversion: 2.1 time: 0.110820 Oct 12 23:11:42.375763 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3190/6281] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:11:42 2022] DELETE /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:11:42.384834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:42.385436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:42.391678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.392163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.392599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.393293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:42.393740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:42.394162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:42.527736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:42.535871 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f3c89a5a-3b23-4f12-acb4-fddf5e3ef587 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1683 microversion: 2.1 time: 0.154990 Oct 12 23:11:42.536473 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3092/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:42 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:43.093597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:43.094260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:43.100271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:43.100768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:43.101220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:43.101922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:43.102392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:43.103341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:43.539406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:43.547645 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90ce6f6d-db5d-45ad-adc1-a7a53096755c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1391 microversion: 2.1 time: 0.458482 Oct 12 23:11:43.548854 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3191/6283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:43 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1391 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:43.562007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:43.562644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:43.569565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:43.570049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:43.570485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:43.571173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:43.571621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:43.572093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:43.698376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:43.706115 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-237d4a31-0907-4639-a6f4-7baba9c5fbf5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1683 microversion: 2.1 time: 0.148083 Oct 12 23:11:43.706686 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3093/6284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:43 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:44.542244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1824de56-9cd3-4d91-a8af-0605d4adfa73 req-fe265178-4c96-4d42-8127-d781802d3608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7344a367-fdc7-4ff5-9e96-5d23e90f371e", "name": "network-vif-deleted", "tag": "af0821aa-0548-46ae-bfe2-a45c8be58878"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:44.553957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1824de56-9cd3-4d91-a8af-0605d4adfa73 req-fe265178-4c96-4d42-8127-d781802d3608 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:44.554458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1824de56-9cd3-4d91-a8af-0605d4adfa73 req-fe265178-4c96-4d42-8127-d781802d3608 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:44.554899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1824de56-9cd3-4d91-a8af-0605d4adfa73 req-fe265178-4c96-4d42-8127-d781802d3608 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:44.567439 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1824de56-9cd3-4d91-a8af-0605d4adfa73 req-fe265178-4c96-4d42-8127-d781802d3608 service nova] Creating event network-vif-deleted:af0821aa-0548-46ae-bfe2-a45c8be58878 for instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e on n-h1-860864-8 Oct 12 23:11:44.572614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:44.573356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:44.573762 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1824de56-9cd3-4d91-a8af-0605d4adfa73 req-fe265178-4c96-4d42-8127-d781802d3608 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035209 Oct 12 23:11:44.574378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3192/6285] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:44.581371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:44.582120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:44.582759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:44.588033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:44.588863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:44.589591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:44.731385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:44.732150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:44.743150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:44.744189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:44.746057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:44.747021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:44.748221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:44.748904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:44.776723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:44.789210 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-55dddfd8-9411-42f4-9232-ba23ee0f8717 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1391 microversion: 2.1 time: 0.221776 Oct 12 23:11:44.804242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:44.804242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:44.804242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:44.805019 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3094/6286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:44 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:44.805924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lazy-loading 'fault' on Instance uuid 7344a367-fdc7-4ff5-9e96-5d23e90f371e {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:11:44.850984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:44.862374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-501ce88d-35cb-4b39-8851-fd5fa8fe9336 req-41e70419-593b-4b87-a4f8-c61b9e553b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "name": "network-vif-plugged", "status": "completed", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:44.862797 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30a50cb6-e77e-472f-ab6c-5270aeb2f5f6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 200 len: 1331 microversion: 2.1 time: 0.136065 Oct 12 23:11:44.863993 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3193/6287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:44 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:44.873000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-501ce88d-35cb-4b39-8851-fd5fa8fe9336 req-41e70419-593b-4b87-a4f8-c61b9e553b68 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:44.873524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-501ce88d-35cb-4b39-8851-fd5fa8fe9336 req-41e70419-593b-4b87-a4f8-c61b9e553b68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:44.874005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-501ce88d-35cb-4b39-8851-fd5fa8fe9336 req-41e70419-593b-4b87-a4f8-c61b9e553b68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:44.887795 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-501ce88d-35cb-4b39-8851-fd5fa8fe9336 req-41e70419-593b-4b87-a4f8-c61b9e553b68 service nova] Creating event network-vif-plugged:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:11:44.893246 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-501ce88d-35cb-4b39-8851-fd5fa8fe9336 req-41e70419-593b-4b87-a4f8-c61b9e553b68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Oct 12 23:11:44.893854 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3095/6288] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:11:45.813190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:45.813814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:45.820838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:45.821327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:45.821771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:45.822458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:45.822915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:45.823344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:45.890808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:45.891617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:45.898732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:45.899730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:45.900402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:45.900876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:45.901364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:45.901790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:45.906177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:45.916246 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e HTTP/1.1 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7344a367-fdc7-4ff5-9e96-5d23e90f371e'} Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:45.917986 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5589341b-02df-472c-abe5-ebceb9b3d1dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 404 len: 111 microversion: 2.1 time: 0.033208 Oct 12 23:11:45.922143 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3096/6289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:45 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:11:45.928416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9be2f51e-5853-4ab4-8429-693960fa7c53 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '.version_select at 0x7f44fe59e8b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:45.939958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:45.951711 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9be2f51e-5853-4ab4-8429-693960fa7c53 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409159933" status: 202 len: 0 microversion: 2.1 time: 0.026875 Oct 12 23:11:45.952330 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3097/6290] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 23:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409159933 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:11:45.961304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:45.969869 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-51806fbb-6511-4b73-9bad-e9c777dae558 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1391 microversion: 2.1 time: 0.160564 Oct 12 23:11:45.971120 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3194/6291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:45 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:46.623500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:46.627785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:46.628386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:46.635852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:46.636358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:46.636791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:46.637465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:46.637909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:46.638323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:46.717226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lazy-loading 'services' on Instance uuid 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:11:46.788747 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-401b150b-395a-4122-ba0b-7a553b3af602 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments/efed02a9-5629-403c-aec7-26d3da47ee7a" status: 202 len: 0 microversion: 2.1 time: 0.165731 Oct 12 23:11:46.789320 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3098/6292] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:11:46 2022] DELETE /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments/efed02a9-5629-403c-aec7-26d3da47ee7a => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:11:46.798436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:46.800617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:46.807662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:46.808303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:46.808762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:46.809587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:46.810169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:46.810655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:46.842447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0839ebcc-cabb-407f-ad8e-bfb79c0d1410 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048153 Oct 12 23:11:46.843090 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3195/6293] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:11:46 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:46.997649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:46.998362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:47.004559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:47.005042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:47.005483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:47.006198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:47.006654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:47.007079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:47.141709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:47.150895 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6a46bc5-2d28-4d09-96fd-227b9c8cd644 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1563 microversion: 2.1 time: 0.159303 Oct 12 23:11:47.151473 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3099/6294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:46 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:47.174113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:47.174787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:47.180783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:47.181282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:47.181737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:47.182441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:47.182913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:47.183355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:47.316197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:47.325025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb666328-ed2d-48c1-884b-835ee33a789e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1563 microversion: 2.1 time: 0.155069 Oct 12 23:11:47.325608 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3196/6295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:47 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:47.855050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:47.858120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:47.865863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:47.866355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:47.866790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:47.867707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:47.868880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:47.869301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:48.161454 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94410195-0418-490c-8fab-c9ec00635051 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.310575 Oct 12 23:11:48.166416 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3100/6296] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:11:47 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments => generated 197 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:49.174376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:49.176693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:49.183282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:49.184043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:49.184674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:49.185564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:49.186028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:49.186462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:49.219098 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-912dde0a-c08c-4242-9d93-1b608b332dea tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048776 Oct 12 23:11:49.219674 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3197/6297] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:11:49 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:49.292745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:49.293366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:49.300604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:49.301638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:49.302254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:49.303136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:49.303750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:49.304365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:49.310459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9d01632b-2825-4261-bff1-28f0a95cd70c req-13a11e96-f3e4-4529-bb44-aafdc0e26910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:49.334713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9d01632b-2825-4261-bff1-28f0a95cd70c req-13a11e96-f3e4-4529-bb44-aafdc0e26910 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:49.335470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9d01632b-2825-4261-bff1-28f0a95cd70c req-13a11e96-f3e4-4529-bb44-aafdc0e26910 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:49.336150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9d01632b-2825-4261-bff1-28f0a95cd70c req-13a11e96-f3e4-4529-bb44-aafdc0e26910 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:49.351776 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9d01632b-2825-4261-bff1-28f0a95cd70c req-13a11e96-f3e4-4529-bb44-aafdc0e26910 service nova] Creating event network-changed:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:11:49.358189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9d01632b-2825-4261-bff1-28f0a95cd70c req-13a11e96-f3e4-4529-bb44-aafdc0e26910 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055047 Oct 12 23:11:49.359415 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3198/6298] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:11:49.552511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:49.564745 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aaf7f3d9-427a-46b9-a8f8-e4bfbec92109 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1563 microversion: 2.1 time: 0.275251 Oct 12 23:11:49.566131 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3101/6299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:49 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1563 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:50.233132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:50.235677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:50.242164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:50.242700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:50.243150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:50.243870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:50.244364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:50.244808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:50.277512 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67a518c7-31f2-4660-9399-9cc0bd077c24 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050481 Oct 12 23:11:50.278088 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3199/6300] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:11:50 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:51.290841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:51.293054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:51.300387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:51.300881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:51.301357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:51.302074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:51.302529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:51.302958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:51.334320 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7ed4634-47a7-49f7-915a-d8b45d1b0e1c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048084 Oct 12 23:11:51.334875 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3102/6301] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:11:51 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:52.346891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:52.349138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:52.356560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:52.357058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:52.357512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:52.358209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:52.358673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:52.359111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:52.388391 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13ea32fb-1080-4e36-8db8-011375c7fc97 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045512 Oct 12 23:11:52.388962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3200/6302] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:11:52 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:11:52.452542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:52.453045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:52.460149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:52.460638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:52.461080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:52.462312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:52.462767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:52.463197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:52.487763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:11:52.560300 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76c82fe9-48b9-4688-8757-a648daca6a48 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 204 len: 0 microversion: 2.1 time: 0.111349 Oct 12 23:11:52.560949 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3103/6303] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:11:52 2022] DELETE /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:11:52.569284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:52.569914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:52.575848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:52.576374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:52.576820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:52.577510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:52.577971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:52.578400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:52.708253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:52.716547 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67a87aaa-c94d-4bd3-8ee5-b63b2cc625a9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1680 microversion: 2.1 time: 0.151290 Oct 12 23:11:52.717104 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3201/6304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:52 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:53.741119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:53.741831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:53.749458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:53.749946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:53.750385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:53.751115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:53.751571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:53.752028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:53.767240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:53.888748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:53.896472 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b565211-2014-428d-b7e8-1f0be0e95353 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1680 microversion: 2.1 time: 0.159590 Oct 12 23:11:53.897036 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3104/6305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:53 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:54.833170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4ac43455-96e9-46de-b0f0-2b6c7b348db5 req-8aa9aca4-683e-4fc5-a59d-797f41f844ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87133479-3c6e-4e0a-88bd-ff34f03cb6f2", "name": "network-vif-deleted", "tag": "58ebc09a-db44-442b-8df9-9ec6b8f37f16"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:54.839803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:54.846119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4ac43455-96e9-46de-b0f0-2b6c7b348db5 req-8aa9aca4-683e-4fc5-a59d-797f41f844ba service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:54.846620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4ac43455-96e9-46de-b0f0-2b6c7b348db5 req-8aa9aca4-683e-4fc5-a59d-797f41f844ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:54.847067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4ac43455-96e9-46de-b0f0-2b6c7b348db5 req-8aa9aca4-683e-4fc5-a59d-797f41f844ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:54.860225 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4ac43455-96e9-46de-b0f0-2b6c7b348db5 req-8aa9aca4-683e-4fc5-a59d-797f41f844ba service nova] Creating event network-vif-deleted:58ebc09a-db44-442b-8df9-9ec6b8f37f16 for instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 on n-h2-860864-8 Oct 12 23:11:54.866183 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4ac43455-96e9-46de-b0f0-2b6c7b348db5 req-8aa9aca4-683e-4fc5-a59d-797f41f844ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036757 Oct 12 23:11:54.869944 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3202/6306] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:54.922290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:54.923038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:54.930776 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:54.931601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:54.932116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:54.933046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:54.933957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:54.934608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:54.976626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:54.978652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:54.979961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:54.980898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lazy-loading 'fault' on Instance uuid 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:11:55.036359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:55.047198 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2cb819d-d5f1-49a4-85c1-b82ae6c896a3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 200 len: 1331 microversion: 2.1 time: 0.129263 Oct 12 23:11:55.047885 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3105/6307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:54 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:56.073794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:56.074467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:56.081763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:56.082256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:56.082706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:56.083411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:56.083877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:56.084341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:56.089163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:56.099177 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 HTTP/1.1 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '87133479-3c6e-4e0a-88bd-ff34f03cb6f2'} Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:11:56.100986 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-040bb32e-3991-4696-a528-6e9edcddaa70 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 404 len: 111 microversion: 2.1 time: 0.034864 Oct 12 23:11:56.105877 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3203/6308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:56 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:11:56.111163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c80ed445-e0f2-4d29-a81d-f7755afb2536 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '.version_select at 0x7f44ff6848b0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:56.132409 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c80ed445-e0f2-4d29-a81d-f7755afb2536 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211674502" status: 202 len: 0 microversion: 2.1 time: 0.024917 Oct 12 23:11:56.133632 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3106/6309] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 12 23:11:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211674502 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:11:56.775219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b821ee5-1575-4a33-a338-7db7faf7e374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: .version_select at 0x7f44ff470040>, body: {"keypair": {"name": "tempest-keypair-1266299263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMB30kjFME1uP6IkrAj9zBz9JxHCme1w+bAQhLTchsNKGJXPYLkktdZUiKZ5aJXf33nnTvka7QO7Gax/E3DjFnG2dKisZXfUwwqQt77+YHbXHjzWbTOItkZ/PRfV5wBYg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:56.792893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6b821ee5-1575-4a33-a338-7db7faf7e374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:11:56.798104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6b821ee5-1575-4a33-a338-7db7faf7e374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:11:56.822150 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b821ee5-1575-4a33-a338-7db7faf7e374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050856 Oct 12 23:11:56.822761 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3204/6310] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:11:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:11:58.065373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-35043748", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97e12d6e-78cf-47d7-bedb-c663c72a095d"}], "security_groups": [{"name": "tempest-securitygroup--1679787120"}], "key_name": "tempest-keypair-1266299263", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:11:58.169525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] validate_networks() for [('97e12d6e-78cf-47d7-bedb-c663c72a095d', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:11:58.640880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:11:58.641316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:11:58.641800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:11:58.642215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:11:58.642635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:11:58.652118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:58.652604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:58.653041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:58.653769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:58.654224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:58.654653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:58.672788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:11:58.678011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:11:58.690204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:11:58.692500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:11:58.738561 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6fcad220-a7b7-4e87-a565-2f7a365a9f76 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678575 Oct 12 23:11:58.739214 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3107/6311] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:11:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:11:58.751832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30372841-fab4-4758-8696-55625e6d8455 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:58.752551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-30372841-fab4-4758-8696-55625e6d8455 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:58.812572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30372841-fab4-4758-8696-55625e6d8455 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:58.819588 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30372841-fab4-4758-8696-55625e6d8455 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1240 microversion: 2.1 time: 0.072736 Oct 12 23:11:58.820208 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3205/6312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:58 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:11:59.844108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:11:59.845325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:11:59.847235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:11:59.853529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:59.854238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:59.854672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:59.855381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:11:59.855828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:11:59.856464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:11:59.928771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:11:59.937375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d224953-ca59-4381-8d8e-52c807730a8e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1298 microversion: 2.1 time: 0.098142 Oct 12 23:11:59.938181 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3108/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:11:59 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:00.962296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:00.962930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:00.969897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:00.970397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:00.970854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:00.971559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:00.972052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:00.972491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:01.163918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:01.172136 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e99f855-519d-4d6e-bbbc-feba04dfad15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1366 microversion: 2.1 time: 0.213890 Oct 12 23:12:01.172374 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3206/6314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:00 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:01.200082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ba2eb5de-bef3-4de8-b0ad-11f001e80f36 req-bf601658-44a3-499a-93fd-b080a510b631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621000c2-0d95-4701-b050-a9e32ba107f7", "tag": "89e28109-96ab-44ea-b03a-ed8c15bfe94b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:01.210362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ba2eb5de-bef3-4de8-b0ad-11f001e80f36 req-bf601658-44a3-499a-93fd-b080a510b631 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:01.211496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ba2eb5de-bef3-4de8-b0ad-11f001e80f36 req-bf601658-44a3-499a-93fd-b080a510b631 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:01.211958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ba2eb5de-bef3-4de8-b0ad-11f001e80f36 req-bf601658-44a3-499a-93fd-b080a510b631 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:01.223057 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ba2eb5de-bef3-4de8-b0ad-11f001e80f36 req-bf601658-44a3-499a-93fd-b080a510b631 service nova] Creating event network-changed:89e28109-96ab-44ea-b03a-ed8c15bfe94b for instance 621000c2-0d95-4701-b050-a9e32ba107f7 on n-h2-860864-8 Oct 12 23:12:01.228662 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ba2eb5de-bef3-4de8-b0ad-11f001e80f36 req-bf601658-44a3-499a-93fd-b080a510b631 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032147 Oct 12 23:12:01.229383 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3109/6315] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:12:02.195038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:02.196245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:02.203010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:02.203507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:02.203983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:02.204693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:02.205157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:02.205593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:02.413232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:02.421319 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6c8d8ff3-e874-4f88-ae6f-1f811a53bf20 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1366 microversion: 2.1 time: 0.230134 Oct 12 23:12:02.422404 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3207/6316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:02 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:03.449107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:03.449837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:03.455960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:03.456440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:03.456871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:03.457555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:03.458000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:03.458418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:03.588132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:03.595791 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec4b9d1a-e079-46be-8c9d-68e09f8ecc38 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1366 microversion: 2.1 time: 0.151808 Oct 12 23:12:03.596394 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3110/6317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:03 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:04.618811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:04.619439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:04.626640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:04.627164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:04.627608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:04.628334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:04.628799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:04.629235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:04.761655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:04.769343 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e11a33a-bd5e-4e08-87c1-bf50e749b708 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1366 microversion: 2.1 time: 0.154587 Oct 12 23:12:04.769911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3208/6318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:04 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:05.793557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:05.794182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:05.800371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:05.800857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:05.801337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:05.802026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:05.802483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:05.802913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:05.937399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:05.945232 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d01dde2a-84d3-4f5d-b4ca-1e48cdf68504 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1366 microversion: 2.1 time: 0.156169 Oct 12 23:12:05.960216 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3111/6319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:05 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:06.969622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:06.970244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:06.977724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:06.978215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:06.978662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:06.979352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:06.979814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:06.980271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:07.109134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:07.117415 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-02b9ce50-b1b5-4098-9065-e003d0b8108a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1366 microversion: 2.1 time: 0.151124 Oct 12 23:12:07.117990 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3209/6320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:06 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:07.679820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4528ac4c-6432-46e9-8d44-1f64fa66b93c req-bab125b5-7e02-4399-8d61-689ae99f2b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621000c2-0d95-4701-b050-a9e32ba107f7", "name": "network-vif-plugged", "status": "completed", "tag": "89e28109-96ab-44ea-b03a-ed8c15bfe94b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:07.690496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4528ac4c-6432-46e9-8d44-1f64fa66b93c req-bab125b5-7e02-4399-8d61-689ae99f2b48 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:07.690979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4528ac4c-6432-46e9-8d44-1f64fa66b93c req-bab125b5-7e02-4399-8d61-689ae99f2b48 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:07.691413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4528ac4c-6432-46e9-8d44-1f64fa66b93c req-bab125b5-7e02-4399-8d61-689ae99f2b48 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:07.704505 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4528ac4c-6432-46e9-8d44-1f64fa66b93c req-bab125b5-7e02-4399-8d61-689ae99f2b48 service nova] Creating event network-vif-plugged:89e28109-96ab-44ea-b03a-ed8c15bfe94b for instance 621000c2-0d95-4701-b050-a9e32ba107f7 on n-h2-860864-8 Oct 12 23:12:07.709774 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4528ac4c-6432-46e9-8d44-1f64fa66b93c req-bab125b5-7e02-4399-8d61-689ae99f2b48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033926 Oct 12 23:12:07.711005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3112/6321] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:08.140334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:08.140988 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:08.148399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:08.148905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:08.149362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:08.150071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:08.150542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:08.151036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:08.280728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:08.288346 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e443f11-34a1-4144-a471-6ef3a609a761 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1366 microversion: 2.1 time: 0.151967 Oct 12 23:12:08.289560 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3210/6322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:08 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:09.312603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:09.313239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:09.315183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:09.316052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:09.323266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:09.323749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:09.324215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:09.324910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:09.325371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:09.325797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:09.454475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:09.462145 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6811273-60a2-4da7-ade4-4ce92ffef0ac tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1556 microversion: 2.1 time: 0.153877 Oct 12 23:12:09.462719 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3113/6323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:09 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:09.484965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:09.485532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:09.487410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:09.494130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:09.494875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:09.495511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:09.496235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:09.496702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:09.497170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:09.573297 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2be60dc7-2ada-4fa0-b8e5-4ecc0ff208d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092260 Oct 12 23:12:09.573911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3211/6324] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:12:09 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:10.512483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4cd4b988-1d4c-4961-81c4-266bb900a7f5 req-06706510-f4e9-4da6-ab90-87511876cac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621000c2-0d95-4701-b050-a9e32ba107f7", "tag": "89e28109-96ab-44ea-b03a-ed8c15bfe94b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:10.523702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4cd4b988-1d4c-4961-81c4-266bb900a7f5 req-06706510-f4e9-4da6-ab90-87511876cac2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:10.524362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4cd4b988-1d4c-4961-81c4-266bb900a7f5 req-06706510-f4e9-4da6-ab90-87511876cac2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:10.525005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4cd4b988-1d4c-4961-81c4-266bb900a7f5 req-06706510-f4e9-4da6-ab90-87511876cac2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:10.538761 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4cd4b988-1d4c-4961-81c4-266bb900a7f5 req-06706510-f4e9-4da6-ab90-87511876cac2 service nova] Creating event network-changed:89e28109-96ab-44ea-b03a-ed8c15bfe94b for instance 621000c2-0d95-4701-b050-a9e32ba107f7 on n-h2-860864-8 Oct 12 23:12:10.544072 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4cd4b988-1d4c-4961-81c4-266bb900a7f5 req-06706510-f4e9-4da6-ab90-87511876cac2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035225 Oct 12 23:12:10.545574 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3114/6325] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:10.839814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:10.843003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:10.850052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:10.850663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:10.852076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:10.853028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:10.853697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:10.854341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:10.912406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-619b3b0e-374d-4080-a576-2ca2660de8ba tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action" status: 200 len: 24571 microversion: 2.1 time: 0.077278 Oct 12 23:12:10.914474 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3212/6326] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:12:10 2022] POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:12:17.288545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:17.289245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:17.295622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.296312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.296764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.297463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.297926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.298373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.425502 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7092ac4b-d203-47a4-a10b-82972736bc64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1832 microversion: 2.1 time: 0.142221 Oct 12 23:12:17.426078 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3115/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:17 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1832 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:17.449594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:17.450311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:17.458422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.458921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.459371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.460111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.460579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.461015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.592175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:17.600896 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7ded9f1d-5ab3-4176-8e46-37790c824276 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1681 microversion: 2.1 time: 0.155112 Oct 12 23:12:17.601455 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3213/6328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:17 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:17.702592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:17.704955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:17.710850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.711330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.711768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.712486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.712965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.713391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.763130 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b59a4222-a846-44ce-a9fa-f2de68b8ef55 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action" status: 200 len: 32646 microversion: 2.1 time: 0.065150 Oct 12 23:12:17.764039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3116/6329] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:12:17 2022] POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action => generated 32646 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:12:17.927856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:17.928469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:17.934976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.935465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.935929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.936629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:17.937093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:17.937526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:17.964479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bed030a1b645490e9a3560a4e2e42791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66f036844eb54e5590faab59eb8c44ce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:17.965078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] flavor_id is None. Assuming migration. {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 12 23:12:17.965531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:12:18.075346 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-73f5ca35-eee4-411c-8548-c76d5ce2c674 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action" status: 202 len: 0 microversion: 2.1 time: 0.151280 Oct 12 23:12:18.076166 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3214/6330] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:12:17 2022] POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:12:18.085234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:18.085970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:18.093192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:18.093680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:18.094122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:18.094818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:18.095273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:18.095763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:18.233120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:18.241123 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0247e39e-a1c9-45ae-aca7-1f85756c1641 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1690 microversion: 2.1 time: 0.160712 Oct 12 23:12:18.241777 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3117/6331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:18 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:19.266203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:19.266831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:19.272829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:19.273324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:19.273778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:19.275099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:19.275577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:19.276051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:19.411193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:19.419795 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-048e38f1-e7cc-4c99-8ecf-666bd5f687c4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1690 microversion: 2.1 time: 0.158532 Oct 12 23:12:19.420401 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3215/6332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:19 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:20.444517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:20.445092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:20.452481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:20.452968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:20.453411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:20.454106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:20.454566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:20.454995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:20.586984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:20.594646 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ad3214c7-4a64-4194-87b9-613f15875685 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.154155 Oct 12 23:12:20.595221 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3118/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:20 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:21.619497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:21.620159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:21.626966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:21.627450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:21.627919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:21.628623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:21.629084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:21.629515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:21.763192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:21.771181 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad8c0818-1f41-4354-923e-9a12799e2f25 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.156519 Oct 12 23:12:21.771752 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3216/6334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:21 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:22.794625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:22.795279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:22.802163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:22.802643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:22.803083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:22.804383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:22.804836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:22.805261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:22.937647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:22.945276 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35bcc938-85b7-414e-80f5-ee5315e3f601 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.154538 Oct 12 23:12:22.945842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3119/6335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:22 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:23.968647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:23.969274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:23.976122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:23.976671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:23.977126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:23.978249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:23.978723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:23.979160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:24.110170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:24.118424 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52635130-52c7-48d2-ae88-052f778a08bc tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.153699 Oct 12 23:12:24.118997 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3217/6336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:23 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:25.142580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:25.143198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:25.150065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:25.150573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:25.151016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:25.151705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:25.152189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:25.152617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:25.155217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=72 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:25.282654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:25.290820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-20089d2b-7901-419c-8456-b362c73c9266 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.152186 Oct 12 23:12:25.291397 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3120/6337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:25 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:26.314836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:26.315470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:26.318288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:26.323484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:26.323997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:26.324448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:26.325148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:26.325614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:26.326050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:26.460377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:26.468227 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ff7b7ff-0e0e-451d-8cfa-c115e8eb845f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.157125 Oct 12 23:12:26.468827 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3218/6338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:26 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:27.492757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:27.493414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:27.500394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:27.500880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:27.501322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:27.502048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:27.502506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:27.502933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:27.637825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:27.645478 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-637819c0-5fc4-47f5-865f-f1e444054569 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.157310 Oct 12 23:12:27.646045 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3121/6339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:27 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:28.669364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:28.669986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:28.676889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:28.677382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:28.678339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:28.679038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:28.679498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:28.679954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:28.683786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:28.811168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:28.818896 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-506bbf68-a84c-45f9-9005-7f5602f33667 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.153494 Oct 12 23:12:28.819462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3219/6340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:28 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:12:29.842169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:29.842781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:29.849610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:29.850092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:29.850531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:29.851217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:29.851669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:29.852133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:29.979951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:29.987582 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9705c9ae-0125-4d7c-8eef-a9c4b78e496c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.149337 Oct 12 23:12:29.988249 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3122/6341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:29 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:31.012220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:31.012851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:31.019754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:31.020217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:31.020670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:31.021379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:31.021862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:31.022295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:31.153751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:31.161454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc371f90-d48a-451a-af48-4698197a0316 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1695 microversion: 2.1 time: 0.153202 Oct 12 23:12:31.162519 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3220/6342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:31 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:32.186213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:32.186913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:32.189756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=30 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:32.196554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:32.197051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:32.197490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:32.198194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:32.198664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:32.199115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:32.242865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e21b5650-380f-4f55-a584-ae419072e89b req-9567ad24-6151-491f-b432-c095630980b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "name": "network-vif-unplugged", "status": "completed", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:32.255089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e21b5650-380f-4f55-a584-ae419072e89b req-9567ad24-6151-491f-b432-c095630980b1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:32.255690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e21b5650-380f-4f55-a584-ae419072e89b req-9567ad24-6151-491f-b432-c095630980b1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:32.256802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e21b5650-380f-4f55-a584-ae419072e89b req-9567ad24-6151-491f-b432-c095630980b1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:32.269258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e21b5650-380f-4f55-a584-ae419072e89b req-9567ad24-6151-491f-b432-c095630980b1 service nova] Creating event network-vif-unplugged:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h2-860864-8 Oct 12 23:12:32.274986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-e21b5650-380f-4f55-a584-ae419072e89b req-9567ad24-6151-491f-b432-c095630980b1 service nova] Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:12:32.286689 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e21b5650-380f-4f55-a584-ae419072e89b req-9567ad24-6151-491f-b432-c095630980b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048287 Oct 12 23:12:32.287416 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3221/6343] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:12:32.345911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:32.354152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d9d5f0b-e82a-456c-bf40-0fd6277e61c8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1694 microversion: 2.1 time: 0.171977 Oct 12 23:12:32.354943 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3123/6344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:32 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:33.379258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:33.380014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:33.386121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:33.386608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:33.387057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:33.387752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:33.388257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:33.388693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:33.521118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:33.530049 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-580c2047-e3ff-45c9-b3aa-619358070e65 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1692 microversion: 2.1 time: 0.155822 Oct 12 23:12:33.531950 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3222/6345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:33 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:34.321098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-16fcd438-07c1-47ad-8564-e85cb3bd5b97 req-5e9552fb-fcf8-46dc-b53d-c6df65824a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:34.331235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-16fcd438-07c1-47ad-8564-e85cb3bd5b97 req-5e9552fb-fcf8-46dc-b53d-c6df65824a69 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:34.331734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-16fcd438-07c1-47ad-8564-e85cb3bd5b97 req-5e9552fb-fcf8-46dc-b53d-c6df65824a69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:34.332185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-16fcd438-07c1-47ad-8564-e85cb3bd5b97 req-5e9552fb-fcf8-46dc-b53d-c6df65824a69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:34.343259 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-16fcd438-07c1-47ad-8564-e85cb3bd5b97 req-5e9552fb-fcf8-46dc-b53d-c6df65824a69 service nova] Creating event network-changed:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h2-860864-8 Oct 12 23:12:34.348419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-16fcd438-07c1-47ad-8564-e85cb3bd5b97 req-5e9552fb-fcf8-46dc-b53d-c6df65824a69 service nova] Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:12:34.359695 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-16fcd438-07c1-47ad-8564-e85cb3bd5b97 req-5e9552fb-fcf8-46dc-b53d-c6df65824a69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042496 Oct 12 23:12:34.360334 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3124/6346] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:34.554764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:34.556067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:34.563324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:34.563881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:34.564418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:34.565397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:34.566101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:34.567007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:34.739190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:34.747295 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f7b910d1-e25f-4dea-b444-fcf59270f178 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1692 microversion: 2.1 time: 0.196499 Oct 12 23:12:34.747882 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3223/6347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:34 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1692 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:35.772410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:35.773123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:35.780969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:35.781466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:35.781915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:35.782618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:35.783078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:35.783509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:35.922116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:35.930319 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21b650f5-6d51-4065-b268-0414800e5695 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1689 microversion: 2.1 time: 0.162232 Oct 12 23:12:35.930885 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3125/6348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:35 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:35.953289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:35.953844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:35.960957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:35.961457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:35.961910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:35.962617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:35.963084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:35.963526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:36.069794 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e7ba211-9b2a-4689-92a8-2a58ab36947a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action" status: 202 len: 0 microversion: 2.1 time: 0.120480 Oct 12 23:12:36.070419 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3224/6349] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:12:35 2022] POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:12:36.079579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:36.080250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:36.088311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:36.088817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:36.089241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:36.090522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:36.091000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:36.091437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:36.251561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:36.260889 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05096d0f-30a2-405f-b559-542563992826 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1688 microversion: 2.1 time: 0.185911 Oct 12 23:12:36.278843 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3126/6350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:36 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:37.286423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:37.287567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:37.293811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:37.294313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:37.294766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:37.295468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:37.295961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:37.296405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:37.426654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:37.434476 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2bd82dc-a534-400a-b90a-4251aff9ff0c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1688 microversion: 2.1 time: 0.153326 Oct 12 23:12:37.435050 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3225/6351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:37 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:37.932185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fa154dc6-e926-43c5-9a85-8e45ff7b68b2 req-58fb0516-4f1a-4e83-87b9-032daaedbe68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "name": "network-vif-plugged", "status": "completed", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:37.941650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa154dc6-e926-43c5-9a85-8e45ff7b68b2 req-58fb0516-4f1a-4e83-87b9-032daaedbe68 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:37.942132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa154dc6-e926-43c5-9a85-8e45ff7b68b2 req-58fb0516-4f1a-4e83-87b9-032daaedbe68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:37.942566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fa154dc6-e926-43c5-9a85-8e45ff7b68b2 req-58fb0516-4f1a-4e83-87b9-032daaedbe68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:37.954534 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fa154dc6-e926-43c5-9a85-8e45ff7b68b2 req-58fb0516-4f1a-4e83-87b9-032daaedbe68 service nova] Creating event network-vif-plugged:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h2-860864-8 Oct 12 23:12:37.960341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-fa154dc6-e926-43c5-9a85-8e45ff7b68b2 req-58fb0516-4f1a-4e83-87b9-032daaedbe68 service nova] Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:12:37.970739 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fa154dc6-e926-43c5-9a85-8e45ff7b68b2 req-58fb0516-4f1a-4e83-87b9-032daaedbe68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166034 Oct 12 23:12:37.971635 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3127/6352] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:12:38.457439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:38.458058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:38.466303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:38.466799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:38.467244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:38.468101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:38.468557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:38.469016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:38.616434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:38.624379 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e1feb65e-3a5b-4a41-8251-687cebd1ef66 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1688 microversion: 2.1 time: 0.170869 Oct 12 23:12:38.624945 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3226/6353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:38 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:39.616528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-613bf3fe-e1cd-454b-8559-8a147e9977d9 req-f84f5026-6cf0-4932-b890-82122c0efd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "name": "network-vif-unplugged", "status": "completed", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:39.629285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-613bf3fe-e1cd-454b-8559-8a147e9977d9 req-f84f5026-6cf0-4932-b890-82122c0efd8f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:39.629755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-613bf3fe-e1cd-454b-8559-8a147e9977d9 req-f84f5026-6cf0-4932-b890-82122c0efd8f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:39.630204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-613bf3fe-e1cd-454b-8559-8a147e9977d9 req-f84f5026-6cf0-4932-b890-82122c0efd8f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:39.641021 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-613bf3fe-e1cd-454b-8559-8a147e9977d9 req-f84f5026-6cf0-4932-b890-82122c0efd8f service nova] Creating event network-vif-unplugged:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:12:39.648073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-613bf3fe-e1cd-454b-8559-8a147e9977d9 req-f84f5026-6cf0-4932-b890-82122c0efd8f service nova] Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:12:39.648838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:39.649462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:39.656440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:39.656931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:39.657372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:39.658270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:39.658887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:39.659480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:39.660994 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-613bf3fe-e1cd-454b-8559-8a147e9977d9 req-f84f5026-6cf0-4932-b890-82122c0efd8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112872 Oct 12 23:12:39.662540 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3128/6354] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:39.805552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:39.814137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c48b7dc-de80-464b-ab17-c83aa984aae8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1688 microversion: 2.1 time: 0.169549 Oct 12 23:12:39.814757 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3227/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:39 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:12:40.839015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:40.839727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:40.847171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:40.847661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:40.848131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:40.849332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:40.849801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:40.850233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:40.984665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:40.993874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-69ae26a6-7e57-4f18-8bad-ac15e0017c51 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1688 microversion: 2.1 time: 0.158882 Oct 12 23:12:40.994446 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3129/6356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:40 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:41.680062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6f7428b1-38c8-4ec7-801b-8aa95eede3ca req-42f1abc7-ea19-4477-83a3-6c4747ca3864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:41.690098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6f7428b1-38c8-4ec7-801b-8aa95eede3ca req-42f1abc7-ea19-4477-83a3-6c4747ca3864 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:41.690588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6f7428b1-38c8-4ec7-801b-8aa95eede3ca req-42f1abc7-ea19-4477-83a3-6c4747ca3864 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:41.691030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6f7428b1-38c8-4ec7-801b-8aa95eede3ca req-42f1abc7-ea19-4477-83a3-6c4747ca3864 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:41.703173 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6f7428b1-38c8-4ec7-801b-8aa95eede3ca req-42f1abc7-ea19-4477-83a3-6c4747ca3864 service nova] Creating event network-changed:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:12:41.709238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-6f7428b1-38c8-4ec7-801b-8aa95eede3ca req-42f1abc7-ea19-4477-83a3-6c4747ca3864 service nova] Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:12:41.720307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6f7428b1-38c8-4ec7-801b-8aa95eede3ca req-42f1abc7-ea19-4477-83a3-6c4747ca3864 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044107 Oct 12 23:12:41.720911 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3228/6357] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:42.019026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:42.019633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:42.026730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:42.027247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:42.027660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:42.028405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:42.028871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:42.029306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:42.182290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:42.190101 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f04cc0c4-af07-4627-8341-ebf932ea3ba2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1688 microversion: 2.1 time: 0.175557 Oct 12 23:12:42.190675 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3130/6358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:42 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:43.216100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:43.216825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:43.223277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:43.224295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:43.224748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:43.225453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:43.225926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:43.226364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:43.355956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:12:43.363558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d0ed711-94e5-4b08-844e-be61547000b4 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1681 microversion: 2.1 time: 0.152954 Oct 12 23:12:43.364175 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3229/6359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:12:43 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:12:46.872207 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e04f4569-172b-44d4-b8c3-69121aebd991 req-65a6914f-fdb9-4aaf-80a0-d3a5618d6d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "name": "network-vif-plugged", "status": "completed", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:46.886544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e04f4569-172b-44d4-b8c3-69121aebd991 req-65a6914f-fdb9-4aaf-80a0-d3a5618d6d75 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:46.887027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e04f4569-172b-44d4-b8c3-69121aebd991 req-65a6914f-fdb9-4aaf-80a0-d3a5618d6d75 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:46.887460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e04f4569-172b-44d4-b8c3-69121aebd991 req-65a6914f-fdb9-4aaf-80a0-d3a5618d6d75 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:46.900048 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e04f4569-172b-44d4-b8c3-69121aebd991 req-65a6914f-fdb9-4aaf-80a0-d3a5618d6d75 service nova] Creating event network-vif-plugged:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:12:46.905130 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e04f4569-172b-44d4-b8c3-69121aebd991 req-65a6914f-fdb9-4aaf-80a0-d3a5618d6d75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036915 Oct 12 23:12:46.905749 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3131/6360] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:46.917020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:46.917538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:46.924030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:46.924518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:46.924959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:46.925653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:46.926110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:46.926540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:46.951219 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b1627a9-b256-4ef9-92bc-ce7c97b982cc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/ips" status: 200 len: 150 microversion: 2.1 time: 0.038193 Oct 12 23:12:46.951804 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3230/6361] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:12:46 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:48.280516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "384d21e1-8068-4551-b520-c80e90fe0a30"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:48.282907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:48.289504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:48.289983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:48.290452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:48.291138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:48.291588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:48.292042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:48.524609 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4518a14d-6441-4c69-8f3c-9cc6881d96d6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249107 Oct 12 23:12:48.525236 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3132/6362] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:12:48 2022] POST /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:12:59.237268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "384d21e1-8068-4551-b520-c80e90fe0a30"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:12:59.240193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:59.243249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=29 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:59.243933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:59.249384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:59.249866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:59.250310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:59.250999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:59.251459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:59.251912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:59.330648 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Invalid volume: volume 384d21e1-8068-4551-b520-c80e90fe0a30 is already attached to instances: 621000c2-0d95-4701-b050-a9e32ba107f7 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments HTTP/1.1 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 74 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: {"volumeAttachment": {"volumeId": "384d21e1-8068-4551-b520-c80e90fe0a30"}} Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: exception: Invalid volume: volume 384d21e1-8068-4551-b520-c80e90fe0a30 is already attached to instances: 621000c2-0d95-4701-b050-a9e32ba107f7 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': '621000c2-0d95-4701-b050-a9e32ba107f7', 'body': {'volumeAttachment': {'volumeId': '384d21e1-8068-4551-b520-c80e90fe0a30'}}} Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 384d21e1-8068-4551-b520-c80e90fe0a30 is already attached to instances: 621000c2-0d95-4701-b050-a9e32ba107f7 Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:12:59.332483 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 384d21e1-8068-4551-b520-c80e90fe0a30 is already attached to instances: 621000c2-0d95-4701-b050-a9e32ba107f7 Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 384d21e1-8068-4551-b520-c80e90fe0a30 is already attached to instances: 621000c2-0d95-4701-b050-a9e32ba107f7 Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 400 to user: Invalid volume: volume 384d21e1-8068-4551-b520-c80e90fe0a30 is already attached to instances: 621000c2-0d95-4701-b050-a9e32ba107f7 {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95970af7-e3ee-4170-8f08-e3a8fe59d03e tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101005 Oct 12 23:12:59.336867 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3231/6363] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:12:59 2022] POST /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:12:59.400185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=19 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:59.400953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:12:59.405774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:59.406355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:59.414519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:59.415027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:59.415464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:59.416172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:59.416625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:59.417077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:59.497736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lazy-loading 'services' on Instance uuid 621000c2-0d95-4701-b050-a9e32ba107f7 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:12:59.567436 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f35989ad-cec8-417b-b4ac-f3fbebbc2dd6 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments/384d21e1-8068-4551-b520-c80e90fe0a30" status: 202 len: 0 microversion: 2.1 time: 0.169223 Oct 12 23:12:59.568186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3133/6364] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:12:59 2022] DELETE /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments/384d21e1-8068-4551-b520-c80e90fe0a30 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:12:59.576632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:12:59.578985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:12:59.585680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:59.585945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:59.586402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:59.587115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:12:59.587671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:12:59.588147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:12:59.620991 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eaa94fce-0e42-4954-93d3-29b2daabbdb4 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048215 Oct 12 23:12:59.621476 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3232/6365] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:12:59 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:00.637319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:00.639825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:00.647137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:00.647621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:00.648098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:00.648993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:00.649444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:00.650039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:00.685626 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4cd42ce4-dec2-4e0a-a13d-44fa7e872535 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056158 Oct 12 23:13:00.686148 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3134/6366] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:13:00 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:01.698903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:01.701259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:01.708200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:01.708700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:01.709152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:01.709859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:01.710323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:01.710758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:01.741772 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52fe908d-565e-46c0-821e-fa6f60953fc3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Oct 12 23:13:01.742346 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3233/6367] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:13:01 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:02.755141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:02.757422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:02.764352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:02.764831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:02.765267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:02.765958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:02.766430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:02.766850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:02.797233 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c1c1f89f-9945-4c11-ab94-d6fbbe77d105 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Oct 12 23:13:02.797997 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3135/6368] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:13:02 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:03.809982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:03.812160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:03.819065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:03.819563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:03.820046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:03.820758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:03.821221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:03.821657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:03.853375 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22373a32-36f8-4f25-b0f7-68564c083754 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047507 Oct 12 23:13:03.853963 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3234/6369] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:13:03 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:13:04.865944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:04.868455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:04.875153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:04.875625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:04.876094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:04.876777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:04.877224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:04.877648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:04.908487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78d518cc-4c8a-4b16-b52d-7b4cfa53f374 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046544 Oct 12 23:13:04.909032 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3136/6370] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:13:04 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:13:04.970579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:04.971093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:04.977723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:04.978215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:04.978660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:04.979351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:04.979810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:04.980275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:05.008962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:13:05.082810 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95854974-065e-406b-9211-0baf568eecca tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 204 len: 0 microversion: 2.1 time: 0.115020 Oct 12 23:13:05.083293 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3235/6371] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:13:04 2022] DELETE /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:13:05.092161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:05.092821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:05.098815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:05.099301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:05.099744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:05.100474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:05.100931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:05.101362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:05.233669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:05.241947 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-210c0713-3606-4a35-aac9-0b2babd515fb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1681 microversion: 2.1 time: 0.154319 Oct 12 23:13:05.242525 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3137/6372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:05 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:06.266948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:06.267666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:06.274478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:06.274970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:06.275420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:06.276158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:06.276619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:06.277051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:06.406959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:06.415173 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cbf720e1-8093-4030-85af-1eb2824d1111 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1681 microversion: 2.1 time: 0.152624 Oct 12 23:13:06.415739 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3236/6373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:06 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:07.411379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c193c0b9-a8f9-4785-ab0d-00e1e0f6f73e req-1df7569a-020a-4616-8391-cdf36e3299a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621000c2-0d95-4701-b050-a9e32ba107f7", "name": "network-vif-deleted", "tag": "89e28109-96ab-44ea-b03a-ed8c15bfe94b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:07.423941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c193c0b9-a8f9-4785-ab0d-00e1e0f6f73e req-1df7569a-020a-4616-8391-cdf36e3299a1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:07.424896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c193c0b9-a8f9-4785-ab0d-00e1e0f6f73e req-1df7569a-020a-4616-8391-cdf36e3299a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:07.425907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c193c0b9-a8f9-4785-ab0d-00e1e0f6f73e req-1df7569a-020a-4616-8391-cdf36e3299a1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:07.439803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:07.440386 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c193c0b9-a8f9-4785-ab0d-00e1e0f6f73e req-1df7569a-020a-4616-8391-cdf36e3299a1 service nova] Creating event network-vif-deleted:89e28109-96ab-44ea-b03a-ed8c15bfe94b for instance 621000c2-0d95-4701-b050-a9e32ba107f7 on n-h2-860864-8 Oct 12 23:13:07.440527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:07.447200 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c193c0b9-a8f9-4785-ab0d-00e1e0f6f73e req-1df7569a-020a-4616-8391-cdf36e3299a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114087 Oct 12 23:13:07.448174 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3138/6374] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:07.452041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:07.452742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:07.453367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:07.454510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:07.455143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:07.455926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:07.504770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:07.505193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:07.505700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:07.506185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lazy-loading 'fault' on Instance uuid 621000c2-0d95-4701-b050-a9e32ba107f7 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:13:07.555592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:07.564890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:07.567445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:07.568604 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-97f1a4b1-77e5-44f4-b9df-9b48914a92f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 200 len: 1330 microversion: 2.1 time: 0.133235 Oct 12 23:13:07.569685 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3237/6375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:07 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:07.574210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:07.574775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:07.575287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:07.582088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:07.582863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:07.583515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:07.649431 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a7c6a4b-7733-45c1-bba8-670e46c6d9f7 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action" status: 200 len: 62049 microversion: 2.1 time: 0.088805 Oct 12 23:13:07.650058 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3139/6376] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:13:07 2022] POST /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e/action => generated 62049 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 23:13:08.593939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:08.594578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:08.601962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:08.602462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:08.602918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:08.603628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:08.604121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:08.604567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:08.618549 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 HTTP/1.1 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '621000c2-0d95-4701-b050-a9e32ba107f7'} Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:13:08.620225 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-66fa9379-3452-41ce-b6fa-6bcb49b5f7ad tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 404 len: 111 microversion: 2.1 time: 0.031740 Oct 12 23:13:08.625327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3238/6377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:08 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:13:08.631067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a02ef74-2597-4ed2-abb0-790585f6f06a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '.version_select at 0x7f44ff7460d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:08.651443 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a02ef74-2597-4ed2-abb0-790585f6f06a tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266299263" status: 202 len: 0 microversion: 2.1 time: 0.024492 Oct 12 23:13:08.652022 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3140/6378] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 23:13:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266299263 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:13:09.272312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e387bf6-ff67-40e0-bb8a-13d498cf55e2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: .version_select at 0x7f44ffbae940>, body: {"keypair": {"name": "tempest-keypair-59099130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwNrBzNjw3sPRk3dkwp3eZEv96k2cs/I39OUgB0hFxRwpolP4tX3Q55oUBCQBZBd3l+xVXIaGDG1NeRSN/LJR37hfzBbYKs9XxX1l3cBc5NuqvNQI7On02ugTwzeQhUQg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:09.288370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6e387bf6-ff67-40e0-bb8a-13d498cf55e2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:13:09.293394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-6e387bf6-ff67-40e0-bb8a-13d498cf55e2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:13:09.316585 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e387bf6-ff67-40e0-bb8a-13d498cf55e2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048652 Oct 12 23:13:09.317157 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3239/6379] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:13:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:10.538438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1451556002", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97e12d6e-78cf-47d7-bedb-c663c72a095d"}], "security_groups": [{"name": "tempest-securitygroup--1197815643"}], "key_name": "tempest-keypair-59099130", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:10.644712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] validate_networks() for [('97e12d6e-78cf-47d7-bedb-c663c72a095d', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:13:11.028320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:13:11.028757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:13:11.029242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:13:11.029662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:13:11.030081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:13:11.038928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:11.039417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:11.039857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:11.040623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:11.041075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:11.041501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:11.061752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:13:11.067827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Getting quotas for user 0b6d75d719a84ad784fef7fff1a553ed and project ab4105e6156f4fc3bb67979e577337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:13:11.080322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:13:11.083362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:13:11.131236 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a81f97d4-d91c-4ca8-8a6e-3fd7cad3010c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598669 Oct 12 23:13:11.132247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3141/6380] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:13:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:13:11.144219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a64ac27f-688c-4872-a78b-91f9d17232b8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:11.144863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a64ac27f-688c-4872-a78b-91f9d17232b8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:11.213634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a64ac27f-688c-4872-a78b-91f9d17232b8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:11.220629 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a64ac27f-688c-4872-a78b-91f9d17232b8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1240 microversion: 2.1 time: 0.081376 Oct 12 23:13:11.221200 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3240/6381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:11 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:12.243563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:12.244167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:12.251478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:12.252090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:12.252611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:12.253568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:12.254109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:12.255184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:12.321363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:12.330033 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56089956-501d-424a-824b-47b9eb026e37 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1300 microversion: 2.1 time: 0.090664 Oct 12 23:13:12.330610 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3142/6382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:12 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:13.354547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:13.355185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:13.363187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:13.363689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:13.364164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:13.364873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:13.365337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:13.365803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:13.561232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:13.568993 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a5decc4-1fd6-411d-9b77-5e2043efda4b tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1366 microversion: 2.1 time: 0.218433 Oct 12 23:13:13.569577 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3241/6383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:13 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:13.662310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-58a6dabf-306a-4e7b-b3ff-d2437431e835 req-f37daf73-f855-4351-98f9-893e7fc7a5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495724ff-b08a-44b1-a80b-39f9d4db5974", "tag": "8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:13.675329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-58a6dabf-306a-4e7b-b3ff-d2437431e835 req-f37daf73-f855-4351-98f9-893e7fc7a5b8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:13.676079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-58a6dabf-306a-4e7b-b3ff-d2437431e835 req-f37daf73-f855-4351-98f9-893e7fc7a5b8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:13.676511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-58a6dabf-306a-4e7b-b3ff-d2437431e835 req-f37daf73-f855-4351-98f9-893e7fc7a5b8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:13.690637 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-58a6dabf-306a-4e7b-b3ff-d2437431e835 req-f37daf73-f855-4351-98f9-893e7fc7a5b8 service nova] Creating event network-changed:8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf for instance 495724ff-b08a-44b1-a80b-39f9d4db5974 on n-h2-860864-8 Oct 12 23:13:13.695330 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-58a6dabf-306a-4e7b-b3ff-d2437431e835 req-f37daf73-f855-4351-98f9-893e7fc7a5b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037947 Oct 12 23:13:13.696032 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3143/6384] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:13.823438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:13.824030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:13.830023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:13.830515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:13.830948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:13.832297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:13.832762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:13.833190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:14.030817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ccef0f1d-8ad3-4d2f-ab25-04f668b1db64 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1832 microversion: 2.1 time: 0.211204 Oct 12 23:13:14.032095 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3242/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:13 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1832 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:14.593217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:14.593917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:14.600751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:14.601236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:14.601670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:14.602378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:14.602835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:14.603267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:14.803191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:14.811083 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c497892-7fd7-4046-a932-0c2b39a2491f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1366 microversion: 2.1 time: 0.222163 Oct 12 23:13:14.811666 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3144/6386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:14 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:14.945239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:14.951102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2922de34-936b-4986-9009-c0a858572aa6 req-ef9c9786-e03f-4ef3-9f09-95aa7572e095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:14.957160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:14.964749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:14.965260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:14.965745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:14.966471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:14.966938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:14.967379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:14.977695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2922de34-936b-4986-9009-c0a858572aa6 req-ef9c9786-e03f-4ef3-9f09-95aa7572e095 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:14.977937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2922de34-936b-4986-9009-c0a858572aa6 req-ef9c9786-e03f-4ef3-9f09-95aa7572e095 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:14.978768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2922de34-936b-4986-9009-c0a858572aa6 req-ef9c9786-e03f-4ef3-9f09-95aa7572e095 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:15.002343 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2922de34-936b-4986-9009-c0a858572aa6 req-ef9c9786-e03f-4ef3-9f09-95aa7572e095 service nova] Creating event network-changed:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:13:15.008826 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2922de34-936b-4986-9009-c0a858572aa6 req-ef9c9786-e03f-4ef3-9f09-95aa7572e095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061298 Oct 12 23:13:15.009542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:13:15.010288 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3145/6387] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:15.109924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-88a16649-3417-4078-9cd5-cebca09bde60 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 204 len: 0 microversion: 2.1 time: 0.168504 Oct 12 23:13:15.110742 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3243/6388] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:13:14 2022] DELETE /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:13:15.120125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:15.123312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:15.131553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:15.132651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:15.133297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:15.134513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:15.135190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:15.135837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:15.313941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:15.322235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7868dff7-f74f-4ba4-b41e-b15638531c59 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1687 microversion: 2.1 time: 0.206611 Oct 12 23:13:15.323596 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3146/6389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:15 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1687 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:15.835433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:15.836243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:15.842188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:15.843217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:15.843664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:15.844402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:15.844867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:15.845314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:15.985570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:15.994357 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3030199-da0c-45c0-a259-1c6e12c00936 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1366 microversion: 2.1 time: 0.163892 Oct 12 23:13:15.995936 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3244/6390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:15 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:16.347503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:16.348259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:16.356395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:16.357307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:16.357802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:16.358635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:16.359596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:16.359720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:16.743389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:16.751304 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1cdcc85b-6a72-430d-a459-84d95f4cb643 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 200 len: 1687 microversion: 2.1 time: 0.408458 Oct 12 23:13:16.751899 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3147/6391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:16 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 1687 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:17.019255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:17.019916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:17.034688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.035194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.035651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:17.036475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.036980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.037424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:17.179516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:17.187806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08847a3c-ac0d-4b8b-8571-39257555d2dc tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1366 microversion: 2.1 time: 0.173034 Oct 12 23:13:17.188039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4ccfa16b-7d5c-422f-a92f-727985acf5c2 req-e0a9ed54-0ed8-4d6a-b2bc-1a8c184b4710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d9dd04-5b4e-4537-b66e-0fd1ca66202e", "name": "network-vif-deleted", "tag": "a46506ec-6365-4832-85b1-eec2dbe1add3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:17.188426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3245/6392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:17 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:17.197828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4ccfa16b-7d5c-422f-a92f-727985acf5c2 req-e0a9ed54-0ed8-4d6a-b2bc-1a8c184b4710 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.198497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4ccfa16b-7d5c-422f-a92f-727985acf5c2 req-e0a9ed54-0ed8-4d6a-b2bc-1a8c184b4710 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.199011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4ccfa16b-7d5c-422f-a92f-727985acf5c2 req-e0a9ed54-0ed8-4d6a-b2bc-1a8c184b4710 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:17.211395 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4ccfa16b-7d5c-422f-a92f-727985acf5c2 req-e0a9ed54-0ed8-4d6a-b2bc-1a8c184b4710 service nova] Creating event network-vif-deleted:a46506ec-6365-4832-85b1-eec2dbe1add3 for instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e on n-h1-860864-8 Oct 12 23:13:17.216548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4ccfa16b-7d5c-422f-a92f-727985acf5c2 req-e0a9ed54-0ed8-4d6a-b2bc-1a8c184b4710 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032315 Oct 12 23:13:17.217389 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3148/6393] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:13:17.774785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:17.775410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: d6d9dd04-5b4e-4537-b66e-0fd1ca66202e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:17.781456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.781947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.782390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:17.783076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.783533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.784002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:17.797487 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] HTTP exception thrown: Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e could not be found. Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Request method failure captured: Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e HTTP/1.1 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0kqmkCckov03ZauIpTDCUZIKTY8Kyp9KOUZNrMzfjEP3qvbaSMWm6I1lMqhBkVkPG05W5JF8FFbYD_Tf2FC3COWkpm1EoMphALrInRN521AzvHylU0eCmOG8Um2UpJ19k754WPIlTPAVplVV32LqXsh--BGtnXiT-J11_CaxsWWCvM Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1440ecf02574c5f8355519787af4360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1440ecf02574c5f8355519787af4360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}] Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: dcfdaa332f374558a08e972c2487dbea Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e could not be found. Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd6d9dd04-5b4e-4537-b66e-0fd1ca66202e'} Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e could not be found. Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e could not be found. Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:17.799113 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e could not be found. Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Returning 404 to user: Instance d6d9dd04-5b4e-4537-b66e-0fd1ca66202e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e55d3803-93a2-45bd-b7d2-6611eaa32d2a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e" status: 404 len: 111 microversion: 2.1 time: 0.029720 Oct 12 23:13:17.804488 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3246/6394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:17 2022] GET /compute/v2.1/servers/d6d9dd04-5b4e-4537-b66e-0fd1ca66202e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:13:17.969212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-16f873fa-6ce8-4bf2-a997-4716c989fe51 req-011451e3-ae1a-45ce-bb4c-2000b820e336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495724ff-b08a-44b1-a80b-39f9d4db5974", "name": "network-vif-plugged", "status": "completed", "tag": "8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:17.985550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-16f873fa-6ce8-4bf2-a997-4716c989fe51 req-011451e3-ae1a-45ce-bb4c-2000b820e336 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:17.986034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-16f873fa-6ce8-4bf2-a997-4716c989fe51 req-011451e3-ae1a-45ce-bb4c-2000b820e336 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:17.986465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-16f873fa-6ce8-4bf2-a997-4716c989fe51 req-011451e3-ae1a-45ce-bb4c-2000b820e336 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:18.002647 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-16f873fa-6ce8-4bf2-a997-4716c989fe51 req-011451e3-ae1a-45ce-bb4c-2000b820e336 service nova] Creating event network-vif-plugged:8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf for instance 495724ff-b08a-44b1-a80b-39f9d4db5974 on n-h2-860864-8 Oct 12 23:13:18.007634 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-16f873fa-6ce8-4bf2-a997-4716c989fe51 req-011451e3-ae1a-45ce-bb4c-2000b820e336 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043808 Oct 12 23:13:18.008706 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3149/6395] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:18.213796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:18.214425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:18.221218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:18.221707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:18.222148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:18.222844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:18.223363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:18.223797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:18.227930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:18.354183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:18.361963 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-33cef596-cd7b-4c3f-9aea-325121ef5fe1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1366 microversion: 2.1 time: 0.152032 Oct 12 23:13:18.362566 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3247/6396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:18 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:19.386492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:19.387206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:19.393926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:19.394643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:19.395796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:19.396684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:19.397303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:19.397907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:19.554279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:19.569490 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4e5cdaf-e6ab-4865-b6ba-f86a2fd240e3 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1556 microversion: 2.1 time: 0.187659 Oct 12 23:13:19.580034 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3150/6397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:19 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:19.592473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:19.593029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:19.601458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:19.601959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:19.602405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:19.603198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:19.603567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:19.604073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:19.693307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9faac5d5-8956-400d-bdd8-b287ba1014b5 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104733 Oct 12 23:13:19.694096 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3248/6398] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:13:19 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:21.030470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a302310-e8fa-4798-a03e-9fe06ab2c6fd tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '.version_select at 0x7f4507a7d430>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:21.052648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:21.054684 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a302310-e8fa-4798-a03e-9fe06ab2c6fd tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-202536976" status: 202 len: 0 microversion: 2.1 time: 0.028151 Oct 12 23:13:21.055832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3151/6399] 10.222.0.20 () {58 vars in 1281 bytes} [Wed Oct 12 23:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-202536976 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:13:21.089831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1548cb13-9a82-4a4a-a258-dfe41f1281e0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: .version_select at 0x7f44fe6a85e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-768190717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo/BK5MJKPQrfGzKVVOLqtcyw7fuLlVhrjLn4QdQPP6Ll07fTh+K6dC06q4kO7TJxzSt8bLlJE63dZPgIT5knt5yRKdIPScF53OlDMUnJGT9dFBWzHuABsoh0CBokvWDw=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:21.105907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1548cb13-9a82-4a4a-a258-dfe41f1281e0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:13:21.111968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-1548cb13-9a82-4a4a-a258-dfe41f1281e0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:13:21.135623 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1548cb13-9a82-4a4a-a258-dfe41f1281e0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050602 Oct 12 23:13:21.137086 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3249/6400] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:13:21 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:21.208160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:21.212305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b75982b5-0a2d-4cc6-85eb-564851f32911 req-8ef6d446-0520-4bbb-b8c4-519dd224915c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495724ff-b08a-44b1-a80b-39f9d4db5974", "tag": "8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:21.223942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b75982b5-0a2d-4cc6-85eb-564851f32911 req-8ef6d446-0520-4bbb-b8c4-519dd224915c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:21.224682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b75982b5-0a2d-4cc6-85eb-564851f32911 req-8ef6d446-0520-4bbb-b8c4-519dd224915c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:21.225123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b75982b5-0a2d-4cc6-85eb-564851f32911 req-8ef6d446-0520-4bbb-b8c4-519dd224915c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:21.235819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b75982b5-0a2d-4cc6-85eb-564851f32911 req-8ef6d446-0520-4bbb-b8c4-519dd224915c service nova] Creating event network-changed:8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf for instance 495724ff-b08a-44b1-a80b-39f9d4db5974 on n-h2-860864-8 Oct 12 23:13:21.240768 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b75982b5-0a2d-4cc6-85eb-564851f32911 req-8ef6d446-0520-4bbb-b8c4-519dd224915c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033746 Oct 12 23:13:21.241709 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3152/6401] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:27.044621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1137010130", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "0c0cf9ed-9fb5-4aba-b2b3-1a954fdf3047"}], "key_name": "tempest-TestNetworkAdvancedServerOps-768190717", "security_groups": [{"name": "tempest-secgroup-smoke-1225734287"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:27.164239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] validate_networks() for [('0c0cf9ed-9fb5-4aba-b2b3-1a954fdf3047', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:13:27.595093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:13:27.595571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:13:27.596125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:13:27.596703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:13:27.597176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:13:27.607869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:27.608391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:27.608834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:27.609556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:27.610010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:27.610484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:27.627378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:13:27.632853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:13:27.646314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:13:27.648716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:13:27.694672 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4f05c095-ecf3-42a4-ae9a-0ecc18b3371f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653928 Oct 12 23:13:27.695508 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3250/6402] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:13:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 23:13:27.708518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9804d831-b9a5-4d44-a529-00ddc5a20b77 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:27.709361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9804d831-b9a5-4d44-a529-00ddc5a20b77 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:27.769571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9804d831-b9a5-4d44-a529-00ddc5a20b77 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:27.777510 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9804d831-b9a5-4d44-a529-00ddc5a20b77 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1266 microversion: 2.1 time: 0.074397 Oct 12 23:13:27.778114 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3153/6403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:27 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:28.801937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:28.802555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:28.812380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:28.813147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:28.814322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:28.815511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:28.816181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:28.816537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:28.899185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:28.906966 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3d02ae8e-752c-46ca-af9c-aafbaa8d9055 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1336 microversion: 2.1 time: 0.109862 Oct 12 23:13:28.907876 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3251/6404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:28 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1336 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:29.931556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:29.932201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:29.935056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:29.947163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:29.947652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:29.950145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:29.951649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:29.952162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:29.952602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:29.957035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:30.153962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:30.162970 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71334a08-66cb-477d-b8f8-02064aa54e1f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1392 microversion: 2.1 time: 0.235619 Oct 12 23:13:30.175983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3154/6405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:29 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:30.289114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-cfbd553e-d3f8-4e0e-8923-cd05bdf3b815 req-a9c088d4-8011-45d1-9eba-d5aab417dfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e97d9c-90c8-4927-9b00-7675fbbe4fa6", "tag": "ff1611a3-6f53-42e0-9096-34f6bd82611f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:30.296274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:30.306945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cfbd553e-d3f8-4e0e-8923-cd05bdf3b815 req-a9c088d4-8011-45d1-9eba-d5aab417dfee service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:30.307563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cfbd553e-d3f8-4e0e-8923-cd05bdf3b815 req-a9c088d4-8011-45d1-9eba-d5aab417dfee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:30.308236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-cfbd553e-d3f8-4e0e-8923-cd05bdf3b815 req-a9c088d4-8011-45d1-9eba-d5aab417dfee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:30.321076 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-cfbd553e-d3f8-4e0e-8923-cd05bdf3b815 req-a9c088d4-8011-45d1-9eba-d5aab417dfee service nova] Creating event network-changed:ff1611a3-6f53-42e0-9096-34f6bd82611f for instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 on n-h1-860864-8 Oct 12 23:13:30.326722 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-cfbd553e-d3f8-4e0e-8923-cd05bdf3b815 req-a9c088d4-8011-45d1-9eba-d5aab417dfee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042454 Oct 12 23:13:30.327252 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3252/6406] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:13:31.186044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:31.186655 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:31.193451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:31.193931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:31.194363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:31.195040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:31.195941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:31.196372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:31.326582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:31.335225 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a82be85-e07c-4795-9bc4-623e96a9a261 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1392 microversion: 2.1 time: 0.153013 Oct 12 23:13:31.335804 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3155/6407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:31 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:32.360029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:32.360747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:32.367836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:32.368614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:32.369062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:32.369758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:32.370221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:32.370656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:32.503842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:32.511561 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-53a9ba45-d575-473c-abb7-2ac9f60de903 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1392 microversion: 2.1 time: 0.156690 Oct 12 23:13:32.512185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3253/6408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:32 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:33.534447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:33.535075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:33.541948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:33.542422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:33.542866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:33.543568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:33.544063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:33.544497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:33.678282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:33.686199 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87d00fdc-4462-400b-8deb-d48915815230 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1392 microversion: 2.1 time: 0.155622 Oct 12 23:13:33.686711 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3156/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:33 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:34.710781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:34.712834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:34.720824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:34.721312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:34.721753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:34.722477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:34.722937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:34.723911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:34.860186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:34.868818 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12486689-71c6-499b-b6a7-ac9548fad37f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1392 microversion: 2.1 time: 0.162804 Oct 12 23:13:34.869387 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3254/6410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:34 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:35.891709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:35.892388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:35.899795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:35.900312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:35.900756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:35.901448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:35.901902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:35.902347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:36.033615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:36.041767 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aaa3ff07-3535-4dca-935b-8a2718588968 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1392 microversion: 2.1 time: 0.154272 Oct 12 23:13:36.042335 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3157/6411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:35 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:37.015720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-14b286ae-3a91-41ba-8d64-0bfc8818903a req-4ef97910-ccad-4402-abd9-963ca23f9712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e97d9c-90c8-4927-9b00-7675fbbe4fa6", "name": "network-vif-plugged", "status": "completed", "tag": "ff1611a3-6f53-42e0-9096-34f6bd82611f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:37.028288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-14b286ae-3a91-41ba-8d64-0bfc8818903a req-4ef97910-ccad-4402-abd9-963ca23f9712 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:37.028787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-14b286ae-3a91-41ba-8d64-0bfc8818903a req-4ef97910-ccad-4402-abd9-963ca23f9712 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:37.029575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-14b286ae-3a91-41ba-8d64-0bfc8818903a req-4ef97910-ccad-4402-abd9-963ca23f9712 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:37.041320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-14b286ae-3a91-41ba-8d64-0bfc8818903a req-4ef97910-ccad-4402-abd9-963ca23f9712 service nova] Creating event network-vif-plugged:ff1611a3-6f53-42e0-9096-34f6bd82611f for instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 on n-h1-860864-8 Oct 12 23:13:37.046734 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-14b286ae-3a91-41ba-8d64-0bfc8818903a req-4ef97910-ccad-4402-abd9-963ca23f9712 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034472 Oct 12 23:13:37.047345 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3255/6412] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:37.064721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:37.065558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:37.072597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:37.073089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:37.073533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:37.075103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:37.075571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:37.076032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:37.273127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:37.280784 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87e01c9d-9f40-4d81-96a2-9194ce891351 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1392 microversion: 2.1 time: 0.220098 Oct 12 23:13:37.281365 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3158/6413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:37 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:38.306021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:38.306679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:38.308746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:38.309419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:38.316832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:38.317330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:38.317780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:38.318496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:38.318959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:38.319394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:38.458863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:38.466675 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b9a51f8-5872-442e-b61d-02f0b97a6c49 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1563 microversion: 2.1 time: 0.166144 Oct 12 23:13:38.467249 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3256/6414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:38 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:13:38.488839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:38.489460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:38.491346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:38.497686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:38.498176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:38.498619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:38.499315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:38.499985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:38.500418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:38.637188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:38.644977 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e6b1655d-fc03-44fa-b7ff-24f63b8a2160 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1563 microversion: 2.1 time: 0.159986 Oct 12 23:13:38.645594 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3159/6415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:38 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:40.507787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:40.508600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:40.510265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c9151966-f7d1-4d84-b2aa-8b13bbc13239 req-cb93fbd3-0f56-47d0-8bed-6a02f71753d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e97d9c-90c8-4927-9b00-7675fbbe4fa6", "tag": "ff1611a3-6f53-42e0-9096-34f6bd82611f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:40.515602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:40.516333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:40.516857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:40.517659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:40.518195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:40.518704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:40.533012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c9151966-f7d1-4d84-b2aa-8b13bbc13239 req-cb93fbd3-0f56-47d0-8bed-6a02f71753d0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:40.533600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c9151966-f7d1-4d84-b2aa-8b13bbc13239 req-cb93fbd3-0f56-47d0-8bed-6a02f71753d0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:40.534235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c9151966-f7d1-4d84-b2aa-8b13bbc13239 req-cb93fbd3-0f56-47d0-8bed-6a02f71753d0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:40.547302 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c9151966-f7d1-4d84-b2aa-8b13bbc13239 req-cb93fbd3-0f56-47d0-8bed-6a02f71753d0 service nova] Creating event network-changed:ff1611a3-6f53-42e0-9096-34f6bd82611f for instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 on n-h1-860864-8 Oct 12 23:13:40.554056 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c9151966-f7d1-4d84-b2aa-8b13bbc13239 req-cb93fbd3-0f56-47d0-8bed-6a02f71753d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047199 Oct 12 23:13:40.555246 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3160/6416] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:40.666334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:13:40.675364 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-501c3ac6-4f90-4573-8c82-3f5503636040 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1563 microversion: 2.1 time: 0.170855 Oct 12 23:13:40.675560 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3257/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:13:40 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:13:55.150182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:13:55.150793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:55.153823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=13 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:55.154459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=37 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:55.160544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:55.161020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:55.161456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:55.162133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:55.162578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:55.163505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:55.187467 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-30999b00-2de5-4fc9-a939-12dd183b66d9 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/ips" status: 200 len: 150 microversion: 2.1 time: 0.041545 Oct 12 23:13:55.188053 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3161/6418] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:13:55 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:13:56.516288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29de0757-287e-4430-976d-c66da656fee1"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:13:56.518698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:13:56.521070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=11 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:56.521736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=44 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:13:56.527559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:56.528088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:56.528546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:56.529261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:13:56.529735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:13:56.530175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:13:56.776028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14ff933a-8474-46ae-acff-dab57177450d tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "POST /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263590 Oct 12 23:13:56.777220 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3258/6419] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:13:56 2022] POST /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:03.946371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:03.948616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:03.956018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:03.956512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:03.956960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:03.957656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:03.958117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:03.958550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:04.011518 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8ac70f2-904a-474d-88ad-4c76e3fae857 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action" status: 200 len: 24571 microversion: 2.1 time: 0.069496 Oct 12 23:14:04.012413 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3162/6420] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:03 2022] POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:14:07.609177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:07.609777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:07.613670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:07.614369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:07.621063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:07.621496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:07.622209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:07.622918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:07.623382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:07.623817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:07.708196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lazy-loading 'services' on Instance uuid 495724ff-b08a-44b1-a80b-39f9d4db5974 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:14:07.778596 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c024d7f7-ad8b-48f2-804f-3b2cdae54aef tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments/29de0757-287e-4430-976d-c66da656fee1" status: 202 len: 0 microversion: 2.1 time: 0.173579 Oct 12 23:14:07.779193 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3259/6421] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:14:07 2022] DELETE /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments/29de0757-287e-4430-976d-c66da656fee1 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:14:07.788311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:07.790629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:07.798224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:07.798828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:07.799269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:07.800101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:07.800559 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:07.801019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:07.834429 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5bb589cf-b974-411a-b67a-535470819763 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050585 Oct 12 23:14:07.835260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3163/6422] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:14:07 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:08.848432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:08.850804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:08.857743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:08.858238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:08.858684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:08.859386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:08.859848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:08.860314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:08.891176 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11cc9372-9f1d-4fb3-a73e-b7ec0f8db2aa tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048046 Oct 12 23:14:08.891738 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3260/6423] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:14:08 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:09.902726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:09.905956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:09.912900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:09.913699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:09.914319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:09.915018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:09.915741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:09.916198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:09.948598 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94b294f0-01f5-4162-b460-5651e6372fe7 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049886 Oct 12 23:14:09.949172 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3164/6424] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:14:09 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:10.403595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:10.404850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:10.411779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.412316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.412772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:10.413493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.413964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.414405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:10.559271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:10.567864 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d867f337-e063-4630-a5b6-2ee3b54b6885 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1682 microversion: 2.1 time: 0.168302 Oct 12 23:14:10.568478 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3261/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:10 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:10.672859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:10.675495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:10.682975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.684329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.684840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:10.685619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.686275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.686799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:10.748213 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ce52f1e-bbad-427a-a1e2-e644b2aab410 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action" status: 200 len: 32641 microversion: 2.1 time: 0.079051 Oct 12 23:14:10.749156 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3165/6426] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:10 2022] POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action => generated 32641 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:14:10.961286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:10.963767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:10.969938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.970440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.973831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:10.973831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.973831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.973831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:10.979598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:10.980342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:10.990607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.991092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.991534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:10.992947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:10.993408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:10.993836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:11.026979 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c87e0b66-043a-4c50-b5d8-f2be0c53fcc0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069780 Oct 12 23:14:11.028302 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3262/6427] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:14:10 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:11.135999 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd9ea4d2-2fd9-4ec3-903b-62e29eceb087 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1833 microversion: 2.1 time: 0.160805 Oct 12 23:14:11.136612 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3166/6428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:10 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1833 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:11.166837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:11.169446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:11.175585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:11.176129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:11.176586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:11.177302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:11.177777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:11.178207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:11.208427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lazy-loading 'flavor' on Instance uuid c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:14:11.222307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Going to try to live migrate instance to another host {{(pid=120542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 12 23:14:12.040507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:12.042674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:12.049507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:12.049988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:12.050418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:12.051139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:12.051588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:12.052034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:12.084884 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6609029e-309d-4767-821e-516cc69edec0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048540 Oct 12 23:14:12.085448 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3167/6429] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:14:12 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:14:12.628326 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1aa7f922-8a03-4a41-8bc0-1a31ae5418c6 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action" status: 202 len: 0 microversion: 2.1 time: 1.465774 Oct 12 23:14:12.629020 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3263/6430] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:11 2022] POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action => generated 0 bytes in 1467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:14:12.638269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:12.638893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:12.646318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:12.647511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:12.647995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:12.649346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:12.649681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:12.650209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:12.793369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:12.801211 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52d65e6f-e926-4cff-9dc4-b5fe001ea62d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.167006 Oct 12 23:14:12.801779 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3168/6431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:12 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:13.097201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:13.099406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:13.107309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.107804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.108349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.109049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.109510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.109948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.139720 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f25efe2b-ef5d-4e9c-bf19-789081cb47f1 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046582 Oct 12 23:14:13.140319 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3264/6432] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:14:13 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:14:13.204509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:13.205093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:13.212646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.213139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.213583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.214281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.214742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.215173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.240686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:14:13.318831 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8d936ed9-6d67-4041-b53c-a216b4fca3b0 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 204 len: 0 microversion: 2.1 time: 0.117959 Oct 12 23:14:13.319434 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3169/6433] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:14:13 2022] DELETE /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:14:13.327990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:13.328667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:13.335955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.337002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.337458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.338168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.338630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.339068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.475626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:13.483861 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff97ff86-da95-4d33-8f16-ab24aefa524c tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1681 microversion: 2.1 time: 0.159973 Oct 12 23:14:13.484457 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3265/6434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:13 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:14:13.826689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:13.827394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:13.833883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.834364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.834830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.835519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:13.835997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:13.837015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:13.966586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:13.974461 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbd951f6-2bf0-481f-bd98-e5bcd3f5d56f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.152042 Oct 12 23:14:13.975039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3170/6435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:13 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:14.507879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:14.508530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:14.515045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:14.515529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:14.516024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:14.516733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:14.517193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:14.517625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:14.736480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:14.745171 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-339d8cc4-de2f-4909-ada0-06890803c7dd tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1681 microversion: 2.1 time: 0.241110 Oct 12 23:14:14.746175 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3266/6436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:14 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:14.885167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b56ee51c-7a0a-4acc-af74-67990ea701e8 req-bdf40dd9-a224-4b24-8ddb-32aaab424b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e97d9c-90c8-4927-9b00-7675fbbe4fa6", "name": "network-vif-unplugged", "status": "completed", "tag": "ff1611a3-6f53-42e0-9096-34f6bd82611f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:14.895519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b56ee51c-7a0a-4acc-af74-67990ea701e8 req-bdf40dd9-a224-4b24-8ddb-32aaab424b37 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:14.896033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b56ee51c-7a0a-4acc-af74-67990ea701e8 req-bdf40dd9-a224-4b24-8ddb-32aaab424b37 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:14.896469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b56ee51c-7a0a-4acc-af74-67990ea701e8 req-bdf40dd9-a224-4b24-8ddb-32aaab424b37 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:14.911589 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b56ee51c-7a0a-4acc-af74-67990ea701e8 req-bdf40dd9-a224-4b24-8ddb-32aaab424b37 service nova] Creating event network-vif-unplugged:ff1611a3-6f53-42e0-9096-34f6bd82611f for instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 on n-h1-860864-8 Oct 12 23:14:14.917675 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b56ee51c-7a0a-4acc-af74-67990ea701e8 req-bdf40dd9-a224-4b24-8ddb-32aaab424b37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036599 Oct 12 23:14:14.918449 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3171/6437] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:14:14.998821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:14.999448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:15.006427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:15.006918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:15.008666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:15.009402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:15.009872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:15.010315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:15.345767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:15.361288 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ed2e9b26-3c8c-4e3c-81f8-a627710d338c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.367162 Oct 12 23:14:15.362204 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3267/6438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:14 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:15.786697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:15.787539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:15.797611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:15.798190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:15.798694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:15.799488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:15.800034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:15.800627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:15.878997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:15.887390 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71536468-227f-435c-b3af-48784e874d15 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1613 microversion: 2.1 time: 0.122006 Oct 12 23:14:15.888054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3172/6439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:15 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:16.386896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:16.387430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:16.394653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:16.395436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:16.395981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:16.396763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:16.397519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:16.398178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:16.545681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:16.553880 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a7fa63a-0eb1-4fd6-b97b-98f4754d2668 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.171789 Oct 12 23:14:16.554473 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3268/6440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:16 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:14:16.911509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:16.912756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:16.920368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:16.920856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:16.921294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:16.922104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:16.922664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:16.923264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:16.956550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:16.957047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:16.957489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:16.957945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lazy-loading 'fault' on Instance uuid 495724ff-b08a-44b1-a80b-39f9d4db5974 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:14:16.969469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6da26ff3-0d1d-489e-a4a2-e74ad011e9dc req-87ffc6b6-547a-4f05-99b1-10c9c05c2972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e97d9c-90c8-4927-9b00-7675fbbe4fa6", "tag": "ff1611a3-6f53-42e0-9096-34f6bd82611f"}, {"server_uuid": "495724ff-b08a-44b1-a80b-39f9d4db5974", "name": "network-vif-deleted", "tag": "8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:16.989373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6da26ff3-0d1d-489e-a4a2-e74ad011e9dc req-87ffc6b6-547a-4f05-99b1-10c9c05c2972 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:16.990461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6da26ff3-0d1d-489e-a4a2-e74ad011e9dc req-87ffc6b6-547a-4f05-99b1-10c9c05c2972 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:16.994777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6da26ff3-0d1d-489e-a4a2-e74ad011e9dc req-87ffc6b6-547a-4f05-99b1-10c9c05c2972 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:17.005900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6d75d719a84ad784fef7fff1a553ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4105e6156f4fc3bb67979e577337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:17.014463 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7286723d-c173-4c7a-a77a-ddb6757d5d57 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 200 len: 1330 microversion: 2.1 time: 0.106736 Oct 12 23:14:17.015054 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3173/6441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:16 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:17.017225 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6da26ff3-0d1d-489e-a4a2-e74ad011e9dc req-87ffc6b6-547a-4f05-99b1-10c9c05c2972 service nova] Creating event network-changed:ff1611a3-6f53-42e0-9096-34f6bd82611f for instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 on n-h1-860864-8 Oct 12 23:14:17.017748 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6da26ff3-0d1d-489e-a4a2-e74ad011e9dc req-87ffc6b6-547a-4f05-99b1-10c9c05c2972 service nova] Creating event network-vif-deleted:8bdb2c68-fc16-4bd2-a3cf-de0a25cb7cbf for instance 495724ff-b08a-44b1-a80b-39f9d4db5974 on n-h2-860864-8 Oct 12 23:14:17.037705 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6da26ff3-0d1d-489e-a4a2-e74ad011e9dc req-87ffc6b6-547a-4f05-99b1-10c9c05c2972 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071732 Oct 12 23:14:17.038327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3269/6442] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:14:17.581001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:17.581613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:17.588336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:17.588823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:17.589259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:17.589948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:17.590397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:17.590816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:17.725830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:17.733529 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b70e524-0143-4293-918f-40b914d7ce7e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.156456 Oct 12 23:14:17.734095 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3174/6443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:17 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:14:18.041160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:18.041785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:18.048038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:18.048529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:18.048978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:18.049680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:18.050138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:18.050568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:18.067563 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 HTTP/1.1 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '495724ff-b08a-44b1-a80b-39f9d4db5974'} Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:18.069287 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-de8fbe79-d446-4da0-95b8-f62133b5bfcf tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 404 len: 111 microversion: 2.1 time: 0.034978 Oct 12 23:14:18.074428 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3270/6444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:18 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:18.080613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12a22b18-ce24-495a-b397-97fc2d0b96cb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '.version_select at 0x7f44ff6e70d0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:18.102348 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12a22b18-ce24-495a-b397-97fc2d0b96cb tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59099130" status: 202 len: 0 microversion: 2.1 time: 0.025577 Oct 12 23:14:18.103212 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3175/6445] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 12 23:14:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59099130 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:14:18.757985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:18.758619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:18.764630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:18.765129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:18.765603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:18.766307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:18.766767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:18.767196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:18.918184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:18.926283 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af01041b-b40f-4f23-943b-33b7cbb6d6eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.173402 Oct 12 23:14:18.926871 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3271/6446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:18 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:19.949916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:19.950695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:19.957900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:19.958459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:19.958903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:19.959596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:19.960086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:19.960515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:20.091318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:20.099096 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e74763c-b287-40bc-91ca-916851d3b52f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.153936 Oct 12 23:14:20.099664 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3176/6447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:19 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:21.123490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:21.124157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:21.131609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:21.132219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:21.132928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:21.133775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:21.134319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:21.135002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:21.317375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:21.328564 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ddd317b6-1c2a-4afa-a421-03c8cb5440c5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1692 microversion: 2.1 time: 0.209751 Oct 12 23:14:21.329255 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3272/6448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:21 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1692 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:21.955071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:21.955659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:21.962518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:21.963246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:21.963690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:21.964421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:21.964878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:21.965301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:21.980045 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 HTTP/1.1 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '495724ff-b08a-44b1-a80b-39f9d4db5974'} Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:21.981756 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-81247e53-5e01-46e1-b2a4-521de916b00f tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 404 len: 111 microversion: 2.1 time: 0.032061 Oct 12 23:14:21.987738 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3177/6449] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:14:21 2022] DELETE /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:14:21.995702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:21.996590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 495724ff-b08a-44b1-a80b-39f9d4db5974] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:22.004520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.005230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.005875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.006721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.007195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.007635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.022005 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 HTTP/1.1 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '495724ff-b08a-44b1-a80b-39f9d4db5974'} Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:22.023885 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:22.028807 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:22.028807 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:22.028807 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:22.028807 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:22.028807 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:22.028807 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. Oct 12 23:14:22.028807 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:22.030180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 495724ff-b08a-44b1-a80b-39f9d4db5974 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:22.031304 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab2b6ea3-c3ce-45c9-bb5e-f77a410d1b78 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974" status: 404 len: 111 microversion: 2.1 time: 0.040216 Oct 12 23:14:22.035583 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3273/6450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:21 2022] GET /compute/v2.1/servers/495724ff-b08a-44b1-a80b-39f9d4db5974 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:22.354328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:22.354997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:22.361220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.361706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.362185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.362860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.363318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.363745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.522533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:22.530177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:22.534848 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-729b40c7-a793-40c9-9fd5-c8eadf0ceda1 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1682 microversion: 2.1 time: 0.185397 Oct 12 23:14:22.539452 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3178/6451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:22 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:22.561970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:22.562717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:22.569696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.570198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.570647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.571410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.571859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.584572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.743137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e388bd4d-6e39-487d-86c2-fade7915c508 tempest-TestNetworkAdvancedServerOps-1019193243 tempest-TestNetworkAdvancedServerOps-1019193243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1833 microversion: 2.1 time: 0.184870 Oct 12 23:14:22.747184 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3274/6452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:22 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1833 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:22.767718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:22.768360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:22.776520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.777011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.777449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.778144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:22.778601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:22.779023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:22.918322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:22.926620 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca9d64cb-79d0-480c-ac8e-419664ef257f tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1682 microversion: 2.1 time: 0.162981 Oct 12 23:14:22.927556 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3179/6453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:22 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:23.035938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:23.038256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:23.044662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:23.045189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:23.045773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:23.046485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:23.046947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:23.047383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:23.051326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:23.103939 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03ba9843-b9b6-408f-bd51-aac5ea68ad70 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action" status: 200 len: 38614 microversion: 2.1 time: 0.072505 Oct 12 23:14:23.104812 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3275/6454] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:14:23 2022] POST /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6/action => generated 38614 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:14:24.108804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5f33a831-240b-41e5-8d21-17a60d525d45 req-4776ec0b-cc9a-4801-a08c-235745556cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e97d9c-90c8-4927-9b00-7675fbbe4fa6", "tag": "ff1611a3-6f53-42e0-9096-34f6bd82611f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:24.112749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:24.113260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:24.126011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:24.126808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:24.127214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:24.127952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:24.131082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:24.131523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:24.133143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5f33a831-240b-41e5-8d21-17a60d525d45 req-4776ec0b-cc9a-4801-a08c-235745556cb9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:24.134323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5f33a831-240b-41e5-8d21-17a60d525d45 req-4776ec0b-cc9a-4801-a08c-235745556cb9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:24.134883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5f33a831-240b-41e5-8d21-17a60d525d45 req-4776ec0b-cc9a-4801-a08c-235745556cb9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:24.147977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5f33a831-240b-41e5-8d21-17a60d525d45 req-4776ec0b-cc9a-4801-a08c-235745556cb9 service nova] Creating event network-changed:ff1611a3-6f53-42e0-9096-34f6bd82611f for instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 on n-h2-860864-8 Oct 12 23:14:24.153733 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5f33a831-240b-41e5-8d21-17a60d525d45 req-4776ec0b-cc9a-4801-a08c-235745556cb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048919 Oct 12 23:14:24.154725 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3276/6455] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:24.162790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:14:24.276718 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38f9b8bc-611c-47a8-a3be-b01b9af64023 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 204 len: 0 microversion: 2.1 time: 0.177395 Oct 12 23:14:24.279238 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3180/6456] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:14:24 2022] DELETE /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:14:24.287954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:24.288505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:24.300054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:24.301708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:24.302320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:24.304185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:24.304798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:24.305257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:24.513186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:24.536936 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e604c900-00fb-4770-a2a5-1c72d51f202b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1688 microversion: 2.1 time: 0.248317 Oct 12 23:14:24.552332 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3277/6457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:24 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1688 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:25.370133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:25.370756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:25.374962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:25.379100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.379583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.380050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.380738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.381204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.381609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.411165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 HTTP/1.1 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '621000c2-0d95-4701-b050-a9e32ba107f7'} Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:25.413142 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:25.417927 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60f6785e-ed63-41e2-960e-ae874caca121 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 404 len: 111 microversion: 2.1 time: 0.049207 Oct 12 23:14:25.418801 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3181/6458] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:14:25 2022] DELETE /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:25.423790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:25.424469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 621000c2-0d95-4701-b050-a9e32ba107f7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:25.431708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.432247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.432691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.433391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.433854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.434303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.448539 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 HTTP/1.1 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '621000c2-0d95-4701-b050-a9e32ba107f7'} Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.450401 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.455208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.455208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.455208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.455208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:25.455208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:25.455208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. Oct 12 23:14:25.455208 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.456438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 621000c2-0d95-4701-b050-a9e32ba107f7 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:25.457467 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40a0e08e-8778-480d-b41a-3f001ed581af tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7" status: 404 len: 111 microversion: 2.1 time: 0.037709 Oct 12 23:14:25.458468 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3278/6459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:25 2022] GET /compute/v2.1/servers/621000c2-0d95-4701-b050-a9e32ba107f7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:25.466750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:25.467261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:25.473643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.474261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.474730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.475531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.476138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.476574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.494762 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e HTTP/1.1 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '7344a367-fdc7-4ff5-9e96-5d23e90f371e'} Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:25.496879 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bdeb0bdf-92d2-48b8-86b3-393d437a3509 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 404 len: 111 microversion: 2.1 time: 0.035618 Oct 12 23:14:25.502197 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3182/6460] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:14:25 2022] DELETE /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:25.508617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:25.509402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 7344a367-fdc7-4ff5-9e96-5d23e90f371e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:25.515706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.516235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.516802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.517585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.518058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.518507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.535564 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e HTTP/1.1 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '7344a367-fdc7-4ff5-9e96-5d23e90f371e'} Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:25.537182 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 7344a367-fdc7-4ff5-9e96-5d23e90f371e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:25.542909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-15e7f054-f874-41fb-be6e-cc18aee050ab tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e" status: 404 len: 111 microversion: 2.1 time: 0.033961 Oct 12 23:14:25.543672 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3279/6461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:25 2022] GET /compute/v2.1/servers/7344a367-fdc7-4ff5-9e96-5d23e90f371e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:25.565841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:25.567251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:25.577428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.578810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.579446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.580437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.581405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.582006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.639455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:25.640204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:25.642271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:25.643046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lazy-loading 'fault' on Instance uuid c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:14:25.716238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:25.725368 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80a01fa3-fc92-413c-bc52-232969ff189c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 200 len: 1356 microversion: 2.1 time: 0.164532 Oct 12 23:14:25.726545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3183/6462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:25 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:26.169833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d07063c7-86f9-434c-bc72-9f69c087ec10 req-fe41989f-409c-441a-951f-110b028b8442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e97d9c-90c8-4927-9b00-7675fbbe4fa6", "name": "network-vif-deleted", "tag": "ff1611a3-6f53-42e0-9096-34f6bd82611f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:26.180201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d07063c7-86f9-434c-bc72-9f69c087ec10 req-fe41989f-409c-441a-951f-110b028b8442 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:26.181313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d07063c7-86f9-434c-bc72-9f69c087ec10 req-fe41989f-409c-441a-951f-110b028b8442 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:26.181829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d07063c7-86f9-434c-bc72-9f69c087ec10 req-fe41989f-409c-441a-951f-110b028b8442 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:26.195025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d07063c7-86f9-434c-bc72-9f69c087ec10 req-fe41989f-409c-441a-951f-110b028b8442 service nova] Creating event network-vif-deleted:ff1611a3-6f53-42e0-9096-34f6bd82611f for instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 on n-h2-860864-8 Oct 12 23:14:26.201048 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d07063c7-86f9-434c-bc72-9f69c087ec10 req-fe41989f-409c-441a-951f-110b028b8442 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 Oct 12 23:14:26.201643 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3280/6463] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:26.749667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:26.750292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: c4e97d9c-90c8-4927-9b00-7675fbbe4fa6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:26.757454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:26.757931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:26.758367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:26.759079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:26.759526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:26.759967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:26.774083 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] HTTP exception thrown: Instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 could not be found. Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Request method failure captured: Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 HTTP/1.1 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0kqmkCckov03ZauIpTDCUZIKTY8Kyp9KOUZNrMzfjEP3qvbaSMWm6I1lMqhBkVkPG05W5JF8FFbYD_Tf2FC3COWkpm1EoMphALrInRN521AzvHylU0eCmOG8Um2UpJ19k754WPIlTPAVplVV32LqXsh--BGtnXiT-J11_CaxsWWCvM Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1440ecf02574c5f8355519787af4360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1440ecf02574c5f8355519787af4360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}] Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: dcfdaa332f374558a08e972c2487dbea Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 could not be found. Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'c4e97d9c-90c8-4927-9b00-7675fbbe4fa6'} Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 could not be found. Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 could not be found. Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:26.775702 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 could not be found. Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Returning 404 to user: Instance c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63deeafd-b204-461e-b47c-d1470056b85d tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6" status: 404 len: 111 microversion: 2.1 time: 0.031933 Oct 12 23:14:26.780424 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3184/6464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:26 2022] GET /compute/v2.1/servers/c4e97d9c-90c8-4927-9b00-7675fbbe4fa6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:28.852987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:28.853723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:28.868275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:28.870490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:28.871209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:28.872226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:28.875211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:28.875931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:28.905152 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 HTTP/1.1 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '87133479-3c6e-4e0a-88bd-ff34f03cb6f2'} Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:28.909464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.914439 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.919389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:28.920549 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be582683-a617-46d3-a85e-d72e98f13fb8 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 404 len: 111 microversion: 2.1 time: 0.072324 Oct 12 23:14:28.925301 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3281/6465] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:14:28 2022] DELETE /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:28.930933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:28.931313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] [instance: 87133479-3c6e-4e0a-88bd-ff34f03cb6f2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:28.939010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:28.942547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:28.945482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:28.947048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:28.949516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:28.950155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:28.965408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] HTTP exception thrown: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Request method failure captured: Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 HTTP/1.1 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0k9NjM6oEquF-3bfWnOtky1maOpFxKCGBdq2fn3qhzU981E6MYhWLShgroBGU6knvZyL7YLQqJO8MameMFJY3AXklgLMLWx-_vvFUQHWGhD6K9Z65EKoNYvd4S3S3lzGaN7fDerOPUMneQFoBAcleBoYMjf7F9LdCdKLAG8tEI0UeQ Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4105e6156f4fc3bb67979e577337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4105e6156f4fc3bb67979e577337c3"}]}] Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: ab4105e6156f4fc3bb67979e577337c3 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1150978401 Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 0b6d75d719a84ad784fef7fff1a553ed Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-1150978401-project Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '87133479-3c6e-4e0a-88bd-ff34f03cb6f2'} Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:14:28.966980 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.972384 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:14:28.972384 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:14:28.972384 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:14:28.972384 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:14:28.972384 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:14:28.972384 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. Oct 12 23:14:28.972384 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:14:28.974189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] Returning 404 to user: Instance 87133479-3c6e-4e0a-88bd-ff34f03cb6f2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:14:28.975277 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c685aaa-40b0-460f-bec9-a0f353f451f2 tempest-AttachVolumeNegativeTest-1150978401 tempest-AttachVolumeNegativeTest-1150978401-project] 10.222.0.20 "GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2" status: 404 len: 111 microversion: 2.1 time: 0.048830 Oct 12 23:14:28.976460 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3185/6466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:28 2022] GET /compute/v2.1/servers/87133479-3c6e-4e0a-88bd-ff34f03cb6f2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:14:30.774805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40bcad3f-cb9b-4799-85d1-62b43e331d81 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '.version_select at 0x7f44ff7bf1f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:30.809399 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40bcad3f-cb9b-4799-85d1-62b43e331d81 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-768190717" status: 202 len: 0 microversion: 2.1 time: 0.038708 Oct 12 23:14:30.819056 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3282/6467] 10.222.0.20 () {58 vars in 1281 bytes} [Wed Oct 12 23:14:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-768190717 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:14:30.848926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36b7579d-a4bc-45e9-ad5f-0e8614b32884 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: .version_select at 0x7f44ff6fb670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1312084251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSGtcVZKq+RUF/3d45eZZDImo0hQPGVBS2UjDbBxvPL04KXDIyrHCzVEr0Hf+vSprZb60cX4FXbX9+80Hr2SltmmEXFLX2AB8Hb6CvPZ3hhBsrXsNHoj+/OCat8SkOuQA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:30.876477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-36b7579d-a4bc-45e9-ad5f-0e8614b32884 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:14:30.885619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-36b7579d-a4bc-45e9-ad5f-0e8614b32884 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:14:30.923754 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36b7579d-a4bc-45e9-ad5f-0e8614b32884 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.083899 Oct 12 23:14:30.924489 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3186/6468] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:14:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:37.621546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-856361764", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "eaba60a1-8cb9-4668-a876-5cf96c7f4648"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1312084251", "security_groups": [{"name": "tempest-secgroup-smoke-1751686941"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:37.637882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:37.819452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] validate_networks() for [('eaba60a1-8cb9-4668-a876-5cf96c7f4648', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:14:38.343467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:14:38.343926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:14:38.344410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:14:38.344825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:14:38.345735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:14:38.356507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:38.357239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:38.357695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:38.358514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:38.359284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:38.359972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:38.389983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:14:38.396986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Getting quotas for user dcfdaa332f374558a08e972c2487dbea and project d1440ecf02574c5f8355519787af4360. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:14:38.410195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:14:38.412606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:14:38.463558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0f08983-a1b6-438a-a087-c7348b53a8f3 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.848403 Oct 12 23:14:38.466463 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3283/6469] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:14:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 23:14:38.477396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0b5c961-a569-4021-b2ad-d9502957323a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:38.478746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0b5c961-a569-4021-b2ad-d9502957323a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:38.569654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0b5c961-a569-4021-b2ad-d9502957323a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:38.586465 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0b5c961-a569-4021-b2ad-d9502957323a tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1266 microversion: 2.1 time: 0.113316 Oct 12 23:14:38.587060 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3187/6470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:38 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:39.613588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:39.614359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:39.631716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:39.634100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:39.639110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:39.640016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:39.640582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:39.647310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:39.792461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:39.800901 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e72d732a-e64c-4e2e-b9ed-88d9b7c72ce2 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1326 microversion: 2.1 time: 0.192374 Oct 12 23:14:39.801497 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3284/6471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:39 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1326 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:40.828578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:40.829609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:40.838499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:40.846037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:40.846747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:40.847210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:40.847972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:40.848437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:40.848867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:41.126730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:41.135032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f4f28c3-99ef-4c52-83dc-3b330eb66f90 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1392 microversion: 2.1 time: 0.310507 Oct 12 23:14:41.149167 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3188/6472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:40 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1392 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:41.396209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-18ff2f69-695d-4c5c-8fe5-e4c6bcb03933 req-8ebe1c1e-f0a3-4caf-b011-942915d84568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1826667-b45c-41a7-b9bf-c764887cb5b7", "tag": "7a58eab0-3525-4dfe-a009-73d97d227151"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:41.409065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-18ff2f69-695d-4c5c-8fe5-e4c6bcb03933 req-8ebe1c1e-f0a3-4caf-b011-942915d84568 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:41.409960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-18ff2f69-695d-4c5c-8fe5-e4c6bcb03933 req-8ebe1c1e-f0a3-4caf-b011-942915d84568 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:41.410650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-18ff2f69-695d-4c5c-8fe5-e4c6bcb03933 req-8ebe1c1e-f0a3-4caf-b011-942915d84568 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:41.423856 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-18ff2f69-695d-4c5c-8fe5-e4c6bcb03933 req-8ebe1c1e-f0a3-4caf-b011-942915d84568 service nova] Creating event network-changed:7a58eab0-3525-4dfe-a009-73d97d227151 for instance f1826667-b45c-41a7-b9bf-c764887cb5b7 on n-h1-860864-8 Oct 12 23:14:41.429345 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-18ff2f69-695d-4c5c-8fe5-e4c6bcb03933 req-8ebe1c1e-f0a3-4caf-b011-942915d84568 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037175 Oct 12 23:14:41.430609 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3285/6473] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:42.160470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:42.161087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:42.168873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:42.169367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:42.169806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:42.170908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:42.171369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:42.171979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:42.309870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:42.317967 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3fb2fc2-5390-4303-ad4e-1251880b640b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1392 microversion: 2.1 time: 0.161412 Oct 12 23:14:42.318551 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3189/6474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:42 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:43.342550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:43.343363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:43.349879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:43.350374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:43.350972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:43.351804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:43.352299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:43.352851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:43.499463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:43.508558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b800020a-4a1f-43e2-bbd8-e98609af5527 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1392 microversion: 2.1 time: 0.171290 Oct 12 23:14:43.509136 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3286/6475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:43 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:44.532959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:44.533508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:44.541400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:44.541853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:44.542286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:44.543029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:44.543408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:44.543826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:44.685496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:44.693734 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ede847e8-fbb7-4fae-a6e9-60abdebf7ead tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1392 microversion: 2.1 time: 0.165056 Oct 12 23:14:44.694123 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3190/6476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:44 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:45.718222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:45.718708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:45.726540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:45.727129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:45.727654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:45.728464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:45.729588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:45.730098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:45.866840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:45.874604 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b82b949-ae70-4e10-92a1-dff50a4269eb tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1392 microversion: 2.1 time: 0.161560 Oct 12 23:14:45.875932 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3287/6477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:45 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:46.897991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:46.898717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:46.906417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:46.906844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:46.907260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:46.908150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:46.908618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:46.909081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:47.043273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:47.051463 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f64ea778-cc39-47e4-a723-9f7c117045e9 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1392 microversion: 2.1 time: 0.157357 Oct 12 23:14:47.052237 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3191/6478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:46 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:47.320994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-25f67907-164a-4831-a8df-4acf9fe51c85 req-1cdf028d-efdb-4633-84a0-b65f797eef45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1826667-b45c-41a7-b9bf-c764887cb5b7", "name": "network-vif-plugged", "status": "completed", "tag": "7a58eab0-3525-4dfe-a009-73d97d227151"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:47.334167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-25f67907-164a-4831-a8df-4acf9fe51c85 req-1cdf028d-efdb-4633-84a0-b65f797eef45 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:47.334680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-25f67907-164a-4831-a8df-4acf9fe51c85 req-1cdf028d-efdb-4633-84a0-b65f797eef45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:47.335138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-25f67907-164a-4831-a8df-4acf9fe51c85 req-1cdf028d-efdb-4633-84a0-b65f797eef45 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:47.350609 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-25f67907-164a-4831-a8df-4acf9fe51c85 req-1cdf028d-efdb-4633-84a0-b65f797eef45 service nova] Creating event network-vif-plugged:7a58eab0-3525-4dfe-a009-73d97d227151 for instance f1826667-b45c-41a7-b9bf-c764887cb5b7 on n-h1-860864-8 Oct 12 23:14:47.355990 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-25f67907-164a-4831-a8df-4acf9fe51c85 req-1cdf028d-efdb-4633-84a0-b65f797eef45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038961 Oct 12 23:14:47.356668 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3288/6479] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:14:48.074777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:48.075428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:48.082416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:48.082897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:48.083330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:48.084048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:48.084501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:48.084920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:48.222638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:48.230503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-31380fcc-a72a-4cc9-9930-6a42a09896b0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1392 microversion: 2.1 time: 0.159975 Oct 12 23:14:48.231331 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3192/6480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:48 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:49.252909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:49.254172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:49.258783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:49.259580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:49.267215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:49.267796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:49.268347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:49.269062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:49.269532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:49.269975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:49.408377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:49.417679 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a50702f-b64b-4a7c-a984-1f722c5a3834 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1563 microversion: 2.1 time: 0.166877 Oct 12 23:14:49.418582 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3289/6481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:49 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:49.440755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:49.441381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:49.443307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:14:49.454112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:49.454615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:49.455062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:49.455780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:49.456269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:49.456701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:49.593220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:49.601062 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b6726d41-066e-4673-80bf-428f7ffbe142 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1563 microversion: 2.1 time: 0.164182 Oct 12 23:14:49.601628 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3193/6482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:49 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:14:51.507828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:14:51.509162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:14:51.513139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b1e44daf-7fe5-4d13-8562-4c496ed6b84e req-c0c1f5bb-0735-4090-9553-6749294d8f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1826667-b45c-41a7-b9bf-c764887cb5b7", "tag": "7a58eab0-3525-4dfe-a009-73d97d227151"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:14:51.516311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:51.516871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:51.517758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:51.518768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:51.519448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:51.520136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:51.527957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1e44daf-7fe5-4d13-8562-4c496ed6b84e req-c0c1f5bb-0735-4090-9553-6749294d8f3c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:14:51.528497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1e44daf-7fe5-4d13-8562-4c496ed6b84e req-c0c1f5bb-0735-4090-9553-6749294d8f3c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:14:51.528932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1e44daf-7fe5-4d13-8562-4c496ed6b84e req-c0c1f5bb-0735-4090-9553-6749294d8f3c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:14:51.541517 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b1e44daf-7fe5-4d13-8562-4c496ed6b84e req-c0c1f5bb-0735-4090-9553-6749294d8f3c service nova] Creating event network-changed:7a58eab0-3525-4dfe-a009-73d97d227151 for instance f1826667-b45c-41a7-b9bf-c764887cb5b7 on n-h1-860864-8 Oct 12 23:14:51.548764 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b1e44daf-7fe5-4d13-8562-4c496ed6b84e req-c0c1f5bb-0735-4090-9553-6749294d8f3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039203 Oct 12 23:14:51.549859 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3194/6483] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:14:51.830663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:14:51.839263 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3fcf6c4d-be14-4ae1-9cde-b3a75ecf60d5 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1563 microversion: 2.1 time: 0.334816 Oct 12 23:14:51.840004 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3290/6484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:14:51 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1563 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:13.133468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:13.134309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=38 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:13.138708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:15:13.141299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:13.149091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:13.149585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:13.150023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:13.150730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:13.151185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:13.151612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:13.204254 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47b22bc0-3400-4d92-bbb4-67ab0114c84b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7/action" status: 200 len: 24573 microversion: 2.1 time: 0.072737 Oct 12 23:15:13.209904 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3195/6485] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:15:13 2022] POST /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:15:19.537829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:15:19.540685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:19.542986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:19.543662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=54 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:19.549600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:19.550089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:19.550528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:19.551219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:19.551680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:19.552142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:19.628308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:15:19.629000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:15:19.629487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:15:19.629908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:15:19.630328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:15:19.690237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:19.696775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:19.697515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:19.698139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:19.699041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:19.700319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:19.700931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:19.733130 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a04f29c3-bd14-463b-a14a-eb32b388a69b tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7/action" status: 202 len: 1136 microversion: 2.1 time: 0.199225 Oct 12 23:15:19.740797 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3291/6486] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:15:19 2022] POST /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7/action => generated 1136 bytes in 201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 23:15:19.771270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:19.772489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:19.780919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:19.781400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:19.781838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:19.782831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:19.783440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:19.784224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:19.931044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:19.939468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b0958cc-f69b-4d48-a31b-662ad5e65d3c tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.187931 Oct 12 23:15:19.940076 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3196/6487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:19 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:20.963006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:20.963626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:20.972456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:20.972949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:20.973606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:20.974370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:20.974833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:20.975265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:21.214897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:21.225726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19741607-a779-417b-a9f2-3a761032d943 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.266704 Oct 12 23:15:21.226333 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3292/6488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:20 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:22.250629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:22.251341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:22.259308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:22.259826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:22.260423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:22.261489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:22.262161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:22.262840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:22.576735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:22.589855 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05745e9f-1075-44cf-9aa6-f4390c989eab tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.341218 Oct 12 23:15:22.591533 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3197/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:22 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:23.617635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:23.619365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:23.628330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:23.629509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:23.630252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:23.631038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:23.631722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:23.632174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:23.787819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:23.796442 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3878a07d-2372-49fb-9b18-fec71f4ac9c6 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.182784 Oct 12 23:15:23.807917 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3293/6490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:23 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:24.821918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:24.822628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:24.829875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:24.830357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:24.830795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:24.831490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:24.831961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:24.832385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:24.984858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:24.993192 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ec99061-70d0-4601-9e3d-c42b01fffb83 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.175691 Oct 12 23:15:24.993859 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3198/6491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:24 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:26.018604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:26.020142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:26.029802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:26.030758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:26.031593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:26.032703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:26.033378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:26.034016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:26.204098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:26.212715 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0596480-9f07-420c-a1d7-189d451e24c0 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.199389 Oct 12 23:15:26.213638 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3294/6492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:26 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:27.240282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:27.240846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:27.248948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:27.249442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:27.249882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:27.250585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:27.251072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:27.251502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:27.400069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:27.407755 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-edbcc5a3-84b0-4733-a6b2-173323dfaaaf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.172185 Oct 12 23:15:27.408356 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3199/6493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:27 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:28.430913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:28.431551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:28.444632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:28.456576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:28.457041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:28.457807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:28.458259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:28.458700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:28.677215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:28.685724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-64001a1c-aecd-4cb8-98b3-a13b9d06e002 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.258821 Oct 12 23:15:28.686416 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3295/6494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:28 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:29.709976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:29.710702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:29.717673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:29.718157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:29.718599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:29.719378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:29.719833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:29.720283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:29.858873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:29.867300 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-accb2b9b-4f68-4986-9834-85d0a6cc6815 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.160970 Oct 12 23:15:29.867552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3200/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:29 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:30.889953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:30.890621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:30.898002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:30.898340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:30.898797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:30.899517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:30.900014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:30.900460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:31.038672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:31.046818 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-067c30b8-b3e4-4a39-b4a1-7568fb6c2830 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1691 microversion: 2.1 time: 0.160859 Oct 12 23:15:31.047404 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3296/6496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:30 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:32.070604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:32.071230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:32.078804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:32.079300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:32.079750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:32.080488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:32.080954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:32.081390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:32.216859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:32.224900 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a4e80942-dc94-4b51-b920-1b919509e831 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1697 microversion: 2.1 time: 0.158205 Oct 12 23:15:32.225555 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3201/6497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:32 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:33.248528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:33.249272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:33.256389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:33.256893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:33.257342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:33.258054 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:33.258523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:33.258970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:33.412553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:33.422325 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d7a5ba57-0db4-40f3-a1b2-614c4a3e0293 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1697 microversion: 2.1 time: 0.177567 Oct 12 23:15:33.423430 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3297/6498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:33 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:34.447658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:15:34.448420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:34.455992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:34.456484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:34.456930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:34.457626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:34.458087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:34.458518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:34.594753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:15:34.603263 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-130ff782-c671-4e71-8b3d-116c67e199be tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1682 microversion: 2.1 time: 0.159487 Oct 12 23:15:34.603772 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3202/6499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:15:34 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:15:35.538118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7d574833-5e3a-45fb-89c3-d50c87104d11 req-17061d5b-33d8-4c8d-ab76-b4302b11618a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1826667-b45c-41a7-b9bf-c764887cb5b7", "name": "network-vif-plugged", "status": "completed", "tag": "7a58eab0-3525-4dfe-a009-73d97d227151"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:15:35.551009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7d574833-5e3a-45fb-89c3-d50c87104d11 req-17061d5b-33d8-4c8d-ab76-b4302b11618a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:35.551379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7d574833-5e3a-45fb-89c3-d50c87104d11 req-17061d5b-33d8-4c8d-ab76-b4302b11618a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:35.551828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7d574833-5e3a-45fb-89c3-d50c87104d11 req-17061d5b-33d8-4c8d-ab76-b4302b11618a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:35.564181 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7d574833-5e3a-45fb-89c3-d50c87104d11 req-17061d5b-33d8-4c8d-ab76-b4302b11618a service nova] Creating event network-vif-plugged:7a58eab0-3525-4dfe-a009-73d97d227151 for instance f1826667-b45c-41a7-b9bf-c764887cb5b7 on n-h1-860864-8 Oct 12 23:15:35.572978 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7d574833-5e3a-45fb-89c3-d50c87104d11 req-17061d5b-33d8-4c8d-ab76-b4302b11618a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039355 Oct 12 23:15:35.573871 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3298/6500] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:15:58.805041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:15:58.807318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:15:58.810272 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:15:58.810446 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:15:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7/action (ip 10.222.0.20) !!! Oct 12 23:15:58.811773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:58.812733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=46 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:15:58.820199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:58.820693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:58.821138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:58.821845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:15:58.822309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:15:58.822745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:15:58.873778 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1e0c648-e030-4d5c-aebf-3f5c95f7393e tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "POST /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7/action" status: 200 len: 24573 microversion: 2.1 time: 0.072602 Oct 12 23:15:58.875951 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3203/6501] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:15:58 2022] POST /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:16:06.458045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b2f02b6f-8768-4966-8854-221727b9fd2f req-e545bffc-7ced-45e8-9740-5af14126fe1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1826667-b45c-41a7-b9bf-c764887cb5b7", "tag": "7a58eab0-3525-4dfe-a009-73d97d227151"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:06.460549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:06.462364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:06.466114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=20 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:06.467586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:06.473468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b2f02b6f-8768-4966-8854-221727b9fd2f req-e545bffc-7ced-45e8-9740-5af14126fe1f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:06.473941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b2f02b6f-8768-4966-8854-221727b9fd2f req-e545bffc-7ced-45e8-9740-5af14126fe1f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:06.474554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b2f02b6f-8768-4966-8854-221727b9fd2f req-e545bffc-7ced-45e8-9740-5af14126fe1f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:06.479758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:06.480879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:06.481350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:06.482077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:06.482554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:06.483003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:06.487426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b2f02b6f-8768-4966-8854-221727b9fd2f req-e545bffc-7ced-45e8-9740-5af14126fe1f service nova] Creating event network-changed:7a58eab0-3525-4dfe-a009-73d97d227151 for instance f1826667-b45c-41a7-b9bf-c764887cb5b7 on n-h1-860864-8 Oct 12 23:16:06.492843 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b2f02b6f-8768-4966-8854-221727b9fd2f req-e545bffc-7ced-45e8-9740-5af14126fe1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038784 Oct 12 23:16:06.493673 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3204/6502] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:06.518992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:16:06.633746 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f0a0143-a623-4e8a-b172-cefa8dc7bcd8 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 204 len: 0 microversion: 2.1 time: 0.183102 Oct 12 23:16:06.634809 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3299/6503] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:16:06 2022] DELETE /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:16:06.644554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:06.645163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:06.655344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:06.656237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:06.656880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:06.657807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:06.658475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:06.658898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:07.010314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:07.018803 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bcfecd2f-bf55-459d-83dd-88e230ae2b53 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1688 microversion: 2.1 time: 0.379349 Oct 12 23:16:07.019382 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3205/6504] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:06 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1688 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:08.043917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:08.044804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:08.052494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:08.053142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:08.053690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:08.054507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:08.055093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:08.055773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:08.277144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfdaa332f374558a08e972c2487dbea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1440ecf02574c5f8355519787af4360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:08.285393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70b56da6-f1f2-4432-97ef-7c1355f62719 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 200 len: 1688 microversion: 2.1 time: 0.246335 Oct 12 23:16:08.285963 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3300/6505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:08 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:08.601400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d52ce4dc-dd6d-44f6-84cc-d3b7902af186 req-fb74ee46-7cd0-40f0-b159-c742848fab05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1826667-b45c-41a7-b9bf-c764887cb5b7", "name": "network-vif-deleted", "tag": "7a58eab0-3525-4dfe-a009-73d97d227151"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:08.614647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d52ce4dc-dd6d-44f6-84cc-d3b7902af186 req-fb74ee46-7cd0-40f0-b159-c742848fab05 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:08.615128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d52ce4dc-dd6d-44f6-84cc-d3b7902af186 req-fb74ee46-7cd0-40f0-b159-c742848fab05 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:08.615929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d52ce4dc-dd6d-44f6-84cc-d3b7902af186 req-fb74ee46-7cd0-40f0-b159-c742848fab05 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:08.628789 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d52ce4dc-dd6d-44f6-84cc-d3b7902af186 req-fb74ee46-7cd0-40f0-b159-c742848fab05 service nova] Creating event network-vif-deleted:7a58eab0-3525-4dfe-a009-73d97d227151 for instance f1826667-b45c-41a7-b9bf-c764887cb5b7 on n-h1-860864-8 Oct 12 23:16:08.634178 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d52ce4dc-dd6d-44f6-84cc-d3b7902af186 req-fb74ee46-7cd0-40f0-b159-c742848fab05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036733 Oct 12 23:16:08.634808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3206/6506] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:09.310726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:09.311268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] [instance: f1826667-b45c-41a7-b9bf-c764887cb5b7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:09.320994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:09.321590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:09.322359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:09.323277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:09.323743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:09.324217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:09.338868 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] HTTP exception thrown: Instance f1826667-b45c-41a7-b9bf-c764887cb5b7 could not be found. Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Request method failure captured: Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 HTTP/1.1 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0kqmkCckov03ZauIpTDCUZIKTY8Kyp9KOUZNrMzfjEP3qvbaSMWm6I1lMqhBkVkPG05W5JF8FFbYD_Tf2FC3COWkpm1EoMphALrInRN521AzvHylU0eCmOG8Um2UpJ19k754WPIlTPAVplVV32LqXsh--BGtnXiT-J11_CaxsWWCvM Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1440ecf02574c5f8355519787af4360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1440ecf02574c5f8355519787af4360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1440ecf02574c5f8355519787af4360"}]}] Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d1440ecf02574c5f8355519787af4360 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-334373881 Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: dcfdaa332f374558a08e972c2487dbea Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-334373881-project Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance f1826667-b45c-41a7-b9bf-c764887cb5b7 could not be found. Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'f1826667-b45c-41a7-b9bf-c764887cb5b7'} Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1826667-b45c-41a7-b9bf-c764887cb5b7 could not be found. Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1826667-b45c-41a7-b9bf-c764887cb5b7 could not be found. Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:16:09.340603 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1826667-b45c-41a7-b9bf-c764887cb5b7 could not be found. Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Returning 404 to user: Instance f1826667-b45c-41a7-b9bf-c764887cb5b7 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4bff8889-d45e-4ccc-8755-2141f169d647 tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7" status: 404 len: 111 microversion: 2.1 time: 0.035921 Oct 12 23:16:09.346316 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3301/6507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:09 2022] GET /compute/v2.1/servers/f1826667-b45c-41a7-b9bf-c764887cb5b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:16:13.060486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e883e45e-7dfc-41e1-aaa4-6ef7da186dbf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] Calling method '.version_select at 0x7f4507c10280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:13.097799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e883e45e-7dfc-41e1-aaa4-6ef7da186dbf tempest-TestNetworkAdvancedServerOps-334373881 tempest-TestNetworkAdvancedServerOps-334373881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1312084251" status: 202 len: 0 microversion: 2.1 time: 0.043114 Oct 12 23:16:13.098394 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3207/6508] 10.222.0.20 () {58 vars in 1284 bytes} [Wed Oct 12 23:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1312084251 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:16:22.092024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df960912-7c03-4a3b-b898-88bc8c694922 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'create', calling method: .version_select at 0x7f44ff5fbb80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-271901353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfZghgHz61hiM6CS4Qn1GN/g+uaaIhVFr2NtavqGdN8TSepcNwaxtmIhc9KSZKmpugBb1Xf7qnULPL+VQy9MwattxQqPJKXnhPO0aRy1vk10G1gLiAV0eqfZlv5Mx4vlg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:22.103338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:22.104050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:22.131432 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-df960912-7c03-4a3b-b898-88bc8c694922 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:16:22.138292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-df960912-7c03-4a3b-b898-88bc8c694922 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for user 01083a9673eb4ff09da0218e24c168f0 and project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:16:22.171760 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-df960912-7c03-4a3b-b898-88bc8c694922 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.084559 Oct 12 23:16:22.172453 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3302/6509] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:16:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:23.824157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=14 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:23.825735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:23.830887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1828090853", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "16bd7518-a230-4c08-af69-ea0a580e6a9c"}], "key_name": "tempest-TestNetworkBasicOps-271901353", "security_groups": [{"name": "tempest-secgroup-smoke-2052698392"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:23.956841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] validate_networks() for [('16bd7518-a230-4c08-af69-ea0a580e6a9c', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:16:24.384548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:16:24.390011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:16:24.390547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:16:24.390997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:16:24.391422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:16:24.401116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:24.401595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:24.402028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:24.402749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:24.403199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:24.403620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:24.422801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:16:24.429252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for user 01083a9673eb4ff09da0218e24c168f0 and project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:16:24.443144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:16:24.445717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:16:24.497687 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e67522b9-3528-4c2b-af00-94255a6b41cb tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675234 Oct 12 23:16:24.498974 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3208/6510] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:16:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:16:24.516386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70358bf5-1cf8-48e2-b9e3-b08b496db684 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:24.518086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70358bf5-1cf8-48e2-b9e3-b08b496db684 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:24.586389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70358bf5-1cf8-48e2-b9e3-b08b496db684 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:24.596626 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70358bf5-1cf8-48e2-b9e3-b08b496db684 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1248 microversion: 2.1 time: 0.089635 Oct 12 23:16:24.597650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3303/6511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:24 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:25.621615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:25.622507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:25.636637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:25.640017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:25.640775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:25.642363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:25.644388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:25.646743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:25.729375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:25.742940 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53725839-a3c5-4493-b1c6-30c9ac62df3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1308 microversion: 2.1 time: 0.126600 Oct 12 23:16:25.743531 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3209/6512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:25 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:25.900815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-94685043", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:25.953960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:16:26.247144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:16:26.247586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:16:26.248146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:16:26.248578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:16:26.249039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:16:26.258234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:26.258732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:26.259720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:26.260498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:26.260968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:26.261410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:26.277987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Getting quotas for project 5a27da64b4004c5e9e158ed9bbdd3054. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:16:26.283767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Getting quotas for user 890df847ce8b46e4996096d25adad726 and project 5a27da64b4004c5e9e158ed9bbdd3054. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:16:26.297308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:16:26.300574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:16:26.349867 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b14a742d-89b5-4d7a-9af4-2fe92df28024 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453033 Oct 12 23:16:26.350710 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3304/6513] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:16:26.362430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7ed205a6-ccee-424a-a348-13fb273ba8a6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:26.363058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7ed205a6-ccee-424a-a348-13fb273ba8a6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:26.437745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ed205a6-ccee-424a-a348-13fb273ba8a6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:26.446723 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7ed205a6-ccee-424a-a348-13fb273ba8a6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1212 microversion: 2.1 time: 0.088973 Oct 12 23:16:26.448795 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3210/6514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:26 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:26.783793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:26.785212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:26.798532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:26.799492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:26.800132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:26.801114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:26.801654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:26.802679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:26.975272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:26.984086 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32f2861a-7ffb-4e1c-94ab-ac8c042972f0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1374 microversion: 2.1 time: 0.207257 Oct 12 23:16:26.986149 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3305/6515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:26 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:27.253530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a9f419df-5553-46a5-8daf-a5c2fd5ca699 req-8484cbc8-de53-4a78-a72e-491196a530af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6050e6e-e42c-43ca-8c33-30a05cd7ad94", "tag": "a318e9b6-1462-4321-bcd3-2acfa7b72779"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:27.265772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a9f419df-5553-46a5-8daf-a5c2fd5ca699 req-8484cbc8-de53-4a78-a72e-491196a530af service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:27.266423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a9f419df-5553-46a5-8daf-a5c2fd5ca699 req-8484cbc8-de53-4a78-a72e-491196a530af service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:27.266950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a9f419df-5553-46a5-8daf-a5c2fd5ca699 req-8484cbc8-de53-4a78-a72e-491196a530af service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:27.277558 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a9f419df-5553-46a5-8daf-a5c2fd5ca699 req-8484cbc8-de53-4a78-a72e-491196a530af service nova] Creating event network-changed:a318e9b6-1462-4321-bcd3-2acfa7b72779 for instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 on n-h1-860864-8 Oct 12 23:16:27.282463 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a9f419df-5553-46a5-8daf-a5c2fd5ca699 req-8484cbc8-de53-4a78-a72e-491196a530af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033623 Oct 12 23:16:27.283146 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3211/6516] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:27.472302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:27.472559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:27.481488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:27.482709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:27.484189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:27.485506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:27.486161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:27.486780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:27.577161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:27.588909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8932a2a1-5bf1-4a00-b8e8-9aa0787ff21f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1272 microversion: 2.1 time: 0.122003 Oct 12 23:16:27.604840 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3306/6517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:27 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:28.007738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:28.008441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:28.015147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:28.015629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:28.016640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:28.017391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:28.018054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:28.018477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:28.158380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:28.166273 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9492c7c8-ee9d-47de-9aa6-4e74300893f5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1374 microversion: 2.1 time: 0.162914 Oct 12 23:16:28.166866 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3212/6518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:28 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:28.614296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:28.615498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:28.622703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:28.623447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:28.624178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:28.625085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:28.625753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:28.626357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:28.845071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:28.856787 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d94d7d5a-77db-4f3d-a62c-2f7e348b5e71 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1312 microversion: 2.1 time: 0.246872 Oct 12 23:16:28.862250 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3307/6519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:28 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:29.103864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-27be5f83-cf6c-4435-8643-cc1155fe8acf req-1587e137-0da8-4127-941e-dfb97f8d3f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f006785-5558-4097-8141-89e80b2458e5", "tag": "7a859861-55a3-433a-b05b-d8b2481ed05b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:29.114798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-27be5f83-cf6c-4435-8643-cc1155fe8acf req-1587e137-0da8-4127-941e-dfb97f8d3f8e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:29.115470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-27be5f83-cf6c-4435-8643-cc1155fe8acf req-1587e137-0da8-4127-941e-dfb97f8d3f8e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:29.119414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-27be5f83-cf6c-4435-8643-cc1155fe8acf req-1587e137-0da8-4127-941e-dfb97f8d3f8e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:29.132774 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-27be5f83-cf6c-4435-8643-cc1155fe8acf req-1587e137-0da8-4127-941e-dfb97f8d3f8e service nova] Creating event network-changed:7a859861-55a3-433a-b05b-d8b2481ed05b for instance 5f006785-5558-4097-8141-89e80b2458e5 on n-h2-860864-8 Oct 12 23:16:29.137907 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-27be5f83-cf6c-4435-8643-cc1155fe8acf req-1587e137-0da8-4127-941e-dfb97f8d3f8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037942 Oct 12 23:16:29.138520 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3213/6520] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:29.191277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:29.192009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:29.198442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:29.198998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:29.199455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:29.200197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:29.200662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:29.201096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:29.401208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:29.409243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6308be42-9899-4225-824d-f6449d772bf4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1374 microversion: 2.1 time: 0.222870 Oct 12 23:16:29.409839 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3308/6521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:29 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:29.886806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:29.887592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:29.894198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:29.894781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:29.895392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:29.896303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:29.896896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:29.897325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:30.030909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:30.039707 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-68fa3859-a95f-45a4-8b31-706b519d7625 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1312 microversion: 2.1 time: 0.157646 Oct 12 23:16:30.040366 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3214/6522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:29 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:30.432628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:30.433260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:30.440158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:30.440660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:30.441111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:30.441818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:30.442285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:30.442724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:30.656386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:30.664148 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3922e264-cfca-4ab2-8a1c-6ce893929aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1374 microversion: 2.1 time: 0.235403 Oct 12 23:16:30.664732 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3309/6523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:30 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:31.062542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:31.063254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:31.070744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:31.071252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:31.071670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:31.072406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:31.072860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:31.073287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:31.198238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:31.205903 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-17a914a7-03e4-4a0f-9c88-cc677cf30830 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1312 microversion: 2.1 time: 0.147286 Oct 12 23:16:31.206468 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3215/6524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:31 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:31.686640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:31.687269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:31.694195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:31.694695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:31.695147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:31.695854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:31.696349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:31.696788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:31.833071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:31.841229 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c6a107b-3313-4617-9f16-623d36f4af6c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1374 microversion: 2.1 time: 0.158510 Oct 12 23:16:31.844001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3310/6525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:31 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:31.844161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-49c753d0-e175-4ce1-989e-e3de52bd8b86 req-c0ef76a9-f0df-43f1-a3d1-2fa280c73a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6050e6e-e42c-43ca-8c33-30a05cd7ad94", "name": "network-vif-plugged", "status": "completed", "tag": "a318e9b6-1462-4321-bcd3-2acfa7b72779"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:31.854012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-49c753d0-e175-4ce1-989e-e3de52bd8b86 req-c0ef76a9-f0df-43f1-a3d1-2fa280c73a10 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:31.854601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-49c753d0-e175-4ce1-989e-e3de52bd8b86 req-c0ef76a9-f0df-43f1-a3d1-2fa280c73a10 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:31.855130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-49c753d0-e175-4ce1-989e-e3de52bd8b86 req-c0ef76a9-f0df-43f1-a3d1-2fa280c73a10 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:31.866517 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-49c753d0-e175-4ce1-989e-e3de52bd8b86 req-c0ef76a9-f0df-43f1-a3d1-2fa280c73a10 service nova] Creating event network-vif-plugged:a318e9b6-1462-4321-bcd3-2acfa7b72779 for instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 on n-h1-860864-8 Oct 12 23:16:31.871400 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-49c753d0-e175-4ce1-989e-e3de52bd8b86 req-c0ef76a9-f0df-43f1-a3d1-2fa280c73a10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031926 Oct 12 23:16:31.872177 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3216/6526] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:32.228851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:32.229391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:32.235422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:32.235936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:32.236383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:32.237073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:32.237532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:32.237962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:32.364290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:32.371856 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d02df4e6-a7ab-4ef1-8487-15f0aac65519 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1312 microversion: 2.1 time: 0.147034 Oct 12 23:16:32.372443 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3311/6527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:32 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:32.867228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:32.867998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:32.875118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:32.875609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:32.876124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:32.876916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:32.877375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:32.877802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:33.023069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:33.031880 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25c8a37a-9f2d-477e-b801-93e95edc553a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1374 microversion: 2.1 time: 0.169698 Oct 12 23:16:33.035920 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3217/6528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:32 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:16:33.394650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:33.395274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:33.402564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:33.403236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:33.403702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:33.404457 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:33.404916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:33.405448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:33.537858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:33.545502 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2787ef44-0cc8-41c8-8ad0-5c20eedd3c6a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1312 microversion: 2.1 time: 0.154820 Oct 12 23:16:33.546076 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3312/6529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:33 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:34.056501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:34.057055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:34.063858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:34.064369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:34.064801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:34.065491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:34.065943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:34.066366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:34.194315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:34.201990 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-364d59b8-a214-4528-adf8-d51931047d23 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1546 microversion: 2.1 time: 0.149459 Oct 12 23:16:34.202559 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3218/6530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:34 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:34.224856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:34.225484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:34.231482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:34.232020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:34.232472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:34.233171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:34.233639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:34.234076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:34.360421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:34.368078 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-314f8148-18be-4d86-883d-c00cbb82aacd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1546 microversion: 2.1 time: 0.147032 Oct 12 23:16:34.368656 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3313/6531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:34 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:34.569636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:34.570170 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:34.572153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:34.577420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:34.577905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:34.578344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:34.579610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:34.580099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:34.580530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:34.715177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:34.722899 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0da94f3-befe-43e1-99f4-691414bf8d84 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1312 microversion: 2.1 time: 0.157317 Oct 12 23:16:34.727940 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3219/6532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:34 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:34.855239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0f643b55-43cc-4486-b165-39130cf827e3 req-523069f9-997f-4ba3-a63b-5fcb3d7db02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f006785-5558-4097-8141-89e80b2458e5", "name": "network-vif-plugged", "status": "completed", "tag": "7a859861-55a3-433a-b05b-d8b2481ed05b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:34.868249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0f643b55-43cc-4486-b165-39130cf827e3 req-523069f9-997f-4ba3-a63b-5fcb3d7db02e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:34.868975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0f643b55-43cc-4486-b165-39130cf827e3 req-523069f9-997f-4ba3-a63b-5fcb3d7db02e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:34.869673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0f643b55-43cc-4486-b165-39130cf827e3 req-523069f9-997f-4ba3-a63b-5fcb3d7db02e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:34.883040 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0f643b55-43cc-4486-b165-39130cf827e3 req-523069f9-997f-4ba3-a63b-5fcb3d7db02e service nova] Creating event network-vif-plugged:7a859861-55a3-433a-b05b-d8b2481ed05b for instance 5f006785-5558-4097-8141-89e80b2458e5 on n-h2-860864-8 Oct 12 23:16:34.888566 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0f643b55-43cc-4486-b165-39130cf827e3 req-523069f9-997f-4ba3-a63b-5fcb3d7db02e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037328 Oct 12 23:16:34.889476 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3314/6533] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:35.746669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:35.747292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:35.755161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:35.755927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:35.756356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:35.757062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:35.757674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:35.758034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:35.899343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:35.907837 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-828a91b5-8606-41c6-b1a6-24192ca4634a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1312 microversion: 2.1 time: 0.164634 Oct 12 23:16:35.908440 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3220/6534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:35 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:36.460791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:36.461584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:36.465684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-82f7f72f-db83-42da-bffa-4f24bbbd51b1 req-6ff0e962-53dc-488e-963c-21a88c014cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6050e6e-e42c-43ca-8c33-30a05cd7ad94", "tag": "a318e9b6-1462-4321-bcd3-2acfa7b72779"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:36.476963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-82f7f72f-db83-42da-bffa-4f24bbbd51b1 req-6ff0e962-53dc-488e-963c-21a88c014cc3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:36.477831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-82f7f72f-db83-42da-bffa-4f24bbbd51b1 req-6ff0e962-53dc-488e-963c-21a88c014cc3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:36.478528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-82f7f72f-db83-42da-bffa-4f24bbbd51b1 req-6ff0e962-53dc-488e-963c-21a88c014cc3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:36.490607 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-82f7f72f-db83-42da-bffa-4f24bbbd51b1 req-6ff0e962-53dc-488e-963c-21a88c014cc3 service nova] Creating event network-changed:a318e9b6-1462-4321-bcd3-2acfa7b72779 for instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 on n-h1-860864-8 Oct 12 23:16:36.496025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-82f7f72f-db83-42da-bffa-4f24bbbd51b1 req-6ff0e962-53dc-488e-963c-21a88c014cc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036846 Oct 12 23:16:36.496847 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3315/6535] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:36.931113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:16:36.931742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:36.933741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:36.941156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:36.941646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:36.942090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:36.942793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:36.943471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:36.943930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:37.114147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:16:37.121871 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-998e01d4-7c75-4dbe-b38b-614426b7ee7a tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1462 microversion: 2.1 time: 0.195163 Oct 12 23:16:37.122443 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3221/6536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:16:36 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1462 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:16:37.147705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74852f36-b9e8-480e-84ff-c3de557a69e3", "device": "/dev/sdb"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:37.151023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:37.157249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:37.157782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:37.158239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:37.158964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:37.159426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:37.159860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:37.416847 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0232404c-f284-4706-ab01-b2c37eae1124 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "POST /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274801 Oct 12 23:16:37.417873 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3316/6537] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:16:37 2022] POST /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:16:57.749648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:16:57.751877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:16:57.755825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:57.756683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=62 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:16:57.760979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:57.761734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:57.762175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:57.762880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:16:57.763332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:16:57.763755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:16:57.819683 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eafeec09-4403-4d04-8f1a-11687b36d5ba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94/action" status: 200 len: 24569 microversion: 2.1 time: 0.073702 Oct 12 23:16:57.820347 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3222/6538] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:16:57 2022] POST /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:17:11.165069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-815be08c-1a11-4565-8db6-a87eca573b57 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'create', calling method: .version_select at 0x7f44feb255e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1755182017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo8YwWy9GKkjFTxk+/7YnwQ5vIhgTOgglDm622oC7g8DQ5m+kpKCpbisFK2GBHSEYtZLlMhc1FTVYZ/2Sid9lw/FLiElZus+Y0HBYcHEEU9L/iUWTEhbALJdC7iBA/UZA=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:11.183525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:11.184718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:11.197711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-815be08c-1a11-4565-8db6-a87eca573b57 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:17:11.206547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-815be08c-1a11-4565-8db6-a87eca573b57 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for user 01083a9673eb4ff09da0218e24c168f0 and project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:17:11.248717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-815be08c-1a11-4565-8db6-a87eca573b57 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.093122 Oct 12 23:17:11.250503 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3317/6539] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:17:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:17:12.585215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-583402333", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "33320df2-ec53-41dd-9096-bc10ffd1beca"}], "key_name": "tempest-TestNetworkBasicOps-1755182017", "security_groups": [{"name": "tempest-secgroup-smoke-49116594"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:12.594400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:12.595059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:12.740753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] validate_networks() for [('33320df2-ec53-41dd-9096-bc10ffd1beca', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:17:13.277279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:17:13.277772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:17:13.278440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:17:13.278850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:17:13.279261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:17:13.289017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:13.289363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:13.289796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:13.290632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:13.291083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:13.291616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:13.309773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:17:13.316359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for user 01083a9673eb4ff09da0218e24c168f0 and project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:17:13.329293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:17:13.332341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:17:13.381319 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d197329-8194-43f9-bca5-f586c1052bd9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.800466 Oct 12 23:17:13.382777 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3223/6540] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:17:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:17:13.396781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32dccf4f-d59e-41e5-974c-cf3002b27fe9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:13.398223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32dccf4f-d59e-41e5-974c-cf3002b27fe9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:13.470930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-32dccf4f-d59e-41e5-974c-cf3002b27fe9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:13.480377 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32dccf4f-d59e-41e5-974c-cf3002b27fe9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1248 microversion: 2.1 time: 0.089808 Oct 12 23:17:13.496342 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3318/6541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:13 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1248 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:14.503701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:14.504320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:14.515407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:14.516208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:14.516902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:14.517888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:14.518429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:14.519100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:14.599909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:14.608480 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a778f6e-bd2b-4b50-b234-28c27328b78e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1318 microversion: 2.1 time: 0.109630 Oct 12 23:17:14.609046 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3224/6542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:14 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:15.633529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:15.634135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:15.642078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:15.642715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:15.644007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:15.644730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:15.647755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:15.648385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:15.814690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:15.823574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1cc239dc-d5e5-4b07-aa3a-020bb5b4766d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1372 microversion: 2.1 time: 0.194799 Oct 12 23:17:15.824391 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3319/6543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:15 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:16.043626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-de79a1ef-72e8-4d47-899f-eb562825d480 req-0b867b9d-eb89-45c3-931c-ed34cf7045a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ceb4d0-92ab-4a33-b504-fe7a7dc4be51", "tag": "394310f0-63a1-470b-813d-4c0c9d633c18"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:16.058411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-de79a1ef-72e8-4d47-899f-eb562825d480 req-0b867b9d-eb89-45c3-931c-ed34cf7045a9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:16.059213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-de79a1ef-72e8-4d47-899f-eb562825d480 req-0b867b9d-eb89-45c3-931c-ed34cf7045a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:16.059950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-de79a1ef-72e8-4d47-899f-eb562825d480 req-0b867b9d-eb89-45c3-931c-ed34cf7045a9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:16.077423 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-de79a1ef-72e8-4d47-899f-eb562825d480 req-0b867b9d-eb89-45c3-931c-ed34cf7045a9 service nova] Creating event network-changed:394310f0-63a1-470b-813d-4c0c9d633c18 for instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 on n-h1-860864-8 Oct 12 23:17:16.084581 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-de79a1ef-72e8-4d47-899f-eb562825d480 req-0b867b9d-eb89-45c3-931c-ed34cf7045a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044167 Oct 12 23:17:16.085490 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3225/6544] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:16.847325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:16.848042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:16.855062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:16.855555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:16.856040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:16.856739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:16.857202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:16.857636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:16.990199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:16.997895 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-91d0e49e-2005-4cb9-840a-7ff278b6c67f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1372 microversion: 2.1 time: 0.155157 Oct 12 23:17:16.998462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3320/6545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:16 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:18.022189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:18.023003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:18.030249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:18.030805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:18.031316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:18.032116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:18.032648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:18.033166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:18.177291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:18.188074 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3363b12-c9c0-4166-9f74-5386a9fa745c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1372 microversion: 2.1 time: 0.170030 Oct 12 23:17:18.189001 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3226/6546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:18 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:19.213883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:19.214512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:19.222772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:19.223268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:19.223944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:19.224756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:19.225221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:19.225653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:19.361471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:19.369308 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-057a65ec-b589-4816-bedd-7dc8be1e227b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1372 microversion: 2.1 time: 0.159758 Oct 12 23:17:19.369962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3321/6547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:19 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:20.393231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:20.394264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:20.402065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:20.402807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:20.403640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:20.404592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:20.405877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:20.406433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:20.558104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:20.566065 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fcf5a47e-cd7d-45d2-a4c3-44ec25a483d3 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1372 microversion: 2.1 time: 0.176980 Oct 12 23:17:20.566748 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3227/6548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:20 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:21.588883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:21.589514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:21.596607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:21.597105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:21.597557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:21.598266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:21.598739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:21.599176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:21.738378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:21.746906 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-701ac921-cddc-44ab-ad6b-341e6ea4c571 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1372 microversion: 2.1 time: 0.161843 Oct 12 23:17:21.747606 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3322/6549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:21 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:21.998648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5c8de754-d5e7-4daf-9b9c-3c97e1f524e3 req-47bfb2ff-679e-4680-b4d6-1919d61c9ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ceb4d0-92ab-4a33-b504-fe7a7dc4be51", "name": "network-vif-plugged", "status": "completed", "tag": "394310f0-63a1-470b-813d-4c0c9d633c18"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:22.010396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5c8de754-d5e7-4daf-9b9c-3c97e1f524e3 req-47bfb2ff-679e-4680-b4d6-1919d61c9ea5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:22.011254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5c8de754-d5e7-4daf-9b9c-3c97e1f524e3 req-47bfb2ff-679e-4680-b4d6-1919d61c9ea5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:22.011881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5c8de754-d5e7-4daf-9b9c-3c97e1f524e3 req-47bfb2ff-679e-4680-b4d6-1919d61c9ea5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:22.024723 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5c8de754-d5e7-4daf-9b9c-3c97e1f524e3 req-47bfb2ff-679e-4680-b4d6-1919d61c9ea5 service nova] Creating event network-vif-plugged:394310f0-63a1-470b-813d-4c0c9d633c18 for instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 on n-h1-860864-8 Oct 12 23:17:22.029637 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5c8de754-d5e7-4daf-9b9c-3c97e1f524e3 req-47bfb2ff-679e-4680-b4d6-1919d61c9ea5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034801 Oct 12 23:17:22.030361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3228/6550] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:22.771144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:22.773060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:22.781753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:22.782404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:22.782865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:22.783589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:22.784089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:22.784535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:22.920048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:22.928492 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9e0e602-3e06-46ad-9f07-9aeda0bbf8a9 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1372 microversion: 2.1 time: 0.161706 Oct 12 23:17:22.929074 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3323/6551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:22 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:23.949868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:23.950721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:23.955152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:23.956475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:23.963584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:23.964094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:23.964540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:23.965236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:23.965693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:23.966123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:24.105886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:24.113715 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a98152cd-ae68-479f-a241-3bc41fdfb5e0 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1545 microversion: 2.1 time: 0.165707 Oct 12 23:17:24.114289 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3229/6552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:23 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1545 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:24.136289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:24.137042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:24.139354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:24.147076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:24.147655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:24.148143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:24.148858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:24.149484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:24.150037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:24.291453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:24.299211 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08ba582d-4e36-49b9-b912-6a7ed32f602a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1545 microversion: 2.1 time: 0.166884 Oct 12 23:17:24.300412 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3324/6553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:24 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:40.949865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:40.950361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:40.952299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:40.953049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=30 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:40.960076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:40.960553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:40.960988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:40.961669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:40.962114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:40.962532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:41.043291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lazy-loading 'services' on Instance uuid 5f006785-5558-4097-8141-89e80b2458e5 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:17:41.111440 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6851189d-86a5-457a-8c3a-de78d79d8786 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5/os-volume_attachments/74852f36-b9e8-480e-84ff-c3de557a69e3" status: 202 len: 0 microversion: 2.1 time: 0.165656 Oct 12 23:17:41.112075 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3230/6554] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:17:40 2022] DELETE /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5/os-volume_attachments/74852f36-b9e8-480e-84ff-c3de557a69e3 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:17:46.479182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:46.479685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:46.482608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:46.483459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=36 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:17:46.490608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:46.491102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:46.491550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:46.492286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:46.492754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:46.493189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:46.519463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:17:46.593123 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92064474-1683-4913-8e82-6660dfdc54c6 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 204 len: 0 microversion: 2.1 time: 0.117718 Oct 12 23:17:46.593715 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3325/6555] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:17:46 2022] DELETE /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:17:46.603875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:46.604600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:46.610811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:46.611288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:46.611718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:46.612421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:46.612867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:46.613290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:46.753746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:46.761535 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-abdd8236-ffa8-4b5d-9007-32381287afe3 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1468 microversion: 2.1 time: 0.162753 Oct 12 23:17:46.762108 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3231/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:46 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:47.786195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:47.786943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:47.793904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:47.794398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:47.794849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:47.795553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:47.796060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:47.796497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:47.927643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:47.935459 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d27fb66-198e-421c-b064-d1f2ef18635f tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1468 microversion: 2.1 time: 0.154227 Oct 12 23:17:47.936080 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3326/6557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:47 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:48.518065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8d0990cc-9d05-4f19-8052-1af6c6fba061 req-b571abb5-e315-4460-83dc-4695a99c4dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f006785-5558-4097-8141-89e80b2458e5", "name": "network-vif-deleted", "tag": "7a859861-55a3-433a-b05b-d8b2481ed05b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:48.529500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d0990cc-9d05-4f19-8052-1af6c6fba061 req-b571abb5-e315-4460-83dc-4695a99c4dc3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:48.529986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d0990cc-9d05-4f19-8052-1af6c6fba061 req-b571abb5-e315-4460-83dc-4695a99c4dc3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:48.530422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8d0990cc-9d05-4f19-8052-1af6c6fba061 req-b571abb5-e315-4460-83dc-4695a99c4dc3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:48.542900 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8d0990cc-9d05-4f19-8052-1af6c6fba061 req-b571abb5-e315-4460-83dc-4695a99c4dc3 service nova] Creating event network-vif-deleted:7a859861-55a3-433a-b05b-d8b2481ed05b for instance 5f006785-5558-4097-8141-89e80b2458e5 on n-h2-860864-8 Oct 12 23:17:48.549833 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8d0990cc-9d05-4f19-8052-1af6c6fba061 req-b571abb5-e315-4460-83dc-4695a99c4dc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035869 Oct 12 23:17:48.550623 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3232/6558] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:48.961268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:48.962030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:48.970874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:48.971370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:48.971842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:48.972577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:48.973576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:48.974922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:49.007951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:49.008635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:49.009281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:49.009740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lazy-loading 'fault' on Instance uuid 5f006785-5558-4097-8141-89e80b2458e5 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:17:49.077499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890df847ce8b46e4996096d25adad726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a27da64b4004c5e9e158ed9bbdd3054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:49.085360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-68c23b62-53b1-4018-ab1e-36c42d825875 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 200 len: 1302 microversion: 2.1 time: 0.130209 Oct 12 23:17:49.085951 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3327/6559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:48 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:17:49.975807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:49.976431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:49.982692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:49.983180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:49.983734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:49.984339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:49.984784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:49.985208 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:50.013691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:17:50.104192 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0dc9e193-5658-4cd7-b5ea-607bb83fd881 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 204 len: 0 microversion: 2.1 time: 0.133198 Oct 12 23:17:50.105271 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3233/6560] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:17:49 2022] DELETE /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:17:50.111993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:50.114142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] [instance: 5f006785-5558-4097-8141-89e80b2458e5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:50.114526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:50.115246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:50.122251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:50.122741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:50.123405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:50.124103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:50.124269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:50.124616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:50.124904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:50.125111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:50.125332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:50.125787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:50.126261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:50.126706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:50.153136 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] HTTP exception thrown: Instance 5f006785-5558-4097-8141-89e80b2458e5 could not be found. Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Request method failure captured: Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 HTTP/1.1 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0rIC8kcHV6vbwoqFyJpCBA6BORkspCTsswJZ7db9RGbASqk7AV1asxyiyRdfw-_1TAg_LFiT7lLjjpZfjLC9yqQwfa9orMld8tbuSCx3VzJup9M48g4bx0C_0JMDF1Cehu8utoO7-NV8MwRqPM9h2ghXKxFkJZpXYQ-0NdDaZ-YDvo Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 5a27da64b4004c5e9e158ed9bbdd3054 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesBackupsTest-1770793298 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a27da64b4004c5e9e158ed9bbdd3054"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a27da64b4004c5e9e158ed9bbdd3054"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a27da64b4004c5e9e158ed9bbdd3054"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a27da64b4004c5e9e158ed9bbdd3054"}]}] Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-VolumesBackupsTest-1770793298 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 5a27da64b4004c5e9e158ed9bbdd3054 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesBackupsTest-1770793298 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-VolumesBackupsTest-1770793298-project Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 890df847ce8b46e4996096d25adad726 Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-VolumesBackupsTest-1770793298-project Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 5f006785-5558-4097-8141-89e80b2458e5 could not be found. Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '5f006785-5558-4097-8141-89e80b2458e5'} Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f006785-5558-4097-8141-89e80b2458e5 could not be found. Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f006785-5558-4097-8141-89e80b2458e5 could not be found. Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:50.155464 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:50.161889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:50.161889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:50.161889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:50.161889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:17:50.161889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:17:50.161889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f006785-5558-4097-8141-89e80b2458e5 could not be found. Oct 12 23:17:50.161889 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:50.163843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] Returning 404 to user: Instance 5f006785-5558-4097-8141-89e80b2458e5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:17:50.164952 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-676132c8-61e6-4190-8855-2ddaeac942b9 tempest-VolumesBackupsTest-1770793298 tempest-VolumesBackupsTest-1770793298-project] 10.222.0.20 "GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5" status: 404 len: 111 microversion: 2.1 time: 0.060371 Oct 12 23:17:50.169271 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3328/6561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:50 2022] GET /compute/v2.1/servers/5f006785-5558-4097-8141-89e80b2458e5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:17:50.322005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:50.330865 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b640e267-4c46-4803-88bf-253496e90bd5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1551 microversion: 2.1 time: 0.221450 Oct 12 23:17:50.331931 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3234/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:50 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1551 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:17:51.355486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:51.356209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:51.363279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:51.364517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:51.364967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:51.366129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:51.366659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:51.367106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:51.499581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:51.508435 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cec4b814-a009-4944-b473-618b6860d2a5 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 200 len: 1551 microversion: 2.1 time: 0.157686 Oct 12 23:17:51.509269 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3329/6563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:51 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:52.107667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-15dfe9c2-8348-4895-bfa1-86192dffb965 req-26a07540-4531-48c5-9b26-a3b44e7ea26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ceb4d0-92ab-4a33-b504-fe7a7dc4be51", "name": "network-vif-deleted", "tag": "394310f0-63a1-470b-813d-4c0c9d633c18"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:52.118168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-15dfe9c2-8348-4895-bfa1-86192dffb965 req-26a07540-4531-48c5-9b26-a3b44e7ea26b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:52.118672 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-15dfe9c2-8348-4895-bfa1-86192dffb965 req-26a07540-4531-48c5-9b26-a3b44e7ea26b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:52.119112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-15dfe9c2-8348-4895-bfa1-86192dffb965 req-26a07540-4531-48c5-9b26-a3b44e7ea26b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:52.130291 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-15dfe9c2-8348-4895-bfa1-86192dffb965 req-26a07540-4531-48c5-9b26-a3b44e7ea26b service nova] Creating event network-vif-deleted:394310f0-63a1-470b-813d-4c0c9d633c18 for instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 on n-h1-860864-8 Oct 12 23:17:52.135184 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-15dfe9c2-8348-4895-bfa1-86192dffb965 req-26a07540-4531-48c5-9b26-a3b44e7ea26b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178962 Oct 12 23:17:52.135807 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3235/6564] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:52.532541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:52.533196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:52.540442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:52.541045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:52.541593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:52.542403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:52.543064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:52.543502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:52.557111 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] HTTP exception thrown: Instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 could not be found. Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Request method failure captured: Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 HTTP/1.1 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0q-06oXRAnY5c4txUfDJGewwM5YwGsSsAEkiGWs2Il3753lnpOAra_uuPuk5Zw5Jxl48iB7gg_K5rhlAQduaMmQtYPslk-paMUIQ_6-ed83b_dF2VkNOlI4FF5M7dD09nRjGy_JveuQ5396DJFWuKZhvmlrDpH8YjvXW9Zhx9cBcN0 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d7b0c56423a64e1c96c0583aea1719d3 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkBasicOps-557816958 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7b0c56423a64e1c96c0583aea1719d3"}]}] Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkBasicOps-557816958 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d7b0c56423a64e1c96c0583aea1719d3 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkBasicOps-557816958 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkBasicOps-557816958-project Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 01083a9673eb4ff09da0218e24c168f0 Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkBasicOps-557816958-project Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 could not be found. Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '48ceb4d0-92ab-4a33-b504-fe7a7dc4be51'} Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 could not be found. Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 could not be found. Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:52.558661 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 could not be found. Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Returning 404 to user: Instance 48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3d16a272-79b3-4de4-985c-fac4cfe53d69 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51" status: 404 len: 111 microversion: 2.1 time: 0.031729 Oct 12 23:17:52.564642 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3330/6565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:52 2022] GET /compute/v2.1/servers/48ceb4d0-92ab-4a33-b504-fe7a7dc4be51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:17:52.731427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f69d61eb-de0f-43fe-8110-8336c52a2733 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '.version_select at 0x7f4507c10f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:52.755666 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f69d61eb-de0f-43fe-8110-8336c52a2733 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1755182017" status: 202 len: 0 microversion: 2.1 time: 0.028574 Oct 12 23:17:52.756904 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3236/6566] 10.222.0.20 () {58 vars in 1257 bytes} [Wed Oct 12 23:17:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1755182017 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:17:55.000187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8fcc02c7-9c20-4f32-a5b2-63a6525cd1b9 req-d2d80fbd-38a0-42c7-b4da-21ddcee405f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6050e6e-e42c-43ca-8c33-30a05cd7ad94", "tag": "a318e9b6-1462-4321-bcd3-2acfa7b72779"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:55.002800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:55.003327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:55.017875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:55.018297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:55.018961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:55.020525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:55.020665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8fcc02c7-9c20-4f32-a5b2-63a6525cd1b9 req-d2d80fbd-38a0-42c7-b4da-21ddcee405f9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:55.021302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:55.021438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8fcc02c7-9c20-4f32-a5b2-63a6525cd1b9 req-d2d80fbd-38a0-42c7-b4da-21ddcee405f9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:55.022058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:55.024953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8fcc02c7-9c20-4f32-a5b2-63a6525cd1b9 req-d2d80fbd-38a0-42c7-b4da-21ddcee405f9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:55.045172 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8fcc02c7-9c20-4f32-a5b2-63a6525cd1b9 req-d2d80fbd-38a0-42c7-b4da-21ddcee405f9 service nova] Creating event network-changed:a318e9b6-1462-4321-bcd3-2acfa7b72779 for instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 on n-h1-860864-8 Oct 12 23:17:55.052081 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8fcc02c7-9c20-4f32-a5b2-63a6525cd1b9 req-d2d80fbd-38a0-42c7-b4da-21ddcee405f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056380 Oct 12 23:17:55.053365 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3237/6567] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:55.055683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:17:55.159642 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10a619d5-e8d5-4876-ae5e-61b2a43b5aec tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 204 len: 0 microversion: 2.1 time: 0.167296 Oct 12 23:17:55.163765 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3331/6568] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:17:54 2022] DELETE /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:17:55.172430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:55.173140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:55.179306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:55.180084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:55.180526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:55.181247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:55.181695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:55.182294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:55.337223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:55.345659 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9fabc1aa-fdbe-4240-825b-21cf9a8b7dab tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1670 microversion: 2.1 time: 0.177430 Oct 12 23:17:55.346349 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3238/6569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:55 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:56.371882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:56.372960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:56.381047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:56.381694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:56.382239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:56.383029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:56.383567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:56.384127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:56.533492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:56.542614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f60c004c-c766-4fdf-a975-34e94c37916d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1670 microversion: 2.1 time: 0.175437 Oct 12 23:17:56.543202 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3332/6570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:56 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:57.098755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-26e0a39a-b828-4b1a-87a2-7f6350d656d6 req-22625cd4-f143-49ad-8158-a404d37bdbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6050e6e-e42c-43ca-8c33-30a05cd7ad94", "name": "network-vif-deleted", "tag": "a318e9b6-1462-4321-bcd3-2acfa7b72779"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:17:57.109925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-26e0a39a-b828-4b1a-87a2-7f6350d656d6 req-22625cd4-f143-49ad-8158-a404d37bdbc7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:57.110513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-26e0a39a-b828-4b1a-87a2-7f6350d656d6 req-22625cd4-f143-49ad-8158-a404d37bdbc7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:57.111175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-26e0a39a-b828-4b1a-87a2-7f6350d656d6 req-22625cd4-f143-49ad-8158-a404d37bdbc7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:57.124166 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-26e0a39a-b828-4b1a-87a2-7f6350d656d6 req-22625cd4-f143-49ad-8158-a404d37bdbc7 service nova] Creating event network-vif-deleted:a318e9b6-1462-4321-bcd3-2acfa7b72779 for instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 on n-h1-860864-8 Oct 12 23:17:57.131163 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-26e0a39a-b828-4b1a-87a2-7f6350d656d6 req-22625cd4-f143-49ad-8158-a404d37bdbc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036058 Oct 12 23:17:57.131909 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3239/6571] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:17:57.565850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:57.566483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:57.574693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:57.575470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:57.575944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:57.576865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:57.577523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:57.578048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:57.613049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:57.613482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:57.614519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:57.614973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lazy-loading 'fault' on Instance uuid e6050e6e-e42c-43ca-8c33-30a05cd7ad94 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:17:57.659118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:17:57.666880 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f2acc54-2bdf-4e5d-bc55-b78dc75489a4 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 200 len: 1338 microversion: 2.1 time: 0.105069 Oct 12 23:17:57.667455 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3333/6572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:57 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:17:58.693179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:58.694157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: e6050e6e-e42c-43ca-8c33-30a05cd7ad94] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:17:58.702897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:58.703394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:58.703832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:58.704587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:17:58.705040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:17:58.705464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:17:58.720029 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] HTTP exception thrown: Instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 could not be found. Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Request method failure captured: Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 HTTP/1.1 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0q-06oXRAnY5c4txUfDJGewwM5YwGsSsAEkiGWs2Il3753lnpOAra_uuPuk5Zw5Jxl48iB7gg_K5rhlAQduaMmQtYPslk-paMUIQ_6-ed83b_dF2VkNOlI4FF5M7dD09nRjGy_JveuQ5396DJFWuKZhvmlrDpH8YjvXW9Zhx9cBcN0 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d7b0c56423a64e1c96c0583aea1719d3 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestNetworkBasicOps-557816958 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7b0c56423a64e1c96c0583aea1719d3"}]}] Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestNetworkBasicOps-557816958 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d7b0c56423a64e1c96c0583aea1719d3 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestNetworkBasicOps-557816958 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestNetworkBasicOps-557816958-project Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 01083a9673eb4ff09da0218e24c168f0 Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestNetworkBasicOps-557816958-project Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 could not be found. Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'e6050e6e-e42c-43ca-8c33-30a05cd7ad94'} Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 could not be found. Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 could not be found. Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:17:58.721948 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 could not be found. Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Returning 404 to user: Instance e6050e6e-e42c-43ca-8c33-30a05cd7ad94 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8863f283-89d4-444f-95cc-84036d61e2cd tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94" status: 404 len: 111 microversion: 2.1 time: 0.036160 Oct 12 23:17:58.726823 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3240/6573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:17:58 2022] GET /compute/v2.1/servers/e6050e6e-e42c-43ca-8c33-30a05cd7ad94 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:17:59.205030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17260c63-d3d1-456d-9eb7-3ea5778379ad tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '.version_select at 0x7f4507b2d670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:17:59.233269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17260c63-d3d1-456d-9eb7-3ea5778379ad tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-271901353" status: 202 len: 0 microversion: 2.1 time: 0.032409 Oct 12 23:17:59.233764 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3334/6574] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Oct 12 23:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-271901353 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:18:08.584702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a2b9be9-69e2-4b5e-a655-b65d0195f44d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'create', calling method: .version_select at 0x7f44ff54e0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1344667618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWWky20T9TPJEOTrndCFl+qM1jk/Xfk9LzVS5oehIkgu0zgaHg+zWCWeyHgw+pEiNV9DrJTWRa6SWSR3hnPpd/b/vaWWkbjZqLoW70vsXAWKovrbsFc6Kz5nzvrHOZ/7g=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:08.610387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0a2b9be9-69e2-4b5e-a655-b65d0195f44d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:18:08.616892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-0a2b9be9-69e2-4b5e-a655-b65d0195f44d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for user 01083a9673eb4ff09da0218e24c168f0 and project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:18:08.651560 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a2b9be9-69e2-4b5e-a655-b65d0195f44d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.070536 Oct 12 23:18:08.652456 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3241/6575] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:18:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:18:09.897856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:09.898621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:09.904119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2145078265", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "21ef5b50-7264-4c6f-92df-90c9c7512ff4"}], "key_name": "tempest-TestNetworkBasicOps-1344667618", "security_groups": [{"name": "tempest-secgroup-smoke-776972083"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:10.032500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] validate_networks() for [('21ef5b50-7264-4c6f-92df-90c9c7512ff4', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:18:10.583470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:18:10.585942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:18:10.586931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:18:10.587687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:18:10.588374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:18:10.600111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:10.601012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:10.601714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:10.602701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:10.603414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:10.604128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:10.636838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:18:10.646265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Getting quotas for user 01083a9673eb4ff09da0218e24c168f0 and project d7b0c56423a64e1c96c0583aea1719d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:18:10.662139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:18:10.664743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:18:10.743391 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f72585b8-ced9-41ac-aba9-1b9992b7d94e tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.844399 Oct 12 23:18:10.744848 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3335/6576] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:18:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:18:10.752916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:10.762112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ce22d3e3-15d3-4a3f-959d-03a38005e60f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:10.763103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ce22d3e3-15d3-4a3f-959d-03a38005e60f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:10.849432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ce22d3e3-15d3-4a3f-959d-03a38005e60f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:10.857455 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ce22d3e3-15d3-4a3f-959d-03a38005e60f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1249 microversion: 2.1 time: 0.105392 Oct 12 23:18:10.858039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3242/6577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:10 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1249 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:11.880693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:11.881462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:11.888928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:11.889437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:11.889892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:11.890613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:11.891083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:11.891985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:11.961365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:11.969414 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-df80da53-af95-4011-b274-5e217fb2e9b6 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1301 microversion: 2.1 time: 0.093275 Oct 12 23:18:11.979795 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3336/6578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:11 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:12.992924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:12.993469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:13.000589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:13.002126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:13.002871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:13.003395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:13.004237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:13.004699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:13.005160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:13.174059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:13.182878 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40113c42-34a6-45b2-9c8a-92b1da58ae13 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1374 microversion: 2.1 time: 0.193958 Oct 12 23:18:13.184049 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3243/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:12 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:13.689565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5b45c527-59e0-44a0-a904-3bf2fdc93990 req-6ec26426-609d-4fec-93cf-b96bee177b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b654e653-e1a0-4798-882b-3f75e36a0693", "tag": "b493dd63-5a0b-48e5-b951-098827da4ec8"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:13.701037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b45c527-59e0-44a0-a904-3bf2fdc93990 req-6ec26426-609d-4fec-93cf-b96bee177b33 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:13.701528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b45c527-59e0-44a0-a904-3bf2fdc93990 req-6ec26426-609d-4fec-93cf-b96bee177b33 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:13.701971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b45c527-59e0-44a0-a904-3bf2fdc93990 req-6ec26426-609d-4fec-93cf-b96bee177b33 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:13.713677 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5b45c527-59e0-44a0-a904-3bf2fdc93990 req-6ec26426-609d-4fec-93cf-b96bee177b33 service nova] Creating event network-changed:b493dd63-5a0b-48e5-b951-098827da4ec8 for instance b654e653-e1a0-4798-882b-3f75e36a0693 on n-h2-860864-8 Oct 12 23:18:13.718746 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5b45c527-59e0-44a0-a904-3bf2fdc93990 req-6ec26426-609d-4fec-93cf-b96bee177b33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121458 Oct 12 23:18:13.719471 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3337/6580] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:18:14.206539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:14.207160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:14.214069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:14.215144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:14.215595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:14.216320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:14.216864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:14.217245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:14.355109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:14.362898 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-868b4529-fd68-46e6-956c-69601a9b0f33 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1374 microversion: 2.1 time: 0.160319 Oct 12 23:18:14.363477 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3244/6581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:14 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:15.390532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:15.391625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:15.398226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:15.398714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:15.399174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:15.399904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:15.400380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:15.400818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:15.547874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:15.557126 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5ca7ac84-a935-4ef8-b6d5-57ef8cf406bc tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1374 microversion: 2.1 time: 0.173651 Oct 12 23:18:15.557745 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3338/6582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:15 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:16.580998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:16.581611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:16.589191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:16.590150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:16.590589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:16.591285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:16.591739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:16.592190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:16.726877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:16.734566 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a50ede49-ebcb-4c57-a332-dca0a2cea29d tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1374 microversion: 2.1 time: 0.157640 Oct 12 23:18:16.735123 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3245/6583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:16 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:17.766074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:17.766879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:17.774934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:17.775434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:17.775878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:17.776615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:17.777078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:17.777512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:17.909221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:17.917347 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3aa51c1-7992-4d0f-b825-1dc441cba4f1 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1374 microversion: 2.1 time: 0.162431 Oct 12 23:18:17.918125 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3339/6584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:17 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:18.940164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:18.940787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:18.948360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:18.948849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:18.949289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:18.949980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:18.950435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:18.950866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:19.085431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:19.093046 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a9ba716c-6340-42b0-ba7c-04ca1cf95d3a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1374 microversion: 2.1 time: 0.156830 Oct 12 23:18:19.093619 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3246/6585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:18 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:19.365010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6dcd0e0c-c276-4144-a487-a927cc707726 req-1f203fb5-2241-446c-b279-d27c0ad7c54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b654e653-e1a0-4798-882b-3f75e36a0693", "name": "network-vif-plugged", "status": "completed", "tag": "b493dd63-5a0b-48e5-b951-098827da4ec8"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:19.377346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6dcd0e0c-c276-4144-a487-a927cc707726 req-1f203fb5-2241-446c-b279-d27c0ad7c54d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:19.378444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6dcd0e0c-c276-4144-a487-a927cc707726 req-1f203fb5-2241-446c-b279-d27c0ad7c54d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:19.379008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6dcd0e0c-c276-4144-a487-a927cc707726 req-1f203fb5-2241-446c-b279-d27c0ad7c54d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:19.390520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6dcd0e0c-c276-4144-a487-a927cc707726 req-1f203fb5-2241-446c-b279-d27c0ad7c54d service nova] Creating event network-vif-plugged:b493dd63-5a0b-48e5-b951-098827da4ec8 for instance b654e653-e1a0-4798-882b-3f75e36a0693 on n-h2-860864-8 Oct 12 23:18:19.395935 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6dcd0e0c-c276-4144-a487-a927cc707726 req-1f203fb5-2241-446c-b279-d27c0ad7c54d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103405 Oct 12 23:18:19.396604 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3340/6586] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:18:20.115909 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:20.116533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:20.123299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:20.123782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:20.124255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:20.124943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:20.125396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:20.125838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:20.254820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:20.263263 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ef038dc-df99-4873-85f3-f0e562f5696c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1374 microversion: 2.1 time: 0.151367 Oct 12 23:18:20.264643 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3247/6587] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:20 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:21.285132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:21.285978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:21.290283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:21.290990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:21.298026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:21.298514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:21.298956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:21.299645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:21.300132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:21.300564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:21.432571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:21.440301 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d4ba78b-41f4-444b-8449-9d44aded18ae tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1545 microversion: 2.1 time: 0.156975 Oct 12 23:18:21.441130 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3341/6588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:21 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1545 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:21.463237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:21.463856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:21.469647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:21.471999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:21.472469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:21.472905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:21.473602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:21.474080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:21.474501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:21.619573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:21.629651 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cc7bc1f3-ea3b-4e0e-980c-eb66e2555b8c tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1545 microversion: 2.1 time: 0.170098 Oct 12 23:18:21.630669 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3248/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:21 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1545 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:23.572802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-bdf0a9ac-ee4b-4155-b756-4ceb7a1312eb req-7ee12adf-43e4-43f7-ad63-e20273fc4724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b654e653-e1a0-4798-882b-3f75e36a0693", "tag": "b493dd63-5a0b-48e5-b951-098827da4ec8"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:23.584922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bdf0a9ac-ee4b-4155-b756-4ceb7a1312eb req-7ee12adf-43e4-43f7-ad63-e20273fc4724 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:23.585778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bdf0a9ac-ee4b-4155-b756-4ceb7a1312eb req-7ee12adf-43e4-43f7-ad63-e20273fc4724 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:23.586462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-bdf0a9ac-ee4b-4155-b756-4ceb7a1312eb req-7ee12adf-43e4-43f7-ad63-e20273fc4724 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:23.599676 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-bdf0a9ac-ee4b-4155-b756-4ceb7a1312eb req-7ee12adf-43e4-43f7-ad63-e20273fc4724 service nova] Creating event network-changed:b493dd63-5a0b-48e5-b951-098827da4ec8 for instance b654e653-e1a0-4798-882b-3f75e36a0693 on n-h2-860864-8 Oct 12 23:18:23.605428 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-bdf0a9ac-ee4b-4155-b756-4ceb7a1312eb req-7ee12adf-43e4-43f7-ad63-e20273fc4724 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036330 Oct 12 23:18:23.606978 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3342/6590] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:18:45.878461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:45.881200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:45.883588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=11 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:45.884321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=36 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:45.890324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:45.890805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:45.891240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:45.891953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:45.892410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:45.892835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:45.944301 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afe11f8d-6100-435d-b884-3f8274ba2bba tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693/action" status: 200 len: 24572 microversion: 2.1 time: 0.069095 Oct 12 23:18:45.944946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3249/6591] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:18:45 2022] POST /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:18:52.448665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:52.450908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:52.453299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:52.453955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:18:52.460875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:52.461394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:52.461884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:52.462613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:52.463072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:52.463502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:52.513006 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f1807ed-2165-421e-868d-532a9b05855a tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "POST /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693/action" status: 200 len: 32647 microversion: 2.1 time: 0.069395 Oct 12 23:18:52.520258 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3343/6592] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:18:52 2022] POST /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693/action => generated 32647 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:18:53.601837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-13c46fcb-470d-465d-9238-9bc1f19d9f19 req-715f55b7-c4d9-44e8-aa93-18f5edd21068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b654e653-e1a0-4798-882b-3f75e36a0693", "tag": "b493dd63-5a0b-48e5-b951-098827da4ec8"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:53.602901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:53.604149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:53.613896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.614859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.616630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.617684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.618367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.619045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.625548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-13c46fcb-470d-465d-9238-9bc1f19d9f19 req-715f55b7-c4d9-44e8-aa93-18f5edd21068 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.626272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-13c46fcb-470d-465d-9238-9bc1f19d9f19 req-715f55b7-c4d9-44e8-aa93-18f5edd21068 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.626878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-13c46fcb-470d-465d-9238-9bc1f19d9f19 req-715f55b7-c4d9-44e8-aa93-18f5edd21068 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.638766 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-13c46fcb-470d-465d-9238-9bc1f19d9f19 req-715f55b7-c4d9-44e8-aa93-18f5edd21068 service nova] Creating event network-changed:b493dd63-5a0b-48e5-b951-098827da4ec8 for instance b654e653-e1a0-4798-882b-3f75e36a0693 on n-h2-860864-8 Oct 12 23:18:53.644262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-13c46fcb-470d-465d-9238-9bc1f19d9f19 req-715f55b7-c4d9-44e8-aa93-18f5edd21068 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046141 Oct 12 23:18:53.645472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3344/6593] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:18:53.655337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:18:53.776681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3fbacac8-61a2-44bf-8c56-498aea57538f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 204 len: 0 microversion: 2.1 time: 0.180452 Oct 12 23:18:53.777869 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3250/6594] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:18:53 2022] DELETE /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:18:53.788525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:53.789485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:53.797319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.798028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.798761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.799630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:53.800282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:53.800875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:53.950313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:53.959028 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-19019395-9e52-43df-8e77-7ae9bbd97c71 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1669 microversion: 2.1 time: 0.176162 Oct 12 23:18:53.959737 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3345/6595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:53 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:54.984188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:54.984887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:54.993046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:54.993526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:54.993960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:54.994643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:54.995090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:54.995511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:55.129762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:55.138102 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec161188-4439-4311-bec2-1e6507d37a4b tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1669 microversion: 2.1 time: 0.158246 Oct 12 23:18:55.138668 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3251/6596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:54 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:55.686979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c2409327-b07b-4962-bba8-d6016e8bcf35 req-43345ab7-18b4-4ca8-8be5-f9c6c17b9fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b654e653-e1a0-4798-882b-3f75e36a0693", "name": "network-vif-deleted", "tag": "b493dd63-5a0b-48e5-b951-098827da4ec8"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:18:55.704817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c2409327-b07b-4962-bba8-d6016e8bcf35 req-43345ab7-18b4-4ca8-8be5-f9c6c17b9fd8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:55.705400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c2409327-b07b-4962-bba8-d6016e8bcf35 req-43345ab7-18b4-4ca8-8be5-f9c6c17b9fd8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:55.706094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c2409327-b07b-4962-bba8-d6016e8bcf35 req-43345ab7-18b4-4ca8-8be5-f9c6c17b9fd8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:55.718827 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c2409327-b07b-4962-bba8-d6016e8bcf35 req-43345ab7-18b4-4ca8-8be5-f9c6c17b9fd8 service nova] Creating event network-vif-deleted:b493dd63-5a0b-48e5-b951-098827da4ec8 for instance b654e653-e1a0-4798-882b-3f75e36a0693 on n-h2-860864-8 Oct 12 23:18:55.726139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c2409327-b07b-4962-bba8-d6016e8bcf35 req-43345ab7-18b4-4ca8-8be5-f9c6c17b9fd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043530 Oct 12 23:18:55.726771 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3346/6597] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:18:56.161298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:56.161907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:56.169898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:56.170482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:56.170989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:56.171758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:56.172242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:56.172711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:56.212298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:56.212738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:56.213180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:56.213638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lazy-loading 'fault' on Instance uuid b654e653-e1a0-4798-882b-3f75e36a0693 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:18:56.262886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01083a9673eb4ff09da0218e24c168f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b0c56423a64e1c96c0583aea1719d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:18:56.270286 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b381ad0-0e83-4e8e-b710-262a858ff948 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 200 len: 1339 microversion: 2.1 time: 0.113231 Oct 12 23:18:56.270894 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3252/6598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:56 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:18:57.294670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:57.295291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] [instance: b654e653-e1a0-4798-882b-3f75e36a0693] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:18:57.303418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:57.303915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:57.304368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:57.305058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:18:57.305824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:18:57.306261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:18:57.322128 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] HTTP exception thrown: Instance b654e653-e1a0-4798-882b-3f75e36a0693 could not be found. Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Request method failure captured: Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 HTTP/1.1 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0q-06oXRAnY5c4txUfDJGewwM5YwGsSsAEkiGWs2Il3753lnpOAra_uuPuk5Zw5Jxl48iB7gg_K5rhlAQduaMmQtYPslk-paMUIQ_6-ed83b_dF2VkNOlI4FF5M7dD09nRjGy_JveuQ5396DJFWuKZhvmlrDpH8YjvXW9Zhx9cBcN0 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d7b0c56423a64e1c96c0583aea1719d3 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkBasicOps-557816958 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d7b0c56423a64e1c96c0583aea1719d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d7b0c56423a64e1c96c0583aea1719d3"}]}] Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkBasicOps-557816958 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d7b0c56423a64e1c96c0583aea1719d3 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkBasicOps-557816958 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkBasicOps-557816958-project Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 01083a9673eb4ff09da0218e24c168f0 Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkBasicOps-557816958-project Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance b654e653-e1a0-4798-882b-3f75e36a0693 could not be found. Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'b654e653-e1a0-4798-882b-3f75e36a0693'} Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b654e653-e1a0-4798-882b-3f75e36a0693 could not be found. Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b654e653-e1a0-4798-882b-3f75e36a0693 could not be found. Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:18:57.323809 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b654e653-e1a0-4798-882b-3f75e36a0693 could not be found. Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Returning 404 to user: Instance b654e653-e1a0-4798-882b-3f75e36a0693 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-163999aa-a1e1-4f57-8064-ad20bca83e32 tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693" status: 404 len: 111 microversion: 2.1 time: 0.035047 Oct 12 23:18:57.329369 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3347/6599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:18:57 2022] GET /compute/v2.1/servers/b654e653-e1a0-4798-882b-3f75e36a0693 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:18:57.728822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b0dbf9b-4ab4-4bdd-ba39-ce9f2a37461f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] Calling method '.version_select at 0x7f44ff447280>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:18:57.769369 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b0dbf9b-4ab4-4bdd-ba39-ce9f2a37461f tempest-TestNetworkBasicOps-557816958 tempest-TestNetworkBasicOps-557816958-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1344667618" status: 202 len: 0 microversion: 2.1 time: 0.044716 Oct 12 23:18:57.770478 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3253/6600] 10.222.0.20 () {58 vars in 1257 bytes} [Wed Oct 12 23:18:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1344667618 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:22:52.789587 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3e96063-e855-4765-b1eb-7b495cad42c1] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:22:52.790850 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:22:52.791482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:52.792548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:52.793483 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:22:52.793630 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 12 23:22:52.795080 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:22:52.795210 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 12 23:22:52.796630 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:22:52.796736 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 12 23:22:52.813659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-150716105", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "dab8d756-9597-46cb-8a9f-7510ddc6d34f"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:53.120633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] validate_networks() for [('dab8d756-9597-46cb-8a9f-7510ddc6d34f', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:22:53.462941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:22:53.463374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:22:53.463853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:22:53.464384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:22:53.464803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:22:53.473629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:53.474110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:53.474546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:53.475272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:53.475731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:53.476189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:53.493505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Getting quotas for project b0b0094243a64960922ce21e5e318108. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:22:53.498640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Getting quotas for user 28ebce4372c048b9ac9c897ae8fdced6 and project b0b0094243a64960922ce21e5e318108. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:22:53.511136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:22:53.513440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:22:53.558784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebaa4a98-d75b-4c1f-aeac-88fb3efb237f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771075 Oct 12 23:22:53.559494 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3348/6601] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:22:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:22:53.569490 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:22:53.570308 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:22:53.570831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:53.571579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:22:53.573602 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:22:53.573776 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec (ip 10.222.0.20) !!! Oct 12 23:22:53.574815 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:22:53.574946 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec (ip 10.222.0.20) !!! Oct 12 23:22:53.576611 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:22:53.576775 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec (ip 10.222.0.20) !!! Oct 12 23:22:53.586485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc516fce-d884-48ef-8d2a-9ba81b4042b1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:53.586959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc516fce-d884-48ef-8d2a-9ba81b4042b1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:53.707736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc516fce-d884-48ef-8d2a-9ba81b4042b1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:53.715546 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc516fce-d884-48ef-8d2a-9ba81b4042b1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1218 microversion: 2.1 time: 0.148126 Oct 12 23:22:53.716271 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3254/6602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:53 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:54.740584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:54.741298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:54.756540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:54.757707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:54.757707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:54.758209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:54.758677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:54.759115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:54.766139 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35930. Oct 12 23:22:54.767214 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3e96063-e855-4765-b1eb-7b495cad42c1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35928. Oct 12 23:22:54.834037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:54.843196 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b919e3c7-edee-45ac-bca3-6615990f815d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1278 microversion: 2.1 time: 0.108563 Oct 12 23:22:54.844181 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3349/6603] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:54 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:55.867092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:55.867838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:55.879398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:55.879885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:55.880342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:55.881037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:55.881489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:55.881910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:55.886412 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35936. Oct 12 23:22:55.889458 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35938. Oct 12 23:22:56.092798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:56.101195 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76515658-c7fa-4f57-b0a6-4eca7d2f88be tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1318 microversion: 2.1 time: 0.238147 Oct 12 23:22:56.101772 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3255/6604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:55 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:56.244703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-323faef2-8684-4dbb-9647-23600ad1690e req-96381e60-6531-4120-b06a-7a57c32c534d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56db18aa-6e49-465b-a54e-151d86c971ec", "tag": "8d1d2f1e-4730-4558-b2a9-6ede63ab8e26"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:22:56.254893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-323faef2-8684-4dbb-9647-23600ad1690e req-96381e60-6531-4120-b06a-7a57c32c534d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:56.255369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-323faef2-8684-4dbb-9647-23600ad1690e req-96381e60-6531-4120-b06a-7a57c32c534d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:56.255820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-323faef2-8684-4dbb-9647-23600ad1690e req-96381e60-6531-4120-b06a-7a57c32c534d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:56.267843 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-323faef2-8684-4dbb-9647-23600ad1690e req-96381e60-6531-4120-b06a-7a57c32c534d service nova] Creating event network-changed:8d1d2f1e-4730-4558-b2a9-6ede63ab8e26 for instance 56db18aa-6e49-465b-a54e-151d86c971ec on n-h1-860864-8 Oct 12 23:22:56.273764 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-323faef2-8684-4dbb-9647-23600ad1690e req-96381e60-6531-4120-b06a-7a57c32c534d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111851 Oct 12 23:22:56.274381 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3350/6605] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:22:57.124286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:57.124903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:57.131796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:57.132319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:57.132750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:57.133433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:57.133879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:57.134298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:57.266164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:57.273736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e27b45f7-a372-4624-bad6-bc16643f9cc2 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1318 microversion: 2.1 time: 0.153415 Oct 12 23:22:57.274321 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3256/6606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:57 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:58.298630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:58.299375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:58.305624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:58.306112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:58.306561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:58.307256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:58.307720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:58.308180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:58.434812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:58.443041 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00aebb3f-b0fc-4291-962d-dc22a37d6f78 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1318 microversion: 2.1 time: 0.150081 Oct 12 23:22:58.443618 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3351/6607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:58 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:22:59.465998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:22:59.466616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:22:59.473980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:59.474465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:59.474904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:59.475595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:22:59.476079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:22:59.476507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:22:59.605623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:22:59.613905 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e42481e3-531b-4bf1-9102-2724af2c0822 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1318 microversion: 2.1 time: 0.151788 Oct 12 23:22:59.614491 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3257/6608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:22:59 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:00.636919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:00.637554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:00.644512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:00.645011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:00.645462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:00.646164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:00.646629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:00.647072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:00.777031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:00.785478 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a4d13e2-1bf7-450a-b04b-d2be5b2b82e9 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1318 microversion: 2.1 time: 0.152542 Oct 12 23:23:00.786050 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3352/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:00 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:01.620706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b28e684d-2a9e-4b64-9538-bd62ccb54daf req-2d311189-88b3-47ef-97dc-a4a1212b7675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56db18aa-6e49-465b-a54e-151d86c971ec", "name": "network-vif-plugged", "status": "completed", "tag": "8d1d2f1e-4730-4558-b2a9-6ede63ab8e26"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:01.632007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b28e684d-2a9e-4b64-9538-bd62ccb54daf req-2d311189-88b3-47ef-97dc-a4a1212b7675 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:01.632658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b28e684d-2a9e-4b64-9538-bd62ccb54daf req-2d311189-88b3-47ef-97dc-a4a1212b7675 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:01.633146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b28e684d-2a9e-4b64-9538-bd62ccb54daf req-2d311189-88b3-47ef-97dc-a4a1212b7675 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:01.648094 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b28e684d-2a9e-4b64-9538-bd62ccb54daf req-2d311189-88b3-47ef-97dc-a4a1212b7675 service nova] Creating event network-vif-plugged:8d1d2f1e-4730-4558-b2a9-6ede63ab8e26 for instance 56db18aa-6e49-465b-a54e-151d86c971ec on n-h1-860864-8 Oct 12 23:23:01.655223 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b28e684d-2a9e-4b64-9538-bd62ccb54daf req-2d311189-88b3-47ef-97dc-a4a1212b7675 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038212 Oct 12 23:23:01.655847 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3258/6610] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:01.809023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:01.809656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:01.817053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:01.817548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:01.817999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:01.818703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:01.819192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:01.819629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:01.948549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:01.956784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89b8886d-3d05-4b8a-868b-0eaed0f6b09b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1318 microversion: 2.1 time: 0.151724 Oct 12 23:23:01.957366 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3353/6611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:01 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:02.981738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:02.982354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:02.989071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:02.989549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:02.989987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:02.990669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:02.991128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:02.991553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:03.122595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:03.130515 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4b1958df-73cf-46b6-8a49-a6966fc24edd tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1506 microversion: 2.1 time: 0.153944 Oct 12 23:23:03.131088 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3259/6612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:02 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:18.344937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a006569-4786-448a-8493-7de640df850d", "device": "/dev/sdb"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:18.347359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:18.350105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:18.350976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:18.351566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:18.352323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=28 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:18.358830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:18.359315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:18.360292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:18.360982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:18.361437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:18.361866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:18.597484 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0920c18b-9c01-4da4-b997-ac1e11d62238 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "POST /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256305 Oct 12 23:23:18.598096 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3354/6613] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:23:18 2022] POST /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:43.443491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:43.444022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:43.446322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:43.447402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=14 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:43.447675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=26 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:43.453762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:43.454247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:43.454689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:43.455382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:43.455838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:43.456902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:43.537110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lazy-loading 'services' on Instance uuid 56db18aa-6e49-465b-a54e-151d86c971ec {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:23:43.606567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40969f22-3adc-45e1-94d9-c78386bbf2b0 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "DELETE /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec/os-volume_attachments/4a006569-4786-448a-8493-7de640df850d" status: 202 len: 0 microversion: 2.1 time: 0.167380 Oct 12 23:23:43.607177 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3260/6614] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:23:43 2022] DELETE /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec/os-volume_attachments/4a006569-4786-448a-8493-7de640df850d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:23:48.978420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:48.979272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:23:48.983928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:48.984644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:48.992587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:48.993078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:48.993524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:48.994221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:48.994683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:48.995116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:49.022904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:23:49.096353 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57a1810e-0c1e-4466-a1c7-b57d3e0ac16e tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "DELETE /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 204 len: 0 microversion: 2.1 time: 0.119528 Oct 12 23:23:49.097335 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3355/6615] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:23:48 2022] DELETE /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:23:49.106592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:49.107310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:49.114075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:49.114549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:49.114982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:49.115662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:49.116139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:49.116556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:49.246621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:49.255129 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-869b6c48-6d0b-4e90-a7b0-00f3ccba8478 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1512 microversion: 2.1 time: 0.153536 Oct 12 23:23:49.256060 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3261/6616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:49 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:50.280412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:50.281130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:50.288467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:50.288960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:50.289410 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:50.290113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:50.290576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:50.291011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:50.424031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:50.432665 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42c58ea2-251f-4021-9e5b-e9f9804d935b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1512 microversion: 2.1 time: 0.156851 Oct 12 23:23:50.433257 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3356/6617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:50 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:51.048795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-57a9d476-bdf0-4e15-a685-db12ae1fb85b req-1c1139dc-679f-4195-98c4-5e2f792ede72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56db18aa-6e49-465b-a54e-151d86c971ec", "name": "network-vif-deleted", "tag": "8d1d2f1e-4730-4558-b2a9-6ede63ab8e26"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:51.063848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57a9d476-bdf0-4e15-a685-db12ae1fb85b req-1c1139dc-679f-4195-98c4-5e2f792ede72 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:51.064512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57a9d476-bdf0-4e15-a685-db12ae1fb85b req-1c1139dc-679f-4195-98c4-5e2f792ede72 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:51.064956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57a9d476-bdf0-4e15-a685-db12ae1fb85b req-1c1139dc-679f-4195-98c4-5e2f792ede72 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:51.078830 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-57a9d476-bdf0-4e15-a685-db12ae1fb85b req-1c1139dc-679f-4195-98c4-5e2f792ede72 service nova] Creating event network-vif-deleted:8d1d2f1e-4730-4558-b2a9-6ede63ab8e26 for instance 56db18aa-6e49-465b-a54e-151d86c971ec on n-h1-860864-8 Oct 12 23:23:51.085468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-57a9d476-bdf0-4e15-a685-db12ae1fb85b req-1c1139dc-679f-4195-98c4-5e2f792ede72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041162 Oct 12 23:23:51.086373 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3262/6618] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:23:51.456320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:51.457041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:51.464333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:51.464829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:51.465294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:51.465984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:51.466447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:51.466879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:51.498638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:51.499125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:51.500235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:51.500235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lazy-loading 'fault' on Instance uuid 56db18aa-6e49-465b-a54e-151d86c971ec {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:23:51.543045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:51.550714 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3cbcbf1a-24d4-4df1-9d8b-f1048c7da89a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 200 len: 1308 microversion: 2.1 time: 0.098711 Oct 12 23:23:51.551330 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3357/6619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:51 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:23:52.576990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:52.577686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 56db18aa-6e49-465b-a54e-151d86c971ec] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:52.583868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:52.584379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:52.584808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:52.585526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:52.585973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:52.586394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:52.599917 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] HTTP exception thrown: Instance 56db18aa-6e49-465b-a54e-151d86c971ec could not be found. Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Request method failure captured: Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec HTTP/1.1 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0wYO7-sH0oT-4NC_mcoNzGCzmjSvyri4JvXH94g-ObnrYiqG6x6b6AOw8eT9ved3JPZxY8e3mXqFrtXpoRq4y7PO86-dQjtqzCJlE7EXzYyKzodwdl03FICXp2hohGcy3W0Btqk77o-o6-AtplXuXoLTIzmjNyMSObllDv812-jFac Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: b0b0094243a64960922ce21e5e318108 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1745284863 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b0b0094243a64960922ce21e5e318108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b0b0094243a64960922ce21e5e318108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b0b0094243a64960922ce21e5e318108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b0b0094243a64960922ce21e5e318108"}]}] Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotTestJSON-1745284863 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: b0b0094243a64960922ce21e5e318108 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1745284863 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotTestJSON-1745284863-project Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 28ebce4372c048b9ac9c897ae8fdced6 Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotTestJSON-1745284863-project Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 56db18aa-6e49-465b-a54e-151d86c971ec could not be found. Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '56db18aa-6e49-465b-a54e-151d86c971ec'} Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56db18aa-6e49-465b-a54e-151d86c971ec could not be found. Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56db18aa-6e49-465b-a54e-151d86c971ec could not be found. Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:23:52.601512 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56db18aa-6e49-465b-a54e-151d86c971ec could not be found. Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Returning 404 to user: Instance 56db18aa-6e49-465b-a54e-151d86c971ec could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e943e432-6547-4258-9aed-5fe489500169 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec" status: 404 len: 111 microversion: 2.1 time: 0.031018 Oct 12 23:23:52.606103 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3263/6620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:52 2022] GET /compute/v2.1/servers/56db18aa-6e49-465b-a54e-151d86c971ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:23:59.353771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106429255", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "dab8d756-9597-46cb-8a9f-7510ddc6d34f"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:23:59.406192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] validate_networks() for [('dab8d756-9597-46cb-8a9f-7510ddc6d34f', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:23:59.806471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:23:59.806976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:23:59.807461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:23:59.807880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:23:59.808332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:23:59.817177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:59.817604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:59.818047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:59.818776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:23:59.819236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:23:59.819671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:23:59.836582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Getting quotas for project b0b0094243a64960922ce21e5e318108. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:23:59.841768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Getting quotas for user 28ebce4372c048b9ac9c897ae8fdced6 and project b0b0094243a64960922ce21e5e318108. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:23:59.854400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:23:59.856751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:23:59.901674 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-16687dff-9eb8-46bf-aa9e-1ed31e6cbc2d tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551902 Oct 12 23:23:59.902338 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3358/6621] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:23:59.914501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-350f122f-82a2-4b4e-8690-1e6fb0811d8b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:23:59.915205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-350f122f-82a2-4b4e-8690-1e6fb0811d8b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:23:59.969209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-350f122f-82a2-4b4e-8690-1e6fb0811d8b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:23:59.976399 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-350f122f-82a2-4b4e-8690-1e6fb0811d8b tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1219 microversion: 2.1 time: 0.065959 Oct 12 23:23:59.976989 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3264/6622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:23:59 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:01.000008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aa8f51ea-5149-4e34-b4ce-7c82636bef62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:01.000648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aa8f51ea-5149-4e34-b4ce-7c82636bef62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:01.056801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aa8f51ea-5149-4e34-b4ce-7c82636bef62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:01.063820 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aa8f51ea-5149-4e34-b4ce-7c82636bef62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1219 microversion: 2.1 time: 0.069153 Oct 12 23:24:01.064435 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3359/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:00 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:02.087885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f8a8a273-0e15-43dd-a4e1-04ee74258eab tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:02.088472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f8a8a273-0e15-43dd-a4e1-04ee74258eab tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:02.150036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f8a8a273-0e15-43dd-a4e1-04ee74258eab tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:02.157259 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f8a8a273-0e15-43dd-a4e1-04ee74258eab tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1219 microversion: 2.1 time: 0.073352 Oct 12 23:24:02.157824 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3265/6624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:02 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:24:03.181284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5f133d71-29c2-498a-9285-5f1201eb1c0f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:03.181925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5f133d71-29c2-498a-9285-5f1201eb1c0f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:03.238369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f133d71-29c2-498a-9285-5f1201eb1c0f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:03.245320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5f133d71-29c2-498a-9285-5f1201eb1c0f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1219 microversion: 2.1 time: 0.068052 Oct 12 23:24:03.245900 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3360/6625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:03 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:04.268954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:04.269586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:04.271820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:04.278374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:04.278881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:04.279316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:04.280023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:04.280736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:04.281157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:04.342276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:04.350454 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3ea3824b-8578-45fa-a9eb-7c901a617078 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1223 microversion: 2.1 time: 0.085944 Oct 12 23:24:04.351047 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3266/6626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:04 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:05.373825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:05.374559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:05.385452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:05.385952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:05.386408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:05.387130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:05.387597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:05.388067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:05.462366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:05.470525 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03c422fc-364e-4033-a9c3-12e9e72e3bc7 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1277 microversion: 2.1 time: 0.101073 Oct 12 23:24:05.471111 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3361/6627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:05 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:06.437157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-46f0fc0b-b749-4194-9efa-4754e03835d1 req-67cb5887-e920-4008-883a-0b984f2075bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c9a456-1c93-4285-9d53-075d4f029f1a", "tag": "75592967-0c90-4bf1-bfeb-96bc0b57bf7c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:24:06.446960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-46f0fc0b-b749-4194-9efa-4754e03835d1 req-67cb5887-e920-4008-883a-0b984f2075bc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:06.447437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-46f0fc0b-b749-4194-9efa-4754e03835d1 req-67cb5887-e920-4008-883a-0b984f2075bc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:06.448084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-46f0fc0b-b749-4194-9efa-4754e03835d1 req-67cb5887-e920-4008-883a-0b984f2075bc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:06.461901 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-46f0fc0b-b749-4194-9efa-4754e03835d1 req-67cb5887-e920-4008-883a-0b984f2075bc service nova] Creating event network-changed:75592967-0c90-4bf1-bfeb-96bc0b57bf7c for instance 96c9a456-1c93-4285-9d53-075d4f029f1a on n-h2-860864-8 Oct 12 23:24:06.466945 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-46f0fc0b-b749-4194-9efa-4754e03835d1 req-67cb5887-e920-4008-883a-0b984f2075bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107899 Oct 12 23:24:06.467600 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3267/6628] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:24:06.494486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:06.495115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:06.502120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:06.502615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:06.503100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:06.503800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:06.504288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:06.504725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:07.019183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:07.028316 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dee44a3a-d397-45b4-a856-dd73815f7241 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1319 microversion: 2.1 time: 0.537558 Oct 12 23:24:07.028828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3362/6629] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:06 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:08.052428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:08.053049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:08.059241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:08.059717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:08.060181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:08.060872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:08.061317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:08.061737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:08.191510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:08.199660 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-250ce894-a62e-46a6-bb4a-5feb4e2bcac5 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1319 microversion: 2.1 time: 0.152495 Oct 12 23:24:08.200271 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3268/6630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:08 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:09.223396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:09.224051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:09.230794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:09.231281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:09.231725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:09.232511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:09.232972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:09.233403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:09.364920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:09.372618 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-164efad1-8565-413b-8a24-73fd3f55f8f1 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1319 microversion: 2.1 time: 0.153196 Oct 12 23:24:09.373190 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3363/6631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:09 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:10.397564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:10.398131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:10.405837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:10.406324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:10.406768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:10.407460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:10.407934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:10.408367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:10.540977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:10.549031 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a87e526-3716-4674-8d6b-5fea6fc02f27 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1319 microversion: 2.1 time: 0.156056 Oct 12 23:24:10.549606 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3269/6632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:10 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:11.572048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:11.572582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:11.574533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:11.580520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:11.581514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:11.581953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:11.582652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:11.583137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:11.583571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:11.716051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:11.724331 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6ff147a-4147-402a-afc8-c5a127b989fa tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1319 microversion: 2.1 time: 0.156346 Oct 12 23:24:11.724898 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3364/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:11 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:12.747088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:12.747811 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:12.750693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:12.756708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:12.757375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:12.758140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:12.759404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:12.760464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:12.761570 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:12.871549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6d6fd379-a7a1-43d1-bda6-45e248a06b44 req-a817953d-dc0b-49e2-89e9-971a75185db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c9a456-1c93-4285-9d53-075d4f029f1a", "name": "network-vif-plugged", "status": "completed", "tag": "75592967-0c90-4bf1-bfeb-96bc0b57bf7c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:24:12.881231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d6fd379-a7a1-43d1-bda6-45e248a06b44 req-a817953d-dc0b-49e2-89e9-971a75185db1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:12.881722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d6fd379-a7a1-43d1-bda6-45e248a06b44 req-a817953d-dc0b-49e2-89e9-971a75185db1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:12.882164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d6fd379-a7a1-43d1-bda6-45e248a06b44 req-a817953d-dc0b-49e2-89e9-971a75185db1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:12.893210 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6d6fd379-a7a1-43d1-bda6-45e248a06b44 req-a817953d-dc0b-49e2-89e9-971a75185db1 service nova] Creating event network-vif-plugged:75592967-0c90-4bf1-bfeb-96bc0b57bf7c for instance 96c9a456-1c93-4285-9d53-075d4f029f1a on n-h2-860864-8 Oct 12 23:24:12.898501 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6d6fd379-a7a1-43d1-bda6-45e248a06b44 req-a817953d-dc0b-49e2-89e9-971a75185db1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101873 Oct 12 23:24:12.899107 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3365/6634] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:24:12.905060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:12.913892 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-452f5597-b881-48d0-a624-301b524df6a3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1319 microversion: 2.1 time: 0.170690 Oct 12 23:24:12.914474 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3270/6635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:12 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:13.934929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:13.940190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:13.940945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:13.947765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:13.948310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:13.948757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:13.949467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:13.949928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:13.950383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:14.082061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:14.090298 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d9a148c-aa9b-406d-89b3-456a05814811 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1319 microversion: 2.1 time: 0.156354 Oct 12 23:24:14.090959 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3366/6636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:13 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:15.114735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:15.115355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:15.118105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=27 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:15.123778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:15.124292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:15.124734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:15.125431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:15.125911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:15.126484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:15.251880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:15.259674 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a02f0f0-427d-49f0-9958-3cf7a480435f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1507 microversion: 2.1 time: 0.149574 Oct 12 23:24:15.260274 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3271/6637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:15 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:15.282480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca831f53-0b69-4e01-ab0e-0327122829ea", "device": "/dev/sdb"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:24:15.285531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:15.292394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:15.292885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:15.293334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:15.294033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:15.294497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:15.294934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:15.533600 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57b806dc-5c31-4c77-80b3-50972938d815 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "POST /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255384 Oct 12 23:24:15.535074 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3367/6638] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:24:15 2022] POST /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:24:37.038788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:37.039283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:37.041310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:37.041951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=32 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:37.048588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:37.049073 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:37.049513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:37.050185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:37.050630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:37.051046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:37.130447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lazy-loading 'services' on Instance uuid 96c9a456-1c93-4285-9d53-075d4f029f1a {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:24:37.200624 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7dfb990-7b36-4796-99ca-ff9ecf30967f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a/os-volume_attachments/ca831f53-0b69-4e01-ab0e-0327122829ea" status: 202 len: 0 microversion: 2.1 time: 0.166587 Oct 12 23:24:37.201217 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3272/6639] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:24:37 2022] DELETE /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a/os-volume_attachments/ca831f53-0b69-4e01-ab0e-0327122829ea => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:24:42.563484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:42.564370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:24:42.570352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:42.570952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:42.578654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:42.579204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:42.579656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:42.580384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:42.580848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:42.581285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:42.607960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:24:42.681664 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7137ef89-60b0-429f-9a2b-6e37c396ed62 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 204 len: 0 microversion: 2.1 time: 0.119865 Oct 12 23:24:42.682448 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3368/6640] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:24:42 2022] DELETE /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:24:42.691509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:42.692245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:42.699154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:42.699633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:42.700111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:42.700799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:42.701244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:42.701664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:42.837051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:42.844843 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2633947e-ab2a-4a26-a56e-c3d7e1dc78bb tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1513 microversion: 2.1 time: 0.157655 Oct 12 23:24:42.845412 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3273/6641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:42 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:43.869213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:43.869935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:43.876812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:43.877308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:43.877757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:43.878460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:43.878926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:43.879363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:44.010262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:44.018133 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d349492a-ae75-436c-b63e-b191a48e549a tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1513 microversion: 2.1 time: 0.153307 Oct 12 23:24:44.018709 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3369/6642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:43 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:44.622281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c85edc5a-2ffb-4a6d-a71a-ee8db639b76c req-00c81f52-fb0e-4986-829c-78fd9efba618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c9a456-1c93-4285-9d53-075d4f029f1a", "name": "network-vif-deleted", "tag": "75592967-0c90-4bf1-bfeb-96bc0b57bf7c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:24:44.634004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c85edc5a-2ffb-4a6d-a71a-ee8db639b76c req-00c81f52-fb0e-4986-829c-78fd9efba618 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:44.634484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c85edc5a-2ffb-4a6d-a71a-ee8db639b76c req-00c81f52-fb0e-4986-829c-78fd9efba618 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:44.634917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c85edc5a-2ffb-4a6d-a71a-ee8db639b76c req-00c81f52-fb0e-4986-829c-78fd9efba618 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:44.647540 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c85edc5a-2ffb-4a6d-a71a-ee8db639b76c req-00c81f52-fb0e-4986-829c-78fd9efba618 service nova] Creating event network-vif-deleted:75592967-0c90-4bf1-bfeb-96bc0b57bf7c for instance 96c9a456-1c93-4285-9d53-075d4f029f1a on n-h2-860864-8 Oct 12 23:24:44.652884 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c85edc5a-2ffb-4a6d-a71a-ee8db639b76c req-00c81f52-fb0e-4986-829c-78fd9efba618 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034382 Oct 12 23:24:44.653504 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3274/6643] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:24:45.042418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:45.043078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:45.050008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:45.050522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:45.050972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:45.051654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:45.052147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:45.052585 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:45.084994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:45.085491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:45.085949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:45.086406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lazy-loading 'fault' on Instance uuid 96c9a456-1c93-4285-9d53-075d4f029f1a {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:24:45.128474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ebce4372c048b9ac9c897ae8fdced6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b0094243a64960922ce21e5e318108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:24:45.136077 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10a189f3-a4c3-4496-99fa-68308e4480c3 tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 200 len: 1309 microversion: 2.1 time: 0.097801 Oct 12 23:24:45.136651 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3370/6644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:45 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:24:46.161946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:24:46.163215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] [instance: 96c9a456-1c93-4285-9d53-075d4f029f1a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:24:46.169390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:46.169870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:46.170306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:46.170991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:24:46.171439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:24:46.171877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:24:46.184930 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] HTTP exception thrown: Instance 96c9a456-1c93-4285-9d53-075d4f029f1a could not be found. Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Request method failure captured: Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a HTTP/1.1 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0wYO7-sH0oT-4NC_mcoNzGCzmjSvyri4JvXH94g-ObnrYiqG6x6b6AOw8eT9ved3JPZxY8e3mXqFrtXpoRq4y7PO86-dQjtqzCJlE7EXzYyKzodwdl03FICXp2hohGcy3W0Btqk77o-o6-AtplXuXoLTIzmjNyMSObllDv812-jFac Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: b0b0094243a64960922ce21e5e318108 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1745284863 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b0b0094243a64960922ce21e5e318108"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b0b0094243a64960922ce21e5e318108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b0b0094243a64960922ce21e5e318108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b0b0094243a64960922ce21e5e318108"}]}] Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotTestJSON-1745284863 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: b0b0094243a64960922ce21e5e318108 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1745284863 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotTestJSON-1745284863-project Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 28ebce4372c048b9ac9c897ae8fdced6 Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotTestJSON-1745284863-project Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 96c9a456-1c93-4285-9d53-075d4f029f1a could not be found. Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '96c9a456-1c93-4285-9d53-075d4f029f1a'} Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c9a456-1c93-4285-9d53-075d4f029f1a could not be found. Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c9a456-1c93-4285-9d53-075d4f029f1a could not be found. Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:24:46.186517 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c9a456-1c93-4285-9d53-075d4f029f1a could not be found. Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] Returning 404 to user: Instance 96c9a456-1c93-4285-9d53-075d4f029f1a could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ba61dcc-b86f-4aff-84b5-7f66b4f8072f tempest-VolumesSnapshotTestJSON-1745284863 tempest-VolumesSnapshotTestJSON-1745284863-project] 10.222.0.20 "GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a" status: 404 len: 111 microversion: 2.1 time: 0.031425 Oct 12 23:24:46.190868 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3275/6645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:24:46 2022] GET /compute/v2.1/servers/96c9a456-1c93-4285-9d53-075d4f029f1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:25:42.099158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:25:42.099915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:25:42.209413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1672235008", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:42.261478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] validate_networks() for None {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:25:42.448247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:25:42.448681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:25:42.449192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:25:42.449612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:25:42.450044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:25:42.458941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:42.459431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:42.459878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:42.460639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:42.461103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:42.461541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:42.478422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Getting quotas for project 46da8067b2d546a4bc4945137cbe64a4. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:25:42.483771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Getting quotas for user 9c5d3ddc65aa4eb086ff0db1a2269a64 and project 46da8067b2d546a4bc4945137cbe64a4. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:25:42.496541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:25:42.498778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:25:42.544535 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc2fea20-74d4-49b2-97c1-09552e78526e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450357 Oct 12 23:25:42.545199 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3371/6646] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:25:42.558634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-82948224-1813-4382-a671-b26518912a4e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:42.559250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-82948224-1813-4382-a671-b26518912a4e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:42.561440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:25:42.562550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:25:42.618309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-82948224-1813-4382-a671-b26518912a4e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:42.625299 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-82948224-1813-4382-a671-b26518912a4e tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1222 microversion: 2.1 time: 0.071514 Oct 12 23:25:42.625979 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3276/6647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:42 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:43.649056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:43.649687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:43.656463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:43.656956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:43.657666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:43.658369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:43.658824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:43.659255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:43.725281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:43.733269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27210f53-0205-48a1-abbd-6ef3e7833094 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1280 microversion: 2.1 time: 0.089900 Oct 12 23:25:43.733857 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3372/6648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:43 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:44.756125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:44.756894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:44.765712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:44.766455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:44.767251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:44.768145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:44.768781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:44.772036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:44.986445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:44.994206 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-642aba67-0b76-457c-9794-1ff68ea2675c tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1322 microversion: 2.1 time: 0.242072 Oct 12 23:25:44.994788 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3277/6649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:44 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:45.354618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d9829bfb-f150-4905-a151-5c3dfeae7ad9 req-2e4821ba-d682-410c-b2ee-61c18da3dde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5456fb36-870d-43b1-9b77-74554cad8467", "tag": "be5c51a8-70e0-4792-bbd8-90469a202b91"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:45.364878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d9829bfb-f150-4905-a151-5c3dfeae7ad9 req-2e4821ba-d682-410c-b2ee-61c18da3dde8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:45.365588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d9829bfb-f150-4905-a151-5c3dfeae7ad9 req-2e4821ba-d682-410c-b2ee-61c18da3dde8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:45.366743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d9829bfb-f150-4905-a151-5c3dfeae7ad9 req-2e4821ba-d682-410c-b2ee-61c18da3dde8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:45.381393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d9829bfb-f150-4905-a151-5c3dfeae7ad9 req-2e4821ba-d682-410c-b2ee-61c18da3dde8 service nova] Creating event network-changed:be5c51a8-70e0-4792-bbd8-90469a202b91 for instance 5456fb36-870d-43b1-9b77-74554cad8467 on n-h1-860864-8 Oct 12 23:25:45.387097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d9829bfb-f150-4905-a151-5c3dfeae7ad9 req-2e4821ba-d682-410c-b2ee-61c18da3dde8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036626 Oct 12 23:25:45.387973 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3373/6650] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:25:46.017700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:46.018453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:46.026284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:46.026774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:46.027212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:46.027940 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:46.028397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:46.028824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:46.156939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:46.165482 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2946c25b-8c57-439f-8bd9-ea3d1fcc3473 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1322 microversion: 2.1 time: 0.151888 Oct 12 23:25:46.166048 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3278/6651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:46 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:47.189443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:47.190080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:47.196312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:47.196810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:47.197266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:47.197969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:47.198439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:47.198877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:47.328587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:47.336208 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36947c5e-6708-446b-8f52-222dc318445a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1322 microversion: 2.1 time: 0.152004 Oct 12 23:25:47.336772 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3374/6652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:47 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:48.359260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:48.359879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:48.367118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:48.367598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:48.368067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:48.368759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:48.369213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:48.369633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:48.499123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:48.506666 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7978d956-0428-470a-8611-b1bae755054a tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1322 microversion: 2.1 time: 0.151358 Oct 12 23:25:48.507277 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3279/6653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:48 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:49.529512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:49.530140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:49.537307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:49.537806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:49.538765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:49.539467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:49.539957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:49.540400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:49.667686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:49.675327 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a3ee552-58a2-4bc0-94aa-e03402007a91 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1322 microversion: 2.1 time: 0.149753 Oct 12 23:25:49.675925 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3375/6654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:49 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:50.357824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-921628c7-7031-4ff5-a52a-b49a680833d0 req-83654b56-42b8-4b7f-ae66-03bd33228d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5456fb36-870d-43b1-9b77-74554cad8467", "name": "network-vif-plugged", "status": "completed", "tag": "be5c51a8-70e0-4792-bbd8-90469a202b91"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:50.370014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-921628c7-7031-4ff5-a52a-b49a680833d0 req-83654b56-42b8-4b7f-ae66-03bd33228d6f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:50.370574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-921628c7-7031-4ff5-a52a-b49a680833d0 req-83654b56-42b8-4b7f-ae66-03bd33228d6f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:50.371078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-921628c7-7031-4ff5-a52a-b49a680833d0 req-83654b56-42b8-4b7f-ae66-03bd33228d6f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:50.382293 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-921628c7-7031-4ff5-a52a-b49a680833d0 req-83654b56-42b8-4b7f-ae66-03bd33228d6f service nova] Creating event network-vif-plugged:be5c51a8-70e0-4792-bbd8-90469a202b91 for instance 5456fb36-870d-43b1-9b77-74554cad8467 on n-h1-860864-8 Oct 12 23:25:50.388199 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-921628c7-7031-4ff5-a52a-b49a680833d0 req-83654b56-42b8-4b7f-ae66-03bd33228d6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034020 Oct 12 23:25:50.389036 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3280/6655] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:25:50.698899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:50.699559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:50.706459 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:50.706940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:50.707398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:50.708138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:50.708612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:50.709058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:50.836668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:50.844416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a2c8d81-675f-4861-a036-25759adbc06d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1322 microversion: 2.1 time: 0.150040 Oct 12 23:25:50.844991 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3376/6656] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:50 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:51.868639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:51.869342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:51.875526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:51.876044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:51.876501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:51.877176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:51.877629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:51.878053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.007991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:52.016219 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-638c0053-40a7-4b31-8b9c-17e18b32552d tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1471 microversion: 2.1 time: 0.152719 Oct 12 23:25:52.016799 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3281/6657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:51 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:52.091235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db72af77-c91e-44a6-a82f-41f61cb3e9b1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Calling method '.version_select at 0x7f44ff4bd8b0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:52.156424 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db72af77-c91e-44a6-a82f-41f61cb3e9b1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/bbfb7b821e204f28b3877b08ccbf0504" status: 200 len: 371 microversion: 2.1 time: 0.119352 Oct 12 23:25:52.156995 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3377/6658] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 23:25:52 2022] GET /compute/v2.1/os-quota-sets/bbfb7b821e204f28b3877b08ccbf0504 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:25:52.169437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c246e6ba-92a7-4b0b-95bf-d0daef44d09e tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2010485883", "id": 867978485, "os-flavor-access:is_public": "True"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:52.187076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c246e6ba-92a7-4b0b-95bf-d0daef44d09e tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021378 Oct 12 23:25:52.187689 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3282/6659] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:25:52 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:25:52.200289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "867978485"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:52.202695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:52.208723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.209235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.209671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.210369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.210830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.211262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.294885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5bd657e00aba4050b82ca3ed51db9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfb7b821e204f28b3877b08ccbf0504', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:52.300602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2010485883 {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:25:52.307706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.308214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.308660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.309389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.309851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.310288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.330242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Getting quotas for project 46da8067b2d546a4bc4945137cbe64a4. Resources: {'ram', 'cores'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:25:52.335473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Getting quotas for user 9c5d3ddc65aa4eb086ff0db1a2269a64 and project 46da8067b2d546a4bc4945137cbe64a4. Resources: {'ram', 'cores'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:25:52.347325 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.compute.api [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] ram quota exceeded for bbfb7b821e204f28b3877b08ccbf0504, tried to resize instance. Oct 12 23:25:52.347875 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Request method failure captured: Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467/action HTTP/1.1 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 38 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0z1lYEvcJcqb1rWu_zNXyvKM5IQldnkRLlkClf8gsTafRodJmXxTgK7KiycEZ-88bKn5GwQzvR2CkEj-tplYegsH-c7kyjtWGWG6dZT0axEv_13C2pv5_ZvMB-GFyXKbuJY1DxA6sFappuoumzB13GrhZNPFQ-mlsyvr1S7Sp3hUrE Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: bbfb7b821e204f28b3877b08ccbf0504 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1431725831 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,admin,member Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,admin,member Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbfb7b821e204f28b3877b08ccbf0504"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbfb7b821e204f28b3877b08ccbf0504"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbfb7b821e204f28b3877b08ccbf0504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbfb7b821e204f28b3877b08ccbf0504"}]}] Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1431725831 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: bbfb7b821e204f28b3877b08ccbf0504 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1431725831 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-1431725831-project-admin Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 5bd657e00aba4050b82ca3ed51db9171 Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1431725831-project-admin Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: {"resize": {"flavorRef": "867978485"}} Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '5456fb36-870d-43b1-9b77-74554cad8467', 'body': {'resize': {'flavorRef': '867978485'}}} Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:25:52.349959 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b794a70-ce20-479b-a5ea-a2b5b0af1656 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467/action" status: 403 len: 118 microversion: 2.1 time: 0.154931 Oct 12 23:25:52.354423 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3378/6660] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:25:52 2022] POST /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467/action => generated 118 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:25:52.360881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-baac583d-ecaa-43fc-8c2a-e33ffed78900 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:52.377639 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-baac583d-ecaa-43fc-8c2a-e33ffed78900 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/867978485" status: 202 len: 0 microversion: 2.1 time: 0.020518 Oct 12 23:25:52.378200 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3283/6661] 10.222.0.20 () {58 vars in 1158 bytes} [Wed Oct 12 23:25:52 2022] DELETE /compute/v2.1/flavors/867978485 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:25:52.385748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a46d797-6780-48d7-b517-451f4185e846 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:52.409459 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a46d797-6780-48d7-b517-451f4185e846 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027249 Oct 12 23:25:52.410009 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3379/6662] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 23:25:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:25:52.430784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-df1afed1-e41b-4ee1-9d56-ce264c7c1df4 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Calling method '.version_select at 0x7f44ff7c01f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:52.503006 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-df1afed1-e41b-4ee1-9d56-ce264c7c1df4 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/bbfb7b821e204f28b3877b08ccbf0504" status: 200 len: 371 microversion: 2.1 time: 0.076442 Oct 12 23:25:52.503568 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3284/6663] 10.222.0.20 () {58 vars in 1242 bytes} [Wed Oct 12 23:25:52 2022] GET /compute/v2.1/os-quota-sets/bbfb7b821e204f28b3877b08ccbf0504 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:25:52.515450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b958bb4-360d-4c71-b1d6-3fe395a6bff0 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-148486761", "id": 1253200374, "os-flavor-access:is_public": "True"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:52.533596 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b958bb4-360d-4c71-b1d6-3fe395a6bff0 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021902 Oct 12 23:25:52.534166 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3380/6664] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:25:52 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:25:52.546644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1253200374"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:52.549038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:52.555642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.556157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.556602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.557291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.557780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.558210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.749714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5bd657e00aba4050b82ca3ed51db9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfb7b821e204f28b3877b08ccbf0504', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:52.755763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-148486761 {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:25:52.763092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.763563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.764026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.764742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.765187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.765605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.786224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Getting quotas for project 46da8067b2d546a4bc4945137cbe64a4. Resources: {'ram', 'cores'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:25:52.791874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Getting quotas for user 9c5d3ddc65aa4eb086ff0db1a2269a64 and project 46da8067b2d546a4bc4945137cbe64a4. Resources: {'ram', 'cores'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:25:52.803696 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] cores quota exceeded for bbfb7b821e204f28b3877b08ccbf0504, tried to resize instance. Oct 12 23:25:52.805193 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Request method failure captured: Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467/action HTTP/1.1 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 39 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0z1lYEvcJcqb1rWu_zNXyvKM5IQldnkRLlkClf8gsTafRodJmXxTgK7KiycEZ-88bKn5GwQzvR2CkEj-tplYegsH-c7kyjtWGWG6dZT0axEv_13C2pv5_ZvMB-GFyXKbuJY1DxA6sFappuoumzB13GrhZNPFQ-mlsyvr1S7Sp3hUrE Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: bbfb7b821e204f28b3877b08ccbf0504 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1431725831 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,admin,member Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,admin,member Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbfb7b821e204f28b3877b08ccbf0504"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbfb7b821e204f28b3877b08ccbf0504"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbfb7b821e204f28b3877b08ccbf0504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbfb7b821e204f28b3877b08ccbf0504"}]}] Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1431725831 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: bbfb7b821e204f28b3877b08ccbf0504 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1431725831 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersAdminNegativeTestJSON-1431725831-project-admin Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 5bd657e00aba4050b82ca3ed51db9171 Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1431725831-project-admin Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: {"resize": {"flavorRef": "1253200374"}} Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '5456fb36-870d-43b1-9b77-74554cad8467', 'body': {'resize': {'flavorRef': '1253200374'}}} Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:25:52.807260 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a74a432-b8a9-4a93-8dc6-8bf5d451b3c1 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467/action" status: 403 len: 113 microversion: 2.1 time: 0.266092 Oct 12 23:25:52.811402 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3285/6665] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:25:52 2022] POST /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467/action => generated 113 bytes in 267 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:25:52.819031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a2ace152-ba2e-4dce-9808-87fe8dd7d0ca tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:52.835237 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a2ace152-ba2e-4dce-9808-87fe8dd7d0ca tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1253200374" status: 202 len: 0 microversion: 2.1 time: 0.019929 Oct 12 23:25:52.835777 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3381/6666] 10.222.0.20 () {58 vars in 1161 bytes} [Wed Oct 12 23:25:52 2022] DELETE /compute/v2.1/flavors/1253200374 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:25:52.843804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-db674731-3d0b-4efd-9219-c1f4b87f0236 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:52.864629 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-db674731-3d0b-4efd-9219-c1f4b87f0236 tempest-ServersAdminNegativeTestJSON-1431725831 tempest-ServersAdminNegativeTestJSON-1431725831-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024348 Oct 12 23:25:52.865166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3286/6667] 10.222.0.20 () {58 vars in 1146 bytes} [Wed Oct 12 23:25:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:52.884855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:52.885392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:52.891497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.892032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.892488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.893187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:52.893695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:52.894094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:52.920717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:25:52.994416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-288b7b45-a160-4e14-a956-9f96d208ddbb tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 204 len: 0 microversion: 2.1 time: 0.113168 Oct 12 23:25:52.995087 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3382/6668] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:25:52 2022] DELETE /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:25:53.004147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:53.004757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:53.012135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:53.012611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:53.013046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:53.013736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:53.014173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:53.014594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:53.146594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:53.154960 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e13e9f88-b372-4738-85f1-6e4156633856 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1477 microversion: 2.1 time: 0.155693 Oct 12 23:25:53.155518 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3287/6669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:52 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:54.178817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:54.179530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:54.186810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:54.187297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:54.187774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:54.188494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:54.188955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:54.189394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:54.323536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5d3ddc65aa4eb086ff0db1a2269a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46da8067b2d546a4bc4945137cbe64a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:25:54.331235 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3f44d17-3e77-4639-98c4-881cd3a958c7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 200 len: 1477 microversion: 2.1 time: 0.156750 Oct 12 23:25:54.331809 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3383/6670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:54 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:25:54.702951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d0ceee21-bb06-4485-abd9-0dcc1e0642b2 req-d8c1bfaf-4efd-455c-92ea-3e87b20a3265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5456fb36-870d-43b1-9b77-74554cad8467", "name": "network-vif-deleted", "tag": "be5c51a8-70e0-4792-bbd8-90469a202b91"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:25:54.714719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d0ceee21-bb06-4485-abd9-0dcc1e0642b2 req-d8c1bfaf-4efd-455c-92ea-3e87b20a3265 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:54.716234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d0ceee21-bb06-4485-abd9-0dcc1e0642b2 req-d8c1bfaf-4efd-455c-92ea-3e87b20a3265 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:54.717133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d0ceee21-bb06-4485-abd9-0dcc1e0642b2 req-d8c1bfaf-4efd-455c-92ea-3e87b20a3265 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:54.731851 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d0ceee21-bb06-4485-abd9-0dcc1e0642b2 req-d8c1bfaf-4efd-455c-92ea-3e87b20a3265 service nova] Creating event network-vif-deleted:be5c51a8-70e0-4792-bbd8-90469a202b91 for instance 5456fb36-870d-43b1-9b77-74554cad8467 on n-h1-860864-8 Oct 12 23:25:54.738222 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d0ceee21-bb06-4485-abd9-0dcc1e0642b2 req-d8c1bfaf-4efd-455c-92ea-3e87b20a3265 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038968 Oct 12 23:25:54.738842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3288/6671] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:25:55.354747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:25:55.355297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] [instance: 5456fb36-870d-43b1-9b77-74554cad8467] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:25:55.361359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:55.361861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:55.362316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:55.363024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:25:55.363492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:25:55.363956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:25:55.377916 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] HTTP exception thrown: Instance 5456fb36-870d-43b1-9b77-74554cad8467 could not be found. Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Request method failure captured: Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 HTTP/1.1 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR0z1qf_Wwms05gOLdGXTcT1jxq1LD19yv5Sxs9dGrB7GZWccQgGguO3qAfJYCKMfImF0JyPjHrQLAJGfpEqhurPkMjAIsHMMJkg1CrsBxVugTmTRt6L_o-94058iDXghwR9lX4SuAhzLZVieit7rdDk34XtTD6l7IBFoB0460gEteaE Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 46da8067b2d546a4bc4945137cbe64a4 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1230977600 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/46da8067b2d546a4bc4945137cbe64a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/46da8067b2d546a4bc4945137cbe64a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_46da8067b2d546a4bc4945137cbe64a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/46da8067b2d546a4bc4945137cbe64a4"}]}] Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1230977600 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 46da8067b2d546a4bc4945137cbe64a4 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1230977600 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersAdminNegativeTestJSON-1230977600-project Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 9c5d3ddc65aa4eb086ff0db1a2269a64 Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1230977600-project Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 5456fb36-870d-43b1-9b77-74554cad8467 could not be found. Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '5456fb36-870d-43b1-9b77-74554cad8467'} Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5456fb36-870d-43b1-9b77-74554cad8467 could not be found. Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5456fb36-870d-43b1-9b77-74554cad8467 could not be found. Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:55.379559 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5456fb36-870d-43b1-9b77-74554cad8467 could not be found. Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] Returning 404 to user: Instance 5456fb36-870d-43b1-9b77-74554cad8467 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c07102a-c3d6-401b-80b4-a40ad8b044e7 tempest-ServersAdminNegativeTestJSON-1230977600 tempest-ServersAdminNegativeTestJSON-1230977600-project] 10.222.0.20 "GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467" status: 404 len: 111 microversion: 2.1 time: 0.031206 Oct 12 23:25:55.383984 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3384/6672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:25:55 2022] GET /compute/v2.1/servers/5456fb36-870d-43b1-9b77-74554cad8467 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:26:01.514313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1617111400", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "f45f2666-b7dc-4ae6-8175-f142cece1191"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:01.569524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] validate_networks() for [('f45f2666-b7dc-4ae6-8175-f142cece1191', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:26:01.975631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:26:01.976100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:26:01.976583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:26:01.976999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:26:01.978031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:26:01.986975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:01.987449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:01.987881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:01.988706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:01.989185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:01.989611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:02.007248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Getting quotas for project 6a838cc45dbd4e44a73aca6fa6a6b277. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:26:02.013168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Getting quotas for user 694d785ef7ba483daca59ac2dcdaa5d6 and project 6a838cc45dbd4e44a73aca6fa6a6b277. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:26:02.025926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:26:02.028341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:26:02.070628 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [f8c3a805-1bc8-4bb5-81e3-45c080c71e92] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:26:03.079447 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [f8c3a805-1bc8-4bb5-81e3-45c080c71e92] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36788. Oct 12 23:26:03.094042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-335bc192-14ed-4824-8748-4cde4e6ca86e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.700325 Oct 12 23:26:03.094705 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3289/6673] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:26:03.107351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67cbc328-a677-46ac-b8b5-71ea0f5053d5 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:03.108327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67cbc328-a677-46ac-b8b5-71ea0f5053d5 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:03.132714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:03.133646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=5 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:03.185444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-67cbc328-a677-46ac-b8b5-71ea0f5053d5 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:03.192446 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67cbc328-a677-46ac-b8b5-71ea0f5053d5 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1215 microversion: 2.1 time: 0.090405 Oct 12 23:26:03.194842 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3385/6674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:03 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:04.221754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:04.222390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:04.232781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:04.233604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:04.234203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:04.235109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:04.235729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:04.236192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:04.354128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:04.362812 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c3ff794-5a35-42f2-b665-c46f13c07e00 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1285 microversion: 2.1 time: 0.148805 Oct 12 23:26:04.378894 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3290/6675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:04 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:05.386609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:05.387239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:05.394640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:05.397427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:05.397923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:05.398535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:05.400442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:05.400918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:05.401354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:05.553029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:05.560736 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c87765b-699c-4453-b983-ae204f46b690 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1315 microversion: 2.1 time: 0.178111 Oct 12 23:26:05.561309 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3386/6676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:05 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:05.604682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ea1f053a-ce49-4b43-ad31-b6f098a9cf5a req-58402e7a-cca0-47bd-a744-4391f9d21e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ca911-f3de-46d0-ac5e-7fe55679880f", "tag": "38d9d29e-0783-4c81-bb88-1504bb6f1eae"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:05.617769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ea1f053a-ce49-4b43-ad31-b6f098a9cf5a req-58402e7a-cca0-47bd-a744-4391f9d21e0b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:05.618209 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ea1f053a-ce49-4b43-ad31-b6f098a9cf5a req-58402e7a-cca0-47bd-a744-4391f9d21e0b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:05.618637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ea1f053a-ce49-4b43-ad31-b6f098a9cf5a req-58402e7a-cca0-47bd-a744-4391f9d21e0b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:05.631219 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ea1f053a-ce49-4b43-ad31-b6f098a9cf5a req-58402e7a-cca0-47bd-a744-4391f9d21e0b service nova] Creating event network-changed:38d9d29e-0783-4c81-bb88-1504bb6f1eae for instance 164ca911-f3de-46d0-ac5e-7fe55679880f on n-h1-860864-8 Oct 12 23:26:05.636709 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ea1f053a-ce49-4b43-ad31-b6f098a9cf5a req-58402e7a-cca0-47bd-a744-4391f9d21e0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Oct 12 23:26:05.637673 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3291/6677] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:26:06.582605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:06.583255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:06.590701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:06.591191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:06.591634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:06.592363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:06.592829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:06.593256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:06.723106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:06.730728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0f6218e-92a6-45f3-8abe-dc22618ebfdc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1315 microversion: 2.1 time: 0.152054 Oct 12 23:26:06.731288 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3387/6678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:06 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:07.753892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:07.754683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:07.762272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:07.762750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:07.763182 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:07.763878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:07.764354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:07.764778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:07.898087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:07.906054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b773c331-7372-4412-ae87-8168423184f0 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1315 microversion: 2.1 time: 0.156421 Oct 12 23:26:07.906640 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3292/6679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:07 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:08.929192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:08.929815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:08.936706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:08.937196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:08.937639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:08.938336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:08.938792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:08.939223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:09.073728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:09.081530 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-867e406e-6c55-499a-8cdc-49039b9b994c tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1315 microversion: 2.1 time: 0.156191 Oct 12 23:26:09.082116 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3388/6680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:08 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:10.105383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:10.106000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:10.112897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:10.113387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:10.113829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:10.114535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:10.114994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:10.115441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:10.251853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:10.260383 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1148286-ac85-4874-8690-c798df6e9e12 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1315 microversion: 2.1 time: 0.159481 Oct 12 23:26:10.261266 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3293/6681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:10 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:10.429022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-aa80492e-cbe3-440d-9234-5c125d52f824 req-fcb7df7d-d44b-4f70-ae26-3c99bb945bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ca911-f3de-46d0-ac5e-7fe55679880f", "name": "network-vif-plugged", "status": "completed", "tag": "38d9d29e-0783-4c81-bb88-1504bb6f1eae"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:10.445639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aa80492e-cbe3-440d-9234-5c125d52f824 req-fcb7df7d-d44b-4f70-ae26-3c99bb945bfc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:10.446482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aa80492e-cbe3-440d-9234-5c125d52f824 req-fcb7df7d-d44b-4f70-ae26-3c99bb945bfc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:10.447067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aa80492e-cbe3-440d-9234-5c125d52f824 req-fcb7df7d-d44b-4f70-ae26-3c99bb945bfc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:10.459654 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-aa80492e-cbe3-440d-9234-5c125d52f824 req-fcb7df7d-d44b-4f70-ae26-3c99bb945bfc service nova] Creating event network-vif-plugged:38d9d29e-0783-4c81-bb88-1504bb6f1eae for instance 164ca911-f3de-46d0-ac5e-7fe55679880f on n-h1-860864-8 Oct 12 23:26:10.465506 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-aa80492e-cbe3-440d-9234-5c125d52f824 req-fcb7df7d-d44b-4f70-ae26-3c99bb945bfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041094 Oct 12 23:26:10.467159 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3389/6682] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:26:11.283204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:11.283837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:11.291186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:11.291677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:11.292148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:11.292859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:11.293315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:11.293743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:11.422552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:11.430196 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a825f95c-1624-4cf4-8c5d-01da29048fd9 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1315 microversion: 2.1 time: 0.151346 Oct 12 23:26:11.431273 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3294/6683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:11 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:12.455186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:12.455920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:12.457845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:12.464719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:12.465210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:12.465660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:12.466361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:12.466826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:12.467263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:12.598778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:12.606444 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d4bcdf76-49e9-4ca9-905e-66576d2e8afc tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1502 microversion: 2.1 time: 0.156438 Oct 12 23:26:12.607023 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3390/6684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:12 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:12.628742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:12.631061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:12.633901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:12.634717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:12.636226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:12.643537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:12.644055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:12.644499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:12.645202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:12.645660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:12.646093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:12.651995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=76 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:12.676348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:12.682026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:26:12.688544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:26:12.688966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:26:12.689444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:26:12.689855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:26:12.690270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:26:12.751883 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dfc6072-d026-4eef-b31a-2cfba2b2f2ff tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "POST /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f/action" status: 202 len: 0 microversion: 2.1 time: 0.127062 Oct 12 23:26:12.752618 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3295/6685] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:26:12 2022] POST /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:26:12.762071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:12.763137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:12.769976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:12.770578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:12.771113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:12.771859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:12.772375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:12.773184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:12.937794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:12.944839 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84344e0b-e1ef-42dd-bae8-23694ade7f46 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1511 microversion: 2.1 time: 0.187717 Oct 12 23:26:12.945422 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3391/6686] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:12 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:13.969999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:13.970611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:13.981447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:13.981926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:13.982355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:13.983035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:13.983483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:13.983916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:14.110982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:14.118555 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-580ec1d7-ccb5-4083-bfb7-5a9f23e66035 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1511 microversion: 2.1 time: 0.152537 Oct 12 23:26:14.119124 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3296/6687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:13 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:15.141961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:15.142592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:15.144518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:15.150653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:15.151177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:15.151622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:15.152351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:15.152815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:15.153249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:15.284179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:15.291988 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-733d3516-336e-4c17-a8bf-2d5f047b805f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.154011 Oct 12 23:26:15.292574 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3392/6688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:15 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:16.314554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:16.315095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:16.322538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:16.323020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:16.323461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:16.324183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:16.324634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:16.325061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:16.452157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:16.459801 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6d3901e-fcb2-45f1-be79-9aa6832a97b1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.149173 Oct 12 23:26:16.460399 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3297/6689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:16 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:17.483731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:17.484400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:17.491369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:17.491868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:17.492348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:17.493051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:17.493524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:17.493979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:17.619488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:17.627228 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04f3faed-8a34-4365-b241-44ee6b48ea6e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.147439 Oct 12 23:26:17.627798 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3393/6690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:17 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:18.650174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:18.650792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:18.653101 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:26:18.653228 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f (ip 10.222.0.20) !!! Oct 12 23:26:18.660108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:18.660591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:18.661032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:18.661727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:18.662179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:18.662606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:18.797243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:18.804978 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-39d999a9-8026-4215-9e77-f0c04dfafb75 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.158793 Oct 12 23:26:18.806225 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3298/6691] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:18 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:26:19.828076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:19.828699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:19.835460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:19.835976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:19.836420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:19.838858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:19.839334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:19.840232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:19.971012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:19.978709 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-369fc6ca-3270-474a-b216-fa1c21b020bf tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.154574 Oct 12 23:26:19.979272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3394/6692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:19 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:21.000966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:21.001588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:21.009033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:21.009514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:21.009951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:21.010642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:21.011098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:21.011525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:21.140011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:21.147904 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3149f192-887e-4dd0-9318-c3f28fcad6b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.150919 Oct 12 23:26:21.148520 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3299/6693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:20 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:22.171165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:22.171792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:22.178724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:22.179216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:22.179665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:22.180910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:22.181373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:22.181808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:22.312950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:22.320742 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab12ef66-40d0-44ff-957e-559d637b62da tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.153512 Oct 12 23:26:22.321305 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3395/6694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:22 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:23.343552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:23.344151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:23.351077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:23.351553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:23.352018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:23.352699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:23.353143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:23.353558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:23.484488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:23.492289 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dbd34871-1c0b-4965-8b08-18e09382516e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.152602 Oct 12 23:26:23.492862 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3300/6695] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:23 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:24.515201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:24.515850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:24.518028 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:26:24.518171 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f (ip 10.222.0.20) !!! Oct 12 23:26:24.525008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:24.525495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:24.525937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:24.526629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:24.527088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:24.527513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:24.658611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:24.666830 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-203c7d5d-52c7-42b4-b5ba-b3b630db23f7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.155561 Oct 12 23:26:24.667410 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3396/6696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:24 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:25.690272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:25.690939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:25.697839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:25.698321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:25.698761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:25.699448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:25.699927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:25.700348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:25.826596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:25.834247 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9715e9ba-af68-4ac4-835b-61ebb0ff7dfa tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.147927 Oct 12 23:26:25.834817 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3301/6697] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:25 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:26.858270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:26.858904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:26.865345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:26.865840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:26.866296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:26.867000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:26.867468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:26.868513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:26.994098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:27.001724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0f29d1a-3498-4b8a-ade1-bc532b6a09de tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.147435 Oct 12 23:26:27.002302 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3397/6698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:26 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:28.025782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:28.025782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:28.031883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:28.032381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:28.032810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:28.033741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:28.034187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:28.034606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:28.165292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:28.173090 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-deb81fc2-62de-41df-b43f-e5f22b84396f tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.152458 Oct 12 23:26:28.173671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3302/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:28 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:29.195547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:29.196209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:29.203151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:29.203746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:29.204234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:29.204944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:29.205423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:29.205862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:29.332186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:29.339853 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cdcc23d9-4a34-4e54-be4b-497024067b91 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.148281 Oct 12 23:26:29.340450 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3398/6700] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:29 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:30.363385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:30.364030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:30.370754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:30.371231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:30.371664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:30.372381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:30.372827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:30.373245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:30.503089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:30.511560 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4683ee3e-5a61-488f-89d5-fd5a7ec0e5b7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.152025 Oct 12 23:26:30.512148 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3303/6701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:30 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:31.534735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:31.535361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:31.542376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:31.542868 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:31.543314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:31.544050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:31.544513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:31.544947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:31.675735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:31.684317 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e67a6626-dd14-4018-a8d4-fa003372d598 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.153683 Oct 12 23:26:31.684929 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3399/6702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:31 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:32.707551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:32.708114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:32.715531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:32.716052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:32.716495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:32.717184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:32.717667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:32.718093 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:32.845950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:32.853649 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2998426b-6418-4484-b20f-d53280d5cb67 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.150124 Oct 12 23:26:32.854216 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3304/6703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:32 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:33.876489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:33.877143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:33.884560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:33.885382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:33.886077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:33.886780 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:33.887352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:33.887984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:34.014743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:34.022618 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ee1a7a7-385a-4571-ade8-51e6b987899e tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.149981 Oct 12 23:26:34.023122 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3400/6704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:33 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:35.046364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:35.046908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:35.054035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:35.054526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:35.055053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:35.055756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:35.056254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:35.056686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:35.186221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:35.194034 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09d8fadf-b8f3-4c9e-8e4f-31abf271e0c3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.151663 Oct 12 23:26:35.194612 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3305/6705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:35 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:36.217935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:36.218566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:36.225493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:36.226105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:36.226650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:36.228071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:36.228549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:36.228989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:36.233266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=87 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:36.359068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:36.366729 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4099008-3326-4e7f-a26f-db3d0c978f4b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.152761 Oct 12 23:26:36.367314 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3401/6706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:36 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:37.390562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:37.391169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:37.397946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:37.398422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:37.399458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:37.400166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:37.400614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:37.401031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:37.528640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:37.536468 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4ad3425-b101-4119-9436-c1afc7d47112 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.149826 Oct 12 23:26:37.537039 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3306/6707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:37 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:38.559744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:38.560405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:38.567365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:38.567853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:38.568329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:38.569017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:38.569476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:38.569905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:38.700508 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:38.708537 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-507eadff-d75a-4e0c-9e9d-98b63d6b9cf3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.152628 Oct 12 23:26:38.709141 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3402/6708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:38 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:26:39.732622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:39.733262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:39.740156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:39.740634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:39.741067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:39.741753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:39.742204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:39.743303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:39.868923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:39.876531 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08b72a9d-a932-4eb2-9c0c-449f4ab1c3f1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.147755 Oct 12 23:26:39.877095 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3307/6709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:39 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:40.898561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:40.899215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:40.906182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:40.906673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:40.907117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:40.907811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:40.908309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:40.909014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:41.034242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:41.042382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6698ea73-eb24-4cac-b881-d93eee62cce3 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1516 microversion: 2.1 time: 0.147782 Oct 12 23:26:41.042948 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3403/6710] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:40 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:42.066759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:42.067449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:42.074427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:42.074915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:42.075419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:42.076253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:42.076716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:42.077150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:42.211623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:42.219417 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7e6c0e9-e969-4f23-b3ca-3eaafe291f85 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1515 microversion: 2.1 time: 0.156603 Oct 12 23:26:42.220004 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3308/6711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:42 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:42.281729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-259dce96-b00f-4e19-b0ca-eae1f6285d8e req-ad1fd498-a1ec-4a06-862d-c954b1bd8ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ca911-f3de-46d0-ac5e-7fe55679880f", "name": "network-vif-unplugged", "status": "completed", "tag": "38d9d29e-0783-4c81-bb88-1504bb6f1eae"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:42.292371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-259dce96-b00f-4e19-b0ca-eae1f6285d8e req-ad1fd498-a1ec-4a06-862d-c954b1bd8ea6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:42.292858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-259dce96-b00f-4e19-b0ca-eae1f6285d8e req-ad1fd498-a1ec-4a06-862d-c954b1bd8ea6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:42.293302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-259dce96-b00f-4e19-b0ca-eae1f6285d8e req-ad1fd498-a1ec-4a06-862d-c954b1bd8ea6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:42.305554 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-259dce96-b00f-4e19-b0ca-eae1f6285d8e req-ad1fd498-a1ec-4a06-862d-c954b1bd8ea6 service nova] Creating event network-vif-unplugged:38d9d29e-0783-4c81-bb88-1504bb6f1eae for instance 164ca911-f3de-46d0-ac5e-7fe55679880f on n-h2-860864-8 Oct 12 23:26:42.310941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-259dce96-b00f-4e19-b0ca-eae1f6285d8e req-ad1fd498-a1ec-4a06-862d-c954b1bd8ea6 service nova] Instance 164ca911-f3de-46d0-ac5e-7fe55679880f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:26:42.322642 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-259dce96-b00f-4e19-b0ca-eae1f6285d8e req-ad1fd498-a1ec-4a06-862d-c954b1bd8ea6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044631 Oct 12 23:26:42.323253 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3404/6712] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:26:43.242244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:43.242863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:43.245534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=32 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:43.250968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:43.251451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:43.251885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:43.252626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:43.253081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:43.253506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:43.256300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:43.387870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:43.395472 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be7ed335-4990-46d7-af02-2e9853190aad tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1513 microversion: 2.1 time: 0.157086 Oct 12 23:26:43.396069 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3309/6713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:43 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:44.347477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9e678fa3-8892-472a-aeef-7b6fa6b07106 req-65a70217-f3ed-4aef-91c6-ebbb8b3dbc9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ca911-f3de-46d0-ac5e-7fe55679880f", "tag": "38d9d29e-0783-4c81-bb88-1504bb6f1eae"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:44.352863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=30 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:26:44.358749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9e678fa3-8892-472a-aeef-7b6fa6b07106 req-65a70217-f3ed-4aef-91c6-ebbb8b3dbc9f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:44.359232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9e678fa3-8892-472a-aeef-7b6fa6b07106 req-65a70217-f3ed-4aef-91c6-ebbb8b3dbc9f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:44.359662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9e678fa3-8892-472a-aeef-7b6fa6b07106 req-65a70217-f3ed-4aef-91c6-ebbb8b3dbc9f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:44.371407 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9e678fa3-8892-472a-aeef-7b6fa6b07106 req-65a70217-f3ed-4aef-91c6-ebbb8b3dbc9f service nova] Creating event network-changed:38d9d29e-0783-4c81-bb88-1504bb6f1eae for instance 164ca911-f3de-46d0-ac5e-7fe55679880f on n-h2-860864-8 Oct 12 23:26:44.376543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-9e678fa3-8892-472a-aeef-7b6fa6b07106 req-65a70217-f3ed-4aef-91c6-ebbb8b3dbc9f service nova] Instance 164ca911-f3de-46d0-ac5e-7fe55679880f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:26:44.386899 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9e678fa3-8892-472a-aeef-7b6fa6b07106 req-65a70217-f3ed-4aef-91c6-ebbb8b3dbc9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044289 Oct 12 23:26:44.387540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3405/6714] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:26:44.419174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:44.419794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:44.426706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:44.427201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:44.427654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:44.428604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:44.429262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:44.429694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:44.669131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:44.680233 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7bec3449-a9a2-4eb4-944e-6aff3042826b tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1513 microversion: 2.1 time: 0.264178 Oct 12 23:26:44.695949 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3310/6715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:44 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:45.705581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:45.706317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:45.712462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:45.712947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:45.713391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:45.714108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:45.714567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:45.714997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:45.846557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:45.854858 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec9e875f-1df3-4884-b2e7-179f3c51edcb tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1510 microversion: 2.1 time: 0.154620 Oct 12 23:26:45.855446 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3406/6716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:45 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:45.877427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:45.877948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:45.884787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:45.885266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:45.885701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:45.886388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:45.886838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:45.887695 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:45.913856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:26:45.965059 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Found an unconfirmed migration during delete, id: 16, status: finished Oct 12 23:26:47.410825 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ffa3c677-b0a1-4a66-af8c-b3e7eef016e1 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 204 len: 0 microversion: 2.1 time: 1.537043 Oct 12 23:26:47.411864 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3311/6717] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:26:45 2022] DELETE /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 0 bytes in 1539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:26:47.420516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:47.421142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:47.427965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:47.428460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:47.428903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:47.429819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:47.430284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:47.430717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:47.502658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c92b7c0d-b349-48dd-81ca-b8cf772e822b req-cb20ae20-aaa6-431d-b352-6921bdc0e500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ca911-f3de-46d0-ac5e-7fe55679880f", "name": "network-vif-plugged", "status": "completed", "tag": "38d9d29e-0783-4c81-bb88-1504bb6f1eae"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:47.513519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c92b7c0d-b349-48dd-81ca-b8cf772e822b req-cb20ae20-aaa6-431d-b352-6921bdc0e500 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:47.514003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c92b7c0d-b349-48dd-81ca-b8cf772e822b req-cb20ae20-aaa6-431d-b352-6921bdc0e500 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:47.514436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c92b7c0d-b349-48dd-81ca-b8cf772e822b req-cb20ae20-aaa6-431d-b352-6921bdc0e500 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:47.526499 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c92b7c0d-b349-48dd-81ca-b8cf772e822b req-cb20ae20-aaa6-431d-b352-6921bdc0e500 service nova] Creating event network-vif-plugged:38d9d29e-0783-4c81-bb88-1504bb6f1eae for instance 164ca911-f3de-46d0-ac5e-7fe55679880f on n-h2-860864-8 Oct 12 23:26:47.531391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c92b7c0d-b349-48dd-81ca-b8cf772e822b req-cb20ae20-aaa6-431d-b352-6921bdc0e500 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032840 Oct 12 23:26:47.532164 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3312/6718] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:26:47.565607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:47.577406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44961af5-9bc2-4451-a444-8d6058154480 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1502 microversion: 2.1 time: 0.160815 Oct 12 23:26:47.577993 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3407/6719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:47 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:48.602833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:48.603533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:48.609681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:48.610163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:48.610598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:48.611280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:48.611730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:48.612176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:48.739826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694d785ef7ba483daca59ac2dcdaa5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a838cc45dbd4e44a73aca6fa6a6b277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:48.748154 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-47fb32b7-3f9f-4a3f-99c5-fd1ac06eadd7 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 200 len: 1502 microversion: 2.1 time: 0.150961 Oct 12 23:26:48.748925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3313/6720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:48 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:26:49.474294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ad5e5bbe-fb0f-495f-9496-0e8dfd25cfd4 req-2ef80e76-171d-4506-99be-60d7d0d69296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ca911-f3de-46d0-ac5e-7fe55679880f", "name": "network-vif-deleted", "tag": "38d9d29e-0783-4c81-bb88-1504bb6f1eae"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:49.487125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ad5e5bbe-fb0f-495f-9496-0e8dfd25cfd4 req-2ef80e76-171d-4506-99be-60d7d0d69296 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.487996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ad5e5bbe-fb0f-495f-9496-0e8dfd25cfd4 req-2ef80e76-171d-4506-99be-60d7d0d69296 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.488450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ad5e5bbe-fb0f-495f-9496-0e8dfd25cfd4 req-2ef80e76-171d-4506-99be-60d7d0d69296 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.501314 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ad5e5bbe-fb0f-495f-9496-0e8dfd25cfd4 req-2ef80e76-171d-4506-99be-60d7d0d69296 service nova] Creating event network-vif-deleted:38d9d29e-0783-4c81-bb88-1504bb6f1eae for instance 164ca911-f3de-46d0-ac5e-7fe55679880f on n-h2-860864-8 Oct 12 23:26:49.506578 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ad5e5bbe-fb0f-495f-9496-0e8dfd25cfd4 req-2ef80e76-171d-4506-99be-60d7d0d69296 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035937 Oct 12 23:26:49.507751 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3408/6721] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:26:49.770677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:49.771283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:49.778099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.778568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.779019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.779696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.780166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.780582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.796713 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] HTTP exception thrown: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Request method failure captured: Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f HTTP/1.1 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR00JJFLbPvKAO0zCJeGzTFTBNLpgB8_1_2xneVE5lKNREV1MVZRQ-G35NEvxjGGXf3eNosuS88w6IaS2G_PhreKXYC7HYglUytLS6KnTs8sodLtUaAo988kSWCCMvjvo95HyMrcpqsUmAGJ8-Yav4zg-JkDUUqgZ1M_oOn-zL7p9DeU Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6a838cc45dbd4e44a73aca6fa6a6b277 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a838cc45dbd4e44a73aca6fa6a6b277"}]}] Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6a838cc45dbd4e44a73aca6fa6a6b277 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-764694897-project Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 694d785ef7ba483daca59ac2dcdaa5d6 Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-764694897-project Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '164ca911-f3de-46d0-ac5e-7fe55679880f'} Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:26:49.798323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Returning 404 to user: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4aea4d5-48ab-486e-b3ee-76d6f87be263 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 404 len: 111 microversion: 2.1 time: 0.033033 Oct 12 23:26:49.802925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3314/6722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:49 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:26:49.815826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:49.816442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:49.823556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.824119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.824591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.825299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.825809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.826250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.839427 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] HTTP exception thrown: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Request method failure captured: Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f HTTP/1.1 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR00JJFLbPvKAO0zCJeGzTFTBNLpgB8_1_2xneVE5lKNREV1MVZRQ-G35NEvxjGGXf3eNosuS88w6IaS2G_PhreKXYC7HYglUytLS6KnTs8sodLtUaAo988kSWCCMvjvo95HyMrcpqsUmAGJ8-Yav4zg-JkDUUqgZ1M_oOn-zL7p9DeU Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 6a838cc45dbd4e44a73aca6fa6a6b277 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a838cc45dbd4e44a73aca6fa6a6b277"}]}] Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 6a838cc45dbd4e44a73aca6fa6a6b277 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-764694897-project Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 694d785ef7ba483daca59ac2dcdaa5d6 Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-764694897-project Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '164ca911-f3de-46d0-ac5e-7fe55679880f'} Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:26:49.841111 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Returning 404 to user: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b390d2f8-f32e-44f4-8d22-cba0202412e8 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 404 len: 111 microversion: 2.1 time: 0.030942 Oct 12 23:26:49.845145 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3409/6723] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:26:49 2022] DELETE /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:26:49.851016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:49.851643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] [instance: 164ca911-f3de-46d0-ac5e-7fe55679880f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:49.857547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.858024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.858453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.859127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:49.859572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:49.860018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:49.873792 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] HTTP exception thrown: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Request method failure captured: Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f HTTP/1.1 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR00JJFLbPvKAO0zCJeGzTFTBNLpgB8_1_2xneVE5lKNREV1MVZRQ-G35NEvxjGGXf3eNosuS88w6IaS2G_PhreKXYC7HYglUytLS6KnTs8sodLtUaAo988kSWCCMvjvo95HyMrcpqsUmAGJ8-Yav4zg-JkDUUqgZ1M_oOn-zL7p9DeU Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 6a838cc45dbd4e44a73aca6fa6a6b277 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6a838cc45dbd4e44a73aca6fa6a6b277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6a838cc45dbd4e44a73aca6fa6a6b277"}]}] Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 6a838cc45dbd4e44a73aca6fa6a6b277 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-764694897 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-764694897-project Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 694d785ef7ba483daca59ac2dcdaa5d6 Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-764694897-project Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '164ca911-f3de-46d0-ac5e-7fe55679880f'} Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:26:49.875323 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] Returning 404 to user: Instance 164ca911-f3de-46d0-ac5e-7fe55679880f could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f2a0ee20-9572-492f-b324-7a47e9f117a2 tempest-DeleteServersTestJSON-764694897 tempest-DeleteServersTestJSON-764694897-project] 10.222.0.20 "GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f" status: 404 len: 111 microversion: 2.1 time: 0.029534 Oct 12 23:26:49.879495 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3315/6724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:49 2022] GET /compute/v2.1/servers/164ca911-f3de-46d0-ac5e-7fe55679880f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:26:58.359285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-225762693", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "34acb3db-0002-4fe4-a99d-80e939d4e38f"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:26:58.418580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] validate_networks() for [('34acb3db-0002-4fe4-a99d-80e939d4e38f', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:26:58.810552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:26:58.810993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:26:58.811488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:26:58.811939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:26:58.812373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:26:58.822178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:58.822675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:58.823123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:58.823874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:26:58.824354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:26:58.824792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:26:58.842612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Getting quotas for project bd82f721eee44031b694a7be758b65eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:26:58.848082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Getting quotas for user e050614fc19b40aab8c994d76316b41e and project bd82f721eee44031b694a7be758b65eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:26:58.860889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:26:58.863244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:26:58.912228 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24cef027-c662-4595-aab3-45c1d5c157ca tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674177 Oct 12 23:26:58.912922 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3410/6725] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:26:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 23:26:58.924376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0540884-0a53-4974-8623-b6a086a02a1f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:26:58.925753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0540884-0a53-4974-8623-b6a086a02a1f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:26:58.986437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0540884-0a53-4974-8623-b6a086a02a1f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:26:58.997487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0540884-0a53-4974-8623-b6a086a02a1f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1217 microversion: 2.1 time: 0.077002 Oct 12 23:26:59.014285 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3316/6726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:26:58 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:00.025842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:00.026997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:00.033889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:00.034619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:00.035240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:00.036160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:00.036773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:00.037359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:00.150946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:00.161177 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c48c928e-3624-4e45-802a-7c10c668abf4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1287 microversion: 2.1 time: 0.140946 Oct 12 23:27:00.171651 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3411/6727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:00 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:01.188642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:01.189897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:01.201183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:01.205942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:01.206993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:01.207657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:01.208603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:01.209223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:01.209680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:01.348390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-30f7dbf0-1aa5-4046-ad3c-0015b17a7e1c req-a71c5507-e2a2-446a-baa1-34b9623833f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd62429-cef0-4a7f-8034-115ee68d96b1", "tag": "614b786e-55aa-47d5-a32f-bf3da76f26d9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:01.351196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:01.363094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-30f7dbf0-1aa5-4046-ad3c-0015b17a7e1c req-a71c5507-e2a2-446a-baa1-34b9623833f7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:01.363878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-30f7dbf0-1aa5-4046-ad3c-0015b17a7e1c req-a71c5507-e2a2-446a-baa1-34b9623833f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:01.364554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-30f7dbf0-1aa5-4046-ad3c-0015b17a7e1c req-a71c5507-e2a2-446a-baa1-34b9623833f7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:01.367827 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-548cbf9e-bca8-45aa-bf2c-765ed103a6c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1317 microversion: 2.1 time: 0.183791 Oct 12 23:27:01.368951 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3317/6728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:01 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:01.377207 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-30f7dbf0-1aa5-4046-ad3c-0015b17a7e1c req-a71c5507-e2a2-446a-baa1-34b9623833f7 service nova] Creating event network-changed:614b786e-55aa-47d5-a32f-bf3da76f26d9 for instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 on n-h2-860864-8 Oct 12 23:27:01.382302 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-30f7dbf0-1aa5-4046-ad3c-0015b17a7e1c req-a71c5507-e2a2-446a-baa1-34b9623833f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037642 Oct 12 23:27:01.383265 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3412/6729] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:27:02.390678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:02.391290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:02.398068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:02.398545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:02.398977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:02.400008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:02.400455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:02.400876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:02.530504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:02.538330 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65afaf9d-24b1-49c5-9696-b8f8e3688199 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1317 microversion: 2.1 time: 0.151524 Oct 12 23:27:02.538900 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3318/6730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:02 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:03.563282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:03.564038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:03.570500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:03.570995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:03.571439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:03.572215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:03.572673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:03.573124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:03.702705 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:03.711074 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c8fff44-ffba-4508-871a-c792778e013c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1317 microversion: 2.1 time: 0.152880 Oct 12 23:27:03.711661 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3413/6731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:03 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:04.733503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:04.734118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:04.740965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:04.741445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:04.741885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:04.743113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:04.743563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:04.744013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:04.871783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:04.879391 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b7d9c404-2f16-4619-b93d-a8ff068eb2c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1317 microversion: 2.1 time: 0.149854 Oct 12 23:27:04.879976 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3319/6732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:04 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:05.633570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a4fb66a3-e99a-4e25-bd5e-a98aefbaff76 req-9b5ee4bb-e410-414c-a6e2-5efa7ff54bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd62429-cef0-4a7f-8034-115ee68d96b1", "name": "network-vif-plugged", "status": "completed", "tag": "614b786e-55aa-47d5-a32f-bf3da76f26d9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:05.643664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4fb66a3-e99a-4e25-bd5e-a98aefbaff76 req-9b5ee4bb-e410-414c-a6e2-5efa7ff54bb1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:05.644195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4fb66a3-e99a-4e25-bd5e-a98aefbaff76 req-9b5ee4bb-e410-414c-a6e2-5efa7ff54bb1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:05.644632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a4fb66a3-e99a-4e25-bd5e-a98aefbaff76 req-9b5ee4bb-e410-414c-a6e2-5efa7ff54bb1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:05.656583 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a4fb66a3-e99a-4e25-bd5e-a98aefbaff76 req-9b5ee4bb-e410-414c-a6e2-5efa7ff54bb1 service nova] Creating event network-vif-plugged:614b786e-55aa-47d5-a32f-bf3da76f26d9 for instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 on n-h2-860864-8 Oct 12 23:27:05.661911 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a4fb66a3-e99a-4e25-bd5e-a98aefbaff76 req-9b5ee4bb-e410-414c-a6e2-5efa7ff54bb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032081 Oct 12 23:27:05.662509 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3414/6733] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:05.904541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:05.905157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:05.912346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:05.912821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:05.913255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:05.913950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:05.914403 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:05.914824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:06.050144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:06.057830 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-776a59fd-e55e-4e6c-afbe-6fb07aa2503c tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1317 microversion: 2.1 time: 0.159238 Oct 12 23:27:06.058396 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3320/6734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:05 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:07.083109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:07.083813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.090548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.091031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.091471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.092191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.092654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.093083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.095643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=60 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:07.219859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:07.228107 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c505c84-d6db-4e15-8f8d-41ea9bcd513d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1505 microversion: 2.1 time: 0.150075 Oct 12 23:27:07.228678 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3415/6735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:07 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:07.250394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:07.251168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.258828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.259310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.259744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.260469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.260920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.261349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.389723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:07.397411 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3fd46ef3-8edd-4dc8-b5cc-5bf134c038e0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1505 microversion: 2.1 time: 0.150875 Oct 12 23:27:07.397983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3321/6736] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:07 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:07.419704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:07.422189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.428148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.428639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.429085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.430403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.430862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.431296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.491595 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fafa1483-40ed-4283-bde7-d834663d9b71 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "PUT /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1077 microversion: 2.1 time: 0.075768 Oct 12 23:27:07.492927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3416/6737] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Oct 12 23:27:07 2022] PUT /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1077 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:07.511608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:07.512258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.518169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.518783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.519225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.519926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.520389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.520809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.655738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:07.663760 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-10d819f4-c609-44b1-9f6d-e1c20dc2af97 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1503 microversion: 2.1 time: 0.156174 Oct 12 23:27:07.664902 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3322/6738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:07 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:07.687017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:07.688028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.694051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.694548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.695020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.695728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.696213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.696640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.828785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:07.836911 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e6c532c-94fc-400b-87ce-90b99d943097 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1503 microversion: 2.1 time: 0.153863 Oct 12 23:27:07.837473 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3417/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:07 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:07.860464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:07.862740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.868697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.869216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.869651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.870339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.870796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.871222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.899057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:07.904533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Old instance type m1.heat2, new instance type m1.heat {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:27:07.911198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:27:07.911622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:27:07.912140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:27:07.912552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:27:07.912973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:27:07.974072 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4170620e-c8cb-4ac4-948c-6dcd8fb644ce tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "POST /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1/action" status: 202 len: 0 microversion: 2.1 time: 0.117571 Oct 12 23:27:07.974678 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3323/6740] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:27:07 2022] POST /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:27:07.983204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:07.983831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:07.990199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.990724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.991191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:07.992053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:07.992514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:07.992945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:08.147885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:08.156732 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6df4c0d-412f-4cef-8e9d-658caf67c75a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1514 microversion: 2.1 time: 0.177271 Oct 12 23:27:08.157399 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3418/6741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:07 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:09.178178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:09.183483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:09.184180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:09.191394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:09.191875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:09.192332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:09.193015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:09.193465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:09.193881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:09.323474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:09.331318 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e96418d8-dcb9-49b9-ac8a-79dfc6e29f41 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1514 microversion: 2.1 time: 0.154991 Oct 12 23:27:09.332166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3324/6742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:09 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:10.354065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:10.354693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:10.356844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:10.357523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:10.366734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:10.367170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:10.367619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:10.368365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:10.368825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:10.369258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:10.510987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:10.519244 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12d11c97-5b32-486a-9666-36f94e43125f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.169123 Oct 12 23:27:10.519851 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3419/6743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:10 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:27:11.544809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:11.545430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:11.552311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:11.552791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:11.553226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:11.553918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:11.554366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:11.554788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:11.687129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:11.694887 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a1045d4b-11c5-4bd7-b88e-b80cc8b71e17 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.153995 Oct 12 23:27:11.695457 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3325/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:11 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:12.717597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:12.718218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:12.725212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:12.725715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:12.726144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:12.726828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:12.727293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:12.727722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:12.854203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:12.861810 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ddaf98e8-4a4c-48b4-a317-1e3278d88c15 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.148129 Oct 12 23:27:12.862379 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3420/6745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:12 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:13.884874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:13.885483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:13.888180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:13.893449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:13.893922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:13.894352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:13.895057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:13.895504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:13.895941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:14.025653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:14.033273 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d6c70ae3-ffc7-4df9-97c0-3b73ff2cba00 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.152330 Oct 12 23:27:14.034084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3326/6746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:13 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:15.056286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:15.056851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:15.059525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:15.065713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:15.066236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:15.066674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:15.067371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:15.067825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:15.068278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:15.199381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:15.207086 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9a02c4c-29de-4c26-8016-3764bf795af4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.154884 Oct 12 23:27:15.207664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3421/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:15 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:16.232618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:16.233266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:16.240161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:16.240767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:16.241089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:16.242123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:16.242888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:16.243323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:16.369910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:16.377571 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c3dafa0-f353-4912-968c-9501a92c20b5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.148907 Oct 12 23:27:16.378141 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3327/6748] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:16 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:17.401493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:17.402145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:17.409221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:17.409714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:17.410163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:17.410859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:17.411322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:17.411757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:17.538320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:17.546608 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2084922-2959-4241-b620-01b2fca0b274 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.149546 Oct 12 23:27:17.547180 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3422/6749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:17 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:27:18.569514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:18.570648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:18.577504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:18.577985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:18.578419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:18.579111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:18.579561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:18.580015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:18.716643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:18.724378 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-234759ca-0400-4c5c-8ec6-c1d57efee71a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.158771 Oct 12 23:27:18.724956 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3328/6750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:18 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:19.747721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:19.748367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:19.755137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:19.755625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:19.756097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:19.756796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:19.757250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:19.758270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:19.885354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:19.892985 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c85ee324-5808-464a-bc86-e806c670dc09 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.149271 Oct 12 23:27:19.893553 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3423/6751] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:19 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:20.916388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:20.917009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:20.924097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:20.924582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:20.925023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:20.925711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:20.926167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:20.926593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:21.056111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:21.064176 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-406036b9-e2ba-4bcb-8ab9-72955a940368 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.152082 Oct 12 23:27:21.064787 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3329/6752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:20 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:22.087651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:22.088788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:22.095082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:22.095567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:22.096048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:22.096747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:22.097203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:22.097632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:22.232938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:22.240733 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-01062883-7d23-48da-a9ca-bf3757136884 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.157587 Oct 12 23:27:22.241320 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3424/6753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:22 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:23.264111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:23.264772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:23.271945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:23.272432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:23.272870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:23.274114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:23.274569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:23.274998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:23.405057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:23.413026 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1cd98f1a-ac9e-4063-9bc2-552baab54a56 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.152838 Oct 12 23:27:23.413611 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3330/6754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:23 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:24.436297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:24.436921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:24.443913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:24.444430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:24.445496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:24.446200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:24.446662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:24.447097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:24.574047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:24.581703 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f95bb4a-87c1-436c-8333-13ac52b1b794 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.149303 Oct 12 23:27:24.582274 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3425/6755] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:24 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:25.605011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:25.605626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:25.612413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:25.612896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:25.613334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:25.614027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:25.614476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:25.614926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:25.742976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:25.750658 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9806f53f-1531-46e8-9db3-a6f3a73e467a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.150149 Oct 12 23:27:25.751244 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3331/6756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:25 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:26.775764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:26.776710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:26.782710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:26.783201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:26.783645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:26.784630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:26.785089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:26.785529 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:26.911253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:26.918973 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ef2394e-677f-4fd0-8c8f-750c88c21526 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.148405 Oct 12 23:27:26.919550 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3426/6757] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:26 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:27.941836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:27.942455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:27.948603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:27.949091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:27.949529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:27.950213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:27.950661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:27.951086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:27.954961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:28.085216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:28.093567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c47927db-d46a-419b-bd70-f7cb6baadacd tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.155915 Oct 12 23:27:28.094145 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3332/6758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:27 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:29.117224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:29.117852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:29.124731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:29.125226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:29.125676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:29.126371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:29.126832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:29.127266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:29.258368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:29.266467 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b6de4fc-e80b-4307-ac62-2c14290600c1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.153172 Oct 12 23:27:29.267044 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3427/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:29 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:30.289724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:30.290337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:30.297203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:30.297682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:30.298112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:30.298790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:30.299235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:30.299652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:30.429541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:30.437878 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-952620c0-11a3-478f-9a6a-dead72d36fbf tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.152021 Oct 12 23:27:30.438444 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3333/6760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:30 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:31.462006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:31.462637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:31.469539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:31.470032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:31.470483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:31.471181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:31.471644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:31.472110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:31.597048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:31.605215 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2177c944-905e-42cf-9095-8e11f8dbe892 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.147479 Oct 12 23:27:31.605998 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3428/6761] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:31 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:32.628595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:32.629240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:32.636833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:32.637313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:32.637746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:32.638434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:32.638883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:32.639305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:32.769604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:32.777323 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f25ff912-fe98-444e-9a28-6fc5906c551b tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.152617 Oct 12 23:27:32.777888 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3334/6762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:32 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:33.800807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:33.801438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:33.808351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:33.808847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:33.809295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:33.809992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:33.810453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:33.810890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:33.940801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:33.949042 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f646af5-35be-4b4b-a2e4-26878d4c2bd7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.152120 Oct 12 23:27:33.949620 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3429/6763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:33 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:34.971417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:34.972096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:34.979503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:34.980015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:34.980451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:34.981140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:34.981592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:34.982019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:35.116055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:35.124370 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f24d3500-c65c-4be2-b615-0f0cfb989c4d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.157012 Oct 12 23:27:35.124951 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3335/6764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:34 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:36.146617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:36.147261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:36.154204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:36.154718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:36.155167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:36.155871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:36.156364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:36.156803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:36.287407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:36.295300 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a3ec022-4d94-4564-ab26-a2248c54a863 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1519 microversion: 2.1 time: 0.152567 Oct 12 23:27:36.296359 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3430/6765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:36 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:37.051517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-528068c5-b2b4-46c3-b880-5e3ada2d6637 req-fdc1afaf-f29d-4659-862a-a4f48c52a200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd62429-cef0-4a7f-8034-115ee68d96b1", "name": "network-vif-unplugged", "status": "completed", "tag": "614b786e-55aa-47d5-a32f-bf3da76f26d9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:37.062076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-528068c5-b2b4-46c3-b880-5e3ada2d6637 req-fdc1afaf-f29d-4659-862a-a4f48c52a200 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:37.062792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-528068c5-b2b4-46c3-b880-5e3ada2d6637 req-fdc1afaf-f29d-4659-862a-a4f48c52a200 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:37.063277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-528068c5-b2b4-46c3-b880-5e3ada2d6637 req-fdc1afaf-f29d-4659-862a-a4f48c52a200 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:37.076010 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-528068c5-b2b4-46c3-b880-5e3ada2d6637 req-fdc1afaf-f29d-4659-862a-a4f48c52a200 service nova] Creating event network-vif-unplugged:614b786e-55aa-47d5-a32f-bf3da76f26d9 for instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 on n-h1-860864-8 Oct 12 23:27:37.081786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-528068c5-b2b4-46c3-b880-5e3ada2d6637 req-fdc1afaf-f29d-4659-862a-a4f48c52a200 service nova] Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:27:37.093014 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-528068c5-b2b4-46c3-b880-5e3ada2d6637 req-fdc1afaf-f29d-4659-862a-a4f48c52a200 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045817 Oct 12 23:27:37.093997 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3336/6766] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:37.319539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:37.320223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:37.328143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:37.328636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:37.329079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:37.329775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:37.330230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:37.330659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:37.337583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:37.476044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:37.483805 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f020e1ed-0520-4c60-979c-974af6352c80 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1518 microversion: 2.1 time: 0.168817 Oct 12 23:27:37.484419 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3431/6767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:37 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:27:38.507682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:38.509113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:38.515199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:38.515671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:38.516132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:38.516814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:38.517259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:38.517681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:38.654613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:38.662594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f1d5007-f06f-4658-ba90-919dd18f3e5d tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1516 microversion: 2.1 time: 0.160051 Oct 12 23:27:38.663159 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3337/6768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:38 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:39.110389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-21a7dd71-9a04-4b69-84b7-f014075a14f4 req-b4a26bd1-5948-4ea1-932e-ef9c694f0e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd62429-cef0-4a7f-8034-115ee68d96b1", "tag": "614b786e-55aa-47d5-a32f-bf3da76f26d9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:39.120636 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-21a7dd71-9a04-4b69-84b7-f014075a14f4 req-b4a26bd1-5948-4ea1-932e-ef9c694f0e4d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:39.121115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-21a7dd71-9a04-4b69-84b7-f014075a14f4 req-b4a26bd1-5948-4ea1-932e-ef9c694f0e4d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:39.121549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-21a7dd71-9a04-4b69-84b7-f014075a14f4 req-b4a26bd1-5948-4ea1-932e-ef9c694f0e4d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:39.132921 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-21a7dd71-9a04-4b69-84b7-f014075a14f4 req-b4a26bd1-5948-4ea1-932e-ef9c694f0e4d service nova] Creating event network-changed:614b786e-55aa-47d5-a32f-bf3da76f26d9 for instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 on n-h1-860864-8 Oct 12 23:27:39.138115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-21a7dd71-9a04-4b69-84b7-f014075a14f4 req-b4a26bd1-5948-4ea1-932e-ef9c694f0e4d service nova] Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:27:39.149577 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-21a7dd71-9a04-4b69-84b7-f014075a14f4 req-b4a26bd1-5948-4ea1-932e-ef9c694f0e4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042342 Oct 12 23:27:39.150163 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3432/6769] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:39.685948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:39.686634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:39.696812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:39.700661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:39.702319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:39.707565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:39.708090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:39.708710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:39.873326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:39.881444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c1a866e8-cd1e-44a1-bc0c-ed0e4aa62008 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1513 microversion: 2.1 time: 0.199387 Oct 12 23:27:39.882034 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3338/6770] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:39 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:39.905676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:39.906268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:39.913250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:39.913745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:39.914192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:39.914898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:39.915359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:39.915793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:39.977604 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-301abd8c-be6a-4dfc-a943-494bc564b140 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "POST /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1/action" status: 204 len: 0 microversion: 2.1 time: 0.076202 Oct 12 23:27:39.978273 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3433/6771] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:27:39 2022] POST /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:27:39.988667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:39.989380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:39.997514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:39.998088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:39.999012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:39.999777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:40.000285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:40.000706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:40.137064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:40.144788 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5d8f964-b5a5-4aab-8ffd-32e24683ffb8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1513 microversion: 2.1 time: 0.162236 Oct 12 23:27:40.145386 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3339/6772] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:39 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:41.169982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:41.170696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:41.176951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:41.177450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:41.177902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:41.178608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:41.179063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:41.179502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:41.322311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:41.330073 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d9e98df-9a24-49c3-8acd-89a2c49d4647 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1505 microversion: 2.1 time: 0.165785 Oct 12 23:27:41.330647 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3434/6773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:41 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:41.353172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:41.353789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:41.360584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:41.361064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:41.361502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:41.362242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:41.362648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:41.363075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:41.491260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:41.498902 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fad903ef-baa4-4cea-8788-9f75e376df54 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1505 microversion: 2.1 time: 0.150168 Oct 12 23:27:41.499502 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3340/6774] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:41 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:41.524217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0d5b6192-c8f8-462d-a9fd-aec5c59b66d8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'create', calling method: .version_select at 0x7f44ff5fba60>, body: {"keypair": {"name": "tempest-keypair-1073903444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfwN7OzLI1odZ4PV1x9OzozF1n3Wo2Q8V6mo9HllkFbq2TIRwLifPIwKpIfUgsysiVIITaqw+dgzaF17W9XQU9UDcSs/efHj17AOaj66laR+7Va+wNlj3Adao8E8/BsHA=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:41.540089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0d5b6192-c8f8-462d-a9fd-aec5c59b66d8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Getting quotas for project bd82f721eee44031b694a7be758b65eb. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:27:41.545089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-0d5b6192-c8f8-462d-a9fd-aec5c59b66d8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Getting quotas for user e050614fc19b40aab8c994d76316b41e and project bd82f721eee44031b694a7be758b65eb. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:27:41.571406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0d5b6192-c8f8-462d-a9fd-aec5c59b66d8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051530 Oct 12 23:27:41.572013 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3435/6775] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:27:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:42.771174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:42.773264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:42.780449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:42.781007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:42.781516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:42.782363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:42.782877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:42.783365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:42.913193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:42.921281 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d27cecc-43d3-489d-b3eb-e2c693a996c4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 200 len: 1505 microversion: 2.1 time: 0.154083 Oct 12 23:27:42.922186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3341/6776] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:42 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:42.933239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-b8965ff8-756b-4ce4-9018-cc5d7b9f3039 req-0b477145-2465-41bf-ade5-d62d0babc095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd62429-cef0-4a7f-8034-115ee68d96b1", "name": "network-vif-plugged", "status": "completed", "tag": "614b786e-55aa-47d5-a32f-bf3da76f26d9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:42.944144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b8965ff8-756b-4ce4-9018-cc5d7b9f3039 req-0b477145-2465-41bf-ade5-d62d0babc095 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:42.944685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b8965ff8-756b-4ce4-9018-cc5d7b9f3039 req-0b477145-2465-41bf-ade5-d62d0babc095 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:42.945227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b8965ff8-756b-4ce4-9018-cc5d7b9f3039 req-0b477145-2465-41bf-ade5-d62d0babc095 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:42.945335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:42.946469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:42.953059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:42.953635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:42.954141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:42.954906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:42.955364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:42.955796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:42.957025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-b8965ff8-756b-4ce4-9018-cc5d7b9f3039 req-0b477145-2465-41bf-ade5-d62d0babc095 service nova] Creating event network-vif-plugged:614b786e-55aa-47d5-a32f-bf3da76f26d9 for instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 on n-h1-860864-8 Oct 12 23:27:42.962123 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-b8965ff8-756b-4ce4-9018-cc5d7b9f3039 req-0b477145-2465-41bf-ade5-d62d0babc095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034082 Oct 12 23:27:42.963015 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3436/6777] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:27:42.982352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:27:43.060184 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ace144bc-6ab0-471e-bfc7-148735480a50 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 204 len: 0 microversion: 2.1 time: 0.118955 Oct 12 23:27:43.061552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3342/6778] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:27:42 2022] DELETE /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:27:43.118489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1828661164", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "34acb3db-0002-4fe4-a99d-80e939d4e38f"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:43.171460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] validate_networks() for [('34acb3db-0002-4fe4-a99d-80e939d4e38f', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:27:43.532652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:27:43.533085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:27:43.533568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:27:43.533982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:27:43.534668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:27:43.544017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:43.544498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:43.544931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:43.545652 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:43.546107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:43.546532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:43.563339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Getting quotas for project bd82f721eee44031b694a7be758b65eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:27:43.568513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Getting quotas for user e050614fc19b40aab8c994d76316b41e and project bd82f721eee44031b694a7be758b65eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:27:43.580712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:27:43.583069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:27:43.627539 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0d45b80-6d71-4820-8c62-35f95df82c43 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513783 Oct 12 23:27:43.628219 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3437/6779] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:27:43.639981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a9f73652-118a-460c-84b8-f4b13bf667e7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:43.640716 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a9f73652-118a-460c-84b8-f4b13bf667e7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:43.694218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a9f73652-118a-460c-84b8-f4b13bf667e7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:43.701125 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a9f73652-118a-460c-84b8-f4b13bf667e7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1218 microversion: 2.1 time: 0.065542 Oct 12 23:27:43.701728 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3343/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:43 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:44.726024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:44.727271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:44.735850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:44.736697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:44.737159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:44.737880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:44.738515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:44.739118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:44.819306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:44.827939 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0fc58d72-04ba-4ac4-aff7-6e910a34a8c9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1278 microversion: 2.1 time: 0.106521 Oct 12 23:27:44.828738 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3438/6781] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:44 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:45.172319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-300de3e0-c19a-4618-a86e-1978708895f5 req-7816d2d1-e193-49a4-aa4a-c31204ad4433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd62429-cef0-4a7f-8034-115ee68d96b1", "name": "network-vif-deleted", "tag": "614b786e-55aa-47d5-a32f-bf3da76f26d9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:45.180160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:45.186411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-300de3e0-c19a-4618-a86e-1978708895f5 req-7816d2d1-e193-49a4-aa4a-c31204ad4433 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:45.186899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-300de3e0-c19a-4618-a86e-1978708895f5 req-7816d2d1-e193-49a4-aa4a-c31204ad4433 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:45.187332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-300de3e0-c19a-4618-a86e-1978708895f5 req-7816d2d1-e193-49a4-aa4a-c31204ad4433 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:45.201846 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-300de3e0-c19a-4618-a86e-1978708895f5 req-7816d2d1-e193-49a4-aa4a-c31204ad4433 service nova] Creating event network-vif-deleted:614b786e-55aa-47d5-a32f-bf3da76f26d9 for instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 on n-h1-860864-8 Oct 12 23:27:45.208122 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-300de3e0-c19a-4618-a86e-1978708895f5 req-7816d2d1-e193-49a4-aa4a-c31204ad4433 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040393 Oct 12 23:27:45.209158 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3344/6782] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:45.851068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:45.852555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:45.856789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:45.860631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:45.861128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:45.861575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:45.862292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:45.862782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:45.863219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:46.001017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:46.009148 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56281ed6-eb72-469f-873f-c5bdda7f7499 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1318 microversion: 2.1 time: 0.162305 Oct 12 23:27:46.009747 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3439/6783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:45 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:47.034127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:47.035053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:47.041262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:47.041738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:47.042172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:47.042856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:47.043306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:47.043734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:47.175427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:47.183697 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f24dc88-4ead-4525-9725-45aa6393b19f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1318 microversion: 2.1 time: 0.154806 Oct 12 23:27:47.184369 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3345/6784] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:47 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:47.225099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-79d890ef-d2ef-4e4a-a28d-8adec2a8df8f req-3a9902ac-8874-47ec-97aa-24cd67001563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c5050db-0767-4792-956a-9981a94ff085", "tag": "cd9b3c10-ae49-4f9b-8b71-26fd9be565df"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:47.236312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-79d890ef-d2ef-4e4a-a28d-8adec2a8df8f req-3a9902ac-8874-47ec-97aa-24cd67001563 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:47.236796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-79d890ef-d2ef-4e4a-a28d-8adec2a8df8f req-3a9902ac-8874-47ec-97aa-24cd67001563 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:47.237234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-79d890ef-d2ef-4e4a-a28d-8adec2a8df8f req-3a9902ac-8874-47ec-97aa-24cd67001563 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:47.248779 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-79d890ef-d2ef-4e4a-a28d-8adec2a8df8f req-3a9902ac-8874-47ec-97aa-24cd67001563 service nova] Creating event network-changed:cd9b3c10-ae49-4f9b-8b71-26fd9be565df for instance 8c5050db-0767-4792-956a-9981a94ff085 on n-h1-860864-8 Oct 12 23:27:47.253648 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-79d890ef-d2ef-4e4a-a28d-8adec2a8df8f req-3a9902ac-8874-47ec-97aa-24cd67001563 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032299 Oct 12 23:27:47.254229 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3440/6785] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:48.206290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:48.206929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:48.214321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:48.214797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:48.215261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:48.215968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:48.216420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:48.216867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:48.348621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:48.356777 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-42b0bb75-aef1-4fed-9561-dc69da74b9f1 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1318 microversion: 2.1 time: 0.154358 Oct 12 23:27:48.357347 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3346/6786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:48 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:49.380790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:49.381506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:49.387571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:49.388088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:49.388534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:49.389224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:49.389681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:49.390107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:49.522228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:49.529931 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e5ca7379-732f-4828-a714-aae3199260cb tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1318 microversion: 2.1 time: 0.154489 Oct 12 23:27:49.530503 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3441/6787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:49 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:50.552671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:50.553280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:50.560729 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:50.561206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:50.561641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:50.562314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:50.562765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:50.563180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:50.690250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:50.698615 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4e09c5b6-c19d-4035-91c2-8012e5b5e6a8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1318 microversion: 2.1 time: 0.149894 Oct 12 23:27:50.699175 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3347/6788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:50 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:50.979154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-b916964a-6deb-494f-bb70-6ebc7625b8bc req-8756c98a-5b59-4c41-b9e5-2b32947df223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c5050db-0767-4792-956a-9981a94ff085", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b3c10-ae49-4f9b-8b71-26fd9be565df"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:50.990977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b916964a-6deb-494f-bb70-6ebc7625b8bc req-8756c98a-5b59-4c41-b9e5-2b32947df223 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:50.991560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b916964a-6deb-494f-bb70-6ebc7625b8bc req-8756c98a-5b59-4c41-b9e5-2b32947df223 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:50.992096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-b916964a-6deb-494f-bb70-6ebc7625b8bc req-8756c98a-5b59-4c41-b9e5-2b32947df223 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:51.004771 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-b916964a-6deb-494f-bb70-6ebc7625b8bc req-8756c98a-5b59-4c41-b9e5-2b32947df223 service nova] Creating event network-vif-plugged:cd9b3c10-ae49-4f9b-8b71-26fd9be565df for instance 8c5050db-0767-4792-956a-9981a94ff085 on n-h1-860864-8 Oct 12 23:27:51.010292 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-b916964a-6deb-494f-bb70-6ebc7625b8bc req-8756c98a-5b59-4c41-b9e5-2b32947df223 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Oct 12 23:27:51.010933 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3442/6789] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:27:51.721253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:51.721866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:51.728822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:51.729307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:51.729748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:51.730434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:51.730885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:51.731310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:51.862506 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:51.870743 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6436aa99-ffd5-42b9-95c9-6928e8feece0 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1318 microversion: 2.1 time: 0.153446 Oct 12 23:27:51.871318 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3348/6790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:51 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:52.895375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:52.896146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:52.902333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:52.902815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:52.903257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:52.903963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:52.904421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:52.904850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:53.089570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:53.097322 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13d1fcef-3e63-4e85-aa94-8620c4f77853 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1507 microversion: 2.1 time: 0.207062 Oct 12 23:27:53.097917 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3443/6791] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:52 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:53.120225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:53.120875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:53.127730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:53.128276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:53.128721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:53.129411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:53.129864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:53.130291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:53.134279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:53.314931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:53.322669 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-043371a5-b382-4a18-81ae-61594ebcb7f5 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1507 microversion: 2.1 time: 0.206975 Oct 12 23:27:53.323239 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3349/6792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:53 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:53.345338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:27:53.347616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:53.354119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:53.354603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:53.355044 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:53.355735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:53.356219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:53.356646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:53.383645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:53.388905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Old instance type m1.heat2, new instance type m1.heat {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:27:53.395195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:27:53.395620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:27:53.396127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:27:53.396542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:27:53.396958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:27:53.458899 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1a30842-6f2a-4ec3-8d2b-4b225406f402 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "POST /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085/action" status: 202 len: 0 microversion: 2.1 time: 0.117692 Oct 12 23:27:53.459503 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3444/6793] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:27:53 2022] POST /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:27:53.468009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:53.468627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:53.474498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:53.474978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:53.475417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:53.476140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:53.477159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:53.477591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:53.615030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:53.623507 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53a13813-65cd-4400-92e5-4c3ecf1bd39a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1514 microversion: 2.1 time: 0.159315 Oct 12 23:27:53.624266 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3350/6794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:53 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:54.642507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:54.643308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:54.648500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:54.649127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:54.656889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:54.657382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:54.657826 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:54.658521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:54.658981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:54.659682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:54.802732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:54.811122 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc974967-629f-4f48-9240-6eed5f532e38 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1514 microversion: 2.1 time: 0.169482 Oct 12 23:27:54.811702 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3445/6795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:54 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:55.833410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:55.834016 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:55.835960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:27:55.841897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:55.842374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:55.842805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:55.843483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:55.843947 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:55.844367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:55.971784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:55.980388 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d22b373d-c867-41ce-beba-2aac61dcd332 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.150853 Oct 12 23:27:55.980965 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3351/6796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:55 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:57.003737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:57.004420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:57.011770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:57.012278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:57.012724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:57.013421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:57.013875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:57.014311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:57.141553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:57.149262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd2b4f62-96b6-412d-a359-21e6f18562ee tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.149596 Oct 12 23:27:57.149833 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3446/6797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:56 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:58.172213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:58.172829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:58.180261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:58.180739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:58.181169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:58.181843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:58.182286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:58.182703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:58.315584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:58.323438 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7411705-3243-4465-a882-ac75e623d286 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.155133 Oct 12 23:27:58.324032 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3352/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:58 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:27:59.346295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:27:59.346913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:27:59.354350 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:59.354835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:59.355279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:59.355998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:27:59.356461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:27:59.356897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:27:59.488150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:27:59.495932 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6721d810-0a61-468c-a3b2-87fa056eb800 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.153553 Oct 12 23:27:59.496509 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3447/6799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:27:59 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:00.518103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:00.518714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:00.526125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:00.526601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:00.527034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:00.527713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:00.528184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:00.528605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:00.656447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:00.666224 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-089c6360-96de-4358-8eae-73d5a480fae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.152010 Oct 12 23:28:00.666810 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3353/6800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:00 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:01.689461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:01.690086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:01.697583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:01.698073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:01.698515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:01.699206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:01.699661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:01.700120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:01.844504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:01.852269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fbaf2d52-f8fc-4080-9c8c-d041c9d9da0f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.166664 Oct 12 23:28:01.852845 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3448/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:01 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:02.875479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:02.876119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:02.882971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:02.883451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:02.883905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:02.884596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:02.885045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:02.885483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:03.018843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:03.026603 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-12fac7c4-d32c-49c9-b7e9-754fec265b36 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.155035 Oct 12 23:28:03.027112 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3354/6802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:02 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:04.049693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:04.050328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:04.057863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:04.058363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:04.058815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:04.059518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:04.060046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:04.060487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:04.064431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:04.189034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:04.197479 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b99c42c-455f-4325-9e56-df869ea70f2a tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.151769 Oct 12 23:28:04.198050 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3449/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:04 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:05.220201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:05.220812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:05.228212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:05.228689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:05.229121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:05.229801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:05.230246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:05.230660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:05.358007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:05.365823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb38be77-83a4-40e1-9453-5f2bf200d307 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.149559 Oct 12 23:28:05.366397 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3355/6804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:05 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:06.389351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:06.389971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:06.397413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:06.397897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:06.398336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:06.399025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:06.399481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:06.399937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:06.529810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:06.537697 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dac050bc-750f-4b8d-baf1-0ecf5032040f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.152256 Oct 12 23:28:06.538267 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3450/6805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:06 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:07.561611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:07.562158 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:07.569110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:07.569595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:07.570141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:07.570838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:07.571300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:07.571728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:07.702513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:07.710225 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b47d181-d90a-4fc4-bdf2-16a3a6f43683 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.152601 Oct 12 23:28:07.711413 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3356/6806] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:07 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:08.734335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:08.734964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:08.742515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:08.743012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:08.743474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:08.744206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:08.744675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:08.745115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:08.876668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:08.884984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-654b11e5-8e1e-49ce-9a49-ad31a82af3d7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.155295 Oct 12 23:28:08.885576 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3451/6807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:08 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:09.908421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:09.909049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:09.916227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:09.916707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:09.917149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:09.917835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:09.918287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:09.918710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:10.045582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:10.053242 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63aab18a-fc40-419c-bf4b-a94e3e95a9f8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.148749 Oct 12 23:28:10.053812 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3357/6808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:09 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:11.077597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:11.078245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:11.085074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:11.085571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:11.086017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:11.086715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:11.087180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:11.087615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:11.223677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:11.231961 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db3b6b44-b7c3-4b5e-8e16-e425597a9516 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.158265 Oct 12 23:28:11.232533 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3452/6809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:11 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:12.255316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:12.255945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:12.263575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:12.264079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:12.264510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:12.265185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:12.265630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:12.266045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:12.394520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:12.402322 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8d42f9b-38dc-426d-97ba-eda926ec1432 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.150868 Oct 12 23:28:12.402911 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3358/6810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:12 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:13.425437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:13.426058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:13.432957 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:13.433441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:13.433879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:13.434570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:13.435023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:13.435451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:13.561847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:13.569564 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aa9b9b57-8166-41a0-8887-a19d0ac81b20 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.148054 Oct 12 23:28:13.570638 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3453/6811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:13 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:14.592815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:14.593426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:14.600288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:14.600763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:14.601195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:14.601876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:14.602326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:14.602745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:14.732157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:14.739756 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3718ebb-b45d-4562-a4a4-a54c6f9ed88f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.150949 Oct 12 23:28:14.740352 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3359/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:14 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:15.763604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:15.764335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:15.771398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:15.771911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:15.772358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:15.773655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:15.774114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:15.774544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:15.908577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:15.916741 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebc3e414-a5c8-44dd-9da3-7e01f09a142e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.157513 Oct 12 23:28:15.917312 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3454/6813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:15 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:16.940189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:16.940812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:16.943541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=32 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:16.949106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:16.949590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:16.950032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:16.950722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:16.951176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:16.951608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:17.082623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:17.090951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-daf44a85-2339-457b-94b6-ef6efea0669f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.154754 Oct 12 23:28:17.091536 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3360/6814] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:16 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:18.113704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:18.114329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:18.117144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=36 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:18.122863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:18.123358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:18.123804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:18.124535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:18.125000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:18.125435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:18.255786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:18.263474 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f3b1370-4b52-428a-96b5-66e9f90be0f4 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.153649 Oct 12 23:28:18.264074 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3455/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:18 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:19.286818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:19.287445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:19.294375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:19.294858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:19.295298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:19.296020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:19.296474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:19.296900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:19.423578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:19.431418 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f45077fa-7546-4a1c-9f9f-19c627515434 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.148768 Oct 12 23:28:19.432010 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3361/6816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:19 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:20.454454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:20.455080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:20.462099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:20.462586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:20.463028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:20.463718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:20.464203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:20.464632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:20.592899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:20.601717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0115fdd4-0344-4384-8ccb-3a921e6bd120 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.150360 Oct 12 23:28:20.602316 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3456/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:20 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:21.624518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:21.625131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:21.631850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:21.632867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:21.633300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:21.633975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:21.634423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:21.634832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:21.767193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:21.777096 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6c22062c-6f55-457b-a21f-b1e096174a4e tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1519 microversion: 2.1 time: 0.156407 Oct 12 23:28:21.777676 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3362/6818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:21 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:22.525486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a5bbd0d0-9b82-4f67-9663-215e706e47f6 req-4421e160-c333-4434-99d2-da5e9ada5c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c5050db-0767-4792-956a-9981a94ff085", "name": "network-vif-unplugged", "status": "completed", "tag": "cd9b3c10-ae49-4f9b-8b71-26fd9be565df"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:22.536799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a5bbd0d0-9b82-4f67-9663-215e706e47f6 req-4421e160-c333-4434-99d2-da5e9ada5c12 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:22.537376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a5bbd0d0-9b82-4f67-9663-215e706e47f6 req-4421e160-c333-4434-99d2-da5e9ada5c12 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:22.537821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a5bbd0d0-9b82-4f67-9663-215e706e47f6 req-4421e160-c333-4434-99d2-da5e9ada5c12 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:22.550855 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a5bbd0d0-9b82-4f67-9663-215e706e47f6 req-4421e160-c333-4434-99d2-da5e9ada5c12 service nova] Creating event network-vif-unplugged:cd9b3c10-ae49-4f9b-8b71-26fd9be565df for instance 8c5050db-0767-4792-956a-9981a94ff085 on n-h2-860864-8 Oct 12 23:28:22.556850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-a5bbd0d0-9b82-4f67-9663-215e706e47f6 req-4421e160-c333-4434-99d2-da5e9ada5c12 service nova] Instance 8c5050db-0767-4792-956a-9981a94ff085 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:28:22.567731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a5bbd0d0-9b82-4f67-9663-215e706e47f6 req-4421e160-c333-4434-99d2-da5e9ada5c12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046006 Oct 12 23:28:22.568703 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3457/6819] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:28:22.802151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:22.804496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:22.812347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:22.812855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:22.813476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:22.814173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:22.814628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:22.815054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:22.954997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:22.963027 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05e778ee-c395-4106-a271-c97226d3f465 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1518 microversion: 2.1 time: 0.166222 Oct 12 23:28:22.963604 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3363/6820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:22 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:23.987482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:23.988221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:23.995023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:23.995510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:23.995990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:23.996685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:23.997137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:23.997564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:24.135387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:24.143562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30c78549-eb33-46ab-926a-5028b6c8bd61 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1516 microversion: 2.1 time: 0.161217 Oct 12 23:28:24.144178 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3458/6821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:23 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:24.581801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-43ed2c63-b2a4-4f8d-8d22-7dc02cbab2c3 req-9f3ac6f0-7fcf-41f9-9c18-6595d6b07fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c5050db-0767-4792-956a-9981a94ff085", "tag": "cd9b3c10-ae49-4f9b-8b71-26fd9be565df"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:24.591965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-43ed2c63-b2a4-4f8d-8d22-7dc02cbab2c3 req-9f3ac6f0-7fcf-41f9-9c18-6595d6b07fbe service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:24.592439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-43ed2c63-b2a4-4f8d-8d22-7dc02cbab2c3 req-9f3ac6f0-7fcf-41f9-9c18-6595d6b07fbe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:24.592866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-43ed2c63-b2a4-4f8d-8d22-7dc02cbab2c3 req-9f3ac6f0-7fcf-41f9-9c18-6595d6b07fbe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:24.595324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=89 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:24.605765 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-43ed2c63-b2a4-4f8d-8d22-7dc02cbab2c3 req-9f3ac6f0-7fcf-41f9-9c18-6595d6b07fbe service nova] Creating event network-changed:cd9b3c10-ae49-4f9b-8b71-26fd9be565df for instance 8c5050db-0767-4792-956a-9981a94ff085 on n-h2-860864-8 Oct 12 23:28:24.611154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-43ed2c63-b2a4-4f8d-8d22-7dc02cbab2c3 req-9f3ac6f0-7fcf-41f9-9c18-6595d6b07fbe service nova] Instance 8c5050db-0767-4792-956a-9981a94ff085 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:28:24.622968 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-43ed2c63-b2a4-4f8d-8d22-7dc02cbab2c3 req-9f3ac6f0-7fcf-41f9-9c18-6595d6b07fbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044857 Oct 12 23:28:24.623635 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3364/6822] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:28:25.167342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:25.168002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:25.174213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:25.174698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:25.175147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:25.175838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:25.176319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:25.176751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:25.323067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:25.330798 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b904d02-11a0-4b3b-997b-210fb84c3024 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1513 microversion: 2.1 time: 0.168047 Oct 12 23:28:25.331376 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3459/6823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:25 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:25.353869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:25.354496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:25.360714 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:25.361200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:25.361637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:25.362329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:25.362787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:25.363212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:25.419252 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a8f8007-577a-42ec-87c9-4d8cac7985ba tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "POST /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085/action" status: 204 len: 0 microversion: 2.1 time: 0.069392 Oct 12 23:28:25.419819 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3365/6824] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:28:25 2022] POST /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:28:25.428741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:25.429406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:25.435368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:25.436012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:25.436491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:25.437296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:25.437767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:25.438211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:25.575473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:25.583473 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39261f76-188e-4670-b3a6-a675ad73dae9 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1513 microversion: 2.1 time: 0.159359 Oct 12 23:28:25.584152 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3460/6825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:25 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:28:26.609781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:26.610493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:26.617177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:26.617660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:26.618098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:26.618794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:26.619246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:26.619669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:26.764515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:26.772311 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1846d5ae-464a-44e5-97db-f4cc74bbad26 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1505 microversion: 2.1 time: 0.168070 Oct 12 23:28:26.773533 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3366/6826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:26 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:26.795594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:26.796257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:26.803069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:26.803567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:26.804053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:26.804758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:26.805226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:26.805666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:26.930883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:26.938540 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14b5f3c0-424a-4ee5-a0ca-2a1017b795df tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1505 microversion: 2.1 time: 0.146914 Oct 12 23:28:26.939107 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3461/6827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:26 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:26.961236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:26.961848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:26.967834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:26.968349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:26.968790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:26.969472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:26.969922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:26.970344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:27.100981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:27.108664 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ba9e1c1-62c6-4d19-b01d-0fcb69a8efa7 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1505 microversion: 2.1 time: 0.151933 Oct 12 23:28:27.109231 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3367/6828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:26 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:27.130914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:27.131359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:27.137884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:27.138372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:27.138881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:27.139566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:27.140060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:27.140492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:27.164696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:28:27.238038 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75e05368-9577-46e9-95bf-11479c2f57f3 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 204 len: 0 microversion: 2.1 time: 0.110810 Oct 12 23:28:27.238710 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3462/6829] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:28:27 2022] DELETE /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:28:27.259739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:27.260280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:27.266292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:27.266773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:27.267211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:27.267918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:27.268375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:27.268801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:27.293629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:28:27.337028 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.compute.api [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Instance is already in deleting state, ignoring this request Oct 12 23:28:27.337841 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13e89362-0305-4dc3-9170-98d83ee5e527 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 204 len: 0 microversion: 2.1 time: 0.082765 Oct 12 23:28:27.338400 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3368/6830] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:28:27 2022] DELETE /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:28:27.347140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:27.347850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:27.353840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:27.354322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:27.354790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:27.355482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:27.355965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:27.356395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:27.482972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:27.490660 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0dcd1c6-f816-4fde-8f9e-368965457f76 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1511 microversion: 2.1 time: 0.147765 Oct 12 23:28:27.491231 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3463/6831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:27 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:28.118297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-cf3f7ca2-3fec-4bf8-ba4b-8613a2859edd req-39fc6fa0-8df5-4eab-8439-c5961c2b4dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c5050db-0767-4792-956a-9981a94ff085", "name": "network-vif-plugged", "status": "completed", "tag": "cd9b3c10-ae49-4f9b-8b71-26fd9be565df"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:28.128864 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cf3f7ca2-3fec-4bf8-ba4b-8613a2859edd req-39fc6fa0-8df5-4eab-8439-c5961c2b4dc7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:28.129430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cf3f7ca2-3fec-4bf8-ba4b-8613a2859edd req-39fc6fa0-8df5-4eab-8439-c5961c2b4dc7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:28.129853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cf3f7ca2-3fec-4bf8-ba4b-8613a2859edd req-39fc6fa0-8df5-4eab-8439-c5961c2b4dc7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:28.141069 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-cf3f7ca2-3fec-4bf8-ba4b-8613a2859edd req-39fc6fa0-8df5-4eab-8439-c5961c2b4dc7 service nova] Creating event network-vif-plugged:cd9b3c10-ae49-4f9b-8b71-26fd9be565df for instance 8c5050db-0767-4792-956a-9981a94ff085 on n-h2-860864-8 Oct 12 23:28:28.146161 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-cf3f7ca2-3fec-4bf8-ba4b-8613a2859edd req-39fc6fa0-8df5-4eab-8439-c5961c2b4dc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031647 Oct 12 23:28:28.146760 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3369/6832] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:28:28.514203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:28.514822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:28.521574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:28.522059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:28.522501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:28.523790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:28.524269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:28.524696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:28.545927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:28.766243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e050614fc19b40aab8c994d76316b41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82f721eee44031b694a7be758b65eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:28.775366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab46c6f1-923c-481e-9f59-0b0d7304cf49 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 200 len: 1511 microversion: 2.1 time: 0.265038 Oct 12 23:28:28.775962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3464/6833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:28 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 1511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:29.041545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b94df334-adc4-49a6-b9d5-994dafcee8a1 req-c6b09765-c258-483b-bb0b-dd6042ef0f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c5050db-0767-4792-956a-9981a94ff085", "name": "network-vif-deleted", "tag": "cd9b3c10-ae49-4f9b-8b71-26fd9be565df"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:29.051786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b94df334-adc4-49a6-b9d5-994dafcee8a1 req-c6b09765-c258-483b-bb0b-dd6042ef0f4d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:29.052286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b94df334-adc4-49a6-b9d5-994dafcee8a1 req-c6b09765-c258-483b-bb0b-dd6042ef0f4d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:29.052711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b94df334-adc4-49a6-b9d5-994dafcee8a1 req-c6b09765-c258-483b-bb0b-dd6042ef0f4d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:29.064695 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b94df334-adc4-49a6-b9d5-994dafcee8a1 req-c6b09765-c258-483b-bb0b-dd6042ef0f4d service nova] Creating event network-vif-deleted:cd9b3c10-ae49-4f9b-8b71-26fd9be565df for instance 8c5050db-0767-4792-956a-9981a94ff085 on n-h2-860864-8 Oct 12 23:28:29.069631 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b94df334-adc4-49a6-b9d5-994dafcee8a1 req-c6b09765-c258-483b-bb0b-dd6042ef0f4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032600 Oct 12 23:28:29.070211 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3370/6834] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:28:29.798017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:29.798647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8c5050db-0767-4792-956a-9981a94ff085] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:29.805453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:29.805937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:29.806378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:29.807070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:29.807525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:29.807977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:29.821409 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] HTTP exception thrown: Instance 8c5050db-0767-4792-956a-9981a94ff085 could not be found. Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Request method failure captured: Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 HTTP/1.1 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR01Cdw6MmhE-seZw-9F_ZsA-g4oL64kzeBsyzhw9IBI8Gx6CKC7-NBic43IPQBZkGbs7MkHwy5SpP6J1vEr-FOpDVLxmMkgGD9tYG-_x_ZRQP9ZBs5pzIaM5SVyFTaVMEy_69xoZIuPly9KGmWMZwbL2q_QNrAUkDMIObUIt6uEFdr8 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: bd82f721eee44031b694a7be758b65eb Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd82f721eee44031b694a7be758b65eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd82f721eee44031b694a7be758b65eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd82f721eee44031b694a7be758b65eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd82f721eee44031b694a7be758b65eb"}]}] Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: bd82f721eee44031b694a7be758b65eb Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerDiskConfigTestJSON-770257728-project Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e050614fc19b40aab8c994d76316b41e Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerDiskConfigTestJSON-770257728-project Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 8c5050db-0767-4792-956a-9981a94ff085 could not be found. Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '8c5050db-0767-4792-956a-9981a94ff085'} Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c5050db-0767-4792-956a-9981a94ff085 could not be found. Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c5050db-0767-4792-956a-9981a94ff085 could not be found. Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:28:29.823078 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c5050db-0767-4792-956a-9981a94ff085 could not be found. Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Returning 404 to user: Instance 8c5050db-0767-4792-956a-9981a94ff085 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9438c6b-e3e3-446d-b853-0779bbc3fa7f tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085" status: 404 len: 111 microversion: 2.1 time: 0.030379 Oct 12 23:28:29.828068 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3465/6835] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:29 2022] GET /compute/v2.1/servers/8c5050db-0767-4792-956a-9981a94ff085 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:28:29.834610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c340a1a7-f2b2-459b-92e0-9aac1773f0e8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '.version_select at 0x7f44ff773940>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:29.858269 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c340a1a7-f2b2-459b-92e0-9aac1773f0e8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073903444" status: 202 len: 0 microversion: 2.1 time: 0.028841 Oct 12 23:28:29.858840 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3371/6836] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 23:28:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073903444 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:28:30.455755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:30.456289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:30.462624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:30.463105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:30.463545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:30.464259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:30.464717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:30.465148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:30.478909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] HTTP exception thrown: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Request method failure captured: Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 HTTP/1.1 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR01Cdw6MmhE-seZw-9F_ZsA-g4oL64kzeBsyzhw9IBI8Gx6CKC7-NBic43IPQBZkGbs7MkHwy5SpP6J1vEr-FOpDVLxmMkgGD9tYG-_x_ZRQP9ZBs5pzIaM5SVyFTaVMEy_69xoZIuPly9KGmWMZwbL2q_QNrAUkDMIObUIt6uEFdr8 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: bd82f721eee44031b694a7be758b65eb Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd82f721eee44031b694a7be758b65eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd82f721eee44031b694a7be758b65eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd82f721eee44031b694a7be758b65eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd82f721eee44031b694a7be758b65eb"}]}] Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: bd82f721eee44031b694a7be758b65eb Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerDiskConfigTestJSON-770257728-project Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: e050614fc19b40aab8c994d76316b41e Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerDiskConfigTestJSON-770257728-project Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '8dd62429-cef0-4a7f-8034-115ee68d96b1'} Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:28:30.480480 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Returning 404 to user: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8699b31b-6b2e-44a0-9cb1-9828a70194c8 tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 404 len: 111 microversion: 2.1 time: 0.030068 Oct 12 23:28:30.485547 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3466/6837] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:28:30 2022] DELETE /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:28:30.490394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:30.491133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] [instance: 8dd62429-cef0-4a7f-8034-115ee68d96b1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:30.498545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:30.499034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:30.499476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:30.500199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:30.500654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:30.501082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:30.514034 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] HTTP exception thrown: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Request method failure captured: Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 HTTP/1.1 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR01Cdw6MmhE-seZw-9F_ZsA-g4oL64kzeBsyzhw9IBI8Gx6CKC7-NBic43IPQBZkGbs7MkHwy5SpP6J1vEr-FOpDVLxmMkgGD9tYG-_x_ZRQP9ZBs5pzIaM5SVyFTaVMEy_69xoZIuPly9KGmWMZwbL2q_QNrAUkDMIObUIt6uEFdr8 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: bd82f721eee44031b694a7be758b65eb Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd82f721eee44031b694a7be758b65eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bd82f721eee44031b694a7be758b65eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bd82f721eee44031b694a7be758b65eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bd82f721eee44031b694a7be758b65eb"}]}] Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: bd82f721eee44031b694a7be758b65eb Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-770257728 Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerDiskConfigTestJSON-770257728-project Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: e050614fc19b40aab8c994d76316b41e Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerDiskConfigTestJSON-770257728-project Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '8dd62429-cef0-4a7f-8034-115ee68d96b1'} Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:28:30.515643 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] Returning 404 to user: Instance 8dd62429-cef0-4a7f-8034-115ee68d96b1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0142187c-9a96-4c46-a301-19e6e4622aff tempest-ServerDiskConfigTestJSON-770257728 tempest-ServerDiskConfigTestJSON-770257728-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1" status: 404 len: 111 microversion: 2.1 time: 0.030610 Oct 12 23:28:30.519533 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3372/6838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:30 2022] GET /compute/v2.1/servers/8dd62429-cef0-4a7f-8034-115ee68d96b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:28:39.267182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b494137-a6c7-4b61-820d-6f3afbbbdc96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'create', calling method: .version_select at 0x7f44fc3d4dc0>, body: {"keypair": {"name": "tempest-keypair-1371574832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFX29epYE0bxP4zTJ7QZMNcoP57Ocok25gfCoJS1vvgWoodpPDZIO7YDSiAO+BFIAQT61fX8re9kjDe2ljiAuyGqsNKQbN1nXMgfNXdlm5+JPJFJi3jI+QEwkhqZbPkRQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:39.282856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-8b494137-a6c7-4b61-820d-6f3afbbbdc96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:28:39.288746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-8b494137-a6c7-4b61-820d-6f3afbbbdc96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for user 32d96aa156934d4c93c8e43544292992 and project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:28:39.312909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b494137-a6c7-4b61-820d-6f3afbbbdc96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226895 Oct 12 23:28:39.313510 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3467/6839] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:28:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:28:40.564795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1017300314", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dfb41e6-ccbb-4458-9a2a-d5373fc71de1"}], "security_groups": [{"name": "tempest-securitygroup--698477333"}], "key_name": "tempest-keypair-1371574832", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:40.574652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:40.575496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:40.903432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] validate_networks() for [('1dfb41e6-ccbb-4458-9a2a-d5373fc71de1', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:28:41.299406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:28:41.299834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:28:41.300341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:28:41.300751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:28:41.301163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:28:41.309830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:41.310316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:41.310749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:41.311470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:41.311939 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:41.312368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:41.329439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:28:41.334718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for user 32d96aa156934d4c93c8e43544292992 and project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:28:41.347454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:28:41.349824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:28:41.399299 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4cc37fc0-101b-420b-af6b-eb0902ab279a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.839299 Oct 12 23:28:41.404265 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3373/6840] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:28:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:28:41.411742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dec14745-48bf-42de-844e-abf1a1a21d96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:41.412395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dec14745-48bf-42de-844e-abf1a1a21d96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:41.428441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:41.614471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dec14745-48bf-42de-844e-abf1a1a21d96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:41.634885 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dec14745-48bf-42de-844e-abf1a1a21d96 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1239 microversion: 2.1 time: 0.227309 Oct 12 23:28:41.635474 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3468/6841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:41 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1239 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:42.658256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:42.659050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:42.667194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:42.667684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:42.668150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:42.668883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:42.669339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:42.669772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:42.735554 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:42.743658 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0db6e644-355a-47b1-b8df-8edecdbbbee5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1309 microversion: 2.1 time: 0.089754 Oct 12 23:28:42.744277 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3374/6842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:42 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:43.767328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:43.768027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:43.775727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:43.776270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:43.776839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:43.777564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:43.778033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:43.778471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:43.969884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:43.978204 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57bc7fce-14cc-49a9-818c-72f97e1d0a1d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1364 microversion: 2.1 time: 0.214872 Oct 12 23:28:43.978979 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3469/6843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:43 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:44.003880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-65f1c789-5e9e-48d6-9977-2e3651052781 req-87f401e5-f7a1-4e13-b602-74b9a528e438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32804f63-7417-4456-9dcc-cbcb73be6396", "tag": "3f7c9468-31cb-4386-b3a5-33f6f8443c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:44.017239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-65f1c789-5e9e-48d6-9977-2e3651052781 req-87f401e5-f7a1-4e13-b602-74b9a528e438 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:44.017723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-65f1c789-5e9e-48d6-9977-2e3651052781 req-87f401e5-f7a1-4e13-b602-74b9a528e438 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:44.018156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-65f1c789-5e9e-48d6-9977-2e3651052781 req-87f401e5-f7a1-4e13-b602-74b9a528e438 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:44.031213 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-65f1c789-5e9e-48d6-9977-2e3651052781 req-87f401e5-f7a1-4e13-b602-74b9a528e438 service nova] Creating event network-changed:3f7c9468-31cb-4386-b3a5-33f6f8443c1b for instance 32804f63-7417-4456-9dcc-cbcb73be6396 on n-h2-860864-8 Oct 12 23:28:44.036602 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-65f1c789-5e9e-48d6-9977-2e3651052781 req-87f401e5-f7a1-4e13-b602-74b9a528e438 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036400 Oct 12 23:28:44.037228 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3375/6844] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:28:45.000998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:45.001667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:45.008975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:45.009463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:45.009907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:45.010610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:45.011069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:45.011498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:45.143492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:45.151446 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1cbf44f1-7ceb-47ff-a517-162e36e8b909 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1364 microversion: 2.1 time: 0.154543 Oct 12 23:28:45.152155 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3470/6845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:44 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:46.175855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:46.176619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:46.183416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:46.183923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:46.184369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:46.185075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:46.185531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:46.185960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:46.318516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:46.326705 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4d88f31-6f56-4e00-8814-88cfe38dfd8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1364 microversion: 2.1 time: 0.156131 Oct 12 23:28:46.327308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3376/6846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:46 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:47.349813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:47.350418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:47.357756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:47.358250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:47.358694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:47.359394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:47.359860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:47.360320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:47.490538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:47.498239 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7c4b1e9d-6b0d-471b-aadd-832749118806 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1364 microversion: 2.1 time: 0.152471 Oct 12 23:28:47.498812 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3471/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:47 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:48.167840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1eb64b58-1fab-47b9-a2e4-4472807aa719 req-fc5811ef-0071-4236-8a2c-7427627e48ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32804f63-7417-4456-9dcc-cbcb73be6396", "name": "network-vif-plugged", "status": "completed", "tag": "3f7c9468-31cb-4386-b3a5-33f6f8443c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:48.179167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1eb64b58-1fab-47b9-a2e4-4472807aa719 req-fc5811ef-0071-4236-8a2c-7427627e48ec service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:48.179731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1eb64b58-1fab-47b9-a2e4-4472807aa719 req-fc5811ef-0071-4236-8a2c-7427627e48ec service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:48.180265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1eb64b58-1fab-47b9-a2e4-4472807aa719 req-fc5811ef-0071-4236-8a2c-7427627e48ec service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:48.191284 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1eb64b58-1fab-47b9-a2e4-4472807aa719 req-fc5811ef-0071-4236-8a2c-7427627e48ec service nova] Creating event network-vif-plugged:3f7c9468-31cb-4386-b3a5-33f6f8443c1b for instance 32804f63-7417-4456-9dcc-cbcb73be6396 on n-h2-860864-8 Oct 12 23:28:48.196234 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1eb64b58-1fab-47b9-a2e4-4472807aa719 req-fc5811ef-0071-4236-8a2c-7427627e48ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033238 Oct 12 23:28:48.196824 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3377/6848] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:28:48.520351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:48.520975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:48.524357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:28:48.529610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:48.530099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:48.530552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:48.531266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:48.531709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:48.532170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:48.662695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:48.670405 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-afa1e2ce-d46f-488f-a733-feca5ff01500 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1364 microversion: 2.1 time: 0.153983 Oct 12 23:28:48.670993 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3472/6849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:48 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:28:49.693791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:49.695101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:49.701333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:49.701817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:49.702257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:49.702944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:49.703402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:49.703829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:49.833674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:28:49.841848 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e5ce1286-b4c9-4297-95f0-04eb35397393 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1551 microversion: 2.1 time: 0.153261 Oct 12 23:28:49.842418 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3378/6850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:28:49 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:28:49.864394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:28:49.864896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:28:49.871661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:49.872173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:49.872620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:49.873339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:49.873795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:49.874231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:49.952135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0bfbd16a-bee0-4d29-9b16-e1c906a63e5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091630 Oct 12 23:28:49.952729 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3473/6851] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:28:49 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:28:51.203113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b3e0acd7-49cb-4e53-a862-de3ced210f86 req-901702e1-a31f-4f46-b0b7-9539accaadb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32804f63-7417-4456-9dcc-cbcb73be6396", "tag": "3f7c9468-31cb-4386-b3a5-33f6f8443c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:28:51.213578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b3e0acd7-49cb-4e53-a862-de3ced210f86 req-901702e1-a31f-4f46-b0b7-9539accaadb8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:28:51.214159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b3e0acd7-49cb-4e53-a862-de3ced210f86 req-901702e1-a31f-4f46-b0b7-9539accaadb8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:28:51.214663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b3e0acd7-49cb-4e53-a862-de3ced210f86 req-901702e1-a31f-4f46-b0b7-9539accaadb8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:28:51.225701 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b3e0acd7-49cb-4e53-a862-de3ced210f86 req-901702e1-a31f-4f46-b0b7-9539accaadb8 service nova] Creating event network-changed:3f7c9468-31cb-4386-b3a5-33f6f8443c1b for instance 32804f63-7417-4456-9dcc-cbcb73be6396 on n-h2-860864-8 Oct 12 23:28:51.230790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b3e0acd7-49cb-4e53-a862-de3ced210f86 req-901702e1-a31f-4f46-b0b7-9539accaadb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031435 Oct 12 23:28:51.231813 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3379/6852] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:29:27.363166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:27.364111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:27.365035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=28 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:27.370337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:27.370965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:27.377986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.378474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.378923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.379638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.380138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.380576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.506724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:27.514366 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f3c309f-fef2-4acf-9916-79f527b3195a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1670 microversion: 2.1 time: 0.153111 Oct 12 23:29:27.514944 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3474/6853] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:27 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:27.534028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:27.534793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:27.537927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:27.538705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=26 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:27.543010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:27.543713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:27.552214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.553350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.553794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.554476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.554929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.555353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.683711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:27.691452 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7feee88-ca70-4835-9c77-2cfc7ecc7161 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1670 microversion: 2.1 time: 0.158329 Oct 12 23:29:27.692049 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3380/6854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:27 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:27.713958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:27.714593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:27.720541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.721038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.721496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.722199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.722669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.723110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.851349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:27.859045 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0971a37b-97bc-4cba-843a-95c0b511237b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1670 microversion: 2.1 time: 0.149721 Oct 12 23:29:27.859623 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3475/6855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:27 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:27.880852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:27.883152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:27.889010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.889473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.889907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.890589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:27.891036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:27.891455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:27.920261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:27.925469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Old instance type m1.heat2, new instance type m1.heat {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:29:27.931801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:29:27.932254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:29:27.932728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:29:27.933136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:29:27.933547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:29:27.994302 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0741de16-02eb-45d2-833d-b2780a6bb3ea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396/action" status: 202 len: 0 microversion: 2.1 time: 0.117275 Oct 12 23:29:27.994925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3381/6856] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:29:27 2022] POST /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:29:28.003226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:28.003930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:28.010380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:28.010886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:28.011335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:28.012082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:28.012563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:28.013003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:28.170225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:28.180825 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49abdd9a-25ac-43e2-8bd7-7b3ebdbc2068 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1679 microversion: 2.1 time: 0.181537 Oct 12 23:29:28.181434 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3476/6857] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:27 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:29.205446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:29.206186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:29.213193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:29.213754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:29.214195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:29.214887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:29.215340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:29.215760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:29.654108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:29.662736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3e5bfd4-d1c3-4d49-9ba0-166b6f2d4024 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1679 microversion: 2.1 time: 0.462180 Oct 12 23:29:29.663326 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3382/6858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:29 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1679 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:30.686799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:30.687449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:30.694322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:30.694805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:30.695258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:30.695970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:30.696431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:30.696857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:30.824189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:30.832145 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fe9190fb-5ab1-4454-a53f-0a48853b8743 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.149202 Oct 12 23:29:30.832716 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3477/6859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:30 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:31.855752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:31.856483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:31.863228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:31.863707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:31.864173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:31.864857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:31.865808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:31.866226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:31.992803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:32.000426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-036445c3-7f3e-41b8-9cfd-3b3fda38bb7d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.148621 Oct 12 23:29:32.001000 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3383/6860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:31 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:33.024184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:33.024754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:33.031577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:33.032103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:33.032558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:33.033260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:33.033723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:33.034158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:33.164911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:33.172656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a59e240e-f6bf-4252-aedc-4e1f9f79e887 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.153216 Oct 12 23:29:33.173229 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3478/6861] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:33 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:34.196590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:34.197205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:34.204006 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:34.204490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:34.204928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:34.205612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:34.206064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:34.206495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:34.335712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:34.343406 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e73af65-522b-4869-a470-99a7a901e5ad tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.151356 Oct 12 23:29:34.343989 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3384/6862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:34 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:35.366841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:35.367702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:35.374489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:35.374971 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:35.375412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:35.376197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:35.376658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:35.377082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:35.506589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:35.514545 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef483f9d-e077-4ac7-ba9f-d507a69af260 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.151581 Oct 12 23:29:35.515120 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3479/6863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:35 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:36.538371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:36.539018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:36.545851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:36.546327 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:36.546763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:36.547448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:36.547919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:36.548340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:36.675726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:36.688820 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63e0ed7b-a4a2-4e6e-b60c-dc364c511697 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.155085 Oct 12 23:29:36.689675 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3385/6864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:36 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:37.711917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:37.712550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:37.719136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:37.719625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:37.720108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:37.720802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:37.721264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:37.721699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:37.854650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:37.862416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e3233e1d-36b0-4dc5-a5db-befa486ce90b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.154440 Oct 12 23:29:37.863017 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3480/6865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:37 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:38.886368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:38.886985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:38.894269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:38.894873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:38.895455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:38.896175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:38.896634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:38.897878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:39.027226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:39.035006 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03a77709-42cc-4cd6-a990-fe4a8762222a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.152490 Oct 12 23:29:39.035848 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3386/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:38 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:40.058757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:40.059342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:40.066178 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:40.066666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:40.067110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:40.067804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:40.068289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:40.068722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:40.196107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:40.203977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c27cfac7-6a46-496e-b965-be6f5d2318cf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.149149 Oct 12 23:29:40.204562 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3481/6867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:40 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:29:41.228166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:41.228787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:41.236484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:41.236967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:41.237396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:41.238080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:41.238527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:41.238946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:41.368946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:41.376656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c2537e2-7a7e-4816-bf4c-86a9a38181e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1684 microversion: 2.1 time: 0.153063 Oct 12 23:29:41.377233 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3387/6868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:41 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:42.213677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6648355c-3385-4f58-9bbc-f51ea6400813 req-beaf460b-4e8e-4528-bc7d-386da5682146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32804f63-7417-4456-9dcc-cbcb73be6396", "name": "network-vif-unplugged", "status": "completed", "tag": "3f7c9468-31cb-4386-b3a5-33f6f8443c1b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:42.223203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6648355c-3385-4f58-9bbc-f51ea6400813 req-beaf460b-4e8e-4528-bc7d-386da5682146 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:42.223693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6648355c-3385-4f58-9bbc-f51ea6400813 req-beaf460b-4e8e-4528-bc7d-386da5682146 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:42.224254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6648355c-3385-4f58-9bbc-f51ea6400813 req-beaf460b-4e8e-4528-bc7d-386da5682146 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:42.236472 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6648355c-3385-4f58-9bbc-f51ea6400813 req-beaf460b-4e8e-4528-bc7d-386da5682146 service nova] Creating event network-vif-unplugged:3f7c9468-31cb-4386-b3a5-33f6f8443c1b for instance 32804f63-7417-4456-9dcc-cbcb73be6396 on n-h1-860864-8 Oct 12 23:29:42.242353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-6648355c-3385-4f58-9bbc-f51ea6400813 req-beaf460b-4e8e-4528-bc7d-386da5682146 service nova] Instance 32804f63-7417-4456-9dcc-cbcb73be6396 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:29:42.253663 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6648355c-3385-4f58-9bbc-f51ea6400813 req-beaf460b-4e8e-4528-bc7d-386da5682146 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093980 Oct 12 23:29:42.254379 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3482/6869] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:42.400515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:42.401136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:42.408365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:42.408881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:42.409318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:42.410027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:42.410801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:42.411227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:42.613793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:42.622046 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a370f4e-080b-40a2-85d2-2d2c6eaadbe5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1683 microversion: 2.1 time: 0.225542 Oct 12 23:29:42.622627 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3388/6870] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:42 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:43.646043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:43.646788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:43.654209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:43.654695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:43.655139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:43.655829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:43.656316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:43.656748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:43.792674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:43.800358 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-359fb898-24b8-4ce9-83d5-8ef73dd7b9f7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1681 microversion: 2.1 time: 0.158611 Oct 12 23:29:43.800935 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3483/6871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:43 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:44.278391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1f87ca24-5e0a-4765-9084-bd8955b0c0ec req-4bd542d9-54d0-40f1-aff5-634313d60fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32804f63-7417-4456-9dcc-cbcb73be6396", "tag": "3f7c9468-31cb-4386-b3a5-33f6f8443c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:44.288826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1f87ca24-5e0a-4765-9084-bd8955b0c0ec req-4bd542d9-54d0-40f1-aff5-634313d60fcc service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:44.289300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1f87ca24-5e0a-4765-9084-bd8955b0c0ec req-4bd542d9-54d0-40f1-aff5-634313d60fcc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:44.289731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1f87ca24-5e0a-4765-9084-bd8955b0c0ec req-4bd542d9-54d0-40f1-aff5-634313d60fcc service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:44.303875 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1f87ca24-5e0a-4765-9084-bd8955b0c0ec req-4bd542d9-54d0-40f1-aff5-634313d60fcc service nova] Creating event network-changed:3f7c9468-31cb-4386-b3a5-33f6f8443c1b for instance 32804f63-7417-4456-9dcc-cbcb73be6396 on n-h1-860864-8 Oct 12 23:29:44.309203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-1f87ca24-5e0a-4765-9084-bd8955b0c0ec req-4bd542d9-54d0-40f1-aff5-634313d60fcc service nova] Instance 32804f63-7417-4456-9dcc-cbcb73be6396 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:29:44.320524 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1f87ca24-5e0a-4765-9084-bd8955b0c0ec req-4bd542d9-54d0-40f1-aff5-634313d60fcc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045717 Oct 12 23:29:44.321112 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3389/6872] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:44.823991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:44.824769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:44.831506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:44.832086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:44.832609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:44.833351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:44.833811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:44.834406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:44.971958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:44.980447 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b1880ec-f419-4565-b81a-b957a9b4c9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1678 microversion: 2.1 time: 0.160776 Oct 12 23:29:44.981035 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3484/6873] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:44 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:45.004242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:45.004881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:45.011027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.011502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.012023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.012709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.013157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.013571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.071152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1003bedb-ecec-4b22-95c0-1e24dfb0ea30 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396/action" status: 204 len: 0 microversion: 2.1 time: 0.071085 Oct 12 23:29:45.071832 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3390/6874] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:29:44 2022] POST /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:29:45.081175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:45.081876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:45.088629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.089133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.089587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.090352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:45.090857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:45.091544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:45.301497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:45.310689 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0959403-9281-41fa-9af4-66b2878ea35c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1678 microversion: 2.1 time: 0.233670 Oct 12 23:29:45.311474 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3485/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:45 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:46.334397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:46.335278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:46.346304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.346796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.347234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.347959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.348416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.348836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.491276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:46.500002 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eff87d25-c949-4b75-ac5b-db02323b79e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1670 microversion: 2.1 time: 0.169686 Oct 12 23:29:46.500753 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3391/6876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:46 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:46.524081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:46.524633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:46.534595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.535079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.535786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.536504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.536963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.537391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.666141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:46.674211 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7e5c98f1-58f2-439e-96ab-56783c29f52c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1670 microversion: 2.1 time: 0.154723 Oct 12 23:29:46.674981 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3486/6877] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:46 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:46.697153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:46.698046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:46.704190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.704665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.705095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.705774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.706218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.706637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.837183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:46.844944 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e0a8f7d-4053-4a52-b4f8-a940dd630803 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1670 microversion: 2.1 time: 0.152276 Oct 12 23:29:46.845513 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3392/6878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:46 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:46.867604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:46.868152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:46.874037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.874530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.874975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.875673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.876163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.876601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.903881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:29:46.978599 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-730aff77-33c5-436e-a8bd-4d9ee4ca0b83 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 204 len: 0 microversion: 2.1 time: 0.114625 Oct 12 23:29:46.979265 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3487/6879] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:29:46 2022] DELETE /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:29:46.987975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:46.988592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:46.994501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.994963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.995400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:46.996120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:46.996575 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:46.996997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:47.128615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:47.137064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb39fc78-0a40-43bc-bce0-4b813da47ecb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1676 microversion: 2.1 time: 0.152963 Oct 12 23:29:47.137671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3393/6880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:46 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:29:47.550545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-37dc7a39-9a3d-4c51-9798-777fc8e0462d req-ce1fa785-452c-4824-bd84-4485753e2a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32804f63-7417-4456-9dcc-cbcb73be6396", "name": "network-vif-plugged", "status": "completed", "tag": "3f7c9468-31cb-4386-b3a5-33f6f8443c1b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:47.560567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-37dc7a39-9a3d-4c51-9798-777fc8e0462d req-ce1fa785-452c-4824-bd84-4485753e2a4e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:47.561048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-37dc7a39-9a3d-4c51-9798-777fc8e0462d req-ce1fa785-452c-4824-bd84-4485753e2a4e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:47.561486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-37dc7a39-9a3d-4c51-9798-777fc8e0462d req-ce1fa785-452c-4824-bd84-4485753e2a4e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:47.572938 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-37dc7a39-9a3d-4c51-9798-777fc8e0462d req-ce1fa785-452c-4824-bd84-4485753e2a4e service nova] Creating event network-vif-plugged:3f7c9468-31cb-4386-b3a5-33f6f8443c1b for instance 32804f63-7417-4456-9dcc-cbcb73be6396 on n-h1-860864-8 Oct 12 23:29:47.577878 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-37dc7a39-9a3d-4c51-9798-777fc8e0462d req-ce1fa785-452c-4824-bd84-4485753e2a4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078678 Oct 12 23:29:47.578441 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3488/6881] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:48.162050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:48.162692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:48.170219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:48.170698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:48.171160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:48.171844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:48.172319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:48.172743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:48.188002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:48.302402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:48.310024 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e56eac1a-351f-4b91-95f5-58f815b0a688 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1676 microversion: 2.1 time: 0.152168 Oct 12 23:29:48.310602 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3394/6882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:48 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:49.215349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e7ea9227-fae7-4f5a-982f-128c5bd22d8a req-2a0402de-a550-4e0e-8949-527d83f5bc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32804f63-7417-4456-9dcc-cbcb73be6396", "name": "network-vif-deleted", "tag": "3f7c9468-31cb-4386-b3a5-33f6f8443c1b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:49.228047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e7ea9227-fae7-4f5a-982f-128c5bd22d8a req-2a0402de-a550-4e0e-8949-527d83f5bc67 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:49.228526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e7ea9227-fae7-4f5a-982f-128c5bd22d8a req-2a0402de-a550-4e0e-8949-527d83f5bc67 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:49.229145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e7ea9227-fae7-4f5a-982f-128c5bd22d8a req-2a0402de-a550-4e0e-8949-527d83f5bc67 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:49.241393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e7ea9227-fae7-4f5a-982f-128c5bd22d8a req-2a0402de-a550-4e0e-8949-527d83f5bc67 service nova] Creating event network-vif-deleted:3f7c9468-31cb-4386-b3a5-33f6f8443c1b for instance 32804f63-7417-4456-9dcc-cbcb73be6396 on n-h1-860864-8 Oct 12 23:29:49.246973 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e7ea9227-fae7-4f5a-982f-128c5bd22d8a req-2a0402de-a550-4e0e-8949-527d83f5bc67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Oct 12 23:29:49.247581 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3489/6883] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:49.333426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:49.334064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:49.342351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:49.343120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:49.344110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:49.344937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:49.345561 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:49.345827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:49.380121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:49.380706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:49.381205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:49.381720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lazy-loading 'fault' on Instance uuid 32804f63-7417-4456-9dcc-cbcb73be6396 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:29:49.426598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:49.434819 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32dc318e-ae0f-4b4f-8278-0aee254a4634 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 200 len: 1329 microversion: 2.1 time: 0.105556 Oct 12 23:29:49.435395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3395/6884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:49 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:50.458853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:50.459493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:50.467015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:50.467511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:50.467992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:50.468694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:50.469160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:50.469599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:50.483212 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 HTTP/1.1 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '32804f63-7417-4456-9dcc-cbcb73be6396'} Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:29:50.484859 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42f2af24-01bf-45a2-990c-ebf487a8f49e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 404 len: 111 microversion: 2.1 time: 0.031781 Oct 12 23:29:50.489516 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3490/6885] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:50 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:29:50.498485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:50.499105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:50.505962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:50.506446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:50.506887 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:50.507579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:50.508067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:50.508495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:50.524448 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 HTTP/1.1 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '32804f63-7417-4456-9dcc-cbcb73be6396'} Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:29:50.526086 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-137e8ccc-fdd1-4f6a-a53e-85981b55dc12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 404 len: 111 microversion: 2.1 time: 0.032868 Oct 12 23:29:50.530728 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3396/6886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:50 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:29:50.576241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1341756432", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "1dfb41e6-ccbb-4458-9a2a-d5373fc71de1"}], "security_groups": [{"name": "tempest-securitygroup--698477333"}], "key_name": "tempest-keypair-1371574832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:50.685292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] validate_networks() for [('1dfb41e6-ccbb-4458-9a2a-d5373fc71de1', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:29:51.125909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:29:51.126486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:29:51.127060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:29:51.127528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:29:51.127991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:29:51.139801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:51.140338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:51.140788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:51.141807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:51.142279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:51.142721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:51.149269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:51.166277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:29:51.171540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for user 32d96aa156934d4c93c8e43544292992 and project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:29:51.184056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:29:51.186400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:29:51.233063 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a482f4a7-b092-44e9-8d3c-c759505e8925 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660680 Oct 12 23:29:51.233714 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3491/6887] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:29:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:29:51.245436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d9c8b1b6-a06e-4a62-adac-ec0708d3400c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:51.246052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d9c8b1b6-a06e-4a62-adac-ec0708d3400c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:51.303227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9c8b1b6-a06e-4a62-adac-ec0708d3400c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:51.313444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d9c8b1b6-a06e-4a62-adac-ec0708d3400c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1239 microversion: 2.1 time: 0.072272 Oct 12 23:29:51.314020 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3397/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:51 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:52.339146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:52.339929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:52.347064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:52.347819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:52.348373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:52.349145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:52.349691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:52.350335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:52.422692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:52.431645 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db79f148-8261-4929-a72b-3c690e5d28ed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1299 microversion: 2.1 time: 0.098066 Oct 12 23:29:52.432664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3492/6889] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:52 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:53.456859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:53.457702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:53.466385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:53.466943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:53.467380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:53.468126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:53.468574 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:53.469024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:53.598713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:53.608260 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b6ee39ad-eb5e-4dfd-91cd-f3520583caab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1364 microversion: 2.1 time: 0.155246 Oct 12 23:29:53.608842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3398/6890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:53 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:53.841533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e7e2f573-9efc-4792-adf0-0d73298d06e0 req-788c660d-6d6f-49eb-9b96-d84ccac55c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de98443f-c02a-491d-9615-d5184cf8b6c1", "tag": "3a03eecc-310e-4d8f-a7cf-1ac8438e99a5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:53.851921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e7e2f573-9efc-4792-adf0-0d73298d06e0 req-788c660d-6d6f-49eb-9b96-d84ccac55c01 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:53.852494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e7e2f573-9efc-4792-adf0-0d73298d06e0 req-788c660d-6d6f-49eb-9b96-d84ccac55c01 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:53.852951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e7e2f573-9efc-4792-adf0-0d73298d06e0 req-788c660d-6d6f-49eb-9b96-d84ccac55c01 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:53.863977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e7e2f573-9efc-4792-adf0-0d73298d06e0 req-788c660d-6d6f-49eb-9b96-d84ccac55c01 service nova] Creating event network-changed:3a03eecc-310e-4d8f-a7cf-1ac8438e99a5 for instance de98443f-c02a-491d-9615-d5184cf8b6c1 on n-h2-860864-8 Oct 12 23:29:53.869015 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e7e2f573-9efc-4792-adf0-0d73298d06e0 req-788c660d-6d6f-49eb-9b96-d84ccac55c01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087734 Oct 12 23:29:53.869622 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3493/6891] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:54.632686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:54.633306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:54.640154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:54.640673 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:54.641110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:54.641801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:54.642255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:54.642681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:54.775880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:54.783679 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3030958-f6b2-4f0f-b97a-18fdd2887851 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1364 microversion: 2.1 time: 0.155571 Oct 12 23:29:54.784273 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3399/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:54 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:55.808732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:55.809469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:55.815561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:55.816087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:55.816531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:55.817221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:55.817675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:55.818101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:55.946611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:55.954326 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db0c7679-ae82-4172-98db-c157a18f9ec2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1364 microversion: 2.1 time: 0.151396 Oct 12 23:29:55.954897 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3494/6893] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:55 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:56.977597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:56.978219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:56.984319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:56.984801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:56.985242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:56.985934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:56.986391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:56.986814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:57.116669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:57.124397 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c869f6da-9096-4550-b0e0-bb517006a45c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1364 microversion: 2.1 time: 0.151022 Oct 12 23:29:57.124970 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3400/6894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:56 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:58.148582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:58.149212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:58.152074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:58.158028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:58.158561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:58.159007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:58.159699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:58.160188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:58.160885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:58.290951 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:58.299243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8cfa827-cd27-4320-86cd-23f3ad6302e6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1364 microversion: 2.1 time: 0.155067 Oct 12 23:29:58.299824 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3495/6895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:58 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:29:58.539340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c13ce847-135d-4820-8bd7-1d250ecb730c req-d9f2874a-d191-4313-a8b5-1b7448e09077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de98443f-c02a-491d-9615-d5184cf8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "3a03eecc-310e-4d8f-a7cf-1ac8438e99a5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:29:58.545687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=51 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:29:58.551788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c13ce847-135d-4820-8bd7-1d250ecb730c req-d9f2874a-d191-4313-a8b5-1b7448e09077 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:58.552292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c13ce847-135d-4820-8bd7-1d250ecb730c req-d9f2874a-d191-4313-a8b5-1b7448e09077 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:58.552728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c13ce847-135d-4820-8bd7-1d250ecb730c req-d9f2874a-d191-4313-a8b5-1b7448e09077 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:58.564675 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c13ce847-135d-4820-8bd7-1d250ecb730c req-d9f2874a-d191-4313-a8b5-1b7448e09077 service nova] Creating event network-vif-plugged:3a03eecc-310e-4d8f-a7cf-1ac8438e99a5 for instance de98443f-c02a-491d-9615-d5184cf8b6c1 on n-h2-860864-8 Oct 12 23:29:58.569629 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c13ce847-135d-4820-8bd7-1d250ecb730c req-d9f2874a-d191-4313-a8b5-1b7448e09077 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034967 Oct 12 23:29:58.570552 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3401/6896] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:29:59.323037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:29:59.323593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:29:59.330417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:59.330911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:59.331361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:59.332094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:29:59.332563 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:29:59.333000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:29:59.459266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:29:59.467097 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-59318cfe-c088-43b1-9027-e91023ac44e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1364 microversion: 2.1 time: 0.148597 Oct 12 23:29:59.467667 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3496/6897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:29:59 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:00.492166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:00.492867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:00.499060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:00.499540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:00.500021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:00.500707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:00.501159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:00.501583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:00.630370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:00.638784 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70ecb5fa-246e-4798-8ed4-b4596864d9b1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1552 microversion: 2.1 time: 0.152488 Oct 12 23:30:00.639353 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3402/6898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:00 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:00.662501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:00.663001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:00.669749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:00.670243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:00.670689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:00.671387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:00.671852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:00.672311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:00.748701 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-011da298-b3e4-4566-9ff9-4d587d5fa4f5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090288 Oct 12 23:30:00.749312 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3497/6899] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:30:00 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:30:01.669028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f6bdb688-7313-4e21-8a83-a8ce5656fd8c req-08fcbbc7-dc64-4c26-9d58-370d1ebe4c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de98443f-c02a-491d-9615-d5184cf8b6c1", "tag": "3a03eecc-310e-4d8f-a7cf-1ac8438e99a5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:30:01.674127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:30:01.681707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f6bdb688-7313-4e21-8a83-a8ce5656fd8c req-08fcbbc7-dc64-4c26-9d58-370d1ebe4c59 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:01.682193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f6bdb688-7313-4e21-8a83-a8ce5656fd8c req-08fcbbc7-dc64-4c26-9d58-370d1ebe4c59 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:01.682628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f6bdb688-7313-4e21-8a83-a8ce5656fd8c req-08fcbbc7-dc64-4c26-9d58-370d1ebe4c59 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:01.696067 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f6bdb688-7313-4e21-8a83-a8ce5656fd8c req-08fcbbc7-dc64-4c26-9d58-370d1ebe4c59 service nova] Creating event network-changed:3a03eecc-310e-4d8f-a7cf-1ac8438e99a5 for instance de98443f-c02a-491d-9615-d5184cf8b6c1 on n-h2-860864-8 Oct 12 23:30:01.701459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f6bdb688-7313-4e21-8a83-a8ce5656fd8c req-08fcbbc7-dc64-4c26-9d58-370d1ebe4c59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036010 Oct 12 23:30:01.702076 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3403/6900] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:30:35.582885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:30:35.583753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:30:35.586556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=5 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:30:35.587216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=30 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:30:35.592416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f076c027-ed96-46de-be61-c9132b7adcde tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:30:35.602547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f076c027-ed96-46de-be61-c9132b7adcde tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:35.603036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f076c027-ed96-46de-be61-c9132b7adcde tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:35.603547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f076c027-ed96-46de-be61-c9132b7adcde tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:35.626137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f076c027-ed96-46de-be61-c9132b7adcde tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 23:30:35.667201 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f076c027-ed96-46de-be61-c9132b7adcde tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action" status: 202 len: 0 microversion: 2.1 time: 0.084806 Oct 12 23:30:35.667815 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3498/6901] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:30:35 2022] POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:30:35.675449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:30:35.676895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=41 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:30:35.680886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:35.682101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:35.690497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:35.690979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:35.691407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:35.692129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:35.692579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:35.692995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:35.830444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:35.838176 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6982909c-a954-4ff0-8269-ba7eed723a17 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.165148 Oct 12 23:30:35.838751 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3404/6902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:35 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:36.860995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:36.861712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:36.871573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:36.872107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:36.872555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:36.873262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:36.873719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:36.874156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:37.009360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:37.016994 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5cf430bc-bdca-4d88-ba86-5417c0752f82 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.160262 Oct 12 23:30:37.017565 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3499/6903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:36 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:38.039519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:38.040069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:38.047359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:38.047841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:38.048304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:38.048990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:38.049443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:38.049868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:38.181938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:38.189571 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-744a92e4-1e28-4019-81de-658bbeda7e52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.154366 Oct 12 23:30:38.190151 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3405/6904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:38 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:39.212426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:39.213056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:39.222051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:39.222550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:39.222993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:39.223691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:39.224183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:39.224620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:39.350198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:39.358431 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d75916b-e158-4028-84dd-f7e669eec6f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.149927 Oct 12 23:30:39.358993 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3500/6905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:39 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:40.382277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:40.382897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:40.392444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:40.392929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:40.393372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:40.394068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:40.394524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:40.394951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:40.528404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:40.536444 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8f1bfa8-3337-4c1e-aec0-5b4c8d411609 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.157806 Oct 12 23:30:40.536996 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3406/6906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:40 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:41.560059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:41.560720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:41.567519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:41.568049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:41.568506 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:41.569207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:41.569673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:41.570110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:41.703311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:41.711125 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22fb7868-a222-4f8f-ae93-7e676304308e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.155133 Oct 12 23:30:41.711735 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3501/6907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:41 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:42.733338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:42.733956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:42.740786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:42.741266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:42.741702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:42.742386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:42.742838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:42.743264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:42.869498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:42.877286 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a316ac8e-fbd7-4591-9475-c834e78c20a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.147876 Oct 12 23:30:42.877852 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3407/6908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:42 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:43.903188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:43.903807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:43.910570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:43.911307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:43.911743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:43.912454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:43.912911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:43.913340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:44.043197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:44.050934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b02831d7-28e8-4c6f-aeda-f206d989d6aa tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.152235 Oct 12 23:30:44.051511 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3502/6909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:43 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:45.074091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:45.074744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:45.081829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:45.082316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:45.082755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:45.083451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:45.083927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:45.084364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:45.211331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:45.218986 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7b6c9fc9-2122-47fc-b9bb-b54eae9daf7b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.148933 Oct 12 23:30:45.219547 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3408/6910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:45 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:46.242552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:46.243173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:46.250626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:46.251109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:46.251582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:46.252306 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:46.252759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:46.253188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:46.382163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:46.390355 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dbc5647f-c7c1-409f-8ccf-ef97ee32b93e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.151777 Oct 12 23:30:46.390927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3503/6911] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:46 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:47.413520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:47.414162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:47.421098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:47.421577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:47.422032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:47.422694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:47.423140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:47.423556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:47.848728 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:47.856400 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93e3e156-a809-4f2d-bd40-bde0da0ec6b0 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.447028 Oct 12 23:30:47.857003 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3409/6912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:47 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:48.879728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:48.880377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:48.887154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:48.887641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:48.888117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:48.888810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:48.889295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:48.889726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:49.018932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:49.026661 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4562928f-5d7f-4824-8a1f-ad697443f250 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.150792 Oct 12 23:30:49.027182 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3504/6913] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:48 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:50.050352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:50.050885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:50.058449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:50.058934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:50.059368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:50.060104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:50.060558 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:50.060983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:50.186261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:50.194120 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0dc9e48-d0fe-4072-a37e-0035e08a290a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.147744 Oct 12 23:30:50.194701 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3410/6914] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:50 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:51.217533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:51.218158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:51.224977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:51.225466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:51.225912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:51.226605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:51.227066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:51.227500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:51.352827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:51.360505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a2f7ef7-38bc-4cc7-8286-334dc3e79834 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1658 microversion: 2.1 time: 0.147556 Oct 12 23:30:51.361085 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3505/6915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:51 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1658 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:51.383408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:30:51.386299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:51.393060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:51.393540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:51.393982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:51.394671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:51.395125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:51.395551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:51.425798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:51.434083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Old instance type m1.heat2, new instance type m1.heat {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:30:51.440814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:30:51.441244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:30:51.441723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:30:51.442137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:30:51.442550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:30:51.505050 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1af4d6d0-7332-4059-a562-0160ba9c9b4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action" status: 202 len: 0 microversion: 2.1 time: 0.125653 Oct 12 23:30:51.505899 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3411/6916] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:30:51 2022] POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:30:51.515878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:51.517264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:51.523657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:51.523657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:51.524058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:51.524729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:51.525183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:51.525616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:51.699801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:51.708819 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-344c0d89-bb0f-4757-b748-66abece06b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.198856 Oct 12 23:30:51.709622 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3506/6917] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:51 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:52.735753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:52.736367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:52.744293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:52.745496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:52.746012 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:52.746727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:52.747188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:52.747619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:52.878110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:52.886144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-67d24795-8424-4dd6-b684-db2cbac7f4d7 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1681 microversion: 2.1 time: 0.155930 Oct 12 23:30:52.886720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3412/6918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:52 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:30:53.909437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:53.910058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:53.917918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:53.918412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:53.918855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:53.919556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:53.920058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:53.920496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:54.046744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:54.054393 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7e8ee3b4-289e-4fbb-a904-e3a356d64766 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1686 microversion: 2.1 time: 0.148830 Oct 12 23:30:54.054962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3507/6919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:53 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:55.077757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:55.078305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:55.086446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:55.086667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:55.087123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:55.088589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:55.089253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:55.089721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:55.293363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:55.300907 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b76ca6c9-b6ae-47b6-80d7-6ad8ac06bc6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1685 microversion: 2.1 time: 0.227190 Oct 12 23:30:55.301489 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3413/6920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:55 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1685 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:55.576849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-10ff46c9-ae75-4fc6-9195-a2c5d63e3b53 req-877d074d-c9ff-4e5f-808e-37ad72184cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de98443f-c02a-491d-9615-d5184cf8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "3a03eecc-310e-4d8f-a7cf-1ac8438e99a5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:30:55.586500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-10ff46c9-ae75-4fc6-9195-a2c5d63e3b53 req-877d074d-c9ff-4e5f-808e-37ad72184cfa service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:55.586992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-10ff46c9-ae75-4fc6-9195-a2c5d63e3b53 req-877d074d-c9ff-4e5f-808e-37ad72184cfa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:55.587442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-10ff46c9-ae75-4fc6-9195-a2c5d63e3b53 req-877d074d-c9ff-4e5f-808e-37ad72184cfa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:55.602900 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-10ff46c9-ae75-4fc6-9195-a2c5d63e3b53 req-877d074d-c9ff-4e5f-808e-37ad72184cfa service nova] Creating event network-vif-unplugged:3a03eecc-310e-4d8f-a7cf-1ac8438e99a5 for instance de98443f-c02a-491d-9615-d5184cf8b6c1 on n-h1-860864-8 Oct 12 23:30:55.608405 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-10ff46c9-ae75-4fc6-9195-a2c5d63e3b53 req-877d074d-c9ff-4e5f-808e-37ad72184cfa service nova] Instance de98443f-c02a-491d-9615-d5184cf8b6c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:30:55.619446 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-10ff46c9-ae75-4fc6-9195-a2c5d63e3b53 req-877d074d-c9ff-4e5f-808e-37ad72184cfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047175 Oct 12 23:30:55.620261 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3508/6921] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:30:56.325153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:56.325791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:56.332054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:56.332537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:56.332969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:56.333664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:56.334111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:56.334525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:56.550276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:56.558128 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ab5d8c4-5175-4fe9-8cf9-edc0f272d464 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1685 microversion: 2.1 time: 0.237698 Oct 12 23:30:56.558707 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3414/6922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:56 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1685 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:57.582896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:57.583607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:57.589754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:57.590248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:57.590695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:57.591391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:57.591853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:57.592312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:57.654214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ef00c2b1-c628-4b62-af10-178ebe6d770b req-02a3e76e-f12f-486b-8956-426431d07200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de98443f-c02a-491d-9615-d5184cf8b6c1", "tag": "3a03eecc-310e-4d8f-a7cf-1ac8438e99a5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:30:57.665478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ef00c2b1-c628-4b62-af10-178ebe6d770b req-02a3e76e-f12f-486b-8956-426431d07200 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:57.666034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ef00c2b1-c628-4b62-af10-178ebe6d770b req-02a3e76e-f12f-486b-8956-426431d07200 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:57.666572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ef00c2b1-c628-4b62-af10-178ebe6d770b req-02a3e76e-f12f-486b-8956-426431d07200 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:57.678282 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ef00c2b1-c628-4b62-af10-178ebe6d770b req-02a3e76e-f12f-486b-8956-426431d07200 service nova] Creating event network-changed:3a03eecc-310e-4d8f-a7cf-1ac8438e99a5 for instance de98443f-c02a-491d-9615-d5184cf8b6c1 on n-h1-860864-8 Oct 12 23:30:57.684240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-ef00c2b1-c628-4b62-af10-178ebe6d770b req-02a3e76e-f12f-486b-8956-426431d07200 service nova] Instance de98443f-c02a-491d-9615-d5184cf8b6c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:30:57.694966 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ef00c2b1-c628-4b62-af10-178ebe6d770b req-02a3e76e-f12f-486b-8956-426431d07200 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044670 Oct 12 23:30:57.695582 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3415/6923] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:30:57.735024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:57.744064 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e3d52d80-c298-427c-a689-0faac0680edc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1683 microversion: 2.1 time: 0.166245 Oct 12 23:30:57.745780 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3509/6924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:57 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:58.771699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:58.772423 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:58.778513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:58.778983 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:58.779414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:58.780127 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:58.780573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:58.780989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:58.910824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:58.920563 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f356d0f-ffeb-4592-a5fc-ffc217a5c2b2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1679 microversion: 2.1 time: 0.153859 Oct 12 23:30:58.921392 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3416/6925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:58 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:58.943263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:30:58.943822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:58.950785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:58.951282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:58.951731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:58.952456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:58.952925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:58.953358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:59.010204 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e0ce7bb-53da-4c11-bdd9-a1ea82f714fb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action" status: 204 len: 0 microversion: 2.1 time: 0.070592 Oct 12 23:30:59.010775 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3510/6926] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:30:58 2022] POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:30:59.020103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:30:59.020727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:30:59.027416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:59.027982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:59.028464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:59.029311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:59.029779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:59.030198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:59.169067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:30:59.177004 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2bef2141-20be-4286-b870-f88a2466f233 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1679 microversion: 2.1 time: 0.161994 Oct 12 23:30:59.177598 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3417/6927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:30:59 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:30:59.956931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-db41e153-cf6d-40a1-ac48-deaae0b63ded req-faaeac87-e072-484b-a4b6-9a31613f10e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de98443f-c02a-491d-9615-d5184cf8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "3a03eecc-310e-4d8f-a7cf-1ac8438e99a5"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:30:59.967269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-db41e153-cf6d-40a1-ac48-deaae0b63ded req-faaeac87-e072-484b-a4b6-9a31613f10e9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:30:59.967770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-db41e153-cf6d-40a1-ac48-deaae0b63ded req-faaeac87-e072-484b-a4b6-9a31613f10e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:30:59.968273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-db41e153-cf6d-40a1-ac48-deaae0b63ded req-faaeac87-e072-484b-a4b6-9a31613f10e9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:30:59.980784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-db41e153-cf6d-40a1-ac48-deaae0b63ded req-faaeac87-e072-484b-a4b6-9a31613f10e9 service nova] Creating event network-vif-plugged:3a03eecc-310e-4d8f-a7cf-1ac8438e99a5 for instance de98443f-c02a-491d-9615-d5184cf8b6c1 on n-h1-860864-8 Oct 12 23:30:59.986215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-db41e153-cf6d-40a1-ac48-deaae0b63ded req-faaeac87-e072-484b-a4b6-9a31613f10e9 service nova] Instance de98443f-c02a-491d-9615-d5184cf8b6c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:30:59.997646 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-db41e153-cf6d-40a1-ac48-deaae0b63ded req-faaeac87-e072-484b-a4b6-9a31613f10e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045897 Oct 12 23:30:59.998322 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3511/6928] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:31:00.199740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:00.200412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:00.207438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:00.207950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:00.208391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:00.209079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:00.209530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:00.209953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:00.350336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:00.358806 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-196f7e8b-b215-477c-adab-2e5b5d0c991f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1658 microversion: 2.1 time: 0.163082 Oct 12 23:31:00.359378 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3418/6929] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:00 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1658 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:00.381337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:00.382043 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:00.388156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:00.388644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:00.389086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:00.389776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:00.390234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:00.390663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:00.518522 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:00.526663 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-076e3319-3636-4a4a-9a34-d2c86e66e56a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1658 microversion: 2.1 time: 0.149505 Oct 12 23:31:00.527235 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3512/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:00 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1658 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:00.549598 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f559ffb1-e940-4475-a059-2b76ef27090a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:00.555549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f559ffb1-e940-4475-a059-2b76ef27090a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:00.556090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f559ffb1-e940-4475-a059-2b76ef27090a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:00.556534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f559ffb1-e940-4475-a059-2b76ef27090a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:00.572808 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:00.579464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f559ffb1-e940-4475-a059-2b76ef27090a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Going to try to start instance {{(pid=120543) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 23:31:00.621874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f559ffb1-e940-4475-a059-2b76ef27090a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action" status: 202 len: 0 microversion: 2.1 time: 0.075981 Oct 12 23:31:00.622667 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3419/6931] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:31:00 2022] POST /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:31:00.630948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:00.631665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:00.637963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:00.638460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:00.638933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:00.639606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:00.640101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:00.640545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:00.644659 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:00.781882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:00.789926 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ffc002ae-5b72-40bd-8774-20e701446a58 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1667 microversion: 2.1 time: 0.162894 Oct 12 23:31:00.790493 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3513/6932] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:00 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:31:01.814106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:01.814921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:01.822971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:01.823397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:01.823839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:01.824703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:01.825204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:01.825693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:01.954618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:01.962300 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25b1394b-767f-45bf-9497-ed99dc2ee653 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1671 microversion: 2.1 time: 0.152476 Oct 12 23:31:01.963379 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3420/6933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:01 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:01.985889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:01.986395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:01.993064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:01.993551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:01.994020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:01.994764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:01.995221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:01.995651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:02.019847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:31:02.097384 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a7c7416-5937-436b-a9e8-c7ed78c076e5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 204 len: 0 microversion: 2.1 time: 0.114935 Oct 12 23:31:02.098061 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3514/6934] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:31:01 2022] DELETE /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:31:02.106474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:02.107099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:02.113123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:02.113610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:02.114052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:02.114743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:02.115198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:02.115626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:02.247181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:02.255042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3554b355-ce3a-47e2-8f98-6f5b4d7de82d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1677 microversion: 2.1 time: 0.152491 Oct 12 23:31:02.255614 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3421/6935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:02 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:03.279238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:03.279980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:03.287124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:03.287628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:03.288119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:03.288824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:03.289289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:03.289731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:03.417453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:03.425402 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04c2a5bf-409d-4154-aaa2-140e2f5f74bb tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 200 len: 1677 microversion: 2.1 time: 0.150913 Oct 12 23:31:03.426185 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3515/6936] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:03 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:04.221568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-02add6ff-3ba1-47c0-81d3-20fdcd382801 req-fc9e6fa1-0d58-4847-a730-21fd9addf71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de98443f-c02a-491d-9615-d5184cf8b6c1", "name": "network-vif-deleted", "tag": "3a03eecc-310e-4d8f-a7cf-1ac8438e99a5"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:04.240177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-02add6ff-3ba1-47c0-81d3-20fdcd382801 req-fc9e6fa1-0d58-4847-a730-21fd9addf71d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:04.240748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-02add6ff-3ba1-47c0-81d3-20fdcd382801 req-fc9e6fa1-0d58-4847-a730-21fd9addf71d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:04.241256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-02add6ff-3ba1-47c0-81d3-20fdcd382801 req-fc9e6fa1-0d58-4847-a730-21fd9addf71d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:04.254815 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-02add6ff-3ba1-47c0-81d3-20fdcd382801 req-fc9e6fa1-0d58-4847-a730-21fd9addf71d service nova] Creating event network-vif-deleted:3a03eecc-310e-4d8f-a7cf-1ac8438e99a5 for instance de98443f-c02a-491d-9615-d5184cf8b6c1 on n-h1-860864-8 Oct 12 23:31:04.261000 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-02add6ff-3ba1-47c0-81d3-20fdcd382801 req-fc9e6fa1-0d58-4847-a730-21fd9addf71d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042624 Oct 12 23:31:04.261657 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3422/6937] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:31:04.451111 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:04.451743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:04.458848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:04.459349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:04.459793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:04.460518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:04.460975 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:04.461407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:04.474981 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 HTTP/1.1 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'de98443f-c02a-491d-9615-d5184cf8b6c1'} Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:31:04.476681 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0417a1ce-a66e-4577-8bb5-9be653141396 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 404 len: 111 microversion: 2.1 time: 0.032855 Oct 12 23:31:04.481954 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3516/6938] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:04 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:31:04.495989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:04.496703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:04.504194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:04.504683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:04.505174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:04.505876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:04.506330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:04.506759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:04.520409 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 HTTP/1.1 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'de98443f-c02a-491d-9615-d5184cf8b6c1'} Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:31:04.522113 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-139f8d10-b4e0-4f12-acf0-c5446e81e544 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 404 len: 111 microversion: 2.1 time: 0.032374 Oct 12 23:31:04.527249 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3423/6939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:04 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:31:04.572635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-245897867", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "1dfb41e6-ccbb-4458-9a2a-d5373fc71de1"}], "security_groups": [{"name": "tempest-securitygroup--698477333"}], "key_name": "tempest-keypair-1371574832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:04.678146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] validate_networks() for [('1dfb41e6-ccbb-4458-9a2a-d5373fc71de1', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:31:05.393918 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:31:05.394357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:31:05.394955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:31:05.395302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:31:05.395760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:31:05.405353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:05.405831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:05.406279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:05.407017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:05.407488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:05.407952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:05.424589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:31:05.429843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for user 32d96aa156934d4c93c8e43544292992 and project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:31:05.441904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:31:05.444342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:31:05.493464 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04e1778f-4e01-4458-a2c1-3412ba53ff47 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.924769 Oct 12 23:31:05.494487 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3517/6940] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:31:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:31:05.505905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c1fc5d0-427c-4ba2-8ce2-436f919614bd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:05.506516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c1fc5d0-427c-4ba2-8ce2-436f919614bd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:05.566647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c1fc5d0-427c-4ba2-8ce2-436f919614bd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:05.576064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c1fc5d0-427c-4ba2-8ce2-436f919614bd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1238 microversion: 2.1 time: 0.074195 Oct 12 23:31:05.576661 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3424/6941] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:05 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:31:06.600766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:06.601434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:06.604040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:06.610244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:06.610741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:06.611311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:06.612057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:06.612525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:06.612964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:06.699456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:06.707509 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-13bae33e-9d86-45e5-935d-da19b72fecb4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1296 microversion: 2.1 time: 0.111204 Oct 12 23:31:06.708299 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3518/6942] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:06 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:07.732449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:07.733233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:07.737664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=49 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:07.741781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:07.742272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:07.742737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:07.743580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:07.744992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:07.745442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:07.851993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f01904e5-f41e-4f6e-9f7b-1f2b0a52fbe4 req-c23f94ca-9880-442b-b8db-e53e61a31554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:07.866396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f01904e5-f41e-4f6e-9f7b-1f2b0a52fbe4 req-c23f94ca-9880-442b-b8db-e53e61a31554 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:07.866888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f01904e5-f41e-4f6e-9f7b-1f2b0a52fbe4 req-c23f94ca-9880-442b-b8db-e53e61a31554 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:07.867330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f01904e5-f41e-4f6e-9f7b-1f2b0a52fbe4 req-c23f94ca-9880-442b-b8db-e53e61a31554 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:07.880369 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f01904e5-f41e-4f6e-9f7b-1f2b0a52fbe4 req-c23f94ca-9880-442b-b8db-e53e61a31554 service nova] Creating event network-changed:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h2-860864-8 Oct 12 23:31:07.885427 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f01904e5-f41e-4f6e-9f7b-1f2b0a52fbe4 req-c23f94ca-9880-442b-b8db-e53e61a31554 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037195 Oct 12 23:31:07.886343 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3519/6943] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:31:07.907298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:07.915586 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e261719a-20f4-429d-aca0-b0c9969bc920 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1363 microversion: 2.1 time: 0.188531 Oct 12 23:31:07.916807 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3425/6944] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:07 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:08.941393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:08.942112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:08.948784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:08.949362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:08.950024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:08.951229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:08.951709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:08.952177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:09.121839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:09.129334 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb954e16-7539-4bd1-a468-5ede776fbbaf tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1363 microversion: 2.1 time: 0.193127 Oct 12 23:31:09.129904 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3520/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:08 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:10.153490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:10.154107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:10.161188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:10.161670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:10.162099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:10.162846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:10.163568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:10.164018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:10.294371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:10.302264 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a6ea1da-bda7-4229-9c9c-7acb83c5fab2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1363 microversion: 2.1 time: 0.153162 Oct 12 23:31:10.302822 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3426/6946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:10 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:11.326117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:11.326650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:11.333883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:11.334400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:11.334835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:11.335553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:11.336046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:11.336485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:11.474278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:11.482495 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e34cccbf-a5b0-4467-b895-c43ef1b8a477 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1363 microversion: 2.1 time: 0.160479 Oct 12 23:31:11.483084 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3521/6947] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:11 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:12.506142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:12.506756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:12.514196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:12.514676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:12.515111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:12.515800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:12.516277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:12.516699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:12.649295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:12.656921 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-926b231e-ed5c-441e-b859-8ca3242ce015 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1363 microversion: 2.1 time: 0.154658 Oct 12 23:31:12.657495 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3427/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:12 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:31:12.945689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f58ac586-a43d-4d9b-85ce-b6e18bae9473 req-67fee62c-10c9-4c73-a352-6853ed1b8ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "name": "network-vif-plugged", "status": "completed", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:12.958808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f58ac586-a43d-4d9b-85ce-b6e18bae9473 req-67fee62c-10c9-4c73-a352-6853ed1b8ce9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:12.960139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f58ac586-a43d-4d9b-85ce-b6e18bae9473 req-67fee62c-10c9-4c73-a352-6853ed1b8ce9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:12.960632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f58ac586-a43d-4d9b-85ce-b6e18bae9473 req-67fee62c-10c9-4c73-a352-6853ed1b8ce9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:12.972596 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f58ac586-a43d-4d9b-85ce-b6e18bae9473 req-67fee62c-10c9-4c73-a352-6853ed1b8ce9 service nova] Creating event network-vif-plugged:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h2-860864-8 Oct 12 23:31:12.978965 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f58ac586-a43d-4d9b-85ce-b6e18bae9473 req-67fee62c-10c9-4c73-a352-6853ed1b8ce9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036086 Oct 12 23:31:12.979595 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3522/6949] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:31:13.680348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:13.680960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:13.688444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:13.688924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:13.689354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:13.690034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:13.690478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:13.690895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:13.817025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:13.824668 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a89dc712-6d6f-4984-b1e8-40c1cca54136 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1363 microversion: 2.1 time: 0.148238 Oct 12 23:31:13.825241 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3428/6950] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:13 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:14.849099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:14.849745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:14.856515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:14.857006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:14.857448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:14.858136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:14.858594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:14.859024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:14.992189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:14.999964 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e2ee5c58-30fe-49aa-a28e-3f09012ecc8b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1550 microversion: 2.1 time: 0.156036 Oct 12 23:31:15.000538 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3523/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:14 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:15.023278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:15.023771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:15.031404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:15.031904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:15.032379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:15.033070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:15.033524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:15.033967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:15.110187 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fea9c3b5-407d-4d03-b400-cf90b189ccc9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090744 Oct 12 23:31:15.110787 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3429/6952] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:31:15 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:31:16.013750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-841ccfca-58ab-4306-aa7d-f262f7fd42c5 req-78f90e54-fff2-414a-8ac4-283e79aba94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:16.019279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:16.020066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:16.027912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-841ccfca-58ab-4306-aa7d-f262f7fd42c5 req-78f90e54-fff2-414a-8ac4-283e79aba94a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:16.028417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-841ccfca-58ab-4306-aa7d-f262f7fd42c5 req-78f90e54-fff2-414a-8ac4-283e79aba94a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:16.028866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-841ccfca-58ab-4306-aa7d-f262f7fd42c5 req-78f90e54-fff2-414a-8ac4-283e79aba94a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:16.040403 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-841ccfca-58ab-4306-aa7d-f262f7fd42c5 req-78f90e54-fff2-414a-8ac4-283e79aba94a service nova] Creating event network-changed:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h2-860864-8 Oct 12 23:31:16.046763 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-841ccfca-58ab-4306-aa7d-f262f7fd42c5 req-78f90e54-fff2-414a-8ac4-283e79aba94a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036180 Oct 12 23:31:16.047458 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3524/6953] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:31:48.888250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:48.891129 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:31:48.891279 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa/action (ip 10.222.0.20) !!! Oct 12 23:31:48.893187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=9 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:48.893843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:48.898313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:31:48.900589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:48.912071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:48.912562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:48.913005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:48.913708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:48.914168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:48.914599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:48.943340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:48.949686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Old instance type m1.heat2, new instance type m1.heat {{(pid=120543) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:31:48.956254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:31:48.956681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:31:48.957155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:31:48.957566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:31:48.957979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:31:49.021342 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-497cde9a-3021-4a4e-b111-ff5edd5609a5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa/action" status: 202 len: 0 microversion: 2.1 time: 0.133287 Oct 12 23:31:49.022102 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3430/6954] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:31:48 2022] POST /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:31:49.029047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=13 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:49.029914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:31:49.031154 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:31:49.031304 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:31:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa (ip 10.222.0.20) !!! Oct 12 23:31:49.036876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:49.037786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:49.053123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:49.053436 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:49.053913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:49.054856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:49.055398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:49.056019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:49.203514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:49.211464 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74818c9c-d099-40f8-97bb-07d0301b88ff tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1678 microversion: 2.1 time: 0.185141 Oct 12 23:31:49.212061 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3525/6955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:49 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:50.233970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:50.234608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:50.242384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:50.242872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:50.243315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:50.244048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:50.244503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:50.244931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:50.380287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:50.389259 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9951207d-f62d-4209-9f0b-4c475f977b6e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1678 microversion: 2.1 time: 0.159066 Oct 12 23:31:50.389791 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3431/6956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:50 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:51.412696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:51.413319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:51.420007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:51.420492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:51.420929 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:51.421615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:51.422100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:51.422528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:51.551505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:51.559135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c0a7cea-a4a9-43ad-8888-6c0baa1e825d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.150628 Oct 12 23:31:51.559708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3526/6957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:51 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:31:52.582515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:52.583152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:52.590067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:52.590545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:52.590979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:52.591660 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:52.592214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:52.592634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:52.725463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:52.733143 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05b87a09-d0ad-42b3-a633-271b0a03630d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.154498 Oct 12 23:31:52.733712 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3432/6958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:52 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:53.757575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:53.758223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:53.765715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:53.766206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:53.766666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:53.767360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:53.767819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:53.768278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:53.893049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:53.900717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b8aa661-400a-489c-8f8f-a38dcb7892da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.147058 Oct 12 23:31:53.901893 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3527/6959] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:53 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:54.924577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:54.925199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:54.932234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:54.933215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:54.933651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:54.934339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:54.934791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:54.935217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:55.065537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:55.074237 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fde3bd29-91e2-4a65-b40f-ca836a2eb584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.153588 Oct 12 23:31:55.074815 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3433/6960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:54 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:56.098064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:56.098724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:56.104939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:56.105461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:56.105906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:56.106605 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:56.107064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:56.107495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:56.239540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:56.247802 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11918dd7-d38c-431d-a508-c53f6897c407 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.153661 Oct 12 23:31:56.248431 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3528/6961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:56 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:57.270807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:57.271417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:57.278552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:57.279034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:57.279472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:57.280178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:57.280628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:57.281048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:57.408677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:57.416484 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41575876-3197-4551-a2f7-cbfd6569a008 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.149853 Oct 12 23:31:57.417053 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3434/6962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:57 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:58.439596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:58.440244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:58.447034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:58.447525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:58.448003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:58.448697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:58.449159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:58.449598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:58.574828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:58.582557 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd87da4d-5b38-48c2-9958-b0200ead7a9b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.146846 Oct 12 23:31:58.583124 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3529/6963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:58 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:31:59.606235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:31:59.606850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:31:59.613727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.614202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.614632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.615306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:31:59.615769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:31:59.616195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:31:59.746192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:31:59.754021 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-55fc27ec-538d-4e2a-87eb-f726f44fafdc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.151707 Oct 12 23:31:59.754597 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3435/6964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:31:59 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:00.778196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:00.778737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:00.787053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:00.787542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:00.788023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:00.788724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:00.789186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:00.789623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:00.916281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:00.924531 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-459a2063-1c8e-4acf-a855-d99876d18842 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.150964 Oct 12 23:32:00.925112 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3530/6965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:00 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:01.947192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:01.947807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:01.955335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:01.955810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:01.956264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:01.956971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:01.957417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:01.957833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:02.086493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:02.094854 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-300b4f30-bc8b-4b1a-8f42-924227d7bf8e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.151584 Oct 12 23:32:02.095431 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3436/6966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:01 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:03.118525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:03.119151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:03.125967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:03.126389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:03.126834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:03.127530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:03.128020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:03.128437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:03.258594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:03.266152 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14b1faa3-5d7b-47b3-811e-df2886083cb9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.151550 Oct 12 23:32:03.266724 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3531/6967] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:03 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:04.289740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:04.290355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:04.297686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:04.298167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:04.298605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:04.299292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:04.299743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:04.300195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:04.434043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:04.441759 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27d4d671-38a2-43e3-811e-2d05445e1b56 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.156206 Oct 12 23:32:04.442330 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3437/6968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:04 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:05.465104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:05.465655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:05.472620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:05.473162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:05.473613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:05.474391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:05.474946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:05.475351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:05.602006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:05.610216 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0d2ba64e-5c04-46f7-8d61-98ab0c12abee tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.149116 Oct 12 23:32:05.610787 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3532/6969] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:05 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:06.633970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:06.634583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:06.641971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:06.642453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:06.642893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:06.643576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:06.644063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:06.644488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:06.772753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:06.780537 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb61bad8-5ca6-42c9-a72c-92e39115c28c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.150470 Oct 12 23:32:06.781108 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3438/6970] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:06 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:07.803946 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:07.804584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:07.812165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:07.812641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:07.813089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:07.813784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:07.814248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:07.814682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:07.944591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:07.952226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c15e90b-0135-47ad-98e1-e8b97177419c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1683 microversion: 2.1 time: 0.152214 Oct 12 23:32:07.952829 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3533/6971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:07 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:08.602783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b000b1a6-b707-4103-bb28-edc4c7ea9d93 req-928df699-7fbd-42ac-8bc0-010a8d81d5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "name": "network-vif-unplugged", "status": "completed", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:08.613339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b000b1a6-b707-4103-bb28-edc4c7ea9d93 req-928df699-7fbd-42ac-8bc0-010a8d81d5d2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:08.613830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b000b1a6-b707-4103-bb28-edc4c7ea9d93 req-928df699-7fbd-42ac-8bc0-010a8d81d5d2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:08.614317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b000b1a6-b707-4103-bb28-edc4c7ea9d93 req-928df699-7fbd-42ac-8bc0-010a8d81d5d2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:08.626737 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b000b1a6-b707-4103-bb28-edc4c7ea9d93 req-928df699-7fbd-42ac-8bc0-010a8d81d5d2 service nova] Creating event network-vif-unplugged:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h1-860864-8 Oct 12 23:32:08.632381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-b000b1a6-b707-4103-bb28-edc4c7ea9d93 req-928df699-7fbd-42ac-8bc0-010a8d81d5d2 service nova] Instance d7842e61-77b3-4218-9818-9fec839240fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:32:08.643617 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b000b1a6-b707-4103-bb28-edc4c7ea9d93 req-928df699-7fbd-42ac-8bc0-010a8d81d5d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044640 Oct 12 23:32:08.644266 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3439/6972] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:32:08.974754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:08.975413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:08.982761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:08.983253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:08.984089 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:08.984818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:08.985278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:08.986038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:09.126105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:09.134083 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-462738c1-b120-4baf-b4ed-221101055eb2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1682 microversion: 2.1 time: 0.163238 Oct 12 23:32:09.134776 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3534/6973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:08 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:10.159074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:10.159818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:10.166932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:10.167418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:10.167858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:10.168578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:10.169034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:10.169462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:10.300194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:10.308726 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8eae3b3a-f9dd-4ce4-9ecd-d06ef980c218 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1680 microversion: 2.1 time: 0.154920 Oct 12 23:32:10.309305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3440/6974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:10 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:10.968052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c87f4da7-4bf6-4cff-80ef-730d4ec12b18 req-6072363e-82bd-40bc-bffe-037dbeeca069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:10.977948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c87f4da7-4bf6-4cff-80ef-730d4ec12b18 req-6072363e-82bd-40bc-bffe-037dbeeca069 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:10.978420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c87f4da7-4bf6-4cff-80ef-730d4ec12b18 req-6072363e-82bd-40bc-bffe-037dbeeca069 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:10.978858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c87f4da7-4bf6-4cff-80ef-730d4ec12b18 req-6072363e-82bd-40bc-bffe-037dbeeca069 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:10.990358 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c87f4da7-4bf6-4cff-80ef-730d4ec12b18 req-6072363e-82bd-40bc-bffe-037dbeeca069 service nova] Creating event network-changed:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h1-860864-8 Oct 12 23:32:10.996061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-c87f4da7-4bf6-4cff-80ef-730d4ec12b18 req-6072363e-82bd-40bc-bffe-037dbeeca069 service nova] Instance d7842e61-77b3-4218-9818-9fec839240fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:32:11.007120 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c87f4da7-4bf6-4cff-80ef-730d4ec12b18 req-6072363e-82bd-40bc-bffe-037dbeeca069 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043362 Oct 12 23:32:11.007919 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3535/6975] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:32:11.332593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:11.333288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:11.350435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:11.351249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:11.351691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:11.352496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:11.353120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:11.353551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:11.564681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:11.573536 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98d8aaad-7ed0-48b5-93c7-070b61774f4b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1680 microversion: 2.1 time: 0.244577 Oct 12 23:32:11.574338 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3441/6976] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:11 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:12.598615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:12.599320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:12.605409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.605896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.606338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.607027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.607480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.607927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.739650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:12.747856 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3a9d211-a0d0-49e2-8066-58fb55b200f4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1677 microversion: 2.1 time: 0.154398 Oct 12 23:32:12.748464 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3536/6977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:12 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:12.770933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:12.771321 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:12.777937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.778409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.778851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.779555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.780019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.780437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.816621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.817089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.817518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.818228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.818669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.819090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.841587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:32:12.846984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for user 32d96aa156934d4c93c8e43544292992 and project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:32:12.925051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:12.946589 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-481424cb-2691-4e72-b911-b93a2c868257 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa/action" status: 202 len: 0 microversion: 2.1 time: 0.179605 Oct 12 23:32:12.947376 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3442/6978] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:32:12 2022] POST /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:32:12.955821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:12.956496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:12.962869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.963365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.963815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:12.964715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:12.965193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:12.965709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:13.096035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:13.104421 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ca6d075-705a-4acd-9df5-7e8623a4b6a4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1676 microversion: 2.1 time: 0.151854 Oct 12 23:32:13.105002 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3537/6979] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:12 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:14.129322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:14.130029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:14.137177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:14.137659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:14.138094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:14.138783 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:14.139232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:14.139662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:14.275446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:14.283739 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-58de548b-2d18-4e43-8d54-6d80edb1ff79 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1676 microversion: 2.1 time: 0.159561 Oct 12 23:32:14.284334 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3443/6980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:14 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:15.307486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:15.308903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:15.316047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:15.316616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:15.317991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:15.318711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:15.319690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:15.320145 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:15.465132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:15.473258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-246a669e-41bb-40cf-b094-e8e21ce1be6c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1676 microversion: 2.1 time: 0.170179 Oct 12 23:32:15.473836 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3538/6981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:15 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:16.403058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7c7f487a-a3f1-4729-8c42-16d58ae96e39 req-2b4e7143-dad5-4401-b9d5-4d68816a73c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:16.415384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7c7f487a-a3f1-4729-8c42-16d58ae96e39 req-2b4e7143-dad5-4401-b9d5-4d68816a73c3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:16.415865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7c7f487a-a3f1-4729-8c42-16d58ae96e39 req-2b4e7143-dad5-4401-b9d5-4d68816a73c3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:16.417076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7c7f487a-a3f1-4729-8c42-16d58ae96e39 req-2b4e7143-dad5-4401-b9d5-4d68816a73c3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:16.429668 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7c7f487a-a3f1-4729-8c42-16d58ae96e39 req-2b4e7143-dad5-4401-b9d5-4d68816a73c3 service nova] Creating event network-changed:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h2-860864-8 Oct 12 23:32:16.436923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-7c7f487a-a3f1-4729-8c42-16d58ae96e39 req-2b4e7143-dad5-4401-b9d5-4d68816a73c3 service nova] Instance d7842e61-77b3-4218-9818-9fec839240fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:32:16.447665 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7c7f487a-a3f1-4729-8c42-16d58ae96e39 req-2b4e7143-dad5-4401-b9d5-4d68816a73c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051042 Oct 12 23:32:16.448334 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3444/6982] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:32:16.497230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:16.497867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:16.505373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:16.505881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:16.506359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:16.507057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:16.516510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:16.517069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:16.719150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:16.728098 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b38f65d-a2e4-4b0e-9e78-6ca1a3a4c7a9 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1676 microversion: 2.1 time: 0.234988 Oct 12 23:32:16.729374 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3539/6983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:16 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:17.753211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:17.753932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:17.760155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:17.760640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:17.761075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:17.761763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:17.762215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:17.762639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:17.891458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:17.899168 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ad2a9ac-d7c9-46aa-9874-f50d26a8141a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1676 microversion: 2.1 time: 0.151153 Oct 12 23:32:17.899734 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3445/6984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:17 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:18.921862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:18.922494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:18.930241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:18.930740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:18.931192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:18.931931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:18.932407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:18.933352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.064788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:19.072542 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26e168a3-8f33-487d-b698-b92484fd846b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1669 microversion: 2.1 time: 0.154593 Oct 12 23:32:19.073582 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3540/6985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:18 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:19.096084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:19.096698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:19.099479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:19.105894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.106393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.106830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.107518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.107989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.108410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.240931 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:19.248646 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7b3adf3b-333a-4273-b372-cfc1f2d8e3e4 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1669 microversion: 2.1 time: 0.156904 Oct 12 23:32:19.249231 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3446/6986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:19 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:19.271431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:19.272091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:19.275028 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=33 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:19.279341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.279836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.280382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.281082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.281547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.281985 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.285094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:19.417983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:19.425655 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e916a6fa-62b7-4733-b310-f0973b12c488 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1669 microversion: 2.1 time: 0.158060 Oct 12 23:32:19.426233 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3541/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:19 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:19.447922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:19.449025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:19.455227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.455994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.456464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.457151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.457622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.458030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.484257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:32:19.563463 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4463cf6c-c817-4c14-a1ff-dd23011b4838 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 204 len: 0 microversion: 2.1 time: 0.119040 Oct 12 23:32:19.567754 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3447/6988] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:32:19 2022] DELETE /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:32:19.574033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:19.574838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:19.582193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.582696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.583144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.583850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:19.584361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:19.584799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:19.712386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:19.720027 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7dbd695a-b475-4225-b568-5e7925c47729 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1675 microversion: 2.1 time: 0.151038 Oct 12 23:32:19.720600 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3542/6989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:19 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:20.743505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:20.744229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:20.751017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:20.751490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:20.752062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:20.752742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:20.753187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:20.753602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:20.887640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:20.895545 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8f6ea55-c630-4e9a-89f7-ff46eedd11fc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1675 microversion: 2.1 time: 0.156094 Oct 12 23:32:20.900672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3448/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:20 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:21.194391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c8e2036c-a1d8-4d47-870e-eed73f98af70 req-1c47903a-350f-4cee-b4fa-801ed1ffafc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "name": "network-vif-plugged", "status": "completed", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:21.208841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c8e2036c-a1d8-4d47-870e-eed73f98af70 req-1c47903a-350f-4cee-b4fa-801ed1ffafc5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:21.209532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c8e2036c-a1d8-4d47-870e-eed73f98af70 req-1c47903a-350f-4cee-b4fa-801ed1ffafc5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:21.210157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c8e2036c-a1d8-4d47-870e-eed73f98af70 req-1c47903a-350f-4cee-b4fa-801ed1ffafc5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:21.223617 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c8e2036c-a1d8-4d47-870e-eed73f98af70 req-1c47903a-350f-4cee-b4fa-801ed1ffafc5 service nova] Creating event network-vif-plugged:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h2-860864-8 Oct 12 23:32:21.229171 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c8e2036c-a1d8-4d47-870e-eed73f98af70 req-1c47903a-350f-4cee-b4fa-801ed1ffafc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038628 Oct 12 23:32:21.230458 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3543/6991] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:32:21.712981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-502166fc-b8cd-4687-8f3d-25125e7cfc7b req-fffa966a-1f5c-4054-a6ee-486ad10d1558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7842e61-77b3-4218-9818-9fec839240fa", "name": "network-vif-deleted", "tag": "3d0c7844-c52c-4f07-bd75-28fedffe1ea0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:21.732837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-502166fc-b8cd-4687-8f3d-25125e7cfc7b req-fffa966a-1f5c-4054-a6ee-486ad10d1558 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:21.733523 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-502166fc-b8cd-4687-8f3d-25125e7cfc7b req-fffa966a-1f5c-4054-a6ee-486ad10d1558 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:21.734272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-502166fc-b8cd-4687-8f3d-25125e7cfc7b req-fffa966a-1f5c-4054-a6ee-486ad10d1558 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:21.751258 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-502166fc-b8cd-4687-8f3d-25125e7cfc7b req-fffa966a-1f5c-4054-a6ee-486ad10d1558 service nova] Creating event network-vif-deleted:3d0c7844-c52c-4f07-bd75-28fedffe1ea0 for instance d7842e61-77b3-4218-9818-9fec839240fa on n-h2-860864-8 Oct 12 23:32:21.756042 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-502166fc-b8cd-4687-8f3d-25125e7cfc7b req-fffa966a-1f5c-4054-a6ee-486ad10d1558 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047319 Oct 12 23:32:21.757309 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3449/6992] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:32:21.921990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:21.922796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:21.928949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:21.929446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:21.929895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:21.930594 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:21.931058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:21.931523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:21.962793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:21.963199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:21.963646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:21.964638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lazy-loading 'fault' on Instance uuid d7842e61-77b3-4218-9818-9fec839240fa {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:32:22.011399 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:22.019724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b963ac6-5520-488b-8417-2da87489fa12 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 200 len: 1328 microversion: 2.1 time: 0.102521 Oct 12 23:32:22.020355 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3544/6993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:21 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:23.041616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:23.045871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:23.046605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:23.052986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:23.053467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:23.053904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:23.054589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:23.055038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:23.055470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:23.068547 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa HTTP/1.1 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'd7842e61-77b3-4218-9818-9fec839240fa'} Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:32:23.070160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56f7089b-f692-46f3-a31e-3a9e740ac9d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 404 len: 111 microversion: 2.1 time: 0.031852 Oct 12 23:32:23.075316 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3450/6994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:23 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:32:23.088745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:23.090039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:23.096939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:23.097461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:23.097906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:23.098644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:23.099106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:23.099542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:23.112728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa HTTP/1.1 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd7842e61-77b3-4218-9818-9fec839240fa'} Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:32:23.114370 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-65af5535-7819-45ad-b44a-3c0b60b9c681 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 404 len: 111 microversion: 2.1 time: 0.031220 Oct 12 23:32:23.118406 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3545/6995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:23 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:32:23.165443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-263305610", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "1dfb41e6-ccbb-4458-9a2a-d5373fc71de1"}], "security_groups": [{"name": "tempest-securitygroup--698477333"}], "key_name": "tempest-keypair-1371574832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:23.271827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] validate_networks() for [('1dfb41e6-ccbb-4458-9a2a-d5373fc71de1', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:32:23.719034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:32:23.719463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:32:23.719980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:32:23.720394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:32:23.720809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:32:23.729955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:23.730439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:23.730877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:23.731609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:23.732178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:23.733078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:23.750088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:32:23.755252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for user 32d96aa156934d4c93c8e43544292992 and project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:32:23.767602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:32:23.769961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:32:23.816874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb92cab0-9cc4-4a7b-b451-19bcf895dfb6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.655538 Oct 12 23:32:23.817544 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3451/6996] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:32:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:32:23.828828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5842699a-a47f-44df-b9ea-a55076bbd505 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:23.829488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5842699a-a47f-44df-b9ea-a55076bbd505 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:23.882580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5842699a-a47f-44df-b9ea-a55076bbd505 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:23.889545 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5842699a-a47f-44df-b9ea-a55076bbd505 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1238 microversion: 2.1 time: 0.064625 Oct 12 23:32:23.890139 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3546/6997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:23 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:24.912871 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:24.913517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:24.921367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:24.921928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:24.922441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:24.923132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:24.923579 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:24.924054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:25.017244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:25.025181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80a6c2a9-4b45-485a-a389-2f336209282c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1296 microversion: 2.1 time: 0.116460 Oct 12 23:32:25.025874 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3452/6998] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:24 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:26.051431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:26.052774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:26.058678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:26.059173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:26.059645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:26.060371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:26.060825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:26.061252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:26.148682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4f97de83-43fc-4720-9b31-14a884da08ba req-b7e89be2-318c-4b22-abd9-bb9ba4d9060b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:26.165965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f97de83-43fc-4720-9b31-14a884da08ba req-b7e89be2-318c-4b22-abd9-bb9ba4d9060b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:26.166466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f97de83-43fc-4720-9b31-14a884da08ba req-b7e89be2-318c-4b22-abd9-bb9ba4d9060b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:26.167115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f97de83-43fc-4720-9b31-14a884da08ba req-b7e89be2-318c-4b22-abd9-bb9ba4d9060b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:26.189996 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4f97de83-43fc-4720-9b31-14a884da08ba req-b7e89be2-318c-4b22-abd9-bb9ba4d9060b service nova] Creating event network-changed:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h1-860864-8 Oct 12 23:32:26.195645 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4f97de83-43fc-4720-9b31-14a884da08ba req-b7e89be2-318c-4b22-abd9-bb9ba4d9060b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050621 Oct 12 23:32:26.196305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3453/6999] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:32:26.529377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:26.537382 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9e78c82-1071-4e1f-b0c5-968823592b13 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1363 microversion: 2.1 time: 0.490576 Oct 12 23:32:26.537950 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3547/7000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:26 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1363 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:27.561916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:27.562614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:27.569719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:27.570196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:27.570627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:27.571307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:27.571758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:27.572206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:28.095656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:28.103426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f5220f5-1fd8-4950-8cfc-3a2714a13090 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1363 microversion: 2.1 time: 0.545682 Oct 12 23:32:28.104029 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3454/7001] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:27 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1363 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:29.127632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:29.128349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:29.135169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:29.135635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:29.136112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:29.136802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:29.137261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:29.138148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:29.265122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:29.272768 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ee616e68-e08b-4e01-9003-3a81ff916797 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1363 microversion: 2.1 time: 0.149054 Oct 12 23:32:29.273335 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3548/7002] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:29 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:30.297395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:30.298013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:30.304756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:30.305234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:30.305693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:30.306373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:30.306817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:30.307233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:30.438513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:30.446353 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-797c7566-f996-4ae6-94bb-5f09dd0b1e05 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1363 microversion: 2.1 time: 0.152794 Oct 12 23:32:30.446946 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3455/7003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:30 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:32:31.470114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:31.470748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:31.477674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:31.478166 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:31.478607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:31.479859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:31.480357 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:31.480790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:31.609013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:31.616721 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bdee08be-2d84-4e18-8bf3-1c65363c0bea tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1363 microversion: 2.1 time: 0.150575 Oct 12 23:32:31.617287 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3549/7004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:31 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:32.378894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b0093623-f3ae-476b-a6cf-65b7ca9a4d08 req-d90fe631-84ac-4497-a840-f64655d96072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "name": "network-vif-plugged", "status": "completed", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:32.390159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b0093623-f3ae-476b-a6cf-65b7ca9a4d08 req-d90fe631-84ac-4497-a840-f64655d96072 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:32.390650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b0093623-f3ae-476b-a6cf-65b7ca9a4d08 req-d90fe631-84ac-4497-a840-f64655d96072 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:32.391761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b0093623-f3ae-476b-a6cf-65b7ca9a4d08 req-d90fe631-84ac-4497-a840-f64655d96072 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:32.403705 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b0093623-f3ae-476b-a6cf-65b7ca9a4d08 req-d90fe631-84ac-4497-a840-f64655d96072 service nova] Creating event network-vif-plugged:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h1-860864-8 Oct 12 23:32:32.408947 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b0093623-f3ae-476b-a6cf-65b7ca9a4d08 req-d90fe631-84ac-4497-a840-f64655d96072 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033639 Oct 12 23:32:32.409606 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3456/7005] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:32:32.640504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:32.641137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:32.647942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:32.648441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:32.648889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:32.649587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:32.650051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:32.650486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:32.780163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:32.788139 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1b1211b-bac2-4fec-8982-b44bbb15715d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1363 microversion: 2.1 time: 0.151535 Oct 12 23:32:32.788713 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3550/7006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:32 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:33.811267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:33.811981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:33.815054 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:33.815707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:33.822476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:33.822987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:33.823428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:33.824179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:33.824634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:33.825059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:33.951733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:32:33.959495 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a79c4a91-f49e-438e-ac21-6352b400266f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1551 microversion: 2.1 time: 0.152570 Oct 12 23:32:33.960094 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3457/7007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:32:33 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:32:33.983743 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:32:33.984362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:32:33.987014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:32:33.992440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:33.992934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:33.993375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:33.994068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:33.994524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:33.995026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:34.069884 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86dfa4f8-2e25-41cd-84df-b42c3e26ae4d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090570 Oct 12 23:32:34.070485 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3551/7008] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:32:33 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:32:34.975305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5abc3aba-ba72-43ce-8622-60052b91c995 req-302c1c6c-7a13-4611-bcca-3d79241471ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:32:34.985953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5abc3aba-ba72-43ce-8622-60052b91c995 req-302c1c6c-7a13-4611-bcca-3d79241471ba service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:32:34.986424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5abc3aba-ba72-43ce-8622-60052b91c995 req-302c1c6c-7a13-4611-bcca-3d79241471ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:32:34.986856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5abc3aba-ba72-43ce-8622-60052b91c995 req-302c1c6c-7a13-4611-bcca-3d79241471ba service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:32:34.998905 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5abc3aba-ba72-43ce-8622-60052b91c995 req-302c1c6c-7a13-4611-bcca-3d79241471ba service nova] Creating event network-changed:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h1-860864-8 Oct 12 23:32:35.003951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5abc3aba-ba72-43ce-8622-60052b91c995 req-302c1c6c-7a13-4611-bcca-3d79241471ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Oct 12 23:32:35.004560 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3458/7009] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:33:06.837026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=25 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:06.837840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=51 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:06.842905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:06.843537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:06.850220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:06.850717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:06.851175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:06.851883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:06.852374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:06.852815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:06.984255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:06.992004 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b442e11e-7270-438d-a9ae-08bb83b2dce3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1670 microversion: 2.1 time: 0.157019 Oct 12 23:33:06.992585 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3552/7010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:06 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:07.012755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:07.013681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:07.018143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5153e5d4-3b50-4bd2-9cd3-27b7cea5d2f2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:07.020585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:07.028718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:07.029226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:07.029782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:07.030466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:07.030911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:07.031328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:07.270138 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-235fc17e-3b67-4ed4-ad93-e249385de8dd tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259953 Oct 12 23:33:07.271072 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3459/7011] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:33:07 2022] POST /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:33:17.985107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:17.987418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:17.990191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:17.990857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:17.996205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:17.996690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:17.997134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:17.997822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:17.998274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:17.998696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:18.026034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:18.032029 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Old instance type m1.heat2, new instance type m1.heat {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:33:18.039165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:33:18.039616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:33:18.040126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:33:18.040561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:33:18.040959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:33:18.102933 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-970d46f7-46dd-4939-bbaa-b604907ef3c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/action" status: 202 len: 0 microversion: 2.1 time: 0.122296 Oct 12 23:33:18.103540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3553/7012] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:33:17 2022] POST /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:33:18.110420 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:18.111183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:18.116011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:18.116422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:18.123996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:18.124545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:18.125053 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:18.125801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:18.126288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:18.126819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:18.264732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:18.273173 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d6b8c7c-a750-4724-b7e5-69ec7a62521a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1725 microversion: 2.1 time: 0.164661 Oct 12 23:33:18.273970 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3460/7013] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:18 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:19.297688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:19.298288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:19.305300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:19.305815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:19.306247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:19.306947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:19.307408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:19.308065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:19.439853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:19.448239 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a24c8929-d14d-47ce-ad4a-1e0e452e5cc1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1725 microversion: 2.1 time: 0.155457 Oct 12 23:33:19.448813 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3554/7014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:19 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:20.473082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:20.473696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:20.480595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:20.481668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:20.482102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:20.482786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:20.483256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:20.483674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:20.616020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:20.625241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b2076d7-3e85-46c7-8266-51639591b02d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.156417 Oct 12 23:33:20.625858 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3461/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:20 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:21.649438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:21.650098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:21.656843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:21.657339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:21.657788 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:21.658482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:21.658943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:21.659387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:21.793588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:21.801989 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b73ddbc-6b45-4022-bd0b-bcb2e8ab3cfe tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.156465 Oct 12 23:33:21.802561 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3555/7016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:21 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:22.825807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:22.826431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:22.833596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:22.834079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:22.834543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:22.835287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:22.835748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:22.836205 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:22.967818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:22.976062 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0aa7b788-3e00-4b84-a751-ca4ff068959b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.154129 Oct 12 23:33:22.976639 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3462/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:22 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:23.998841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:23.999473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:24.006298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:24.006784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:24.007227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:24.007937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:24.008400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:24.008831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:24.138370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:24.146609 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7042fdf6-fcc0-48da-81c7-237bd6ab59cc tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.151797 Oct 12 23:33:24.147187 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3556/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:23 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:25.170862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:25.171475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:25.178373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:25.178850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:25.179285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:25.179998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:25.180445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:25.180863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:25.311155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:25.319424 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0da4bd0d-54e9-43dc-8017-d8bfdbd94028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.152988 Oct 12 23:33:25.320026 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3463/7019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:25 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:26.343000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:26.343920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:26.350175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:26.350669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:26.351121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:26.351819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:26.352320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:26.352759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:26.483513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:26.491785 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4f2ed22f-36a2-4be5-9eff-ad8dfb7356db tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.152758 Oct 12 23:33:26.492398 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3557/7020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:26 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:27.515226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:27.515767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:27.522411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:27.522890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:27.523371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:27.524048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:27.524500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:27.524923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:27.660616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:27.669053 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2e506d08-a0db-4864-86f1-fb48e2a17444 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.158286 Oct 12 23:33:27.669634 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3464/7021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:27 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:28.691809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:28.692502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:28.699313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:28.699798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:28.700278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:28.700969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:28.701465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:28.701892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:28.830768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:28.839012 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ba01d028-14b0-4d7b-85ec-cd2013114e81 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.151223 Oct 12 23:33:28.839591 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3558/7022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:28 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:29.862855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:29.863471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:29.871075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:29.871555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:29.872033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:29.872726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:29.873210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:29.873635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:29.999916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:30.008072 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e875174-613f-4574-a9f7-fd5bfccd79ce tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.149108 Oct 12 23:33:30.008645 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3465/7023] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:29 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:31.031332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:31.031936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:31.039663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:31.040186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:31.040637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:31.041341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:31.041806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:31.042240 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:31.170891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:31.179408 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec7834c6-a654-498a-aaf0-1ce442c02294 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.152077 Oct 12 23:33:31.180001 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3559/7024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:31 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:32.203694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:32.204338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:32.211225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:32.211708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:32.212198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:32.212890 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:32.213346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:32.213772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:32.340252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:32.348327 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec2a10c5-015c-4b93-a2d8-eb132b01e0da tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.149131 Oct 12 23:33:32.348896 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3466/7025] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:32 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:33.371277 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:33.371924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:33.378764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:33.379261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:33.379712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:33.380444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:33.380916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:33.381355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:33.515557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:33.523965 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b07d039f-d774-488d-a7dc-390fe7684ce5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.156602 Oct 12 23:33:33.524539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3560/7026] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:33 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:34.547700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:34.548342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:34.555119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:34.555593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:34.556066 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:34.556748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:34.557210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:34.557613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:34.687726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:34.695911 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1af3509a-911e-4b72-8b55-a52c322c0b5e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.152847 Oct 12 23:33:34.696498 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3467/7027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:34 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:35.719770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:35.720335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:35.727180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:35.727679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:35.728159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:35.728863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:35.729335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:35.729771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:35.857941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:35.866131 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ad0605b-373a-44af-bdf0-9f0dcd070d0f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.150331 Oct 12 23:33:35.866709 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3561/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:35 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:36.890035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:36.890652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:36.897713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:36.898197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:36.898634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:36.899320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:36.899772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:36.900229 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:37.028077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:37.036210 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b7809a9c-c754-4226-8e3d-ac68aa9dc1d5 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.150718 Oct 12 23:33:37.037044 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3468/7029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:36 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:38.060740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:38.061292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:38.068062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:38.068552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:38.068992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:38.069685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:38.070144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:38.070575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:38.202875 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:38.211072 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-118fbc96-68c9-45d6-937b-a3fcaab5c39c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.155027 Oct 12 23:33:38.211648 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3562/7030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:38 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:39.235965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:39.236608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:39.243313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:39.243787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:39.244259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:39.244938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:39.245383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:39.245803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:39.377001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:39.385485 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1819ad32-7385-4aa6-8235-752a84040b89 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.154537 Oct 12 23:33:39.386062 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3469/7031] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:39 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:40.462524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:40.463152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:40.469143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:40.469634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:40.470102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:40.470797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:40.471259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:40.471694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:40.598941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:40.607651 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c67654f2-771f-46ef-a279-7c5dc4b1a0a3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.203102 Oct 12 23:33:40.608261 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3563/7032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:40 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:41.632325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:41.632978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:41.639614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:41.640151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:41.640585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:41.641286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:41.641881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:41.642253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:41.820413 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:41.828724 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aa051d96-6cb8-49ff-9a36-0f88c32d37d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.200824 Oct 12 23:33:41.829311 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3470/7033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:41 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:42.852723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:42.853352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:42.860795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:42.861291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:42.861738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:42.862439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:42.862899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:42.863331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:43.042008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:43.051071 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c97b1a3-208b-4103-9f72-6cdfef1558c6 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1730 microversion: 2.1 time: 0.202297 Oct 12 23:33:43.051649 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3564/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:42 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:44.074556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:44.075689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:44.082556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:44.083038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:44.083473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:44.084194 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:44.084643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:44.085064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:44.174406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-93a76ecf-755a-4b20-ad65-27fed75c2542 req-38811560-ebb9-45e5-aed7-f8edc117f9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "name": "network-vif-unplugged", "status": "completed", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:44.188135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93a76ecf-755a-4b20-ad65-27fed75c2542 req-38811560-ebb9-45e5-aed7-f8edc117f9ed service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:44.189245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93a76ecf-755a-4b20-ad65-27fed75c2542 req-38811560-ebb9-45e5-aed7-f8edc117f9ed service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:44.189916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-93a76ecf-755a-4b20-ad65-27fed75c2542 req-38811560-ebb9-45e5-aed7-f8edc117f9ed service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:44.204256 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-93a76ecf-755a-4b20-ad65-27fed75c2542 req-38811560-ebb9-45e5-aed7-f8edc117f9ed service nova] Creating event network-vif-unplugged:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h2-860864-8 Oct 12 23:33:44.210333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-93a76ecf-755a-4b20-ad65-27fed75c2542 req-38811560-ebb9-45e5-aed7-f8edc117f9ed service nova] Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:33:44.222388 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-93a76ecf-755a-4b20-ad65-27fed75c2542 req-38811560-ebb9-45e5-aed7-f8edc117f9ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051762 Oct 12 23:33:44.223642 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3565/7035] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:33:44.231806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:44.240430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f8116c82-415c-426c-a7fa-4fb4b284040c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1729 microversion: 2.1 time: 0.169856 Oct 12 23:33:44.241346 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3471/7036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:44 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:45.266430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:45.267146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:45.273339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:45.273832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:45.274276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:45.274974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:45.275431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:45.275865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:45.438493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:45.446733 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b5bc409-4af7-4410-85c6-70d4acd32028 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1729 microversion: 2.1 time: 0.186096 Oct 12 23:33:45.447600 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3566/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:45 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:46.261611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-38b7f957-c833-4632-bee8-f5bf39dd1829 req-6b008864-8605-4457-b459-d96f9e134630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:46.271865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-38b7f957-c833-4632-bee8-f5bf39dd1829 req-6b008864-8605-4457-b459-d96f9e134630 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:46.272372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-38b7f957-c833-4632-bee8-f5bf39dd1829 req-6b008864-8605-4457-b459-d96f9e134630 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:46.272799 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-38b7f957-c833-4632-bee8-f5bf39dd1829 req-6b008864-8605-4457-b459-d96f9e134630 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:46.284910 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-38b7f957-c833-4632-bee8-f5bf39dd1829 req-6b008864-8605-4457-b459-d96f9e134630 service nova] Creating event network-changed:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h2-860864-8 Oct 12 23:33:46.290491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-38b7f957-c833-4632-bee8-f5bf39dd1829 req-6b008864-8605-4457-b459-d96f9e134630 service nova] Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:33:46.303124 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-38b7f957-c833-4632-bee8-f5bf39dd1829 req-6b008864-8605-4457-b459-d96f9e134630 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044933 Oct 12 23:33:46.303920 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3472/7038] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:33:46.473520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:46.474795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:46.484575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:46.485343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:46.485967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:46.487049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:46.487677 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:46.488678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:46.714536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:46.729482 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c69fa69b-bca1-4e61-afc1-ef8ea2fc745b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.261250 Oct 12 23:33:46.741014 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3567/7039] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:46 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:47.756933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:47.758303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:47.767694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:47.768291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:47.768759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:47.770072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:47.770771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:47.771204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:47.903539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:47.912023 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-689bf25d-5fb3-4781-b849-12873aef4b65 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.160037 Oct 12 23:33:47.912600 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3473/7040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:47 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:48.936609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:48.937238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:48.940136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=35 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:48.945504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:48.946000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:48.946444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:48.947154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:48.947616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:48.948084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:48.951559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:49.085524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:49.094186 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22ab408b-7f24-4b92-b8c3-c03a2ebc979f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.161525 Oct 12 23:33:49.094778 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3568/7041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:48 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:50.116912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:50.117643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:50.120772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=29 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:50.126215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:50.126701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:50.127134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:50.127816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:50.128283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:50.128731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:50.134030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=83 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:33:50.267380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:50.275754 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ddc067d4-e769-470f-a3a5-4dfa5e945695 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.162713 Oct 12 23:33:50.276373 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3474/7042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:50 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:51.298931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:51.299557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:51.306376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:51.306858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:51.307299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:51.308015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:51.308472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:51.309394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:51.440593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:51.448838 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-569d52e6-a8c8-4d39-a6cd-35383d90b82a tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.153759 Oct 12 23:33:51.449411 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3569/7043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:51 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:52.471382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:52.472024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:52.478938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:52.479417 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:52.479855 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:52.480562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:52.481525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:52.481948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:52.609489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:52.617671 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b01b067-69d9-4f0e-ab1b-b47cf1395243 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.150201 Oct 12 23:33:52.618244 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3475/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:52 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:53.640917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:53.641546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:53.648346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:53.648840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:53.649290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:53.649990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:53.650453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:53.650887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:53.779474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:53.788140 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-68b5445c-d9e2-4c16-8fed-d59771c53e1e tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.151479 Oct 12 23:33:53.788723 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3570/7045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:53 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:54.812651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:54.813269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:54.820065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:54.820546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:54.820978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:54.821668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:54.822117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:54.822540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:54.949230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:54.957949 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-795b8e5d-bed6-4e22-94b6-0535116146be tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.149838 Oct 12 23:33:54.958521 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3476/7046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:54 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:55.981905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:55.982543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:55.988903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:55.989392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:55.989839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:55.990550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:55.990997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:55.991431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:56.124454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:56.132716 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6693966-d040-486f-8f24-524400eed891 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1727 microversion: 2.1 time: 0.154756 Oct 12 23:33:56.133294 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3571/7047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:55 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:57.156605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:57.157293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:57.164002 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.164489 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.164936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.165632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.166088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.166564 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.300961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:57.309766 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40b4e308-bc05-40a3-8bf4-e361a273e584 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1724 microversion: 2.1 time: 0.157917 Oct 12 23:33:57.310363 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3477/7048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:57 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:57.333163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:57.333722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:57.340542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.341034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.341480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.342173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.342638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.343072 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.379482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.380000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.380440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.381163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.381621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.382049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.402248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:33:57.407384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Getting quotas for user 32d96aa156934d4c93c8e43544292992 and project d0ff3df1ff4c4996a5fceaa836420be7. Resources: {'ram', 'cores'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:33:57.505378 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8651c348-f015-459e-b4cc-61b8510a8c02 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "POST /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/action" status: 202 len: 0 microversion: 2.1 time: 0.175870 Oct 12 23:33:57.505991 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3572/7049] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:33:57 2022] POST /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:33:57.514749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:57.515398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:57.522359 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.522878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.523316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.524100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:57.524602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:57.525028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:57.665350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:57.676344 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc796cd4-45e4-485e-898f-1a8a915ab459 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.165965 Oct 12 23:33:57.676937 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3478/7050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:57 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:58.702117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:58.702834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:58.709981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:58.710473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:58.710919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:58.711612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:58.712101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:58.712536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:58.845526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:33:58.853747 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a196f915-18a6-4327-9341-aa3efe01bc6d tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.157238 Oct 12 23:33:58.854329 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3573/7051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:58 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:33:59.737568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-570d132f-fca9-424b-a1bf-09cc83708c6b req-be087379-6509-4656-a8da-27d2dd69c1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "name": "network-vif-plugged", "status": "completed", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:33:59.748515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-570d132f-fca9-424b-a1bf-09cc83708c6b req-be087379-6509-4656-a8da-27d2dd69c1c0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:59.748996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-570d132f-fca9-424b-a1bf-09cc83708c6b req-be087379-6509-4656-a8da-27d2dd69c1c0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:59.750004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-570d132f-fca9-424b-a1bf-09cc83708c6b req-be087379-6509-4656-a8da-27d2dd69c1c0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:59.762846 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-570d132f-fca9-424b-a1bf-09cc83708c6b req-be087379-6509-4656-a8da-27d2dd69c1c0 service nova] Creating event network-vif-plugged:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h2-860864-8 Oct 12 23:33:59.768756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-570d132f-fca9-424b-a1bf-09cc83708c6b req-be087379-6509-4656-a8da-27d2dd69c1c0 service nova] Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:33:59.779735 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-570d132f-fca9-424b-a1bf-09cc83708c6b req-be087379-6509-4656-a8da-27d2dd69c1c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045801 Oct 12 23:33:59.780535 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3479/7052] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:33:59.878016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:33:59.878709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:33:59.885533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:59.886025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:59.886475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:33:59.887198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:33:59.887658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:33:59.888133 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:00.023620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:00.032060 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c505ce7a-e14b-44b8-9de4-71851ea0531c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.158008 Oct 12 23:34:00.032639 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3574/7053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:33:59 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:01.057915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:01.058571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:01.064785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:01.065273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:01.065715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:01.066408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:01.066863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:01.067289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:01.201678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:01.210164 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a32fdedd-576b-4560-92f4-1b83138d012f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.157509 Oct 12 23:34:01.211051 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3480/7054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:01 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:02.234411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:02.235042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:02.241883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:02.242379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:02.242872 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:02.243583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:02.244073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:02.244518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:02.374388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:02.382743 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ec439211-25d0-4008-b4a9-46a1b4e8a643 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.152783 Oct 12 23:34:02.383327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3575/7055] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:02 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:02.609917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-caae1151-bae8-431f-95cd-348fea8e4869 req-b3e1cf7a-4bf9-499d-b27c-6391b597ee6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "name": "network-vif-unplugged", "status": "completed", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:02.620043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-caae1151-bae8-431f-95cd-348fea8e4869 req-b3e1cf7a-4bf9-499d-b27c-6391b597ee6b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:02.620515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-caae1151-bae8-431f-95cd-348fea8e4869 req-b3e1cf7a-4bf9-499d-b27c-6391b597ee6b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:02.621063 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-caae1151-bae8-431f-95cd-348fea8e4869 req-b3e1cf7a-4bf9-499d-b27c-6391b597ee6b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:02.633044 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-caae1151-bae8-431f-95cd-348fea8e4869 req-b3e1cf7a-4bf9-499d-b27c-6391b597ee6b service nova] Creating event network-vif-unplugged:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h1-860864-8 Oct 12 23:34:02.638385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-caae1151-bae8-431f-95cd-348fea8e4869 req-b3e1cf7a-4bf9-499d-b27c-6391b597ee6b service nova] Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:34:02.648976 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-caae1151-bae8-431f-95cd-348fea8e4869 req-b3e1cf7a-4bf9-499d-b27c-6391b597ee6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043340 Oct 12 23:34:02.649694 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3481/7056] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:03.406462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:03.407081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:03.414121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:03.414611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:03.415059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:03.415755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:03.416251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:03.416691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:03.549699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:03.558077 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-222a4a18-2d76-4146-ac7c-bec7a06ea134 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.155550 Oct 12 23:34:03.559168 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3576/7057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:03 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:04.587180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:04.587883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:04.594748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:04.595295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:04.595727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:04.596433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:04.596879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:04.597297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:04.693915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-add9e766-3aa4-4078-8914-948678305264 req-7e8181c8-80d8-4a83-b5a6-97c4dba8c5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:04.705207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-add9e766-3aa4-4078-8914-948678305264 req-7e8181c8-80d8-4a83-b5a6-97c4dba8c5ca service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:04.705700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-add9e766-3aa4-4078-8914-948678305264 req-7e8181c8-80d8-4a83-b5a6-97c4dba8c5ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:04.706138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-add9e766-3aa4-4078-8914-948678305264 req-7e8181c8-80d8-4a83-b5a6-97c4dba8c5ca service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:04.719137 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-add9e766-3aa4-4078-8914-948678305264 req-7e8181c8-80d8-4a83-b5a6-97c4dba8c5ca service nova] Creating event network-changed:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h1-860864-8 Oct 12 23:34:04.724647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-add9e766-3aa4-4078-8914-948678305264 req-7e8181c8-80d8-4a83-b5a6-97c4dba8c5ca service nova] Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:34:04.735572 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-add9e766-3aa4-4078-8914-948678305264 req-7e8181c8-80d8-4a83-b5a6-97c4dba8c5ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045266 Oct 12 23:34:04.736631 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3577/7058] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:34:04.739352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:04.750586 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62b4a091-a5bd-43c2-a99c-6b85022916a2 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.168526 Oct 12 23:34:04.751532 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3482/7059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:04 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:05.775772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:05.776530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:05.783956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:05.784465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:05.784921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:05.785648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:05.786118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:05.786828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:05.920466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:05.929214 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e462c394-a775-4f96-82dc-afc7874a149c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.158609 Oct 12 23:34:05.930426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3578/7060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:05 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:06.956272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:06.956888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:06.963701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:06.964214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:06.965269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:06.965968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:06.966421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:06.966844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:07.096443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:07.104732 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bf7acdba-95f6-468f-b13a-724651f88eed tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.152417 Oct 12 23:34:07.105305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3483/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:06 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:08.127056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:08.127751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:08.130634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:08.136210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:08.137205 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:08.137650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:08.138355 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:08.138819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:08.139254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:08.285286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:08.293872 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a0c6125-6890-4cc7-84ea-b6e0839f305c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.170702 Oct 12 23:34:08.294449 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3579/7062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:08 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:09.317145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:09.317754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:09.324777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:09.325256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:09.325685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:09.326366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:09.326810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:09.327227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:09.768584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:09.777654 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d55573a-5118-4c31-86f5-66e220c3e1c1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.463833 Oct 12 23:34:09.778231 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3484/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:09 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:10.801113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:10.801746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:10.808611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:10.809109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:10.809559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:10.810265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:10.810731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:10.811167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:10.941143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:10.949938 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39e9185b-2d36-4b8b-aac8-2969fc22c983 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.152736 Oct 12 23:34:10.950517 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3580/7064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:10 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:11.974304 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:11.974843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:11.981906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:11.982426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:11.982859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:11.983535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:11.984010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:11.984431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:12.112614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:12.120711 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41408f31-fd6f-4695-b0f0-c0ceec50b70f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.150446 Oct 12 23:34:12.121286 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3485/7065] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:11 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:13.143917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:13.144590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:13.151443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:13.152486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:13.152937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:13.153645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:13.154146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:13.154584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:13.288829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:13.297614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75b42a5b-4887-4dcb-a1b0-84ea2d1cbc76 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.157664 Oct 12 23:34:13.298195 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3581/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:13 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:14.320785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:14.321394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:14.328221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:14.328699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:14.329134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:14.329812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:14.330260 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:14.330677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:14.459699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:14.468496 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2bf67257-5a49-482c-8dba-09a1462dc877 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1723 microversion: 2.1 time: 0.151623 Oct 12 23:34:14.469061 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3486/7067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:14 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:15.493035 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:15.493600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:15.500888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:15.501383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:15.501832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:15.502534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:15.502997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:15.503434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:15.507310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:15.636322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:15.644559 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0f1f64f-08cc-4b07-9e0e-df02e7b02946 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1716 microversion: 2.1 time: 0.156229 Oct 12 23:34:15.645134 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3582/7068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:15 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:15.667442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:15.668098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:15.675348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:15.675825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:15.676299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:15.676994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:15.677479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:15.677906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:15.803831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:15.812702 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e4748d02-bd1a-4524-9511-0a75b56c1fd8 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1716 microversion: 2.1 time: 0.149174 Oct 12 23:34:15.813287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3487/7069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:15 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:15.834586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:15.835216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:15.841192 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:15.841692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:15.842144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:15.842843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:15.843310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:15.843746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:15.969884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:15.978192 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0356d85-38f8-48c8-bd03-6e0da1976493 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1716 microversion: 2.1 time: 0.147435 Oct 12 23:34:15.978775 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3583/7070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:15 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:16.000736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:16.001244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:16.007252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:16.007679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:16.008167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:16.008860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:16.009312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:16.009738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:16.034764 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:34:16.112041 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37f32143-c33b-485a-a466-d9e30741f5ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 204 len: 0 microversion: 2.1 time: 0.114802 Oct 12 23:34:16.113076 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3488/7071] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:34:15 2022] DELETE /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:34:16.121372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:16.122006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:16.127912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:16.128423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:16.128877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:16.129579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:16.130041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:16.130487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:16.260901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:16.268974 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b79f162d-39c8-4af4-9ebb-d29648f03677 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1722 microversion: 2.1 time: 0.151557 Oct 12 23:34:16.269542 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3584/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:16 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:17.294857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:17.295618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:17.302287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:17.302766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:17.303195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:17.303882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:17.304353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:17.304771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:17.432275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:17.436448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:17.442667 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4074aaca-c011-4fae-bc9c-d1cbe8731549 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1722 microversion: 2.1 time: 0.153923 Oct 12 23:34:17.443252 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3489/7073] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:17 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:18.465045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:18.465676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:18.473095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:18.473606 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:18.474060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:18.474773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:18.475238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:18.475675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:18.496975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-78394882-709a-4410-9f0d-bcfc2e4e3ed9 req-819f600e-8fc7-4ddd-a237-65f7e01035be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba", "name": "network-vif-deleted", "tag": "5ba53635-6eb0-44e0-8553-c5fc4110e20d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:18.509526 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-78394882-709a-4410-9f0d-bcfc2e4e3ed9 req-819f600e-8fc7-4ddd-a237-65f7e01035be service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:18.510244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-78394882-709a-4410-9f0d-bcfc2e4e3ed9 req-819f600e-8fc7-4ddd-a237-65f7e01035be service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:18.510683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-78394882-709a-4410-9f0d-bcfc2e4e3ed9 req-819f600e-8fc7-4ddd-a237-65f7e01035be service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:18.528545 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-78394882-709a-4410-9f0d-bcfc2e4e3ed9 req-819f600e-8fc7-4ddd-a237-65f7e01035be service nova] Creating event network-vif-deleted:5ba53635-6eb0-44e0-8553-c5fc4110e20d for instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba on n-h1-860864-8 Oct 12 23:34:18.532487 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-78394882-709a-4410-9f0d-bcfc2e4e3ed9 req-819f600e-8fc7-4ddd-a237-65f7e01035be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039512 Oct 12 23:34:18.537122 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3490/7074] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:34:18.556998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:18.570472 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03ae6744-55af-4677-b29d-90228b49825f tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1655 microversion: 2.1 time: 0.109109 Oct 12 23:34:18.571083 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3585/7075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:18 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:19.596143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:19.596899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:19.603075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:19.603555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:19.604090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:19.604781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:19.605234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:19.605662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:19.676950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:19.685787 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f9845681-63e4-417f-8a53-638ff2221764 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1369 microversion: 2.1 time: 0.094910 Oct 12 23:34:19.686416 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3491/7076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:19 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:20.708590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:20.709792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:20.712770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:20.722749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:20.723253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:20.723702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:20.724442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:20.724906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:20.725339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:20.789018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:20.798082 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a540b2d-b5e6-489b-b08c-8eee4347cb64 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1369 microversion: 2.1 time: 0.093526 Oct 12 23:34:20.798873 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3586/7077] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:20 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:34:21.820908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:21.821519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:21.826814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:21.830893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:21.831379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:21.831817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:21.832581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:21.833033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:21.833485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:21.896806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:21.906323 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-45540791-a593-4d32-b99c-f210b66ba763 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1369 microversion: 2.1 time: 0.089469 Oct 12 23:34:21.906902 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3492/7078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:21 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:22.929524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:22.930143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:22.937071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:22.937586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:22.938014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:22.938713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:22.939202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:22.939637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:22.971940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:22.972442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:22.972893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:22.973582 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lazy-loading 'fault' on Instance uuid a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:34:23.018201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d96aa156934d4c93c8e43544292992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff3df1ff4c4996a5fceaa836420be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:23.026327 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e05349d0-e878-4e65-b2bc-35303f369666 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 200 len: 1374 microversion: 2.1 time: 0.100685 Oct 12 23:34:23.026905 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3587/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:22 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 1374 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:24.051217 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:24.051784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:24.058619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:24.059102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:24.059537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:24.060249 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:24.060702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:24.061126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:24.074213 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba HTTP/1.1 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba'} Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:24.076411 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fbff1e52-fd17-4b3d-8df4-f83a1b2efc52 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 404 len: 111 microversion: 2.1 time: 0.030622 Oct 12 23:34:24.081204 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3493/7080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:24 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:24.139694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:24.141881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:24.148694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:24.149174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:24.149609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:24.150292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:24.150756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:24.151171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:24.166574 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/os-volume_attachments HTTP/1.1 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'server_id': 'a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba'} Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:24.168265 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-549e1590-5b74-48fc-8ab0-efa2fb0547d1 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034504 Oct 12 23:34:24.172694 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3588/7081] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:34:24 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:27.491656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.492203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.498267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.498738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.499174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.499849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.500320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.500739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.513916 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba HTTP/1.1 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba'} Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.515424 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f191919-eb4a-4667-a558-589df9ee7083 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 404 len: 111 microversion: 2.1 time: 0.029395 Oct 12 23:34:27.520058 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3494/7082] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:34:27 2022] DELETE /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:27.525576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.526231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.533263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.533784 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.534230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.534950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.535413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.536140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.551934 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba HTTP/1.1 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba'} Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.553540 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f16c7fca-7e89-408e-a1b8-21c9b393f724 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba" status: 404 len: 111 microversion: 2.1 time: 0.033636 Oct 12 23:34:27.557751 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3589/7083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:27 2022] GET /compute/v2.1/servers/a1c3b4d0-a498-4a0b-bfaf-b897ec3e93ba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:34:27.563642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.564173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.570494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.570991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.571428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.572173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.572635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.573681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.589183 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa HTTP/1.1 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'd7842e61-77b3-4218-9818-9fec839240fa'} Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.591341 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-644e39bc-7b67-4fe9-961b-b2580cb3a19b tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 404 len: 111 microversion: 2.1 time: 0.032972 Oct 12 23:34:27.595166 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3495/7084] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:34:27 2022] DELETE /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:27.601855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.602507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: d7842e61-77b3-4218-9818-9fec839240fa] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.608782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.609291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.609776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.610491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.610960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.611401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.625647 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa HTTP/1.1 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'd7842e61-77b3-4218-9818-9fec839240fa'} Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.627202 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance d7842e61-77b3-4218-9818-9fec839240fa could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42e60a6f-4f34-4716-a841-bf5fcc165341 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa" status: 404 len: 111 microversion: 2.1 time: 0.030972 Oct 12 23:34:27.632271 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3590/7085] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:27 2022] GET /compute/v2.1/servers/d7842e61-77b3-4218-9818-9fec839240fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:27.637325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.638330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.644256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.644735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.645169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.645851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.646298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.646722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.660702 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 HTTP/1.1 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'de98443f-c02a-491d-9615-d5184cf8b6c1'} Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.662491 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-362a1d36-3450-4878-bdf7-6faba9855e18 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 404 len: 111 microversion: 2.1 time: 0.030485 Oct 12 23:34:27.666631 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3496/7086] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:34:27 2022] DELETE /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:34:27.674768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.675758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: de98443f-c02a-491d-9615-d5184cf8b6c1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.681920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.682413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.682869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.683573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.684068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.685058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.698651 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 HTTP/1.1 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'de98443f-c02a-491d-9615-d5184cf8b6c1'} Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.700247 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance de98443f-c02a-491d-9615-d5184cf8b6c1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ed7cd64-a58f-4a8c-84b5-80269c0da4e3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1" status: 404 len: 111 microversion: 2.1 time: 0.032740 Oct 12 23:34:27.704760 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3591/7087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:27 2022] GET /compute/v2.1/servers/de98443f-c02a-491d-9615-d5184cf8b6c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:27.710312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.710820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.716863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.717303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.717747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.718441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.718926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.719357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.733282 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 HTTP/1.1 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '32804f63-7417-4456-9dcc-cbcb73be6396'} Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.734833 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.739761 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-61ae0a7a-11c1-488c-a21b-ac716859fef3 tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 404 len: 111 microversion: 2.1 time: 0.029773 Oct 12 23:34:27.740834 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3497/7088] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:34:27 2022] DELETE /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:27.745953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.746695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] [instance: 32804f63-7417-4456-9dcc-cbcb73be6396] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:27.753460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.754038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.754558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.759756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:27.759756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:27.759756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:27.772583 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] HTTP exception thrown: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Request method failure captured: Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 HTTP/1.1 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR02mJSnYqfMPt7AgWrkTcEAoiUR1Vzf3BsaQ8hmIn7Bqspr2ALSUDYJ5R9U5b8aE8VeDJfawkoPddTfBcg-bfKyY99TBy8sc1N8B8EHILa258n5mml-4uyqF6CfYsBC1HnavNOL8XfXRUKY1bxwN94CJi4taA7EUTScxbe2OkJP8sPo Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0ff3df1ff4c4996a5fceaa836420be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0ff3df1ff4c4996a5fceaa836420be7"}]}] Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: d0ff3df1ff4c4996a5fceaa836420be7 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1974901664 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 32d96aa156934d4c93c8e43544292992 Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServerActionsTestJSON-1974901664-project Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '32804f63-7417-4456-9dcc-cbcb73be6396'} Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:27.774604 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Returning 404 to user: Instance 32804f63-7417-4456-9dcc-cbcb73be6396 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70898d61-a97a-4a69-b36d-cb2bc4a2836c tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396" status: 404 len: 111 microversion: 2.1 time: 0.034452 Oct 12 23:34:27.779168 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3592/7089] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:27 2022] GET /compute/v2.1/servers/32804f63-7417-4456-9dcc-cbcb73be6396 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:27.787762 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-174f2187-3598-49b6-bb2e-e27af7b9a4ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] Calling method '.version_select at 0x7f44fe5ca820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:27.812051 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-174f2187-3598-49b6-bb2e-e27af7b9a4ab tempest-ServerActionsTestJSON-1974901664 tempest-ServerActionsTestJSON-1974901664-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371574832" status: 202 len: 0 microversion: 2.1 time: 0.030026 Oct 12 23:34:27.812828 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3498/7090] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 12 23:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371574832 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:34:37.097548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1259897780", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "50dd68fd-5c76-43be-86b6-7d3c9343f0e9"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:37.155914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] validate_networks() for [('50dd68fd-5c76-43be-86b6-7d3c9343f0e9', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:34:37.574161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:34:37.575121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:34:37.575601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:34:37.576064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:34:37.576484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:34:37.589395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:37.589905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:37.590928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:37.591670 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:37.592173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:37.592616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:37.610132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Getting quotas for project 93de3aefe0a5475596c38e221addea9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:34:37.615616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Getting quotas for user 4c4c3aac44bc4ea19f50c081f36781fc and project 93de3aefe0a5475596c38e221addea9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:34:37.628404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:34:37.630737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:34:37.678510 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc11c2d1-285b-4962-81ae-93564faa24e0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729989 Oct 12 23:34:37.679352 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3593/7091] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:34:37.692056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ebec609d-5be5-4b4f-a6fa-eefb238fe5d4 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:37.692684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ebec609d-5be5-4b4f-a6fa-eefb238fe5d4 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:37.724681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=25 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:37.760846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ebec609d-5be5-4b4f-a6fa-eefb238fe5d4 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:37.770127 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ebec609d-5be5-4b4f-a6fa-eefb238fe5d4 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1217 microversion: 2.1 time: 0.082799 Oct 12 23:34:37.771358 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3499/7092] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:37 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:38.795272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:38.795928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:38.803238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:38.804147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:38.804855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:38.805801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:38.806488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:38.807138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:38.881183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:38.889770 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-53f56273-6f50-4908-bbe4-0c976d95bc5a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1287 microversion: 2.1 time: 0.100246 Oct 12 23:34:38.890353 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3594/7093] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:38 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:39.913883 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:39.914509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:39.924110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:39.924900 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:39.925363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:39.926076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:39.926845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:39.927275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:40.134364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:40.143533 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2213c7a-8082-41de-8b62-59865f4bcae9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1317 microversion: 2.1 time: 0.234164 Oct 12 23:34:40.144241 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3500/7094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:39 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:40.274294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-46a3a832-548a-4481-b26f-9f722e48c13b req-25ec152c-a1b8-4cd8-acdd-8a09fe6762ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae94a476-ec48-4cef-9c51-8b578cae6cd8", "tag": "f7999bc8-2b48-495a-82f7-0d1285c8949a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:40.292945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-46a3a832-548a-4481-b26f-9f722e48c13b req-25ec152c-a1b8-4cd8-acdd-8a09fe6762ef service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:40.294467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-46a3a832-548a-4481-b26f-9f722e48c13b req-25ec152c-a1b8-4cd8-acdd-8a09fe6762ef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:40.295250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-46a3a832-548a-4481-b26f-9f722e48c13b req-25ec152c-a1b8-4cd8-acdd-8a09fe6762ef service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:40.308492 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-46a3a832-548a-4481-b26f-9f722e48c13b req-25ec152c-a1b8-4cd8-acdd-8a09fe6762ef service nova] Creating event network-changed:f7999bc8-2b48-495a-82f7-0d1285c8949a for instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 on n-h1-860864-8 Oct 12 23:34:40.314924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-46a3a832-548a-4481-b26f-9f722e48c13b req-25ec152c-a1b8-4cd8-acdd-8a09fe6762ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043916 Oct 12 23:34:40.315539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3595/7095] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:41.167421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:41.168082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:41.174888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:41.175373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:41.175814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:41.176531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:41.176991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:41.177418 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:41.313981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:41.321611 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae12db07-3868-47bb-a02d-e4db9d3acb14 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1317 microversion: 2.1 time: 0.158167 Oct 12 23:34:41.322193 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3501/7096] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:41 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:42.347039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:42.347671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:42.353858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:42.354798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:42.355251 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:42.356553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:42.357012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:42.357442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:42.485298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:42.492910 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b40e1d9-f5b7-4565-821a-1e0b9ae9668f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1317 microversion: 2.1 time: 0.151172 Oct 12 23:34:42.493487 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3596/7097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:42 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:34:43.514690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:43.515234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:43.521904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:43.522380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:43.522819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:43.523498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:43.523971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:43.524392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:43.649878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:43.657532 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f73c0f1-a794-4c8e-8a07-b3029bfd2668 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1317 microversion: 2.1 time: 0.146853 Oct 12 23:34:43.658096 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3502/7098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:43 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:44.680831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:44.681462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:44.688338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:44.688832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:44.689273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:44.689967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:44.690425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:44.690853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:44.823699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:44.832179 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b4484cf-0830-4b65-8471-e13d399254c0 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1317 microversion: 2.1 time: 0.155133 Oct 12 23:34:44.832773 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3597/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:44 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:45.856435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:45.857059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:45.863959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:45.864446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:45.864885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:45.865581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:45.866035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:45.866463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:45.997426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:46.005075 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb08e1e7-acec-451e-9994-7d428c527bd3 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1317 microversion: 2.1 time: 0.153132 Oct 12 23:34:46.005690 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3503/7100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:45 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:34:46.848150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-27f89eee-ad6a-47f4-8b36-1e3834992afe req-072d2a5a-e05a-472f-9ff9-99946d1dec06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae94a476-ec48-4cef-9c51-8b578cae6cd8", "name": "network-vif-plugged", "status": "completed", "tag": "f7999bc8-2b48-495a-82f7-0d1285c8949a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:46.858879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-27f89eee-ad6a-47f4-8b36-1e3834992afe req-072d2a5a-e05a-472f-9ff9-99946d1dec06 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:46.859381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-27f89eee-ad6a-47f4-8b36-1e3834992afe req-072d2a5a-e05a-472f-9ff9-99946d1dec06 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:46.859854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-27f89eee-ad6a-47f4-8b36-1e3834992afe req-072d2a5a-e05a-472f-9ff9-99946d1dec06 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:46.863821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=70 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:46.872429 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-27f89eee-ad6a-47f4-8b36-1e3834992afe req-072d2a5a-e05a-472f-9ff9-99946d1dec06 service nova] Creating event network-vif-plugged:f7999bc8-2b48-495a-82f7-0d1285c8949a for instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 on n-h1-860864-8 Oct 12 23:34:46.877340 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-27f89eee-ad6a-47f4-8b36-1e3834992afe req-072d2a5a-e05a-472f-9ff9-99946d1dec06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033001 Oct 12 23:34:46.877937 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3598/7101] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:47.027867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:47.028509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:47.035266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:47.035748 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:47.036223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:47.037211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:47.037663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:47.038089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:47.165891 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:47.174120 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f1cf220e-4c2e-4c5a-b91b-38c1e570be78 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1317 microversion: 2.1 time: 0.150162 Oct 12 23:34:47.174633 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3504/7102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:47 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:48.194733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:48.195519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:48.200772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:48.201490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:48.208142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:48.208632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:48.209077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:48.209772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:48.210233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:48.210666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:48.343564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:48.351278 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c8070186-8bcf-4b52-983b-600dfddc0adb tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1505 microversion: 2.1 time: 0.157547 Oct 12 23:34:48.351849 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3599/7103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:48 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:48.414167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1948509534", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "50dd68fd-5c76-43be-86b6-7d3c9343f0e9"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:48.423234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:48.467346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] validate_networks() for [('50dd68fd-5c76-43be-86b6-7d3c9343f0e9', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:34:48.828428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:34:48.828856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:34:48.829332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:34:48.829740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:34:48.830151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:34:48.839199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:48.839675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:48.840750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:48.841470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:48.841920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:48.842340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:48.858649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Getting quotas for project 93de3aefe0a5475596c38e221addea9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:34:48.863821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Getting quotas for user 4c4c3aac44bc4ea19f50c081f36781fc and project 93de3aefe0a5475596c38e221addea9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:34:48.875984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:34:48.878241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:34:48.923646 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ce95b18-12df-4776-a549-1b3b4a888756 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513455 Oct 12 23:34:48.924304 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3505/7104] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:34:48.936289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d03568f-5ee5-492b-8bd9-4a699ec795d8 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:48.937003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d03568f-5ee5-492b-8bd9-4a699ec795d8 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:48.989983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d03568f-5ee5-492b-8bd9-4a699ec795d8 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:48.997413 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d03568f-5ee5-492b-8bd9-4a699ec795d8 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1217 microversion: 2.1 time: 0.065680 Oct 12 23:34:48.997985 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3600/7105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:48 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:50.022275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:50.022822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:50.029668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:50.030160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:50.030603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:50.031314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:50.031774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:50.032827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:50.095392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:50.103884 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9886f129-32a2-4e6e-b2e5-18cef95e8734 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1275 microversion: 2.1 time: 0.087087 Oct 12 23:34:50.104692 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3506/7106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:50 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:51.127475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:51.128253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:51.130978 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:51.136789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:51.137283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:51.137725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:51.138449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:51.138886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:51.139315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:51.376937 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:51.384788 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36463ee0-0436-4949-8fe8-97a5e83dd674 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1317 microversion: 2.1 time: 0.261343 Oct 12 23:34:51.385373 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3601/7107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:51 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:34:51.525896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0f060132-b4da-4dab-9d88-d34a3bef093c req-ba9b6af2-ca59-4b41-b14c-67acefe42e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b", "tag": "dea1e896-3371-4111-8ab7-6cf098018228"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:51.540674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0f060132-b4da-4dab-9d88-d34a3bef093c req-ba9b6af2-ca59-4b41-b14c-67acefe42e78 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:51.541068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0f060132-b4da-4dab-9d88-d34a3bef093c req-ba9b6af2-ca59-4b41-b14c-67acefe42e78 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:51.541499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0f060132-b4da-4dab-9d88-d34a3bef093c req-ba9b6af2-ca59-4b41-b14c-67acefe42e78 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:51.553675 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0f060132-b4da-4dab-9d88-d34a3bef093c req-ba9b6af2-ca59-4b41-b14c-67acefe42e78 service nova] Creating event network-changed:dea1e896-3371-4111-8ab7-6cf098018228 for instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b on n-h2-860864-8 Oct 12 23:34:51.559168 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0f060132-b4da-4dab-9d88-d34a3bef093c req-ba9b6af2-ca59-4b41-b14c-67acefe42e78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037714 Oct 12 23:34:51.559784 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3507/7108] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:52.406647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:52.407321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:52.414431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:52.414927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:52.415372 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:52.416096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:52.416565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:52.417000 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:52.547660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:52.555412 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3530636b-8b25-4f25-9c27-f24439a7d758 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1317 microversion: 2.1 time: 0.152746 Oct 12 23:34:52.556013 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3602/7109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:52 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:53.579641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:53.580501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:53.583290 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:53.588613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:53.589084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:53.589514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:53.590189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:53.590663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:53.591075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:53.721925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:53.729598 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d91bfaa-9734-4894-92bc-21bbb3988242 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1317 microversion: 2.1 time: 0.154662 Oct 12 23:34:53.730179 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3508/7110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:53 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:34:54.751709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:54.752361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:54.759258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:54.759749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:54.760221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:54.760919 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:54.761374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:54.761803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:54.889576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:54.897106 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f492b6b-4df5-4321-ad86-c2171497f59c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1317 microversion: 2.1 time: 0.149256 Oct 12 23:34:54.897676 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3603/7111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:54 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:55.921361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:55.921936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:55.927946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:55.928529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:55.929033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:55.929750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:55.930230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:55.930652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:55.988730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a2b7bc6b-8b78-4100-8cd5-79110804b487 req-22940a69-3740-4940-983b-543a9e47f477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b", "name": "network-vif-plugged", "status": "completed", "tag": "dea1e896-3371-4111-8ab7-6cf098018228"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:56.000433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2b7bc6b-8b78-4100-8cd5-79110804b487 req-22940a69-3740-4940-983b-543a9e47f477 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:56.000926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2b7bc6b-8b78-4100-8cd5-79110804b487 req-22940a69-3740-4940-983b-543a9e47f477 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:56.001368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2b7bc6b-8b78-4100-8cd5-79110804b487 req-22940a69-3740-4940-983b-543a9e47f477 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:56.012682 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a2b7bc6b-8b78-4100-8cd5-79110804b487 req-22940a69-3740-4940-983b-543a9e47f477 service nova] Creating event network-vif-plugged:dea1e896-3371-4111-8ab7-6cf098018228 for instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b on n-h2-860864-8 Oct 12 23:34:56.017726 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a2b7bc6b-8b78-4100-8cd5-79110804b487 req-22940a69-3740-4940-983b-543a9e47f477 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092976 Oct 12 23:34:56.018361 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3604/7112] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:56.099530 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:56.107389 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-929a2654-0e9e-4cff-9bf3-7108deefcc76 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1317 microversion: 2.1 time: 0.190895 Oct 12 23:34:56.108028 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3509/7113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:55 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:34:57.131913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:57.132631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:57.139282 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:57.139809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:57.140289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:57.140991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:57.141467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:57.141909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:57.281382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:57.289342 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0118dba-32cd-49af-b316-2ec05a5c2e77 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1506 microversion: 2.1 time: 0.162805 Oct 12 23:34:57.289909 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3605/7114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:57 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:57.311705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:57.312265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:57.318963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:57.319439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:57.319875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:57.320590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:57.321040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:57.321464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:57.346725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:34:57.418583 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b54ccb38-5a20-4f4d-ad7b-955a1e4598a7 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 204 len: 0 microversion: 2.1 time: 0.110845 Oct 12 23:34:57.419088 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3510/7115] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:34:57 2022] DELETE /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:34:57.427343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:57.427999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:57.434587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:57.435110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:57.435542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:57.436267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:57.436726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:57.437160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:57.563840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:57.571459 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0946eac-1e51-439c-92d8-7dc8bc3e7d1f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1512 microversion: 2.1 time: 0.148140 Oct 12 23:34:57.572051 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3606/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:57 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:34:58.595365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:58.596197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:58.602956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:58.603440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:58.603882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:58.604597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:58.605076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:58.605524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:58.734572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:58.742382 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-443271a9-b6e8-44d4-a611-0e057d7eba9c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 200 len: 1512 microversion: 2.1 time: 0.151930 Oct 12 23:34:58.742961 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3511/7117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:58 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:59.133530 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:59.208947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0a031cf2-6c56-448e-a932-a0489210934e req-42ba12cb-3fc2-4de7-a294-32dd577149d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b", "name": "network-vif-deleted", "tag": "dea1e896-3371-4111-8ab7-6cf098018228"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:59.220292 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a031cf2-6c56-448e-a932-a0489210934e req-42ba12cb-3fc2-4de7-a294-32dd577149d6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:59.221284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a031cf2-6c56-448e-a932-a0489210934e req-42ba12cb-3fc2-4de7-a294-32dd577149d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:59.221894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a031cf2-6c56-448e-a932-a0489210934e req-42ba12cb-3fc2-4de7-a294-32dd577149d6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:59.235748 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0a031cf2-6c56-448e-a932-a0489210934e req-42ba12cb-3fc2-4de7-a294-32dd577149d6 service nova] Creating event network-vif-deleted:dea1e896-3371-4111-8ab7-6cf098018228 for instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b on n-h2-860864-8 Oct 12 23:34:59.242656 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0a031cf2-6c56-448e-a932-a0489210934e req-42ba12cb-3fc2-4de7-a294-32dd577149d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113863 Oct 12 23:34:59.243958 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3607/7118] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:34:59.765485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:59.766099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:59.768117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:59.768757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:34:59.775449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:59.775943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:59.776376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:59.777052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:59.777496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:59.778426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:59.791861 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] HTTP exception thrown: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Request method failure captured: Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b HTTP/1.1 Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR08MfNC5HBRrZxKM_oxfMy3wOSGyLmx1PItat41Ze6zOD8lITmT6sWiVOE6i6pQPG31cEpOUgB6bLPr5-Pkhkkvovx-dGISU47XBaoruXjJ1YsIbvdgq-z4VxfYZQ6PbOPxowd6ZF7DzeUYHfneJzCQKP7pBMmz6QBhFcfRGZxYcThE Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93de3aefe0a5475596c38e221addea9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}] Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4c4c3aac44bc4ea19f50c081f36781fc Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b'} Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:59.794219 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Returning 404 to user: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-326b4f2d-0d7c-4719-a1ac-88867ba34de9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 404 len: 111 microversion: 2.1 time: 0.034733 Oct 12 23:34:59.799129 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3512/7119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:59 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:59.807451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:59.808168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:59.814328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:59.814808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:59.815247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:59.815956 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:59.816413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:34:59.816846 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:34:59.943422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:34:59.951498 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-658d8266-8d27-4151-8c7f-44cb92e3bf9a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1505 microversion: 2.1 time: 0.148401 Oct 12 23:34:59.952092 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3608/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:59 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:34:59.973810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5cf6f57-4f88-40dc-ae60-8e4d8ae5007a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:34:59.976147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c5cf6f57-4f88-40dc-ae60-8e4d8ae5007a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 2465b694-f1a2-4ccc-b848-ce71e2dfb411] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:59.981544 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c5cf6f57-4f88-40dc-ae60-8e4d8ae5007a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] HTTP exception thrown: Instance 2465b694-f1a2-4ccc-b848-ce71e2dfb411 could not be found. Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5cf6f57-4f88-40dc-ae60-8e4d8ae5007a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Request method failure captured: Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/2465b694-f1a2-4ccc-b848-ce71e2dfb411/action HTTP/1.1 Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 32 Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR08MfNC5HBRrZxKM_oxfMy3wOSGyLmx1PItat41Ze6zOD8lITmT6sWiVOE6i6pQPG31cEpOUgB6bLPr5-Pkhkkvovx-dGISU47XBaoruXjJ1YsIbvdgq-z4VxfYZQ6PbOPxowd6ZF7DzeUYHfneJzCQKP7pBMmz6QBhFcfRGZxYcThE Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93de3aefe0a5475596c38e221addea9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}] Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4c4c3aac44bc4ea19f50c081f36781fc Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: {"resize": {"flavorRef": "452"}} Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 2465b694-f1a2-4ccc-b848-ce71e2dfb411 could not be found. Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '2465b694-f1a2-4ccc-b848-ce71e2dfb411', 'body': {'resize': {'flavorRef': '452'}}} Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2465b694-f1a2-4ccc-b848-ce71e2dfb411 could not be found. Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:34:59.983068 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2465b694-f1a2-4ccc-b848-ce71e2dfb411 could not be found. Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2465b694-f1a2-4ccc-b848-ce71e2dfb411 could not be found. Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5cf6f57-4f88-40dc-ae60-8e4d8ae5007a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Returning 404 to user: Instance 2465b694-f1a2-4ccc-b848-ce71e2dfb411 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c5cf6f57-4f88-40dc-ae60-8e4d8ae5007a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "POST /compute/v2.1/servers/2465b694-f1a2-4ccc-b848-ce71e2dfb411/action" status: 404 len: 111 microversion: 2.1 time: 0.014570 Oct 12 23:34:59.988051 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3513/7121] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:34:59 2022] POST /compute/v2.1/servers/2465b694-f1a2-4ccc-b848-ce71e2dfb411/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:34:59.992880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:34:59.993538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:34:59.999507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:34:59.999977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.000431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.001132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.001598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.002036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.132249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:00.141334 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-129b6c0a-1fcf-4001-8fd1-7060e05d469a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1505 microversion: 2.1 time: 0.152314 Oct 12 23:35:00.141927 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3609/7122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:34:59 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:35:00.164726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:00.165373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.172264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.172814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.173253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.173941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.174394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.174821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.300320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:00.307991 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3edbc99-9d96-49de-80a9-afca4eccdcb1 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1505 microversion: 2.1 time: 0.147386 Oct 12 23:35:00.308562 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3514/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:00 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:00.331186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "62a56a0e-5cd0-42e0-987b-ee0879a7cc27"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:00.333613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.339400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.339924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.340400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.341104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.341573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.342015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.369866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:00.375055 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] HTTP exception thrown: Flavor 62a56a0e-5cd0-42e0-987b-ee0879a7cc27 could not be found. Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Request method failure captured: Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8/action HTTP/1.1 Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 65 Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR08MfNC5HBRrZxKM_oxfMy3wOSGyLmx1PItat41Ze6zOD8lITmT6sWiVOE6i6pQPG31cEpOUgB6bLPr5-Pkhkkvovx-dGISU47XBaoruXjJ1YsIbvdgq-z4VxfYZQ6PbOPxowd6ZF7DzeUYHfneJzCQKP7pBMmz6QBhFcfRGZxYcThE Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93de3aefe0a5475596c38e221addea9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}] Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4c4c3aac44bc4ea19f50c081f36781fc Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: {"resize": {"flavorRef": "62a56a0e-5cd0-42e0-987b-ee0879a7cc27"}} Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: exception: Flavor 62a56a0e-5cd0-42e0-987b-ee0879a7cc27 could not be found. Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'ae94a476-ec48-4cef-9c51-8b578cae6cd8', 'body': {'resize': {'flavorRef': '62a56a0e-5cd0-42e0-987b-ee0879a7cc27'}}} Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:35:00.376961 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 62a56a0e-5cd0-42e0-987b-ee0879a7cc27 could not be found. Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 62a56a0e-5cd0-42e0-987b-ee0879a7cc27 could not be found. Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 62a56a0e-5cd0-42e0-987b-ee0879a7cc27 could not be found. Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Returning 400 to user: Flavor 62a56a0e-5cd0-42e0-987b-ee0879a7cc27 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:35:00.381229 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c8f37dd4-18a0-41af-93d8-7c0497c99eb9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "POST /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8/action" status: 400 len: 107 microversion: 2.1 time: 0.051163 Oct 12 23:35:00.383650 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3610/7124] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:35:00 2022] POST /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8/action => generated 107 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:35:00.387034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:00.388227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.394062 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.394540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.394982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.395665 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.396142 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.396567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.527163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:00.534825 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f2a6b46f-95dd-4ac7-8c13-8e7a26d3dddd tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1505 microversion: 2.1 time: 0.151673 Oct 12 23:35:00.535397 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3515/7125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:00 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:35:00.558381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:00.559615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.565593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.566081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.566523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.567287 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.568063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.568498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.695650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:00.703424 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5380eeb4-edb1-4627-ad6d-5685b66a1f8d tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1505 microversion: 2.1 time: 0.148902 Oct 12 23:35:00.704019 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3611/7126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:00 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:00.725257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e03c055c-03ec-479c-bc63-0e81ff7ed7f9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e03c055c-03ec-479c-bc63-0e81ff7ed7f9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Request method failure captured: Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8/action HTTP/1.1 Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 29 Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR08MfNC5HBRrZxKM_oxfMy3wOSGyLmx1PItat41Ze6zOD8lITmT6sWiVOE6i6pQPG31cEpOUgB6bLPr5-Pkhkkvovx-dGISU47XBaoruXjJ1YsIbvdgq-z4VxfYZQ6PbOPxowd6ZF7DzeUYHfneJzCQKP7pBMmz6QBhFcfRGZxYcThE Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93de3aefe0a5475596c38e221addea9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}] Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4c4c3aac44bc4ea19f50c081f36781fc Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: {"resize": {"flavorRef": ""}} Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ae94a476-ec48-4cef-9c51-8b578cae6cd8', 'body': {'resize': {'flavorRef': ''}}} Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '' Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.728869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e03c055c-03ec-479c-bc63-0e81ff7ed7f9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e03c055c-03ec-479c-bc63-0e81ff7ed7f9 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "POST /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8/action" status: 400 len: 113 microversion: 2.1 time: 0.008974 Oct 12 23:35:00.734320 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3516/7127] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:35:00 2022] POST /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 23:35:00.738896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:00.739515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.745318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.745800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.746247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.747573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.748068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.748494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.879351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:00.886999 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b849ce1-db73-4322-afb8-da67795c2aee tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1505 microversion: 2.1 time: 0.151902 Oct 12 23:35:00.887599 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3612/7128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:00 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:00.913365 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:00.913852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.923394 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.923875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.924340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.925024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.925478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.925907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.939366 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] HTTP exception thrown: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Request method failure captured: Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b HTTP/1.1 Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR08MfNC5HBRrZxKM_oxfMy3wOSGyLmx1PItat41Ze6zOD8lITmT6sWiVOE6i6pQPG31cEpOUgB6bLPr5-Pkhkkvovx-dGISU47XBaoruXjJ1YsIbvdgq-z4VxfYZQ6PbOPxowd6ZF7DzeUYHfneJzCQKP7pBMmz6QBhFcfRGZxYcThE Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93de3aefe0a5475596c38e221addea9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}] Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4c4c3aac44bc4ea19f50c081f36781fc Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b'} Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:35:00.940920 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Returning 404 to user: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb503cde-6ce6-4bed-bb31-383799531d22 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 404 len: 111 microversion: 2.1 time: 0.033986 Oct 12 23:35:00.945730 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3517/7129] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:35:00 2022] DELETE /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:35:00.950757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:00.951362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.957156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.957638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.958076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.958768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.959224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.959653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.974907 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] HTTP exception thrown: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Request method failure captured: Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b HTTP/1.1 Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR08MfNC5HBRrZxKM_oxfMy3wOSGyLmx1PItat41Ze6zOD8lITmT6sWiVOE6i6pQPG31cEpOUgB6bLPr5-Pkhkkvovx-dGISU47XBaoruXjJ1YsIbvdgq-z4VxfYZQ6PbOPxowd6ZF7DzeUYHfneJzCQKP7pBMmz6QBhFcfRGZxYcThE Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93de3aefe0a5475596c38e221addea9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}] Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: 4c4c3aac44bc4ea19f50c081f36781fc Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b'} Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:00.976512 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Returning 404 to user: Instance 3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-87d7c76a-45aa-40c4-ad48-16c14f05ba74 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b" status: 404 len: 111 microversion: 2.1 time: 0.031154 Oct 12 23:35:00.982228 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3613/7130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:00 2022] GET /compute/v2.1/servers/3b05a9ab-90c8-4cc5-8a3d-95a1cc3b090b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:35:00.986772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:00.987273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:00.993150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.993622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.994055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:00.994734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:00.995180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:00.995597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:01.020014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:35:01.046993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:01.095165 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-701e5688-bf4b-41bf-a1af-5a238c3b449a tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 204 len: 0 microversion: 2.1 time: 0.111871 Oct 12 23:35:01.095778 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3518/7131] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:35:00 2022] DELETE /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:35:01.104706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:01.105336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:01.112030 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:01.112528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:01.112974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:01.113678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:01.114138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:01.114570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:01.240909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:01.248658 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-544f5bc2-241a-4a83-b832-b6a119741c0c tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1511 microversion: 2.1 time: 0.148188 Oct 12 23:35:01.249228 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3614/7132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:01 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:02.271803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:02.272536 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:02.280020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:02.280503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:02.280935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:02.281614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:02.282060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:02.282477 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:02.409514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4c3aac44bc4ea19f50c081f36781fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93de3aefe0a5475596c38e221addea9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:02.417448 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-acce1fc0-a46a-4e38-8d95-3d28b4840599 tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 200 len: 1511 microversion: 2.1 time: 0.149890 Oct 12 23:35:02.418012 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3519/7133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:02 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:03.022602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ea9526a5-77c0-402e-a0d5-079c2093b5b8 req-5d7fa1d7-cdc4-4232-b5a0-4854ab5d03a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae94a476-ec48-4cef-9c51-8b578cae6cd8", "name": "network-vif-deleted", "tag": "f7999bc8-2b48-495a-82f7-0d1285c8949a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:03.033236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ea9526a5-77c0-402e-a0d5-079c2093b5b8 req-5d7fa1d7-cdc4-4232-b5a0-4854ab5d03a4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:03.033720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ea9526a5-77c0-402e-a0d5-079c2093b5b8 req-5d7fa1d7-cdc4-4232-b5a0-4854ab5d03a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:03.034466 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ea9526a5-77c0-402e-a0d5-079c2093b5b8 req-5d7fa1d7-cdc4-4232-b5a0-4854ab5d03a4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:03.048565 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ea9526a5-77c0-402e-a0d5-079c2093b5b8 req-5d7fa1d7-cdc4-4232-b5a0-4854ab5d03a4 service nova] Creating event network-vif-deleted:f7999bc8-2b48-495a-82f7-0d1285c8949a for instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 on n-h1-860864-8 Oct 12 23:35:03.053676 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ea9526a5-77c0-402e-a0d5-079c2093b5b8 req-5d7fa1d7-cdc4-4232-b5a0-4854ab5d03a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098466 Oct 12 23:35:03.055298 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3615/7134] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:35:03.440352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:03.441049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] [instance: ae94a476-ec48-4cef-9c51-8b578cae6cd8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:03.448528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:03.449019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:03.450037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:03.450925 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:03.451458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:03.451907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:03.466925 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] HTTP exception thrown: Instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 could not be found. Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Request method failure captured: Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 HTTP/1.1 Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR08MfNC5HBRrZxKM_oxfMy3wOSGyLmx1PItat41Ze6zOD8lITmT6sWiVOE6i6pQPG31cEpOUgB6bLPr5-Pkhkkvovx-dGISU47XBaoruXjJ1YsIbvdgq-z4VxfYZQ6PbOPxowd6ZF7DzeUYHfneJzCQKP7pBMmz6QBhFcfRGZxYcThE Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93de3aefe0a5475596c38e221addea9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93de3aefe0a5475596c38e221addea9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93de3aefe0a5475596c38e221addea9c"}]}] Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 93de3aefe0a5475596c38e221addea9c Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1782621689 Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4c4c3aac44bc4ea19f50c081f36781fc Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-ServersNegativeTestJSON-1782621689-project Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 could not be found. Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ae94a476-ec48-4cef-9c51-8b578cae6cd8'} Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 could not be found. Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 could not be found. Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:35:03.468739 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 could not be found. Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] Returning 404 to user: Instance ae94a476-ec48-4cef-9c51-8b578cae6cd8 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-50a31a6e-942d-4670-87c7-9cd741c55b3f tempest-ServersNegativeTestJSON-1782621689 tempest-ServersNegativeTestJSON-1782621689-project] 10.222.0.20 "GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8" status: 404 len: 111 microversion: 2.1 time: 0.034360 Oct 12 23:35:03.473827 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3520/7135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:03 2022] GET /compute/v2.1/servers/ae94a476-ec48-4cef-9c51-8b578cae6cd8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:35:35.501616 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:35:35.502884 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:35:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 12 23:35:35.505039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=31 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:35.506052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=79 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:35.716977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b779e91b-2460-4f19-b901-4ed2fff8ca5e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: .version_select at 0x7f44fc1a7c10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-170248084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGz/R4fBX1HfxTDVq1pjvDeJYc11wRQ74tkQIBXHcPMxJ/bKvbdf5XtA4JAZe1BN3jbK7gAXzzpCiKbuILIVg6Jya81wlyO/ffknQDS1TQu8Y2NnLGGrT5hbonueuMdkg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:35.733722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b779e91b-2460-4f19-b901-4ed2fff8ca5e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for project 8462c35bff5c43aa82574d827292cf30. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:35:35.739243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-b779e91b-2460-4f19-b901-4ed2fff8ca5e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for user 4cd226a5ea5c446c8250719cfb02b986 and project 8462c35bff5c43aa82574d827292cf30. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:35:35.778701 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b779e91b-2460-4f19-b901-4ed2fff8ca5e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.283563 Oct 12 23:35:35.779748 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3616/7136] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:35:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:35:35.836833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1752188289", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-170248084", "networks": [{"uuid": "bde00fb0-98a1-4181-8d35-7e9939840579"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:35.857897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:35.858680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:35.904670 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] validate_networks() for [('bde00fb0-98a1-4181-8d35-7e9939840579', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:35:36.313105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:35:36.313535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:35:36.314035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:35:36.314450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:35:36.314863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:35:36.323752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:36.324484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:36.324936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:36.325644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:36.326104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:36.326531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:36.343952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for project 8462c35bff5c43aa82574d827292cf30. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:35:36.349175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for user 4cd226a5ea5c446c8250719cfb02b986 and project 8462c35bff5c43aa82574d827292cf30. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:35:36.362081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:35:36.364432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:35:36.411983 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ecfa010-f3d3-4364-a7bd-cb4be783a18c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579044 Oct 12 23:35:36.412638 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3521/7137] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:35:36.423993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-938b11b3-81b8-4b14-9279-d1793315828e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:36.424700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-938b11b3-81b8-4b14-9279-d1793315828e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:36.483600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-938b11b3-81b8-4b14-9279-d1793315828e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:36.490533 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-938b11b3-81b8-4b14-9279-d1793315828e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1262 microversion: 2.1 time: 0.070447 Oct 12 23:35:36.491110 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3617/7138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:36 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:37.515323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:37.516460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:37.527688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:37.528646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:37.529330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:37.530816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:37.531499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:37.532310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:37.939219 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:37.948915 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d225cc2d-b315-4249-8f07-09a3681a6110 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1322 microversion: 2.1 time: 0.438922 Oct 12 23:35:37.949783 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3522/7139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:37 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:38.976827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:38.977481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:38.992776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:38.993208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:38.993660 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:38.994390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:38.994870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:38.995348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:39.136607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:39.145278 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-887f974d-5cf6-482a-ba51-3b3b43ae513a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1362 microversion: 2.1 time: 0.173275 Oct 12 23:35:39.146139 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3618/7140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:38 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:39.297557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8aacb797-570e-42fb-a243-cebac4bd713a req-fb33ec62-bd6a-40e3-ae0e-1f3f47f2177a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1049f39d-9824-47b8-af49-5e2b6011ac4a", "tag": "1c753e37-b53a-424e-ab45-712407ee7982"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:39.308683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8aacb797-570e-42fb-a243-cebac4bd713a req-fb33ec62-bd6a-40e3-ae0e-1f3f47f2177a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:39.309172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8aacb797-570e-42fb-a243-cebac4bd713a req-fb33ec62-bd6a-40e3-ae0e-1f3f47f2177a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:39.309608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8aacb797-570e-42fb-a243-cebac4bd713a req-fb33ec62-bd6a-40e3-ae0e-1f3f47f2177a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:39.322542 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8aacb797-570e-42fb-a243-cebac4bd713a req-fb33ec62-bd6a-40e3-ae0e-1f3f47f2177a service nova] Creating event network-changed:1c753e37-b53a-424e-ab45-712407ee7982 for instance 1049f39d-9824-47b8-af49-5e2b6011ac4a on n-h1-860864-8 Oct 12 23:35:39.330315 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8aacb797-570e-42fb-a243-cebac4bd713a req-fb33ec62-bd6a-40e3-ae0e-1f3f47f2177a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036447 Oct 12 23:35:39.330954 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3523/7141] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:35:40.169447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:40.170101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:40.177269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:40.177771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:40.178219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:40.178936 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:40.179400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:40.179835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:40.307090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:40.314677 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fad38cb-15f2-433d-9aba-adf1d1d7281d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1362 microversion: 2.1 time: 0.149805 Oct 12 23:35:40.315242 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3619/7142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:40 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:41.338200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:41.338915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:41.346119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:41.346597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:41.347030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:41.347718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:41.348192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:41.348619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:41.488310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:41.496173 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1204ce50-e851-4f4a-a21b-08c318bb83dd tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1362 microversion: 2.1 time: 0.162154 Oct 12 23:35:41.496749 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3524/7143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:41 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:42.518830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:42.519440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:42.527083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:42.527575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:42.528055 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:42.528758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:42.529248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:42.529707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:42.663570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:42.671534 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-68183970-cc8e-4aa6-91ba-f80e43781b9b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1362 microversion: 2.1 time: 0.156676 Oct 12 23:35:42.672198 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3620/7144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:42 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:43.694223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:43.694837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:43.701797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:43.702273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:43.702704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:43.703384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:43.703830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:43.704271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:43.832003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:43.840250 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1e03223d-7f22-43b9-9ee5-1243b5128d1e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1362 microversion: 2.1 time: 0.149930 Oct 12 23:35:43.840814 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3525/7145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:43 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:44.863696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:44.864349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:44.871202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:44.871690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:44.872151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:44.872841 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:44.873296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:44.873725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:44.998738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:45.006564 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-91ed5680-e160-4e2a-8e27-eecacb7f3a18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1362 microversion: 2.1 time: 0.146751 Oct 12 23:35:45.007127 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3621/7146] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:44 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:45.145259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5bc2a916-fe23-4812-b8df-d01de92db361 req-7919c7a7-a086-40f5-83fd-a578991b1c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1049f39d-9824-47b8-af49-5e2b6011ac4a", "name": "network-vif-plugged", "status": "completed", "tag": "1c753e37-b53a-424e-ab45-712407ee7982"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:45.156453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5bc2a916-fe23-4812-b8df-d01de92db361 req-7919c7a7-a086-40f5-83fd-a578991b1c36 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:45.156934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5bc2a916-fe23-4812-b8df-d01de92db361 req-7919c7a7-a086-40f5-83fd-a578991b1c36 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:45.157362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5bc2a916-fe23-4812-b8df-d01de92db361 req-7919c7a7-a086-40f5-83fd-a578991b1c36 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:45.168736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5bc2a916-fe23-4812-b8df-d01de92db361 req-7919c7a7-a086-40f5-83fd-a578991b1c36 service nova] Creating event network-vif-plugged:1c753e37-b53a-424e-ab45-712407ee7982 for instance 1049f39d-9824-47b8-af49-5e2b6011ac4a on n-h1-860864-8 Oct 12 23:35:45.173643 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5bc2a916-fe23-4812-b8df-d01de92db361 req-7919c7a7-a086-40f5-83fd-a578991b1c36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Oct 12 23:35:45.174471 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3526/7147] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:35:46.029480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:46.030106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:46.037284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:46.037774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:46.038219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:46.038917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:46.039383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:46.039823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:46.173275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:46.180957 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5fe4d6d-f544-4c56-a2a3-09ce7e4e3757 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1362 microversion: 2.1 time: 0.155890 Oct 12 23:35:46.181531 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3622/7148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:46 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:47.201105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:47.201802 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:47.206328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:47.207068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:47.214408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:47.214886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:47.215318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:47.216231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:47.216754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:47.217183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:47.344456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:47.352173 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b996a3ec-4d52-4edb-bba1-0984590f1d73 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1553 microversion: 2.1 time: 0.152911 Oct 12 23:35:47.352747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3527/7149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:47 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:47.375122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:35:47.375738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:47.377617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:35:47.383476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:47.384012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:47.384461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:47.385150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:47.385604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:47.386033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:47.513070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:35:47.521192 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30fd9e3f-5e00-4313-a1dc-2acad6fe540d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1553 microversion: 2.1 time: 0.149857 Oct 12 23:35:47.521767 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3623/7150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:35:47 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:35:49.182168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9624f40a-aaca-4b3a-b73f-53a85cb9605c"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:35:49.184599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:35:49.191295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:49.191779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:49.192248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:49.192935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:35:49.193384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:35:49.193806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:35:49.428606 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7c4fa809-3b5f-4c3a-bb23-f9c5500a051d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250199 Oct 12 23:35:49.429222 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3528/7151] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:35:49 2022] POST /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:00.131785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:00.132333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:00.134431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:00.135220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=36 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:00.141734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:00.142216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:00.142657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:00.143341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:00.143798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:00.144250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:00.223118 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lazy-loading 'services' on Instance uuid 1049f39d-9824-47b8-af49-5e2b6011ac4a {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:36:00.292634 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-225605c5-eea6-4c9a-a37b-cf8acc3b80cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments/9624f40a-aaca-4b3a-b73f-53a85cb9605c" status: 202 len: 0 microversion: 2.1 time: 0.164696 Oct 12 23:36:00.293276 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3624/7152] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:36:00 2022] DELETE /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments/9624f40a-aaca-4b3a-b73f-53a85cb9605c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:36:00.299723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:00.300516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:00.304917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:00.307236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:00.315740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:00.316314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:00.316754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:00.317463 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:00.317911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:00.318336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:00.351539 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d36cfc9-5109-4001-9cd9-8597ab928edb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053763 Oct 12 23:36:00.352267 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3529/7153] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:00 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:01.365980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:01.368318 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:01.374629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:01.375128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:01.375586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:01.376330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:01.376800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:01.377238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:01.408935 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-795765e5-49ac-4a8c-b8b5-20f7b3850d16 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048327 Oct 12 23:36:01.409507 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3625/7154] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:01 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:02.422185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:02.424354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:02.431149 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:02.431625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:02.432097 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:02.432788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:02.433239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:02.433662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:02.465682 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d36f104f-061f-4a85-b22f-1d1b0a5a6045 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Oct 12 23:36:02.466256 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3530/7155] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:02 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:03.478275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:03.480662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:03.487415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:03.487944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:03.488397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:03.489090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:03.489556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:03.489989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:03.520354 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8805129c-6b18-4ee3-bfa6-b371db535505 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Oct 12 23:36:03.520930 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3626/7156] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:03 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:04.533375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:04.535540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:04.542609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:04.543087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:04.543515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:04.544234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:04.544681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:04.545099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:04.575326 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd0f0267-c8b3-4b5e-a3ea-581f905979eb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Oct 12 23:36:04.575916 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3531/7157] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:04 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:36:05.587622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:05.589817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:05.596589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:05.597080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:05.597553 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:05.598249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:05.598710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:05.599147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:05.628238 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-051fde17-4e1e-4721-af63-d9853d6c4fa3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044819 Oct 12 23:36:05.628794 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3627/7158] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:05 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:36:05.640699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:05.641201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:05.647872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:05.648374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:05.648805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:05.649481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:05.649924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:05.650339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:05.724451 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] HTTP exception thrown: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a is not attached to volume 9624f40a-aaca-4b3a-b73f-53a85cb9605c Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Request method failure captured: Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments/9624f40a-aaca-4b3a-b73f-53a85cb9605c HTTP/1.1 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR09ClI7IUNRhnB01i6XE4F9ksW2zstXQ43LhxRB2xwYGJoI0vr9w6GJvxaQ7eZiOvmA2PnEOox1lDQHG4wuJkcu_NL33Cvj5m5GHuJT_-L8LvHfbPKX2lvMYuOum6oVwVURPrn_Y2a7tAUHbPocoT4uJo0WhKUdPxnqJRhjQPY7flJ0 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8462c35bff5c43aa82574d827292cf30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}] Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4cd226a5ea5c446c8250719cfb02b986 Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a is not attached to volume 9624f40a-aaca-4b3a-b73f-53a85cb9605c Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '1049f39d-9824-47b8-af49-5e2b6011ac4a', 'id': '9624f40a-aaca-4b3a-b73f-53a85cb9605c'} Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9624f40a-aaca-4b3a-b73f-53a85cb9605c. Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a is not attached to volume 9624f40a-aaca-4b3a-b73f-53a85cb9605c Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:05.733721 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:05.738160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:36:05.738160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:36:05.738160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a is not attached to volume 9624f40a-aaca-4b3a-b73f-53a85cb9605c Oct 12 23:36:05.738160 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:05.738160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Returning 404 to user: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a is not attached to volume 9624f40a-aaca-4b3a-b73f-53a85cb9605c {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:36:05.738160 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-97ceb080-0091-4c6d-a6e3-98782d9199f0 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments/9624f40a-aaca-4b3a-b73f-53a85cb9605c" status: 404 len: 154 microversion: 2.1 time: 0.099183 Oct 12 23:36:05.738160 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3532/7159] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:36:05 2022] DELETE /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a/os-volume_attachments/9624f40a-aaca-4b3a-b73f-53a85cb9605c => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:36:09.081015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:09.081560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:09.088617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:09.089112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:09.089556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:09.090266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:09.090726 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:09.091156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:09.120524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:36:09.198943 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-928a2c19-ec63-4e0f-a28f-b4bb90830eea tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 204 len: 0 microversion: 2.1 time: 0.121453 Oct 12 23:36:09.200029 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3628/7160] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:36:09 2022] DELETE /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:36:09.208414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:09.209027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:09.219833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:09.220336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:09.220768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:09.221456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:09.221899 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:09.222324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:09.356545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:09.364322 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cff4ed62-5216-4556-bccc-937567b5495d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1559 microversion: 2.1 time: 0.159899 Oct 12 23:36:09.364895 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3533/7161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:09 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:10.388425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:10.389096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:10.396197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:10.396692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:10.397137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:10.397842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:10.398305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:10.398741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:10.532085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:10.540072 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-612a9b14-a623-42e9-bb70-027cb1dc437a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1559 microversion: 2.1 time: 0.156129 Oct 12 23:36:10.540638 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3629/7162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:10 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:11.216990 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8bb275bd-fe04-46e6-947f-25696034e8e7 req-4c46ebcc-3110-4964-9b96-c589f5c816d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1049f39d-9824-47b8-af49-5e2b6011ac4a", "name": "network-vif-deleted", "tag": "1c753e37-b53a-424e-ab45-712407ee7982"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:11.229538 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8bb275bd-fe04-46e6-947f-25696034e8e7 req-4c46ebcc-3110-4964-9b96-c589f5c816d7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:11.229936 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8bb275bd-fe04-46e6-947f-25696034e8e7 req-4c46ebcc-3110-4964-9b96-c589f5c816d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:11.230363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8bb275bd-fe04-46e6-947f-25696034e8e7 req-4c46ebcc-3110-4964-9b96-c589f5c816d7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:11.242392 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8bb275bd-fe04-46e6-947f-25696034e8e7 req-4c46ebcc-3110-4964-9b96-c589f5c816d7 service nova] Creating event network-vif-deleted:1c753e37-b53a-424e-ab45-712407ee7982 for instance 1049f39d-9824-47b8-af49-5e2b6011ac4a on n-h1-860864-8 Oct 12 23:36:11.247735 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8bb275bd-fe04-46e6-947f-25696034e8e7 req-4c46ebcc-3110-4964-9b96-c589f5c816d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035018 Oct 12 23:36:11.248361 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3534/7163] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:11.563331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:11.564023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:11.571047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:11.571548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:11.572027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:11.572752 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:11.573216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:11.573662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:11.607990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:11.608493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:11.608938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:11.609407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lazy-loading 'fault' on Instance uuid 1049f39d-9824-47b8-af49-5e2b6011ac4a {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:36:11.672682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:11.680957 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9836ccb-009e-4f8a-96da-71c599be399e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 200 len: 1352 microversion: 2.1 time: 0.122134 Oct 12 23:36:11.681580 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3630/7164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:11 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 1352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:12.705834 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:12.706562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 1049f39d-9824-47b8-af49-5e2b6011ac4a] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:12.712742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:12.713213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:12.713646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:12.714318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:12.714763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:12.715753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:12.728648 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] HTTP exception thrown: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a could not be found. Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Request method failure captured: Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a HTTP/1.1 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR09ClI7IUNRhnB01i6XE4F9ksW2zstXQ43LhxRB2xwYGJoI0vr9w6GJvxaQ7eZiOvmA2PnEOox1lDQHG4wuJkcu_NL33Cvj5m5GHuJT_-L8LvHfbPKX2lvMYuOum6oVwVURPrn_Y2a7tAUHbPocoT4uJo0WhKUdPxnqJRhjQPY7flJ0 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8462c35bff5c43aa82574d827292cf30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}] Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4cd226a5ea5c446c8250719cfb02b986 Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a could not be found. Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '1049f39d-9824-47b8-af49-5e2b6011ac4a'} Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a could not be found. Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a could not be found. Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:12.730213 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a could not be found. Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Returning 404 to user: Instance 1049f39d-9824-47b8-af49-5e2b6011ac4a could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6523cd57-c46f-4156-91e5-914be993ef0a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a" status: 404 len: 111 microversion: 2.1 time: 0.030918 Oct 12 23:36:12.734288 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3535/7165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:12 2022] GET /compute/v2.1/servers/1049f39d-9824-47b8-af49-5e2b6011ac4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:36:12.740404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac4f9099-da62-45a9-8a65-724442822c38 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '.version_select at 0x7f44fc198c10>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:12.762545 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac4f9099-da62-45a9-8a65-724442822c38 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-170248084" status: 202 len: 0 microversion: 2.1 time: 0.025326 Oct 12 23:36:12.763129 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3631/7166] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 12 23:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-170248084 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:36:12.781977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57d8318f-b03a-4eb8-aefe-9c5af9e8fc45 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: .version_select at 0x7f44fe535dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1074421063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeY9KqPah39h+2MH/8HpRiL2tfW5lakEsVe2evChdEfKURLk1me4/LAqdzbPkLNZ4qLDfH8X2P7Agk9bCgzwN9IOrO80D1NSzemLo+IcDwhZv6SGlgqDO2Z9FFgaVy18w=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:12.797227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-57d8318f-b03a-4eb8-aefe-9c5af9e8fc45 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for project 8462c35bff5c43aa82574d827292cf30. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:36:12.802992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-57d8318f-b03a-4eb8-aefe-9c5af9e8fc45 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for user 4cd226a5ea5c446c8250719cfb02b986 and project 8462c35bff5c43aa82574d827292cf30. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:36:12.825176 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57d8318f-b03a-4eb8-aefe-9c5af9e8fc45 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.047160 Oct 12 23:36:12.825748 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3536/7167] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:36:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:12.875027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-255625793", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1074421063", "networks": [{"uuid": "bde00fb0-98a1-4181-8d35-7e9939840579"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:12.926730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] validate_networks() for [('bde00fb0-98a1-4181-8d35-7e9939840579', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:36:13.386765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:36:13.387198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:36:13.387681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:36:13.388127 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:36:13.388544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:36:13.397798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:13.398286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:13.398729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:13.399464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:13.399954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:13.400391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:13.417637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for project 8462c35bff5c43aa82574d827292cf30. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:36:13.423341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for user 4cd226a5ea5c446c8250719cfb02b986 and project 8462c35bff5c43aa82574d827292cf30. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:36:13.436132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:36:13.438446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:36:13.484479 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b58d802-2f61-46a5-9b35-ddc25266c193 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613834 Oct 12 23:36:13.485136 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3632/7168] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:36:13.496972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e64be022-f20f-4697-8b87-94acb1bc4b98 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:13.497593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e64be022-f20f-4697-8b87-94acb1bc4b98 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:13.551215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e64be022-f20f-4697-8b87-94acb1bc4b98 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:13.558203 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e64be022-f20f-4697-8b87-94acb1bc4b98 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1262 microversion: 2.1 time: 0.065909 Oct 12 23:36:13.559460 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3537/7169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:13 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:14.582598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:14.583311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:14.590351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:14.590845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:14.591286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:14.592003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:14.592460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:14.592890 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:14.654179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:14.662583 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac29578e-2668-47c0-98f0-4bc391786b9e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1320 microversion: 2.1 time: 0.084856 Oct 12 23:36:14.663164 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3633/7170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:14 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1320 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:15.686522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:15.687173 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:15.693942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:15.694427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:15.694860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:15.695551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:15.696028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:15.696454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:15.817758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-646b9a62-2c58-47ca-94f3-ea3c2a01c385 req-5188b864-c6ca-4c06-af32-a340c7f8e69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800dbf81-0a6e-4c34-8c04-1f901fab4cb7", "tag": "9d949f9c-fe9a-4f12-83f0-fe5b9dfea6c9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:15.829157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-646b9a62-2c58-47ca-94f3-ea3c2a01c385 req-5188b864-c6ca-4c06-af32-a340c7f8e69c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:15.829934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-646b9a62-2c58-47ca-94f3-ea3c2a01c385 req-5188b864-c6ca-4c06-af32-a340c7f8e69c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:15.830373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-646b9a62-2c58-47ca-94f3-ea3c2a01c385 req-5188b864-c6ca-4c06-af32-a340c7f8e69c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:15.842912 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-646b9a62-2c58-47ca-94f3-ea3c2a01c385 req-5188b864-c6ca-4c06-af32-a340c7f8e69c service nova] Creating event network-changed:9d949f9c-fe9a-4f12-83f0-fe5b9dfea6c9 for instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 on n-h1-860864-8 Oct 12 23:36:15.847927 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-646b9a62-2c58-47ca-94f3-ea3c2a01c385 req-5188b864-c6ca-4c06-af32-a340c7f8e69c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034142 Oct 12 23:36:15.848693 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3634/7171] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:15.931612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:15.940303 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ed999b7-11f9-4f61-ace6-65254181f1b4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1362 microversion: 2.1 time: 0.257506 Oct 12 23:36:15.940905 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3538/7172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:15 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:16.963915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:16.964650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:16.972155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:16.972648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:16.973097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:16.973793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:16.974254 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:16.974690 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:17.109800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:17.118398 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e08668c-b010-4cd8-a750-fde6a205f45a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1362 microversion: 2.1 time: 0.158728 Oct 12 23:36:17.118996 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3635/7173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:16 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:18.141237 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:18.141958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:18.148751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:18.149222 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:18.149648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:18.150322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:18.150763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:18.151178 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:18.282630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:18.290524 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1deae10d-ed9c-4d26-b0ed-7a9398e6d1fa tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1362 microversion: 2.1 time: 0.153169 Oct 12 23:36:18.291115 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3539/7174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:18 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:19.314808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:19.315349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:19.323013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:19.323524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:19.324018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:19.324740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:19.325207 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:19.325644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:19.458762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:19.466340 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61d757c7-e558-4555-a621-bf94add8c42a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1362 microversion: 2.1 time: 0.155683 Oct 12 23:36:19.466909 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3636/7175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:19 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:20.489494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:20.490112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:20.497013 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:20.497495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:20.497942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:20.498633 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:20.499086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:20.499511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:20.624350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:20.632191 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-de19d7ff-d53f-43e0-af1c-3f5141deafb7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1362 microversion: 2.1 time: 0.146569 Oct 12 23:36:20.632791 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3540/7176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:20 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:21.306326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-826cf2d2-2073-4723-a716-de1ce5e2817e req-c92567f0-9827-4b28-badd-5e6ac8935a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800dbf81-0a6e-4c34-8c04-1f901fab4cb7", "name": "network-vif-plugged", "status": "completed", "tag": "9d949f9c-fe9a-4f12-83f0-fe5b9dfea6c9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:21.317755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-826cf2d2-2073-4723-a716-de1ce5e2817e req-c92567f0-9827-4b28-badd-5e6ac8935a4d service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:21.318278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-826cf2d2-2073-4723-a716-de1ce5e2817e req-c92567f0-9827-4b28-badd-5e6ac8935a4d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:21.318930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-826cf2d2-2073-4723-a716-de1ce5e2817e req-c92567f0-9827-4b28-badd-5e6ac8935a4d service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:21.331102 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-826cf2d2-2073-4723-a716-de1ce5e2817e req-c92567f0-9827-4b28-badd-5e6ac8935a4d service nova] Creating event network-vif-plugged:9d949f9c-fe9a-4f12-83f0-fe5b9dfea6c9 for instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 on n-h1-860864-8 Oct 12 23:36:21.336191 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-826cf2d2-2073-4723-a716-de1ce5e2817e req-c92567f0-9827-4b28-badd-5e6ac8935a4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033522 Oct 12 23:36:21.336946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3637/7177] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:21.655091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:21.655702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:21.662777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:21.663258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:21.663689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:21.664392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:21.664838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:21.665259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:21.793131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:21.801071 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a3e81b5-9ff5-4420-a2fe-36b5edef7178 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1362 microversion: 2.1 time: 0.149982 Oct 12 23:36:21.801641 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3541/7178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:21 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:22.826314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:22.827026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:22.833380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:22.833873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:22.834316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:22.835018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:22.835479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:22.835931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:22.967373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:22.975158 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3417a32-6014-4b8a-b42b-72070eebf9a4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1554 microversion: 2.1 time: 0.154712 Oct 12 23:36:22.975734 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3638/7179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:22 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:22.997795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:22.998400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:23.005202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:23.005674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:23.006108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:23.006784 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:23.007231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:23.007651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:23.135739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:23.143348 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8746b740-c36b-4781-b4e1-cdd04997936a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1554 microversion: 2.1 time: 0.149994 Oct 12 23:36:23.143927 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3542/7180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:22 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:24.634905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "203c34b3-c009-42bc-b799-8e22fe4871d4"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:24.637270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:24.641016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:24.642048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:24.648395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:24.648882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:24.649323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:24.650018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:24.650562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:24.650991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:24.886671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:24.904239 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7401da87-7468-4276-b45c-8b72c410a911 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273469 Oct 12 23:36:24.904861 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3639/7181] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:36:24 2022] POST /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:35.615164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:35.615686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:35.618044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:35.618825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:35.619731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=64 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:35.626761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:35.627243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:35.627681 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:35.628396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:35.628844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:35.629292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:35.710625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lazy-loading 'services' on Instance uuid 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:36:35.781517 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac0d704c-7658-43b8-8060-b20470fe6aa2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments/203c34b3-c009-42bc-b799-8e22fe4871d4" status: 202 len: 0 microversion: 2.1 time: 0.170177 Oct 12 23:36:35.782180 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3543/7182] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:36:35 2022] DELETE /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments/203c34b3-c009-42bc-b799-8e22fe4871d4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:36:35.792426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:35.794903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:35.797955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:35.804983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:35.805461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:35.805902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:35.806603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:35.807487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:35.808319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:35.842741 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-987204ae-b8e2-47ac-b05e-f062c0648263 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055068 Oct 12 23:36:35.843325 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3640/7183] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:35 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:36:36.856702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:36.859051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:36.865552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:36.866035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:36.866464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:36.867147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:36.867590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:36.868026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:36.897681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a57e76cc-6943-406c-9fae-3a8e3d2e21f8 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046741 Oct 12 23:36:36.898243 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3544/7184] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:36 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:37.910286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:37.912781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:37.919666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:37.920195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:37.920648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:37.921352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:37.921819 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:37.922255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:37.956196 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b83adae-5f6e-4298-9c4d-7539050d9344 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049946 Oct 12 23:36:37.956783 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3641/7185] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:37 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:38.968758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:38.971213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:38.977954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:38.978440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:38.978851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:38.979527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:38.979993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:38.980412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:39.012943 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe3435d3-970a-43d7-a3b8-bff415f1fabc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Oct 12 23:36:39.013501 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3545/7186] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:38 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:36:40.025479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:40.028239 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:40.035085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:40.035597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:40.036066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:40.037017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:40.037471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:40.037897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:40.353612 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d3bcb6e-43eb-48e5-9842-e23933b1e25e tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.331868 Oct 12 23:36:40.354226 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3642/7187] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:36:40 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments => generated 25 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:36:40.365048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:40.365581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:40.372385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:40.372861 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:40.373289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:40.373968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:40.374412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:40.374839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:40.450381 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] HTTP exception thrown: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 is not attached to volume 203c34b3-c009-42bc-b799-8e22fe4871d4 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Request method failure captured: Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments/203c34b3-c009-42bc-b799-8e22fe4871d4 HTTP/1.1 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR09ClI7IUNRhnB01i6XE4F9ksW2zstXQ43LhxRB2xwYGJoI0vr9w6GJvxaQ7eZiOvmA2PnEOox1lDQHG4wuJkcu_NL33Cvj5m5GHuJT_-L8LvHfbPKX2lvMYuOum6oVwVURPrn_Y2a7tAUHbPocoT4uJo0WhKUdPxnqJRhjQPY7flJ0 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8462c35bff5c43aa82574d827292cf30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}] Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4cd226a5ea5c446c8250719cfb02b986 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 is not attached to volume 203c34b3-c009-42bc-b799-8e22fe4871d4 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '800dbf81-0a6e-4c34-8c04-1f901fab4cb7', 'id': '203c34b3-c009-42bc-b799-8e22fe4871d4'} Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 203c34b3-c009-42bc-b799-8e22fe4871d4. Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 is not attached to volume 203c34b3-c009-42bc-b799-8e22fe4871d4 Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:40.452076 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:40.456314 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:36:40.456314 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:36:40.456314 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 is not attached to volume 203c34b3-c009-42bc-b799-8e22fe4871d4 Oct 12 23:36:40.456314 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:40.456314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Returning 404 to user: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 is not attached to volume 203c34b3-c009-42bc-b799-8e22fe4871d4 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:36:40.456314 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93f039e0-e8f3-4b1d-b8fa-068549d8c649 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments/203c34b3-c009-42bc-b799-8e22fe4871d4" status: 404 len: 154 microversion: 2.1 time: 0.092512 Oct 12 23:36:40.456314 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3546/7188] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:36:40 2022] DELETE /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7/os-volume_attachments/203c34b3-c009-42bc-b799-8e22fe4871d4 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 23:36:43.838905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:43.839413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:43.846389 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:43.846884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:43.847332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:43.848071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:43.848536 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:43.848974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:43.874113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:36:43.952524 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0dcb5df9-e019-443d-8f98-0a0ee180d509 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 204 len: 0 microversion: 2.1 time: 0.116947 Oct 12 23:36:43.952976 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3643/7189] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:36:43 2022] DELETE /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:36:43.962197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:43.962996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:43.969689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:43.970278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:43.970810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:43.971584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:43.972133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:43.972623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:44.106970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:44.115385 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a04bc33b-afa8-497a-ba30-bc4b2f4be15d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1560 microversion: 2.1 time: 0.157895 Oct 12 23:36:44.115980 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3547/7190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:43 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:45.140290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:45.141002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:45.148477 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:45.148973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:45.149423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:45.150130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:45.150592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:45.151025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:45.281640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:45.289696 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b6a728c-7771-4bb6-b0d5-8555f89b5d95 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1560 microversion: 2.1 time: 0.154407 Oct 12 23:36:45.290264 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3644/7191] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:45 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:36:45.993105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1fac5d4e-9494-4dc2-b397-e7359649dd63 req-05d8f8e0-3f64-4fed-ab7a-5663747e8207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800dbf81-0a6e-4c34-8c04-1f901fab4cb7", "name": "network-vif-deleted", "tag": "9d949f9c-fe9a-4f12-83f0-fe5b9dfea6c9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:46.006348 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1fac5d4e-9494-4dc2-b397-e7359649dd63 req-05d8f8e0-3f64-4fed-ab7a-5663747e8207 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:46.006944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1fac5d4e-9494-4dc2-b397-e7359649dd63 req-05d8f8e0-3f64-4fed-ab7a-5663747e8207 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:46.007648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1fac5d4e-9494-4dc2-b397-e7359649dd63 req-05d8f8e0-3f64-4fed-ab7a-5663747e8207 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:46.021152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1fac5d4e-9494-4dc2-b397-e7359649dd63 req-05d8f8e0-3f64-4fed-ab7a-5663747e8207 service nova] Creating event network-vif-deleted:9d949f9c-fe9a-4f12-83f0-fe5b9dfea6c9 for instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 on n-h1-860864-8 Oct 12 23:36:46.027107 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1fac5d4e-9494-4dc2-b397-e7359649dd63 req-05d8f8e0-3f64-4fed-ab7a-5663747e8207 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038593 Oct 12 23:36:46.027821 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3548/7192] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:46.313452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:46.314025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:46.323164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:46.323667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:46.324149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:46.324864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:46.325335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:46.325776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:46.357237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:46.357733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:46.358182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:46.358645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lazy-loading 'fault' on Instance uuid 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:36:46.401177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:46.410221 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b139a08-6ee9-4cd7-9161-72e0c6ffc0e7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 200 len: 1352 microversion: 2.1 time: 0.100903 Oct 12 23:36:46.410828 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3645/7193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:46 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:47.435438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:47.436193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 800dbf81-0a6e-4c34-8c04-1f901fab4cb7] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:47.443203 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:47.443661 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:47.444140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:47.444827 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:47.445276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:47.445697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:47.459597 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] HTTP exception thrown: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 could not be found. Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Request method failure captured: Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 HTTP/1.1 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR09ClI7IUNRhnB01i6XE4F9ksW2zstXQ43LhxRB2xwYGJoI0vr9w6GJvxaQ7eZiOvmA2PnEOox1lDQHG4wuJkcu_NL33Cvj5m5GHuJT_-L8LvHfbPKX2lvMYuOum6oVwVURPrn_Y2a7tAUHbPocoT4uJo0WhKUdPxnqJRhjQPY7flJ0 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8462c35bff5c43aa82574d827292cf30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}] Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4cd226a5ea5c446c8250719cfb02b986 Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 could not be found. Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '800dbf81-0a6e-4c34-8c04-1f901fab4cb7'} Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 could not be found. Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 could not be found. Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:47.461223 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 could not be found. Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Returning 404 to user: Instance 800dbf81-0a6e-4c34-8c04-1f901fab4cb7 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5b650a6-f028-4726-bf91-55a7cb6ab2d3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7" status: 404 len: 111 microversion: 2.1 time: 0.032213 Oct 12 23:36:47.465355 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3549/7194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:47 2022] GET /compute/v2.1/servers/800dbf81-0a6e-4c34-8c04-1f901fab4cb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:36:47.471470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4dd28933-e557-4946-854a-9455e6ccc3b7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '.version_select at 0x7f44fc279790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:47.490807 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4dd28933-e557-4946-854a-9455e6ccc3b7 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1074421063" status: 202 len: 0 microversion: 2.1 time: 0.023161 Oct 12 23:36:47.491378 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3646/7195] 10.222.0.20 () {58 vars in 1278 bytes} [Wed Oct 12 23:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1074421063 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:36:47.508517 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6221099c-2bb6-40aa-82ba-20d380ff3a1d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: .version_select at 0x7f44fe5e88b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1644057942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5igxoqxveSi0tMkMBPWoiCVhBc5FYsuy/AcIS1uD3IH7vQr4mS4OFrsdRtttq7r7ts8GQNZtP+9epQpl8HWp1C/cV1wWDvsLw8XBUQN6JXNrP3rxvD/bUYwufF8RK6dg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:47.524382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6221099c-2bb6-40aa-82ba-20d380ff3a1d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for project 8462c35bff5c43aa82574d827292cf30. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:36:47.530250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-6221099c-2bb6-40aa-82ba-20d380ff3a1d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for user 4cd226a5ea5c446c8250719cfb02b986 and project 8462c35bff5c43aa82574d827292cf30. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:36:47.553225 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6221099c-2bb6-40aa-82ba-20d380ff3a1d tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048530 Oct 12 23:36:47.553809 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3550/7196] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:36:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:47.603527 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1023761308", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1644057942", "networks": [{"uuid": "bde00fb0-98a1-4181-8d35-7e9939840579"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:47.654892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] validate_networks() for [('bde00fb0-98a1-4181-8d35-7e9939840579', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:36:48.018296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:36:48.018732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:36:48.019216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:36:48.019635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:36:48.020095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:36:48.029419 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:48.029908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:48.030351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:48.031081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:48.031543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:48.032004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:48.048925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for project 8462c35bff5c43aa82574d827292cf30. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:36:48.054146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Getting quotas for user 4cd226a5ea5c446c8250719cfb02b986 and project 8462c35bff5c43aa82574d827292cf30. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:36:48.067148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:36:48.069578 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:36:48.116138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79f7c10c-cdcc-40af-91dd-a4b58752875b tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516534 Oct 12 23:36:48.116802 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3647/7197] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:36:48.128486 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1e51b951-2712-4d23-a943-b95c33350e5a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:48.129111 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1e51b951-2712-4d23-a943-b95c33350e5a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:48.187499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1e51b951-2712-4d23-a943-b95c33350e5a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:48.194518 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1e51b951-2712-4d23-a943-b95c33350e5a tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1263 microversion: 2.1 time: 0.069896 Oct 12 23:36:48.195088 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3551/7198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:48 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:49.219666 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:49.220467 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:49.229863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:49.230422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:49.230955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:49.231746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:49.232291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:49.232786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:49.310645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:49.318233 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d8764267-409a-4e0f-b6f0-43210b2d64c1 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1321 microversion: 2.1 time: 0.104166 Oct 12 23:36:49.318802 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3648/7199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:49 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1321 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:50.343227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:50.343865 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:50.351253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:50.352083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:50.352519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:50.353293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:50.353785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:50.354296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:50.431962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-aad0bf62-411d-499f-9db0-e11e7ae69878 req-354f144c-8af4-4123-bfb5-0a72afcc746f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d7770d-5f5f-4c1a-acce-35d24557ad2c", "tag": "49f66057-28ea-4c25-abe7-abf3478d2b0b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:50.452880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aad0bf62-411d-499f-9db0-e11e7ae69878 req-354f144c-8af4-4123-bfb5-0a72afcc746f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:50.453733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aad0bf62-411d-499f-9db0-e11e7ae69878 req-354f144c-8af4-4123-bfb5-0a72afcc746f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:50.454767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aad0bf62-411d-499f-9db0-e11e7ae69878 req-354f144c-8af4-4123-bfb5-0a72afcc746f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:50.470221 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-aad0bf62-411d-499f-9db0-e11e7ae69878 req-354f144c-8af4-4123-bfb5-0a72afcc746f service nova] Creating event network-changed:49f66057-28ea-4c25-abe7-abf3478d2b0b for instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c on n-h2-860864-8 Oct 12 23:36:50.476785 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-aad0bf62-411d-499f-9db0-e11e7ae69878 req-354f144c-8af4-4123-bfb5-0a72afcc746f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048651 Oct 12 23:36:50.477568 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3649/7200] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:50.499817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:50.507644 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75ecf8e9-9735-4d5d-aa0d-91d71aea94cc tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1363 microversion: 2.1 time: 0.168690 Oct 12 23:36:50.508242 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3552/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:50 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:51.531856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:51.532564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:51.539845 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:51.540376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:51.540830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:51.541533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:51.542003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:51.542443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:51.724786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:51.732645 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1090fdfc-3480-4477-8ab1-02ec1ca3c9e2 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1363 microversion: 2.1 time: 0.205772 Oct 12 23:36:51.733235 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3650/7202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:51 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:52.754606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:52.757067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:52.764001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:52.764491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:52.765143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:52.765845 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:52.766452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:52.766884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:52.898153 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:52.906317 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d49555ee-58b6-4404-9b4a-f72ca6789a4c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1363 microversion: 2.1 time: 0.155622 Oct 12 23:36:52.906897 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3553/7203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:52 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:53.929941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:53.930573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:53.937518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:53.938017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:53.938468 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:53.939172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:53.939644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:53.940116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:54.068110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:54.076411 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8cf86ad-716f-49ba-907f-fb7352a34a43 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1363 microversion: 2.1 time: 0.150402 Oct 12 23:36:54.076974 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3651/7204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:53 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:54.499613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-179edff5-bbbf-468f-86d6-58c950a71cfb req-9413078a-1eba-4501-a805-d907d05ac3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d7770d-5f5f-4c1a-acce-35d24557ad2c", "name": "network-vif-plugged", "status": "completed", "tag": "49f66057-28ea-4c25-abe7-abf3478d2b0b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:54.510839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-179edff5-bbbf-468f-86d6-58c950a71cfb req-9413078a-1eba-4501-a805-d907d05ac3b9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:54.512273 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-179edff5-bbbf-468f-86d6-58c950a71cfb req-9413078a-1eba-4501-a805-d907d05ac3b9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:54.512775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-179edff5-bbbf-468f-86d6-58c950a71cfb req-9413078a-1eba-4501-a805-d907d05ac3b9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:54.526703 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-179edff5-bbbf-468f-86d6-58c950a71cfb req-9413078a-1eba-4501-a805-d907d05ac3b9 service nova] Creating event network-vif-plugged:49f66057-28ea-4c25-abe7-abf3478d2b0b for instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c on n-h2-860864-8 Oct 12 23:36:54.531735 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-179edff5-bbbf-468f-86d6-58c950a71cfb req-9413078a-1eba-4501-a805-d907d05ac3b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036475 Oct 12 23:36:54.532539 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3554/7205] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:36:55.098906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:55.099456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:55.105715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:55.106894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:55.107356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:55.108248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:55.108715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:55.109188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:55.236556 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:55.244093 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5a101068-c94b-4213-bcfa-66e21dfe3c31 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1363 microversion: 2.1 time: 0.149355 Oct 12 23:36:55.244668 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3652/7206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:55 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:56.267390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:56.268120 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:56.274632 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:56.275108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:56.275537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:56.276274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:56.276719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:56.277163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:56.405949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:56.413865 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2c4cdfd-feaa-4c1d-9ecc-ad5d3563d9e9 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1554 microversion: 2.1 time: 0.151030 Oct 12 23:36:56.414440 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3555/7207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:56 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:56.436341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:36:56.437004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:56.443792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:56.444323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:56.444775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:56.445478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:56.445944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:56.446384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:56.576185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:36:56.583833 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-62256d64-1fe5-4197-bc9b-dc549ae018ca tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1554 microversion: 2.1 time: 0.151478 Oct 12 23:36:56.584431 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3653/7208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:36:56 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:36:58.068975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5393e991-4fff-4fa7-b5d3-74fbcef39e56"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:36:58.071308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:36:58.078025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:58.078510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:58.078946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:58.079686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:36:58.080169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:36:58.080597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:36:58.192059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:36:58.315459 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0344b022-43f1-49ca-a54c-5195601d8ffb tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "POST /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250222 Oct 12 23:36:58.316135 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3556/7209] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:36:58 2022] POST /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:09.015686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:09.016237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:09.019022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:09.019873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:09.020685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:09.021294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:09.028073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:09.028675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:09.029135 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:09.030360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:09.030834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:09.031278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:09.116322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lazy-loading 'services' on Instance uuid 10d7770d-5f5f-4c1a-acce-35d24557ad2c {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:37:09.187500 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75e2796c-3612-4714-9000-a235ce687672 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments/5393e991-4fff-4fa7-b5d3-74fbcef39e56" status: 202 len: 0 microversion: 2.1 time: 0.176211 Oct 12 23:37:09.188151 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3654/7210] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:37:09 2022] DELETE /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments/5393e991-4fff-4fa7-b5d3-74fbcef39e56 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:37:09.195270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:09.196548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:09.201433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:09.203918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:09.214251 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:09.214755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:09.215197 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:09.216438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:09.216913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:09.217323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:09.250359 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71476377-c659-4d49-80a1-8f1d350b8dff tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057699 Oct 12 23:37:09.250922 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3557/7211] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:37:09 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:37:10.264383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:10.266844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:10.273221 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:10.273720 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:10.274164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:10.275061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:10.275533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:10.275991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:10.307784 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce92a426-22e4-4c37-82d8-d68b6b5584d4 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Oct 12 23:37:10.308605 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3655/7212] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:37:10 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:11.320924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:11.323086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:11.330511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:11.330994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:11.331426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:11.332146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:11.332594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:11.333018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:11.362746 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24090dc9-fb04-4703-bd6c-d472a6d6da9f tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Oct 12 23:37:11.363599 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3558/7213] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:37:11 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:12.374746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:12.377094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:12.384138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:12.384637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:12.385088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:12.385800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:12.386267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:12.386716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:12.416592 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0865fff-23d8-4685-97a3-3ec1062881e5 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Oct 12 23:37:12.417167 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3656/7214] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:37:12 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:13.429757 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:13.432098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:13.439476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:13.439986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:13.440426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:13.441113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:13.441556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:13.441972 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:13.471208 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52065ccf-f187-4cff-b0aa-887fa0782022 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Oct 12 23:37:13.471790 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3559/7215] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:37:13 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:14.483641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:14.485827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:14.492586 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.493071 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.493514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.494203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.494661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.495092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.524262 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a487e998-04a0-4050-86a7-c94099bebf18 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044640 Oct 12 23:37:14.524810 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3657/7216] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:37:14 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:37:14.535247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:14.535746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:14.542730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.543210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.543654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.544383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:14.544838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:14.545267 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:14.622965 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] HTTP exception thrown: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c is not attached to volume 5393e991-4fff-4fa7-b5d3-74fbcef39e56 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Request method failure captured: Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments/5393e991-4fff-4fa7-b5d3-74fbcef39e56 HTTP/1.1 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR09ClI7IUNRhnB01i6XE4F9ksW2zstXQ43LhxRB2xwYGJoI0vr9w6GJvxaQ7eZiOvmA2PnEOox1lDQHG4wuJkcu_NL33Cvj5m5GHuJT_-L8LvHfbPKX2lvMYuOum6oVwVURPrn_Y2a7tAUHbPocoT4uJo0WhKUdPxnqJRhjQPY7flJ0 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8462c35bff5c43aa82574d827292cf30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}] Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4cd226a5ea5c446c8250719cfb02b986 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c is not attached to volume 5393e991-4fff-4fa7-b5d3-74fbcef39e56 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '10d7770d-5f5f-4c1a-acce-35d24557ad2c', 'id': '5393e991-4fff-4fa7-b5d3-74fbcef39e56'} Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5393e991-4fff-4fa7-b5d3-74fbcef39e56. Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c is not attached to volume 5393e991-4fff-4fa7-b5d3-74fbcef39e56 Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:37:14.624617 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:37:14.629829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:37:14.629829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:37:14.629829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c is not attached to volume 5393e991-4fff-4fa7-b5d3-74fbcef39e56 Oct 12 23:37:14.629829 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:14.629829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Returning 404 to user: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c is not attached to volume 5393e991-4fff-4fa7-b5d3-74fbcef39e56 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:37:14.629829 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cfc6e8a0-285e-4dbb-aa16-f987ecd7a25c tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments/5393e991-4fff-4fa7-b5d3-74fbcef39e56" status: 404 len: 154 microversion: 2.1 time: 0.094822 Oct 12 23:37:14.629829 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3560/7217] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:37:14 2022] DELETE /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c/os-volume_attachments/5393e991-4fff-4fa7-b5d3-74fbcef39e56 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:37:17.976864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:17.977416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:17.984750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:17.985246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:17.985696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:17.986412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:17.986870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:17.987297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:18.014219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:37:18.093002 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9998992-97ca-4e95-a655-c5e466c7d356 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 204 len: 0 microversion: 2.1 time: 0.119930 Oct 12 23:37:18.096629 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3658/7218] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:37:17 2022] DELETE /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:37:18.101734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:18.102345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:18.111911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:18.112457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:18.112874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:18.113565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:18.114017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:18.114436 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:18.246585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:18.255164 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe19bac8-12b8-4aa3-a868-7608824d5de3 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1560 microversion: 2.1 time: 0.157315 Oct 12 23:37:18.255725 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3561/7219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:18 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:19.282738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:19.283463 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:19.290773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:19.291223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:19.291684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:19.292421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:19.292959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:19.293320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:19.424062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:19.431688 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a7f23c82-7f95-4b5b-b76f-225e8ce63546 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1560 microversion: 2.1 time: 0.153937 Oct 12 23:37:19.432295 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3659/7220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:19 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:20.106860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e4131b00-8903-4526-97ac-b91b202e9c43 req-936aa224-14d2-49a3-b149-c90031bf0f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d7770d-5f5f-4c1a-acce-35d24557ad2c", "name": "network-vif-deleted", "tag": "49f66057-28ea-4c25-abe7-abf3478d2b0b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:37:20.118521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e4131b00-8903-4526-97ac-b91b202e9c43 req-936aa224-14d2-49a3-b149-c90031bf0f98 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:20.118999 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e4131b00-8903-4526-97ac-b91b202e9c43 req-936aa224-14d2-49a3-b149-c90031bf0f98 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:20.119432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e4131b00-8903-4526-97ac-b91b202e9c43 req-936aa224-14d2-49a3-b149-c90031bf0f98 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:20.132170 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e4131b00-8903-4526-97ac-b91b202e9c43 req-936aa224-14d2-49a3-b149-c90031bf0f98 service nova] Creating event network-vif-deleted:49f66057-28ea-4c25-abe7-abf3478d2b0b for instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c on n-h2-860864-8 Oct 12 23:37:20.137152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e4131b00-8903-4526-97ac-b91b202e9c43 req-936aa224-14d2-49a3-b149-c90031bf0f98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034011 Oct 12 23:37:20.138127 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3562/7221] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:20.454596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:20.455220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:20.461916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:20.462403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:20.462847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:20.463540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:20.464023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:20.464460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:20.497770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:20.498247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:20.498682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:20.499131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lazy-loading 'fault' on Instance uuid 10d7770d-5f5f-4c1a-acce-35d24557ad2c {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:37:20.540520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cd226a5ea5c446c8250719cfb02b986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8462c35bff5c43aa82574d827292cf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:20.549106 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8331c97c-a59e-4a15-bfca-209c2ececd94 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 200 len: 1353 microversion: 2.1 time: 0.098344 Oct 12 23:37:20.549682 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3660/7222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:20 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:21.574363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:21.574992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] [instance: 10d7770d-5f5f-4c1a-acce-35d24557ad2c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:21.581087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:21.581557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:21.581981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:21.582656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:21.583098 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:21.583514 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:21.596542 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] HTTP exception thrown: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c could not be found. Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Request method failure captured: Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c HTTP/1.1 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR09ClI7IUNRhnB01i6XE4F9ksW2zstXQ43LhxRB2xwYGJoI0vr9w6GJvxaQ7eZiOvmA2PnEOox1lDQHG4wuJkcu_NL33Cvj5m5GHuJT_-L8LvHfbPKX2lvMYuOum6oVwVURPrn_Y2a7tAUHbPocoT4uJo0WhKUdPxnqJRhjQPY7flJ0 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8462c35bff5c43aa82574d827292cf30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8462c35bff5c43aa82574d827292cf30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8462c35bff5c43aa82574d827292cf30"}]}] Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 8462c35bff5c43aa82574d827292cf30 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1244007695 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 4cd226a5ea5c446c8250719cfb02b986 Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestEncryptedCinderVolumes-1244007695-project Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c could not be found. Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '10d7770d-5f5f-4c1a-acce-35d24557ad2c'} Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c could not be found. Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c could not be found. Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:21.598147 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c could not be found. Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Returning 404 to user: Instance 10d7770d-5f5f-4c1a-acce-35d24557ad2c could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b8269206-5b69-40bf-992f-b5b08c194e62 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c" status: 404 len: 111 microversion: 2.1 time: 0.030408 Oct 12 23:37:21.603058 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3563/7223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:21 2022] GET /compute/v2.1/servers/10d7770d-5f5f-4c1a-acce-35d24557ad2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:37:21.608746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bf9ee520-5663-4a80-853b-7a855a165046 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] Calling method '.version_select at 0x7f44fe434ca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:21.629361 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bf9ee520-5663-4a80-853b-7a855a165046 tempest-TestEncryptedCinderVolumes-1244007695 tempest-TestEncryptedCinderVolumes-1244007695-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1644057942" status: 202 len: 0 microversion: 2.1 time: 0.024966 Oct 12 23:37:21.629925 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3661/7224] 10.222.0.20 () {58 vars in 1278 bytes} [Wed Oct 12 23:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1644057942 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:37:48.471512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7dff7ff-2693-43e9-bb53-3d888df3bc08 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'create', calling method: .version_select at 0x7f44fe5ca280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-509465404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWJ0k5np5a5pa76WO++lxR2G18G3VSnLrGBJzDYm5+8ZSwtUQYFF+JCI9KoWEtNXQiD3u4r+IW2wT+5TnG/X1mw5H2XwRR4yRunBZaPPh33Uu0qPsp/915ZjbC3Ohoqsg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:37:48.477555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=14 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:48.478211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=34 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:48.490338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e7dff7ff-2693-43e9-bb53-3d888df3bc08 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:37:48.495419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e7dff7ff-2693-43e9-bb53-3d888df3bc08 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for user 38bb5e2f389e420e8771c7bc770a2bd7 and project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:37:48.518293 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7dff7ff-2693-43e9-bb53-3d888df3bc08 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050543 Oct 12 23:37:48.518814 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3564/7225] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:37:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:37:48.570763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1470088595", "imageRef": "ee51b47d-0b62-4bd0-92db-b9be57dc7932", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-509465404", "networks": [{"uuid": "811590fe-a9ef-4803-bcd9-daeb73534c79"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:37:48.580439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:48.581288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:37:48.625729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] validate_networks() for [('811590fe-a9ef-4803-bcd9-daeb73534c79', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:37:48.994769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:37:48.995235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:37:48.995723 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:37:48.996184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:37:48.996634 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:37:49.005404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:49.005896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:49.006332 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:49.007057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:49.007516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:49.008034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:49.024275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:37:49.029855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for user 38bb5e2f389e420e8771c7bc770a2bd7 and project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:37:49.042067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:37:49.044909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ee51b47d-0b62-4bd0-92db-b9be57dc7932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:37:49.088143 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-39f6c36f-b6f8-484d-a7a8-930ec49e020d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521229 Oct 12 23:37:49.088793 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3662/7226] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:37:49.100048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bba05364-e762-40bd-8eea-2508295afe54 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:49.100663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bba05364-e762-40bd-8eea-2508295afe54 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:49.160640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bba05364-e762-40bd-8eea-2508295afe54 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:49.168064 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bba05364-e762-40bd-8eea-2508295afe54 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1258 microversion: 2.1 time: 0.071783 Oct 12 23:37:49.168671 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3565/7227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:49 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:50.192537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:50.193169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:50.200220 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:50.200722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:50.201176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:50.202179 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:50.202830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:50.203276 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:50.270124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:50.279129 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0a273dd-b20c-4679-9100-9bb7ece0acf5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1316 microversion: 2.1 time: 0.091744 Oct 12 23:37:50.279719 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3663/7228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:50 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:51.303473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:51.304124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:51.311453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:51.311991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:51.312629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:51.313364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:51.313829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:51.314257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:51.789071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:51.798009 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c922b6b9-651c-4535-8b17-7936f51028d2 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.498335 Oct 12 23:37:51.799145 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3566/7229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:51 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:52.825075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:52.825734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:52.833324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:52.833823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:52.834279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:52.835018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:52.835473 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:52.835941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:52.982520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:52.991235 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-63ef6b8b-247c-4f00-87a1-485e605ea367 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.170264 Oct 12 23:37:52.992502 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3664/7230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:52 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:54.013948 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:54.014712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:54.022437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:54.022951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:54.023469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:54.024280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:54.024810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:54.025311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:54.176392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:54.184311 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7252a8a-4d9d-4081-87cc-5b1f34077fcc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.174186 Oct 12 23:37:54.184870 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3567/7231] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:54 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:55.207881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:55.208551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:55.215230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:55.215795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:55.216392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:55.217092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:55.217744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:55.218231 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:55.363672 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:55.371489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-718d6abc-d987-40a1-bf0c-2a917d129ca3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.168052 Oct 12 23:37:55.372603 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3665/7232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:55 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:56.396451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:56.398096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:56.406896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:56.407378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:56.408023 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:56.408724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:56.409172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:56.409589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:56.556588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:56.577263 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-303dd749-4d1a-48c4-8ad2-68afe5da61ca tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.185932 Oct 12 23:37:56.578210 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3568/7233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:56 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:57.600772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:57.601368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:57.608834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:57.609336 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:57.609791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:57.610512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:57.610980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:57.611418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:57.741470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:57.750419 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0306d8ae-0478-440e-a7d2-c4454d0d5788 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.153550 Oct 12 23:37:57.751079 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3666/7234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:57 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:37:58.773844 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:37:58.774494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:37:58.781867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:58.782354 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:58.782795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:58.783493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:58.784001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:58.784428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:58.931934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-809d40c3-da31-4ff8-b97f-082f1720f1d9 req-a1e746da-594d-44e0-a198-8a4eea831eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cc57e2-ece7-4865-a1e1-bb4dd804abe3", "tag": "b96bb4b3-ae69-4cb2-82ab-6783a9ad0025"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:37:58.946047 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-809d40c3-da31-4ff8-b97f-082f1720f1d9 req-a1e746da-594d-44e0-a198-8a4eea831eb1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:37:58.946552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-809d40c3-da31-4ff8-b97f-082f1720f1d9 req-a1e746da-594d-44e0-a198-8a4eea831eb1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:37:58.947003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-809d40c3-da31-4ff8-b97f-082f1720f1d9 req-a1e746da-594d-44e0-a198-8a4eea831eb1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:37:58.958946 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-809d40c3-da31-4ff8-b97f-082f1720f1d9 req-a1e746da-594d-44e0-a198-8a4eea831eb1 service nova] Creating event network-changed:b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 for instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 on n-h1-860864-8 Oct 12 23:37:58.964357 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-809d40c3-da31-4ff8-b97f-082f1720f1d9 req-a1e746da-594d-44e0-a198-8a4eea831eb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036019 Oct 12 23:37:58.964969 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3667/7235] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:37:59.041596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:37:59.049769 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-69297ba3-24d0-4037-98a0-b359cf60298a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.279804 Oct 12 23:37:59.050798 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3569/7236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:37:58 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:00.074112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:00.074742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:00.076722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:00.077400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:00.084148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:00.084644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:00.085097 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:00.085805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:00.086268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:00.086703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:00.219991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:00.227837 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3dc6ef63-f45d-4956-aa53-beb79849d563 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.158067 Oct 12 23:38:00.228441 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3668/7237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:00 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:01.251657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:01.252337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:01.254227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:01.260339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:01.260825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:01.261269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:01.261964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:01.262422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:01.262851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:01.388702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:01.396335 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-776b2e17-3f17-4966-916b-070a0552749a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.148563 Oct 12 23:38:01.396902 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3570/7238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:01 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:02.418983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:02.419621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:02.426500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:02.427001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:02.427453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:02.428187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:02.428662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:02.429100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:02.562524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:02.570125 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e44bfe6-de91-4348-8291-eb5848ba0e3f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.155408 Oct 12 23:38:02.570694 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3669/7239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:02 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:03.593395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:03.594017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:03.601464 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:03.601955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:03.602401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:03.603136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:03.603593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:03.604051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:03.734606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:03.742500 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e691ec35-310f-4b25-b80a-5d44c696c8c9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.153241 Oct 12 23:38:03.743070 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3571/7240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:03 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:03.825902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6d6f4b70-bb07-4b1a-aa2a-3c5b9e942c5f req-1a6fe922-26bc-4aea-913a-03468d88b0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cc57e2-ece7-4865-a1e1-bb4dd804abe3", "name": "network-vif-plugged", "status": "completed", "tag": "b96bb4b3-ae69-4cb2-82ab-6783a9ad0025"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:38:03.837413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d6f4b70-bb07-4b1a-aa2a-3c5b9e942c5f req-1a6fe922-26bc-4aea-913a-03468d88b0e6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:03.837904 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d6f4b70-bb07-4b1a-aa2a-3c5b9e942c5f req-1a6fe922-26bc-4aea-913a-03468d88b0e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:03.838348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6d6f4b70-bb07-4b1a-aa2a-3c5b9e942c5f req-1a6fe922-26bc-4aea-913a-03468d88b0e6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:03.850003 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6d6f4b70-bb07-4b1a-aa2a-3c5b9e942c5f req-1a6fe922-26bc-4aea-913a-03468d88b0e6 service nova] Creating event network-vif-plugged:b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 for instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 on n-h1-860864-8 Oct 12 23:38:03.854743 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6d6f4b70-bb07-4b1a-aa2a-3c5b9e942c5f req-1a6fe922-26bc-4aea-913a-03468d88b0e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033221 Oct 12 23:38:03.855344 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3670/7241] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:38:04.766975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:04.767622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:04.774468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:04.774944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:04.775378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:04.776096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:04.776544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:04.776963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:04.903430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:04.911310 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0463af19-1a66-4bfb-9d06-ce2537e1c3b7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1358 microversion: 2.1 time: 0.147934 Oct 12 23:38:04.911875 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3572/7242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:04 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:05.936832 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:05.937558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:05.944434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:05.944933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:05.945390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:05.946104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:05.946573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:05.947014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:06.074671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:06.082516 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1827bfb9-5fb8-4d24-9f45-757d586d13fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1548 microversion: 2.1 time: 0.151634 Oct 12 23:38:06.083112 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3671/7243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:05 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:06.106542 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:06.107165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:06.114629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:06.115252 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:06.115694 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:06.116406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:06.116863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:06.117292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:06.246557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:06.254144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98b48efd-1c1f-4a52-846b-a5eacf8c6abb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1548 microversion: 2.1 time: 0.152207 Oct 12 23:38:06.254718 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3573/7244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:06 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:06.275546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:06.280808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:06.281589 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Searching by: {'deleted': False, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:38:06.287115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:06.287631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:06.288123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:06.288888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:06.289384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:06.289827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:06.313544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:38:06.339420 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-97330dff-deac-437d-bf77-b2b5b2e90986 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067825 Oct 12 23:38:06.340539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3672/7245] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 23:38:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:38:06.352726 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:06.353377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:06.360843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:06.361326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:06.361771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:06.362460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:06.362912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:06.363338 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:06.492818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:06.501161 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3df490ed-47f6-4b5f-8ff0-c540e0092ed5 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1548 microversion: 2.1 time: 0.152913 Oct 12 23:38:06.501732 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3574/7246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:06 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:08.032085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b68c116f-e5ec-4d16-9eb0-a2b4b8d69074"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:38:08.034449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:08.041470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:08.041965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:08.042411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:08.043148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:08.043613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:08.044090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:08.278128 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f7816892-0d14-482a-a551-e3707ed30d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249909 Oct 12 23:38:08.278740 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3673/7247] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:38:08 2022] POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:38:21.313322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:21.313938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:21.316812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:21.317475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=54 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:21.323218 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:21.323700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:21.325755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:21.326510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:21.326982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:21.327419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:21.460375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:21.468889 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c5166b1-a425-4721-8a32-ebff43432057 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1594 microversion: 2.1 time: 0.159903 Oct 12 23:38:21.469466 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3575/7248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:21 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:38:23.384496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:23.385314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:23.385921 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:38:23.389976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-af60814e-7496-48d4-b2ed-bb05b2b27fa1 req-55a2cd91-916f-47eb-92fc-bacef03a27ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cc57e2-ece7-4865-a1e1-bb4dd804abe3", "tag": "b96bb4b3-ae69-4cb2-82ab-6783a9ad0025"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:38:23.401048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-af60814e-7496-48d4-b2ed-bb05b2b27fa1 req-55a2cd91-916f-47eb-92fc-bacef03a27ad service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:23.401539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-af60814e-7496-48d4-b2ed-bb05b2b27fa1 req-55a2cd91-916f-47eb-92fc-bacef03a27ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:23.401976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-af60814e-7496-48d4-b2ed-bb05b2b27fa1 req-55a2cd91-916f-47eb-92fc-bacef03a27ad service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:23.417085 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-af60814e-7496-48d4-b2ed-bb05b2b27fa1 req-55a2cd91-916f-47eb-92fc-bacef03a27ad service nova] Creating event network-changed:b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 for instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 on n-h1-860864-8 Oct 12 23:38:23.422762 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-af60814e-7496-48d4-b2ed-bb05b2b27fa1 req-55a2cd91-916f-47eb-92fc-bacef03a27ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040031 Oct 12 23:38:23.423699 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3674/7249] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:38:24.462952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1027501065"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:38:24.463509 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:24.470590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:24.471077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:24.471682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:24.472412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:24.472862 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:24.473270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:24.599035 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.network.security_group_api [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Adding security group c9476723-17a2-406a-ab5b-b6b7ede27cda to port b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 Oct 12 23:38:24.906962 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b78e2124-ffec-4ec9-bace-83c880ad0c4a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action" status: 202 len: 0 microversion: 2.1 time: 0.448071 Oct 12 23:38:24.912287 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3576/7250] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:38:24 2022] POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:38:24.917562 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:38:24.918824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fda66e98-3c67-4c44-9672-3c80bd6983a7 req-f5268f8b-223d-4dd8-a412-768699dd9d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cc57e2-ece7-4865-a1e1-bb4dd804abe3", "tag": "b96bb4b3-ae69-4cb2-82ab-6783a9ad0025"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:38:24.918973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:38:24.927331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:24.927842 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:24.928324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:24.928470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fda66e98-3c67-4c44-9672-3c80bd6983a7 req-f5268f8b-223d-4dd8-a412-768699dd9d4a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:24.928818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fda66e98-3c67-4c44-9672-3c80bd6983a7 req-f5268f8b-223d-4dd8-a412-768699dd9d4a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:24.929253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fda66e98-3c67-4c44-9672-3c80bd6983a7 req-f5268f8b-223d-4dd8-a412-768699dd9d4a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:24.929371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:38:24.929740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:38:24.930185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:38:24.941075 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fda66e98-3c67-4c44-9672-3c80bd6983a7 req-f5268f8b-223d-4dd8-a412-768699dd9d4a service nova] Creating event network-changed:b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 for instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 on n-h1-860864-8 Oct 12 23:38:24.948927 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fda66e98-3c67-4c44-9672-3c80bd6983a7 req-f5268f8b-223d-4dd8-a412-768699dd9d4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Oct 12 23:38:24.950114 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3577/7251] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:38:25.100888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:38:25.117047 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3959eef6-8866-4894-b283-22fb9d8274d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1760 microversion: 2.1 time: 0.204414 Oct 12 23:38:25.117908 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3675/7252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:38:24 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1760 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:40:02.858449 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:40:02.859517 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 23:40:02.859960 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:40:02.860704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:40:02.862136 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:40:02.862289 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action (ip 10.222.0.20) !!! Oct 12 23:40:02.863678 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:40:02.863814 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action (ip 10.222.0.20) !!! Oct 12 23:40:02.870740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:40:02.873050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:40:02.881488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:40:02.881966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:40:02.882404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:40:02.883092 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:40:02.883549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:40:02.883996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:40:02.957893 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-285dedca-51bb-4ea4-9bb7-f56109af1ae9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action" status: 202 len: 0 microversion: 2.1 time: 0.100956 Oct 12 23:40:02.958535 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3578/7253] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:40:02 2022] POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:40:02.968706 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:40:02.969354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:40:02.972025 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:40:02.972767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:40:02.973444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:40:02.974752 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:40:02.974902 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 (ip 10.222.0.20) !!! Oct 12 23:40:02.977122 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:40:02.977292 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 (ip 10.222.0.20) !!! Oct 12 23:40:02.990830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:40:02.991344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:40:02.991800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:40:02.992570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:40:02.993041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:40:02.993484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:40:03.298253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:40:03.306715 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34867c63-7272-4f3e-a7ea-27d66f0b7c68 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1762 microversion: 2.1 time: 0.343921 Oct 12 23:40:03.307302 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3676/7254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:40:02 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1762 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:40:04.334474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:40:04.335179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:40:04.345969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:40:04.346454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:40:04.346893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:40:04.347608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:40:04.349179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:40:04.349613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:40:04.351331 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39550. Oct 12 23:40:04.356965 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39548. Oct 12 23:40:04.540821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:40:04.549647 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05fdb7f2-4fe9-41c7-b9c0-a5011fe55f75 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1760 microversion: 2.1 time: 0.223168 Oct 12 23:40:04.550206 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3579/7255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:40:04 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1760 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:18.257211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:18.258022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:18.262981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1027501065"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:18.263538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:18.273034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:18.273531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:18.274007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:18.274966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:18.275437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:18.275876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:18.280307 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39582. Oct 12 23:41:18.401802 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.network.security_group_api [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Removing security group c9476723-17a2-406a-ab5b-b6b7ede27cda from port b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 Oct 12 23:41:18.705918 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6373dca5-6d49-4910-b15d-39299cb4788b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action" status: 202 len: 0 microversion: 2.1 time: 0.451313 Oct 12 23:41:18.707584 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3677/7256] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:41:18 2022] POST /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:41:18.712255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:18.714136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:18.808223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9a00153e-91ef-436a-892a-5996f0b21c51 req-85ef3f3d-5caa-4e75-a0ef-1c1dcab19e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cc57e2-ece7-4865-a1e1-bb4dd804abe3", "tag": "b96bb4b3-ae69-4cb2-82ab-6783a9ad0025"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:18.818709 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9a00153e-91ef-436a-892a-5996f0b21c51 req-85ef3f3d-5caa-4e75-a0ef-1c1dcab19e9b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:18.819525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9a00153e-91ef-436a-892a-5996f0b21c51 req-85ef3f3d-5caa-4e75-a0ef-1c1dcab19e9b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:18.819662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9a00153e-91ef-436a-892a-5996f0b21c51 req-85ef3f3d-5caa-4e75-a0ef-1c1dcab19e9b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:18.832423 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9a00153e-91ef-436a-892a-5996f0b21c51 req-85ef3f3d-5caa-4e75-a0ef-1c1dcab19e9b service nova] Creating event network-changed:b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 for instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 on n-h1-860864-8 Oct 12 23:41:18.838322 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9a00153e-91ef-436a-892a-5996f0b21c51 req-85ef3f3d-5caa-4e75-a0ef-1c1dcab19e9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127795 Oct 12 23:41:18.839020 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3580/7257] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:41:19.896593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:19.897213 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:19.904330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:19.905656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:19.906325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:19.907232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:19.907713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:19.908210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:19.999941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lazy-loading 'services' on Instance uuid 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:41:20.074506 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [74713e47-df99-4ee9-b35d-c5f127485b20] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:41:20.854191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0b6b7152-8cd5-4ff0-b529-6b6b24326d45 req-d8e6857e-c21d-422b-ae3f-7145cb602b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cc57e2-ece7-4865-a1e1-bb4dd804abe3", "tag": "b96bb4b3-ae69-4cb2-82ab-6783a9ad0025"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:20.864124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0b6b7152-8cd5-4ff0-b529-6b6b24326d45 req-d8e6857e-c21d-422b-ae3f-7145cb602b48 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:20.864596 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0b6b7152-8cd5-4ff0-b529-6b6b24326d45 req-d8e6857e-c21d-422b-ae3f-7145cb602b48 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:20.865026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0b6b7152-8cd5-4ff0-b529-6b6b24326d45 req-d8e6857e-c21d-422b-ae3f-7145cb602b48 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:20.876357 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0b6b7152-8cd5-4ff0-b529-6b6b24326d45 req-d8e6857e-c21d-422b-ae3f-7145cb602b48 service nova] Creating event network-changed:b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 for instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 on n-h1-860864-8 Oct 12 23:41:20.881170 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0b6b7152-8cd5-4ff0-b529-6b6b24326d45 req-d8e6857e-c21d-422b-ae3f-7145cb602b48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032339 Oct 12 23:41:20.881735 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3581/7258] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:41:21.082498 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [74713e47-df99-4ee9-b35d-c5f127485b20] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 39612. Oct 12 23:41:21.085905 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a0f13f8-77e7-4adf-a09f-4bc25846a412 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments/b68c116f-e5ec-4d16-9eb0-a2b4b8d69074" status: 202 len: 0 microversion: 2.1 time: 1.193609 Oct 12 23:41:21.086671 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3678/7259] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:41:19 2022] DELETE /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments/b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 => generated 0 bytes in 1195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:41:21.096851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:21.099342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:21.106325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:21.106897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:21.107515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:21.109167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:21.109718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:21.110233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:21.149581 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-94a13375-8dbe-48a6-98a2-46774d66ada9 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057461 Oct 12 23:41:21.150150 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3582/7260] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:41:21 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:41:22.163378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:22.165855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:22.173211 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:22.173702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:22.174180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:22.174874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:22.175334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:22.175770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:22.205817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c14d60b-4efd-4967-beff-e57972261630 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 Oct 12 23:41:22.206380 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3679/7261] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:41:22 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:23.219172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:23.221459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:23.228562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:23.229031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:23.229457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:23.230133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:23.230576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:23.230993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:23.263113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f75f0dc-6e5d-4234-807f-02c079a4bb1d tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048041 Oct 12 23:41:23.263672 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3583/7262] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:41:23 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:24.276782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:24.278902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:24.286024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:24.286520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:24.286973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:24.287681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:24.288171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:24.288613 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:24.318737 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2483d870-7790-481a-afba-cb4d89f4da8b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046181 Oct 12 23:41:24.319304 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3680/7263] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:41:24 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:25.330818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:25.333057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:25.339973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:25.340454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:25.340895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:25.341583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:25.342031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:25.342511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:25.372547 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8cf6748c-01f9-494a-9248-da4c00f13225 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045816 Oct 12 23:41:25.373119 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3584/7264] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:41:25 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:26.386039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:26.388261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:26.395441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:26.395960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:26.396413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:26.397108 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:26.397569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:26.398003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:26.426004 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50c21fc0-fd88-4550-8310-9bb13a4e6b99 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044075 Oct 12 23:41:26.426603 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3681/7265] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:41:26 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:41:26.438636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:26.439167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:26.445918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:26.446401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:26.446842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:26.447569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:26.448047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:26.448478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:26.522722 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] HTTP exception thrown: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 is not attached to volume b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Request method failure captured: Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments/b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 HTTP/1.1 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0--FGE3he39ISkEgMlXIEkSgu_HBnHe7ZzUf0EXZDXvmHVMLHSL6c1jR3AOmu1onOqFJK0BBUYKw_2nLXj0AwhtaEEmFQGbdl0xJq_c7lmYNG6mhJseECHNMjiIhqBoog6ITMfT2va90gujvVIO3lJl7BoSHfIQVsQ_fAFxGEn4M4E Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}] Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 38bb5e2f389e420e8771c7bc770a2bd7 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 is not attached to volume b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': '29cc57e2-ece7-4865-a1e1-bb4dd804abe3', 'id': 'b68c116f-e5ec-4d16-9eb0-a2b4b8d69074'} Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b68c116f-e5ec-4d16-9eb0-a2b4b8d69074. Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 is not attached to volume b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:41:26.524355 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:41:26.529239 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:41:26.529239 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:41:26.529239 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 is not attached to volume b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 Oct 12 23:41:26.529239 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:26.529239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Returning 404 to user: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 is not attached to volume b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:41:26.529239 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3f32305-8e7e-4594-be15-ef82ca61ce48 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments/b68c116f-e5ec-4d16-9eb0-a2b4b8d69074" status: 404 len: 154 microversion: 2.1 time: 0.091788 Oct 12 23:41:26.529239 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3585/7266] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:41:26 2022] DELETE /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3/os-volume_attachments/b68c116f-e5ec-4d16-9eb0-a2b4b8d69074 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:41:29.778130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:29.778650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:29.786495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:29.786993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:29.787449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:29.788188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:29.788657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:29.789099 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:29.816053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:41:29.901993 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ac204fb-67ef-4641-9d44-0451b6b7fa2a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 204 len: 0 microversion: 2.1 time: 0.127421 Oct 12 23:41:29.902792 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3682/7267] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:41:29 2022] DELETE /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 23:41:29.911777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:29.912525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:29.920068 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:29.920588 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:29.921028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:29.921718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:29.922168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:29.922591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:30.051988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:30.060109 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2971ef68-60cd-4e4f-8d04-da6f6f344f18 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1554 microversion: 2.1 time: 0.152804 Oct 12 23:41:30.060744 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3586/7268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:29 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:41:31.084595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:31.085379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:31.092169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:31.092689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:31.093131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:31.093822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:31.094283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:31.094711 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:31.228489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:31.240243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f64119c2-a0ce-4852-b0dd-e2e162ac81fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1554 microversion: 2.1 time: 0.159942 Oct 12 23:41:31.240831 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3683/7269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:31 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:31.973518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f329d840-ebe6-445d-bed0-4b24eb4de34e req-5002f1ea-62e5-41a7-b086-72722ee37e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cc57e2-ece7-4865-a1e1-bb4dd804abe3", "name": "network-vif-deleted", "tag": "b96bb4b3-ae69-4cb2-82ab-6783a9ad0025"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:31.983027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f329d840-ebe6-445d-bed0-4b24eb4de34e req-5002f1ea-62e5-41a7-b086-72722ee37e69 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:31.983501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f329d840-ebe6-445d-bed0-4b24eb4de34e req-5002f1ea-62e5-41a7-b086-72722ee37e69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:31.983968 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f329d840-ebe6-445d-bed0-4b24eb4de34e req-5002f1ea-62e5-41a7-b086-72722ee37e69 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:31.996681 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f329d840-ebe6-445d-bed0-4b24eb4de34e req-5002f1ea-62e5-41a7-b086-72722ee37e69 service nova] Creating event network-vif-deleted:b96bb4b3-ae69-4cb2-82ab-6783a9ad0025 for instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 on n-h1-860864-8 Oct 12 23:41:32.001571 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f329d840-ebe6-445d-bed0-4b24eb4de34e req-5002f1ea-62e5-41a7-b086-72722ee37e69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089094 Oct 12 23:41:32.002260 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3587/7270] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:32.265195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:32.265922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:32.273651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:32.274612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:32.275130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:32.276037 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:32.276624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:32.277155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:32.313086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:32.313510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:32.313960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:32.314749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lazy-loading 'fault' on Instance uuid 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:41:32.359490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:32.367981 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0410f2e-4892-412f-9829-b1dcedd29cfb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 200 len: 1348 microversion: 2.1 time: 0.106805 Oct 12 23:41:32.368586 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3684/7271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:32 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:33.392659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:33.393358 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: 29cc57e2-ece7-4865-a1e1-bb4dd804abe3] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:33.399493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:33.400009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:33.400452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:33.401128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:33.401577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:33.401997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:33.415969 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] HTTP exception thrown: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 could not be found. Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Request method failure captured: Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 HTTP/1.1 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0--FGE3he39ISkEgMlXIEkSgu_HBnHe7ZzUf0EXZDXvmHVMLHSL6c1jR3AOmu1onOqFJK0BBUYKw_2nLXj0AwhtaEEmFQGbdl0xJq_c7lmYNG6mhJseECHNMjiIhqBoog6ITMfT2va90gujvVIO3lJl7BoSHfIQVsQ_fAFxGEn4M4E Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}] Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 38bb5e2f389e420e8771c7bc770a2bd7 Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 could not be found. Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': '29cc57e2-ece7-4865-a1e1-bb4dd804abe3'} Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 could not be found. Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 could not be found. Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:41:33.417581 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 could not be found. Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Returning 404 to user: Instance 29cc57e2-ece7-4865-a1e1-bb4dd804abe3 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7935448-177a-4e3e-983e-bdc87a4032f7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3" status: 404 len: 111 microversion: 2.1 time: 0.031999 Oct 12 23:41:33.422375 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3588/7272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:33 2022] GET /compute/v2.1/servers/29cc57e2-ece7-4865-a1e1-bb4dd804abe3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:41:33.428575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0285c619-7a68-4ef1-96bf-d77d0619ca3c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '.version_select at 0x7f44fc3cd700>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:33.452943 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0285c619-7a68-4ef1-96bf-d77d0619ca3c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-509465404" status: 202 len: 0 microversion: 2.1 time: 0.028644 Oct 12 23:41:33.453518 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3685/7273] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 23:41:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-509465404 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:41:42.509254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a9027fc-e6bc-4bf8-a9fa-5c2e267f5b5b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'create', calling method: .version_select at 0x7f44fe4fdee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-287256769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6aHmaqXCcMm/WoTDIqF6KN/k4VPo3UGh8fY7ix9hz5DOLTxNZOBCOtWuiOraxX4ULKzijYerqmOFTHR90rhTNPaMleWDad1vZ3Gb6e0uMZVLojIEYY71gmGbYYlOwtvg=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:42.525775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-3a9027fc-e6bc-4bf8-a9fa-5c2e267f5b5b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:41:42.531511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-3a9027fc-e6bc-4bf8-a9fa-5c2e267f5b5b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for user 38bb5e2f389e420e8771c7bc770a2bd7 and project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:41:42.557592 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a9027fc-e6bc-4bf8-a9fa-5c2e267f5b5b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052346 Oct 12 23:41:42.558200 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3589/7274] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:41:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:42.608560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1438653318", "imageRef": "acb69b06-4dcd-4f8b-9cf2-e3a4395ff800", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-287256769", "networks": [{"uuid": "811590fe-a9ef-4803-bcd9-daeb73534c79"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:42.618699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:42.662635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] validate_networks() for [('811590fe-a9ef-4803-bcd9-daeb73534c79', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:41:43.066518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:41:43.066962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:41:43.067450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:41:43.067871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:41:43.068325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:41:43.077626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:43.078148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:43.078593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:43.079330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:43.079794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:43.080253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:43.097894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:41:43.103119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Getting quotas for user 38bb5e2f389e420e8771c7bc770a2bd7 and project 70f897ac19fc42a98a3a7c01cab7e00e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:41:43.115224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:41:43.117471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acb69b06-4dcd-4f8b-9cf2-e3a4395ff800',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:41:43.163264 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e84b19db-2d3c-4f55-b405-d6274908eea0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558551 Oct 12 23:41:43.163967 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3686/7275] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:41:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:41:43.175614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90bcc68f-6379-4d85-9a1a-5ab1a4fdcf5c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:43.176332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90bcc68f-6379-4d85-9a1a-5ab1a4fdcf5c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:43.232336 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-90bcc68f-6379-4d85-9a1a-5ab1a4fdcf5c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:43.239298 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90bcc68f-6379-4d85-9a1a-5ab1a4fdcf5c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1258 microversion: 2.1 time: 0.068213 Oct 12 23:41:43.239940 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3590/7276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:43 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:44.263331 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:44.263909 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:44.270769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:44.271264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:44.272368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:44.273086 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:44.273550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:44.274236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:44.356584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:44.365811 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1915b2aa-83c8-4baf-a5f9-1462c040f3ba tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1318 microversion: 2.1 time: 0.107517 Oct 12 23:41:44.366488 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3687/7277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:44 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1318 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:45.388963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:45.389754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:45.392958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=38 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:45.399515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:45.400397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:45.400964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:45.401801 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:45.402479 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:45.403124 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:45.550129 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:45.559235 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e636518-1147-4762-8590-4856c26312eb tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.173940 Oct 12 23:41:45.560720 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3591/7278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:45 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:46.583414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:46.584719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:46.591628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:46.592156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:46.592607 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:46.593339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:46.593806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:46.594244 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:46.739611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:46.746924 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d192ca2-8a34-4795-a352-40df911d2d2c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.167533 Oct 12 23:41:46.747714 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3688/7279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:46 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:47.770422 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:47.770974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:47.778416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:47.778908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:47.779388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:47.780116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:47.780573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:47.780996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:47.926226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:47.935273 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-39bfe5c6-f1b4-4dfe-91fa-71a03252b1f1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.168735 Oct 12 23:41:47.936509 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3592/7280] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:47 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:48.960008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:48.960793 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:48.967313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:48.968869 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:48.969664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:48.970183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:48.971027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:48.971638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:48.972259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:49.122474 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:49.131427 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38f9ad57-c676-4dd1-acda-93f57850e9ea tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.175442 Oct 12 23:41:49.132402 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3689/7281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:48 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:50.156010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:50.156857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:50.159732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:50.165744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:50.166216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:50.166682 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:50.167382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:50.167838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:50.168287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:50.303648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:50.311527 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-74f29f73-bec7-4f5b-a03e-0ce8cc43a20a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.160723 Oct 12 23:41:50.312525 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3593/7282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:50 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:51.334889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:51.335641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:51.343692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:51.344311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:51.344833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:51.345635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:51.346237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:51.346683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:51.485140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:51.493202 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5424f405-3bf4-4cb7-9eeb-1d98fffec12b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.162205 Oct 12 23:41:51.493804 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3690/7283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:51 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:52.516712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:52.517389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:52.524573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:52.525056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:52.525492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:52.526176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:52.526622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:52.527037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:52.662557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:52.670230 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ba9a7f77-f5cd-45ff-bfa5-d24b600deaf3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.158114 Oct 12 23:41:52.670800 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3594/7284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:52 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:52.812242 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6a6316ed-dbb7-4218-ab1a-4066a70c1ad5 req-2f67ac78-499a-4af4-b0c1-7fe939d03e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd267a41-45d8-4d9a-b909-b2c0c3f19e46", "tag": "3e7744d9-68d6-4deb-a046-e3dad04e9f76"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:52.824596 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6a6316ed-dbb7-4218-ab1a-4066a70c1ad5 req-2f67ac78-499a-4af4-b0c1-7fe939d03e5a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:52.825123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6a6316ed-dbb7-4218-ab1a-4066a70c1ad5 req-2f67ac78-499a-4af4-b0c1-7fe939d03e5a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:52.825569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6a6316ed-dbb7-4218-ab1a-4066a70c1ad5 req-2f67ac78-499a-4af4-b0c1-7fe939d03e5a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:52.837065 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6a6316ed-dbb7-4218-ab1a-4066a70c1ad5 req-2f67ac78-499a-4af4-b0c1-7fe939d03e5a service nova] Creating event network-changed:3e7744d9-68d6-4deb-a046-e3dad04e9f76 for instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 on n-h2-860864-8 Oct 12 23:41:52.842560 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6a6316ed-dbb7-4218-ab1a-4066a70c1ad5 req-2f67ac78-499a-4af4-b0c1-7fe939d03e5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035213 Oct 12 23:41:52.843177 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3691/7285] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:41:53.693904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:53.694577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:53.696551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:53.703199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:53.703674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:53.704138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:53.704816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:53.705261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:53.705680 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:53.832569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:53.840169 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-86f70c32-51db-49a2-b465-b0b066e93731 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.150234 Oct 12 23:41:53.840728 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3595/7286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:53 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:54.860617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:54.861406 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:41:54.866750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:54.867478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:54.875082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:54.875581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:54.876073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:54.876801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:54.877269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:54.877712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:55.004776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:55.012654 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36879f40-6251-4dd3-9293-84f9d31318fc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.152998 Oct 12 23:41:55.013880 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3692/7287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:54 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:56.036363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:56.036889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:56.043674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:56.044185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:56.045128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:56.045820 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:56.046274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:56.046697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:56.184274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:56.191849 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-888f177f-2aad-45aa-8a6f-5ccd1c32c4e3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.159688 Oct 12 23:41:56.192449 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3596/7288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:56 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:57.214595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:57.215230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:57.222341 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:57.222837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:57.223289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:57.224019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:57.224494 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:57.224934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:57.354587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:57.362771 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a252b8b-3902-4063-a40c-6103268635b8 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.152198 Oct 12 23:41:57.363342 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3693/7289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:57 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:58.172533 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c87cfe9d-1646-48df-99f0-d916ffb51bc1 req-fb6a1712-01c9-473f-9327-7e7f196cd4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd267a41-45d8-4d9a-b909-b2c0c3f19e46", "name": "network-vif-plugged", "status": "completed", "tag": "3e7744d9-68d6-4deb-a046-e3dad04e9f76"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:41:58.182294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c87cfe9d-1646-48df-99f0-d916ffb51bc1 req-fb6a1712-01c9-473f-9327-7e7f196cd4da service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:58.182791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c87cfe9d-1646-48df-99f0-d916ffb51bc1 req-fb6a1712-01c9-473f-9327-7e7f196cd4da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:58.183200 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c87cfe9d-1646-48df-99f0-d916ffb51bc1 req-fb6a1712-01c9-473f-9327-7e7f196cd4da service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:58.194602 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c87cfe9d-1646-48df-99f0-d916ffb51bc1 req-fb6a1712-01c9-473f-9327-7e7f196cd4da service nova] Creating event network-vif-plugged:3e7744d9-68d6-4deb-a046-e3dad04e9f76 for instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 on n-h2-860864-8 Oct 12 23:41:58.199783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c87cfe9d-1646-48df-99f0-d916ffb51bc1 req-fb6a1712-01c9-473f-9327-7e7f196cd4da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085615 Oct 12 23:41:58.200464 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3597/7290] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:58.390002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:58.391185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:58.400121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:58.400619 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:58.401069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:58.401778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:58.402245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:58.402682 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:58.531680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:58.539724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-150baca1-8486-4bc2-ba06-adf7138f6cb6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1358 microversion: 2.1 time: 0.157233 Oct 12 23:41:58.540350 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3694/7291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:58 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:59.564573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:59.565278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:59.571511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.572029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.572471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:59.573162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.573616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.574044 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:59.700557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:59.708317 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03603d85-0071-4992-90ef-c90ccd0f8372 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1547 microversion: 2.1 time: 0.149354 Oct 12 23:41:59.708917 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3598/7292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:59 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:59.730068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:59.730731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:59.738079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.738575 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.739026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:59.739728 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.740217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.740656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:59.874873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:59.882649 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d195f995-f24f-43fd-96dc-846dda94c004 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1547 microversion: 2.1 time: 0.156516 Oct 12 23:41:59.883409 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3695/7293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:59 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:41:59.904568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:59.909236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:41:59.910245 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Searching by: {'deleted': False, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e'} {{(pid=120543) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 23:41:59.915370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.915841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.916299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:59.917001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.917444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.917857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:59.944372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.multi_cell_list [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120543) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 23:41:59.970542 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1872bc9-64a6-4629-9479-0cb32e8155b0 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070257 Oct 12 23:41:59.971093 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3599/7294] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 12 23:41:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:41:59.983484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:41:59.984187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:41:59.990120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.990614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.991059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:41:59.991758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:41:59.992252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:41:59.993077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:00.119383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:00.127126 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0d3c46a-631e-4d9f-b798-74f9544bb2fa tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1547 microversion: 2.1 time: 0.148182 Oct 12 23:42:00.127703 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3696/7295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:41:59 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:01.633320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "850f010c-0955-4854-96ab-73b4ba1b0e68"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:42:01.635628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:01.642371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:01.642852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:01.643286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:01.643992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:01.644444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:01.644874 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:01.883249 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dd4aa243-617f-42e2-948b-a1336d6f7da4 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253686 Oct 12 23:42:01.884047 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3600/7296] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 12 23:42:01 2022] POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:42:12.662079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:12.662739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:12.665616 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=15 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:12.666285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=58 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:12.671991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:12.672490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:12.672941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:12.673647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:12.674112 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:12.674551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:12.806134 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:12.815025 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-55aad216-e4ea-4aa4-810c-ab87c2c2d487 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1593 microversion: 2.1 time: 0.157142 Oct 12 23:42:12.815601 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3697/7297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:12 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:14.483021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:14.483788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=15 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:14.484493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:14.488511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-57b3d05e-2b6e-4e9f-a09d-a1891d57c67b req-d1824206-4c92-45c4-b49f-88bb2edc981a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd267a41-45d8-4d9a-b909-b2c0c3f19e46", "tag": "3e7744d9-68d6-4deb-a046-e3dad04e9f76"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:42:14.501134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57b3d05e-2b6e-4e9f-a09d-a1891d57c67b req-d1824206-4c92-45c4-b49f-88bb2edc981a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:14.501604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57b3d05e-2b6e-4e9f-a09d-a1891d57c67b req-d1824206-4c92-45c4-b49f-88bb2edc981a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:14.502234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57b3d05e-2b6e-4e9f-a09d-a1891d57c67b req-d1824206-4c92-45c4-b49f-88bb2edc981a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:14.516148 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-57b3d05e-2b6e-4e9f-a09d-a1891d57c67b req-d1824206-4c92-45c4-b49f-88bb2edc981a service nova] Creating event network-changed:3e7744d9-68d6-4deb-a046-e3dad04e9f76 for instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 on n-h2-860864-8 Oct 12 23:42:14.521734 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-57b3d05e-2b6e-4e9f-a09d-a1891d57c67b req-d1824206-4c92-45c4-b49f-88bb2edc981a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040459 Oct 12 23:42:14.522545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3601/7298] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:42:15.567812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1365106770"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:42:15.568488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:15.576050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:15.576624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:15.577180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:15.577966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:15.578498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:15.579024 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:15.712472 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.network.security_group_api [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Adding security group a1742c43-9e33-42fb-b5ac-6c7ac3de0018 to port 3e7744d9-68d6-4deb-a046-e3dad04e9f76 Oct 12 23:42:16.016484 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c47312ca-7227-4faa-b9e5-a14cbd244a8f tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/action" status: 202 len: 0 microversion: 2.1 time: 0.452530 Oct 12 23:42:16.021018 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3698/7299] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:42:15 2022] POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:42:16.025847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:16.026486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:16.027606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b4fdfe8a-5320-4ddf-80e8-9eca569004fe req-b22ca59b-e98b-48fb-b6e8-1d0c1b2e83e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd267a41-45d8-4d9a-b909-b2c0c3f19e46", "tag": "3e7744d9-68d6-4deb-a046-e3dad04e9f76"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:42:16.033036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:16.033561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:16.034493 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:16.035491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:16.035993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:16.036442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:16.048255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b4fdfe8a-5320-4ddf-80e8-9eca569004fe req-b22ca59b-e98b-48fb-b6e8-1d0c1b2e83e1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:16.048734 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b4fdfe8a-5320-4ddf-80e8-9eca569004fe req-b22ca59b-e98b-48fb-b6e8-1d0c1b2e83e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:16.049165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b4fdfe8a-5320-4ddf-80e8-9eca569004fe req-b22ca59b-e98b-48fb-b6e8-1d0c1b2e83e1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:16.065817 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b4fdfe8a-5320-4ddf-80e8-9eca569004fe req-b22ca59b-e98b-48fb-b6e8-1d0c1b2e83e1 service nova] Creating event network-changed:3e7744d9-68d6-4deb-a046-e3dad04e9f76 for instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 on n-h2-860864-8 Oct 12 23:42:16.072038 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b4fdfe8a-5320-4ddf-80e8-9eca569004fe req-b22ca59b-e98b-48fb-b6e8-1d0c1b2e83e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049444 Oct 12 23:42:16.072648 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3602/7300] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:42:16.308273 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:16.318902 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dfa3ccbf-7a5b-46e5-8770-172d0247223c tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1759 microversion: 2.1 time: 0.296853 Oct 12 23:42:16.319719 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3699/7301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:16 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1759 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:31.329074 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:31.329813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:31.333975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:42:31.336291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:31.343747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:31.344265 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:31.344700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:31.345387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:31.345841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:31.346268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:31.415188 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35f9ebc8-a97d-4694-a837-d72fb76befce tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/action" status: 202 len: 0 microversion: 2.1 time: 0.087850 Oct 12 23:42:31.416022 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3603/7302] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:42:31 2022] POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:42:31.425452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:31.426090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:31.428264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:31.428924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:42:31.435120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:31.435612 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:31.436093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:31.436797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:31.437252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:31.437687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:31.677195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:31.687400 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12c7e258-4f8a-46d9-8287-15eb8cb36195 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1751 microversion: 2.1 time: 0.267340 Oct 12 23:42:31.688015 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3700/7303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:31 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1751 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:32.713388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:32.714121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:32.720272 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:32.720750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:32.721188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:32.721867 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:32.722314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:32.722733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:32.862450 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:32.870685 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c3ecec3-0ca8-4b47-8eb0-027ffdf72474 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.162405 Oct 12 23:42:32.871812 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3604/7304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:32 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:33.895045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:33.895683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:33.903293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:33.903806 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:33.904274 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:33.904984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:33.905455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:33.905895 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:34.046698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:34.055345 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2cc8c8e-ed2d-4287-845a-f78efd43f543 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.164291 Oct 12 23:42:34.055967 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3701/7305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:33 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:35.079040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:35.079679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:35.085666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:35.086137 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:35.086568 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:35.087243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:35.087685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:35.088133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:35.229409 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:35.238155 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-865f03dd-d4eb-41a1-b0e3-5d96ce56e0b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.163313 Oct 12 23:42:35.238729 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3605/7306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:35 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:36.261339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:36.262509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:36.269369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:36.269864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:36.270316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:36.271025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:36.271492 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:36.271959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:36.411761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:36.420269 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aa608061-8456-4291-b447-ba7a0a114833 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.162850 Oct 12 23:42:36.420850 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3702/7307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:36 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:37.443448 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:37.444836 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:37.452849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:37.453335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:37.453772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:37.454485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:37.454951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:37.455752 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:37.602165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:37.610438 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91f46dd9-8897-4bfe-9fc0-45d1eb4679b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.171073 Oct 12 23:42:37.611005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3606/7308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:37 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:38.683082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:38.684315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:38.690260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:38.690750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:38.691191 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:38.691885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:38.692370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:38.692803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:38.838131 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:38.846328 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c81ce429-7dda-46f6-b906-6a66b1c2a155 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.216092 Oct 12 23:42:38.846899 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3703/7309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:38 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:39.869765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:39.870376 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:39.877662 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:39.878136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:39.878569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:39.879248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:39.879697 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:39.880150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:40.020439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:40.028802 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a681485d-a3f7-43d2-8722-5ec7dccab9d7 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.162773 Oct 12 23:42:40.029524 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3607/7310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:39 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:41.053186 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:41.053815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:41.061285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:41.061778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:41.062230 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:41.062933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:41.063395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:41.063831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:41.202183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:41.210466 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d7e40530-7d9b-40d8-801d-0e8c1baa3c6e tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.161282 Oct 12 23:42:41.211072 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3704/7311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:41 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:42.234314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:42.234923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:42.241840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:42.242325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:42.242768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:42.243458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:42.243929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:42.244363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:42.385974 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:42.394139 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8a64262-613e-4813-b126-e074cfdeef52 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1756 microversion: 2.1 time: 0.163729 Oct 12 23:42:42.394709 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3608/7312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:42 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:42:43.417680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:42:43.418945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:42:43.425823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:43.426311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:43.426755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:43.427447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:42:43.427923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:42:43.428359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:42:43.573140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:42:43.582083 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aa6f5d92-bc7e-485e-b495-dadaa8ded68b tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1759 microversion: 2.1 time: 0.168378 Oct 12 23:42:43.582664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3705/7313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:42:43 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:15.792118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1365106770"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:15.792666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:15.794814 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:15.795476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:15.801986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:15.802468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:15.802908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:15.803611 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:15.804081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:15.804537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:15.932311 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.network.security_group_api [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Removing security group a1742c43-9e33-42fb-b5ac-6c7ac3de0018 from port 3e7744d9-68d6-4deb-a046-e3dad04e9f76 Oct 12 23:43:16.544951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f46dd5da-33ef-483d-98b1-ff0956a089ed tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/action" status: 202 len: 0 microversion: 2.1 time: 0.757081 Oct 12 23:43:16.545861 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3609/7314] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:43:15 2022] POST /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:43:16.553495 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2489f667-005b-4182-8394-a5b9c60f0717 req-0995878f-4b1e-41d1-9182-68252a431bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd267a41-45d8-4d9a-b909-b2c0c3f19e46", "tag": "3e7744d9-68d6-4deb-a046-e3dad04e9f76"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:16.565096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:16.566345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=36 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:16.586555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2489f667-005b-4182-8394-a5b9c60f0717 req-0995878f-4b1e-41d1-9182-68252a431bb5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:16.587062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2489f667-005b-4182-8394-a5b9c60f0717 req-0995878f-4b1e-41d1-9182-68252a431bb5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:16.587514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2489f667-005b-4182-8394-a5b9c60f0717 req-0995878f-4b1e-41d1-9182-68252a431bb5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:16.599605 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2489f667-005b-4182-8394-a5b9c60f0717 req-0995878f-4b1e-41d1-9182-68252a431bb5 service nova] Creating event network-changed:3e7744d9-68d6-4deb-a046-e3dad04e9f76 for instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 on n-h2-860864-8 Oct 12 23:43:16.616816 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2489f667-005b-4182-8394-a5b9c60f0717 req-0995878f-4b1e-41d1-9182-68252a431bb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066815 Oct 12 23:43:16.620748 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3706/7315] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:17.649345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:17.649850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:17.655833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:17.656345 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:17.656782 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:17.657998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:17.658446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:17.658875 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:17.741885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lazy-loading 'services' on Instance uuid cd267a41-45d8-4d9a-b909-b2c0c3f19e46 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:43:17.814470 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc40e988-e8fa-4272-8c91-1964a8aa94b6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments/850f010c-0955-4854-96ab-73b4ba1b0e68" status: 202 len: 0 microversion: 2.1 time: 0.169881 Oct 12 23:43:17.815182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3610/7316] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:43:17 2022] DELETE /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments/850f010c-0955-4854-96ab-73b4ba1b0e68 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:43:17.825138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:17.828450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:17.838323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:17.838926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:17.839737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:17.840548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:17.841016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:17.841450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:17.873132 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f58a2f03-1df5-4e48-9713-9bc240487470 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052829 Oct 12 23:43:17.873705 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3707/7317] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:43:17 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:43:18.635003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7d59186d-d0f9-4ed5-9229-b78ff37227c9 req-067ca619-d480-4efb-910c-2eb01d988eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd267a41-45d8-4d9a-b909-b2c0c3f19e46", "tag": "3e7744d9-68d6-4deb-a046-e3dad04e9f76"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:18.645136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d59186d-d0f9-4ed5-9229-b78ff37227c9 req-067ca619-d480-4efb-910c-2eb01d988eee service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:18.645600 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d59186d-d0f9-4ed5-9229-b78ff37227c9 req-067ca619-d480-4efb-910c-2eb01d988eee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:18.646027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d59186d-d0f9-4ed5-9229-b78ff37227c9 req-067ca619-d480-4efb-910c-2eb01d988eee service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:18.657600 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7d59186d-d0f9-4ed5-9229-b78ff37227c9 req-067ca619-d480-4efb-910c-2eb01d988eee service nova] Creating event network-changed:3e7744d9-68d6-4deb-a046-e3dad04e9f76 for instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 on n-h2-860864-8 Oct 12 23:43:18.662783 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7d59186d-d0f9-4ed5-9229-b78ff37227c9 req-067ca619-d480-4efb-910c-2eb01d988eee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031837 Oct 12 23:43:18.663373 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3611/7318] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:18.886383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:18.888628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:18.895786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:18.896312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:18.896757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:18.897458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:18.898113 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:18.898551 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:18.930336 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bdaa1bf4-a2c2-4e36-8320-589605e4c5ec tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048022 Oct 12 23:43:18.931277 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3708/7319] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:43:18 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:19.944786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:19.947075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:19.953264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:19.953747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:19.954181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:19.954872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:19.955323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:19.955750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:19.990532 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71722712-73f3-452d-99b1-7f39c6eab7c3 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050912 Oct 12 23:43:19.991112 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3612/7320] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:43:19 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:21.002633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:21.004867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:21.011824 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:21.012368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:21.012818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:21.013519 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:21.013986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:21.014422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:21.045407 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c9c994a-74c0-4ca4-8f93-915e8315782a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Oct 12 23:43:21.045986 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3709/7321] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:43:20 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:22.057809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:22.060060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:22.067019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:22.067499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:22.067955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:22.068651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:22.069102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:22.069529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:22.099565 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57950243-0004-40d1-b4cd-9359b59da72a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045979 Oct 12 23:43:22.100163 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3613/7322] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:43:22 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:23.112309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:23.114584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:23.122994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:23.123496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:23.123982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:23.124686 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:23.125154 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:23.125590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:23.154167 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8f7ffb2-a361-4a95-9a8a-6e8bcc4d5040 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045979 Oct 12 23:43:23.154735 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3710/7323] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 12 23:43:23 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 23:43:23.166282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:23.166778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:23.173428 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:23.173897 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:23.174324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:23.174997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:23.175438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:23.175857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:23.181182 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:43:23.181313 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments/850f010c-0955-4854-96ab-73b4ba1b0e68 (ip 10.222.0.20) !!! Oct 12 23:43:23.255466 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] HTTP exception thrown: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 is not attached to volume 850f010c-0955-4854-96ab-73b4ba1b0e68 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Request method failure captured: Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments/850f010c-0955-4854-96ab-73b4ba1b0e68 HTTP/1.1 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0--FGE3he39ISkEgMlXIEkSgu_HBnHe7ZzUf0EXZDXvmHVMLHSL6c1jR3AOmu1onOqFJK0BBUYKw_2nLXj0AwhtaEEmFQGbdl0xJq_c7lmYNG6mhJseECHNMjiIhqBoog6ITMfT2va90gujvVIO3lJl7BoSHfIQVsQ_fAFxGEn4M4E Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}] Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 38bb5e2f389e420e8771c7bc770a2bd7 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 is not attached to volume 850f010c-0955-4854-96ab-73b4ba1b0e68 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'server_id': 'cd267a41-45d8-4d9a-b909-b2c0c3f19e46', 'id': '850f010c-0955-4854-96ab-73b4ba1b0e68'} Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 850f010c-0955-4854-96ab-73b4ba1b0e68. Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 is not attached to volume 850f010c-0955-4854-96ab-73b4ba1b0e68 Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:43:23.257084 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:43:23.262130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:43:23.262130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:43:23.262130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 is not attached to volume 850f010c-0955-4854-96ab-73b4ba1b0e68 Oct 12 23:43:23.262130 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:23.262130 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Returning 404 to user: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 is not attached to volume 850f010c-0955-4854-96ab-73b4ba1b0e68 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:43:23.262130 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f5e817e4-18d8-4938-8c2f-7e0c2d1dcf47 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments/850f010c-0955-4854-96ab-73b4ba1b0e68" status: 404 len: 154 microversion: 2.1 time: 0.096399 Oct 12 23:43:23.262130 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3614/7324] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 12 23:43:23 2022] DELETE /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46/os-volume_attachments/850f010c-0955-4854-96ab-73b4ba1b0e68 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:43:26.508046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:26.508665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:26.515759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:26.517009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:26.517560 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:26.518404 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:26.518878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:26.519346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:26.550482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:43:26.634972 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a80394f-c270-41df-ae1b-71c04f084efc tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 204 len: 0 microversion: 2.1 time: 0.130650 Oct 12 23:43:26.635996 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3711/7325] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:43:26 2022] DELETE /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:43:26.644544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:26.645906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:26.653881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:26.654364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:26.654797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:26.655487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:26.656152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:26.657113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:26.792275 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:26.800152 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37ece111-533d-4961-97cb-0b2404fa44d1 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1553 microversion: 2.1 time: 0.160097 Oct 12 23:43:26.800760 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3615/7326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:26 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:27.823843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:27.824644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:27.832308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:27.832803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:27.833345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:27.833959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:27.834420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:27.834885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:27.961910 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:27.970297 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-29d3f7fd-e3ec-473a-9195-729a968599a6 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1553 microversion: 2.1 time: 0.150811 Oct 12 23:43:27.970875 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3712/7327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:27 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:28.689254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4de25363-6591-409e-9d44-40679b4d9b39 req-db55e70f-8a24-4761-aeda-66254e95c814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd267a41-45d8-4d9a-b909-b2c0c3f19e46", "name": "network-vif-deleted", "tag": "3e7744d9-68d6-4deb-a046-e3dad04e9f76"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:28.700148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4de25363-6591-409e-9d44-40679b4d9b39 req-db55e70f-8a24-4761-aeda-66254e95c814 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:28.700623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4de25363-6591-409e-9d44-40679b4d9b39 req-db55e70f-8a24-4761-aeda-66254e95c814 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:28.701050 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4de25363-6591-409e-9d44-40679b4d9b39 req-db55e70f-8a24-4761-aeda-66254e95c814 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:28.713271 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4de25363-6591-409e-9d44-40679b4d9b39 req-db55e70f-8a24-4761-aeda-66254e95c814 service nova] Creating event network-vif-deleted:3e7744d9-68d6-4deb-a046-e3dad04e9f76 for instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 on n-h2-860864-8 Oct 12 23:43:28.718349 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4de25363-6591-409e-9d44-40679b4d9b39 req-db55e70f-8a24-4761-aeda-66254e95c814 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033224 Oct 12 23:43:28.718958 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3616/7328] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:28.994162 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:28.994797 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:29.002464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:29.002965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:29.003415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:29.004177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:29.004642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:29.005076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:29.038487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:29.038979 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:29.039422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:29.039881 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lazy-loading 'fault' on Instance uuid cd267a41-45d8-4d9a-b909-b2c0c3f19e46 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:43:29.084334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bb5e2f389e420e8771c7bc770a2bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f897ac19fc42a98a3a7c01cab7e00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:29.093473 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5f89102b-bc29-48f0-84fb-34d87222f64a tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 200 len: 1348 microversion: 2.1 time: 0.103235 Oct 12 23:43:29.094540 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3713/7329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:28 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:30.119791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:30.120528 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] [instance: cd267a41-45d8-4d9a-b909-b2c0c3f19e46] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:30.126678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:30.127152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:30.127582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:30.128296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:30.128747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:30.129168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:30.143214 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] HTTP exception thrown: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 could not be found. Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Request method failure captured: Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 HTTP/1.1 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR0--FGE3he39ISkEgMlXIEkSgu_HBnHe7ZzUf0EXZDXvmHVMLHSL6c1jR3AOmu1onOqFJK0BBUYKw_2nLXj0AwhtaEEmFQGbdl0xJq_c7lmYNG6mhJseECHNMjiIhqBoog6ITMfT2va90gujvVIO3lJl7BoSHfIQVsQ_fAFxGEn4M4E Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70f897ac19fc42a98a3a7c01cab7e00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70f897ac19fc42a98a3a7c01cab7e00e"}]}] Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 70f897ac19fc42a98a3a7c01cab7e00e Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestMinimumBasicScenario-853836158 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: 38bb5e2f389e420e8771c7bc770a2bd7 Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestMinimumBasicScenario-853836158-project Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 could not be found. Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'cd267a41-45d8-4d9a-b909-b2c0c3f19e46'} Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 could not be found. Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 could not be found. Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:43:30.144849 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 could not be found. Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Returning 404 to user: Instance cd267a41-45d8-4d9a-b909-b2c0c3f19e46 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d9eb580-83f4-47cb-b9fa-b61fe5b410ae tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46" status: 404 len: 111 microversion: 2.1 time: 0.031538 Oct 12 23:43:30.149725 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3617/7330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:30 2022] GET /compute/v2.1/servers/cd267a41-45d8-4d9a-b909-b2c0c3f19e46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:43:30.155190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3d1e4e2-6a3a-4868-91e8-29f46b1a7154 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] Calling method '.version_select at 0x7f44fc17eca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:30.176892 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3d1e4e2-6a3a-4868-91e8-29f46b1a7154 tempest-TestMinimumBasicScenario-853836158 tempest-TestMinimumBasicScenario-853836158-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287256769" status: 202 len: 0 microversion: 2.1 time: 0.025632 Oct 12 23:43:30.177511 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3714/7331] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Oct 12 23:43:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287256769 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:43:39.076472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-318ccde1-4b01-4d9e-a6f2-eb431903bd98 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: .version_select at 0x7f45050eaaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1294560659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6pte5K7koHf5DI6DrFkCll9PhK3rGEO9yBizx2rD3DbBehHS+c0aR2WYERNbrbXXLfB+gxNOxXRvnw5n9yySZW5H9VI5qfnWE5YT2NnXeEBYmEbRRZUgRYJ3LTDQ1cGw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:39.092215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-318ccde1-4b01-4d9e-a6f2-eb431903bd98 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:43:39.097383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-318ccde1-4b01-4d9e-a6f2-eb431903bd98 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:43:39.120928 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-318ccde1-4b01-4d9e-a6f2-eb431903bd98 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.207458 Oct 12 23:43:39.121508 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3618/7332] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:43:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:45.083200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:45.084009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:45.088420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-114491452", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "d214d028-7670-4864-9234-1c512f607847"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1294560659", "security_groups": [{"name": "tempest-secgroup-smoke-2100582239"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:45.220330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] validate_networks() for [('d214d028-7670-4864-9234-1c512f607847', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:43:45.695566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:43:45.696420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:43:45.697018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:43:45.697554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:43:45.698088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:43:45.708763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:45.709365 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:45.709883 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:45.710697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:45.711235 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:45.711678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:45.737223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:43:45.743429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:43:45.756844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:43:45.759484 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:43:45.815131 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fdbae100-b45c-4f02-9777-c123124dbbf6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733931 Oct 12 23:43:45.816236 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3715/7333] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:43:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:43:45.827150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-855dd874-aaf9-4ff7-81f9-af1d1bfeddc6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:45.828924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-855dd874-aaf9-4ff7-81f9-af1d1bfeddc6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:45.836688 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:45.837140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:45.896241 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-855dd874-aaf9-4ff7-81f9-af1d1bfeddc6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:45.903187 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-855dd874-aaf9-4ff7-81f9-af1d1bfeddc6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1266 microversion: 2.1 time: 0.079895 Oct 12 23:43:45.903756 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3619/7334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:45 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:46.928005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e46602db-714e-47a2-9975-e8fd8c1fc655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:46.929250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e46602db-714e-47a2-9975-e8fd8c1fc655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:46.990678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e46602db-714e-47a2-9975-e8fd8c1fc655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:46.998098 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e46602db-714e-47a2-9975-e8fd8c1fc655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1266 microversion: 2.1 time: 0.074718 Oct 12 23:43:46.998700 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3716/7335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:46 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:48.021388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b5ca559-cd17-493f-9cfc-3be70c6c8983 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:48.022005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b5ca559-cd17-493f-9cfc-3be70c6c8983 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:48.080256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b5ca559-cd17-493f-9cfc-3be70c6c8983 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:48.087870 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b5ca559-cd17-493f-9cfc-3be70c6c8983 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1266 microversion: 2.1 time: 0.070410 Oct 12 23:43:48.096909 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3620/7336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:48 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:49.110779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27734ff4-c45c-478d-b86e-da35162de5f9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:49.111416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-27734ff4-c45c-478d-b86e-da35162de5f9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:49.165180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-27734ff4-c45c-478d-b86e-da35162de5f9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:49.171976 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27734ff4-c45c-478d-b86e-da35162de5f9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1266 microversion: 2.1 time: 0.065350 Oct 12 23:43:49.172550 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3717/7337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:49 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1266 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:50.195162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:50.195772 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:50.203363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:50.203841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:50.204310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:50.204992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:50.205441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:50.205860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:50.267713 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:50.275399 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40642c10-49be-4e83-9d0c-0e36b6b72090 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1270 microversion: 2.1 time: 0.084218 Oct 12 23:43:50.276025 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3621/7338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:50 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:51.299013 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:51.299700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:51.307236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:51.307730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:51.308218 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:51.308930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:51.309396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:51.309857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:51.371796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:51.380392 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f15ae50-fe9d-4bd8-9936-050b8c2b49e4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1324 microversion: 2.1 time: 0.085315 Oct 12 23:43:51.380992 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3718/7339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:51 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1324 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:52.345658 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7d56f96d-a886-495c-97fc-b5fd8e785ee8 req-73493ed4-2736-4a33-94a6-3912f4125ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca49cac-1751-4a1f-958b-037bbba75963", "tag": "0ed0c76e-ed9c-417c-b73c-af135f250134"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:52.356707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d56f96d-a886-495c-97fc-b5fd8e785ee8 req-73493ed4-2736-4a33-94a6-3912f4125ec7 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:52.357185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d56f96d-a886-495c-97fc-b5fd8e785ee8 req-73493ed4-2736-4a33-94a6-3912f4125ec7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:52.357608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d56f96d-a886-495c-97fc-b5fd8e785ee8 req-73493ed4-2736-4a33-94a6-3912f4125ec7 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:52.369076 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7d56f96d-a886-495c-97fc-b5fd8e785ee8 req-73493ed4-2736-4a33-94a6-3912f4125ec7 service nova] Creating event network-changed:0ed0c76e-ed9c-417c-b73c-af135f250134 for instance fca49cac-1751-4a1f-958b-037bbba75963 on n-h1-860864-8 Oct 12 23:43:52.373808 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7d56f96d-a886-495c-97fc-b5fd8e785ee8 req-73493ed4-2736-4a33-94a6-3912f4125ec7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032472 Oct 12 23:43:52.374419 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3622/7340] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:52.404280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:52.404998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:52.412959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:52.413535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:52.414060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:52.414828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:52.415359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:52.415882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:52.550520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:52.558426 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3c280ff5-b82c-449e-a372-665036725281 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1392 microversion: 2.1 time: 0.158162 Oct 12 23:43:52.559021 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3719/7341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:52 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:53.582761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:53.583380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:53.589522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:53.590004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:53.590438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:53.591126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:53.591577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:53.592038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:53.802738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:53.810787 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35f6e53b-ecd2-4bd6-9bf6-ff04ec04c53d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1392 microversion: 2.1 time: 0.233250 Oct 12 23:43:53.811460 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3623/7342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:53 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:54.834255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:54.834876 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:54.841310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:54.841801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:54.842243 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:54.842938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:54.843409 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:54.843871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:54.976358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:54.984031 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70bcddb8-40bf-4c23-8112-99ae7ffd0c8b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1392 microversion: 2.1 time: 0.153841 Oct 12 23:43:54.985161 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3720/7343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:54 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:56.006657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:56.007266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:56.014145 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:56.014621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:56.015051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:56.016334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:56.016779 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:56.017196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:56.151005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:56.160059 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac446636-82a8-4e3f-a6ba-0a4bc101b5e0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1392 microversion: 2.1 time: 0.157127 Oct 12 23:43:56.160634 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3624/7344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:56 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:57.182749 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:57.183382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:57.185264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:57.191427 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:57.191945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:57.192402 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:57.193102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:57.193566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:57.194003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:57.322865 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:57.330505 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9333530b-72a8-4b0f-90e1-568255d44799 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1392 microversion: 2.1 time: 0.151805 Oct 12 23:43:57.331072 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3721/7345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:57 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:57.503179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-24c41126-4b32-4d85-b419-0eba848cae75 req-9b65cbc0-3408-49f2-80be-2fb21e74dbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca49cac-1751-4a1f-958b-037bbba75963", "name": "network-vif-plugged", "status": "completed", "tag": "0ed0c76e-ed9c-417c-b73c-af135f250134"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:43:57.514580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-24c41126-4b32-4d85-b419-0eba848cae75 req-9b65cbc0-3408-49f2-80be-2fb21e74dbf8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:57.515049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-24c41126-4b32-4d85-b419-0eba848cae75 req-9b65cbc0-3408-49f2-80be-2fb21e74dbf8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:57.515480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-24c41126-4b32-4d85-b419-0eba848cae75 req-9b65cbc0-3408-49f2-80be-2fb21e74dbf8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:57.527008 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-24c41126-4b32-4d85-b419-0eba848cae75 req-9b65cbc0-3408-49f2-80be-2fb21e74dbf8 service nova] Creating event network-vif-plugged:0ed0c76e-ed9c-417c-b73c-af135f250134 for instance fca49cac-1751-4a1f-958b-037bbba75963 on n-h1-860864-8 Oct 12 23:43:57.532649 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-24c41126-4b32-4d85-b419-0eba848cae75 req-9b65cbc0-3408-49f2-80be-2fb21e74dbf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033952 Oct 12 23:43:57.533402 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3625/7346] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:43:58.353446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:58.354027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:58.361475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:58.361968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:58.362416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:58.363128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:58.363593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:58.364059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:58.498422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:58.507027 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08c7f780-0cf4-4612-81f1-e75d665566a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1392 microversion: 2.1 time: 0.157620 Oct 12 23:43:58.507590 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3722/7347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:58 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:59.526480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:59.532601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:59.533303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:59.540075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:59.540555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:59.541010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:59.541686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:59.542139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:59.542566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:59.670257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:59.678597 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88b69bb9-f74c-4d4b-b365-312daface197 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1565 microversion: 2.1 time: 0.153052 Oct 12 23:43:59.679164 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3626/7348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:59 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:43:59.700416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:43:59.701051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:43:59.702955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:43:59.709061 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:59.709561 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:59.710076 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:59.710785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:43:59.711256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:43:59.711698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:43:59.842144 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:43:59.850620 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6df857a-c1d5-42b3-a7b7-8fcff06c1f0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1565 microversion: 2.1 time: 0.154122 Oct 12 23:43:59.851205 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3723/7349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:43:59 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:01.663286 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:01.664168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:01.665460 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a2c911a8-0efe-437d-9ca6-b1758c1e8f9b req-8008abfd-8e7d-4279-8b6b-e7c3b4fe06fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca49cac-1751-4a1f-958b-037bbba75963", "tag": "0ed0c76e-ed9c-417c-b73c-af135f250134"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:01.671756 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:01.672521 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:01.672967 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:01.673678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:01.674174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:01.674605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:01.685782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2c911a8-0efe-437d-9ca6-b1758c1e8f9b req-8008abfd-8e7d-4279-8b6b-e7c3b4fe06fe service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:01.686461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2c911a8-0efe-437d-9ca6-b1758c1e8f9b req-8008abfd-8e7d-4279-8b6b-e7c3b4fe06fe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:01.687105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2c911a8-0efe-437d-9ca6-b1758c1e8f9b req-8008abfd-8e7d-4279-8b6b-e7c3b4fe06fe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:01.701809 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a2c911a8-0efe-437d-9ca6-b1758c1e8f9b req-8008abfd-8e7d-4279-8b6b-e7c3b4fe06fe service nova] Creating event network-changed:0ed0c76e-ed9c-417c-b73c-af135f250134 for instance fca49cac-1751-4a1f-958b-037bbba75963 on n-h1-860864-8 Oct 12 23:44:01.708462 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a2c911a8-0efe-437d-9ca6-b1758c1e8f9b req-8008abfd-8e7d-4279-8b6b-e7c3b4fe06fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046274 Oct 12 23:44:01.709079 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3724/7350] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:44:01.910508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:01.919216 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-689c906d-54b0-4b70-b6f5-2e82374b461c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1565 microversion: 2.1 time: 0.260344 Oct 12 23:44:01.920005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3627/7351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:01 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1565 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:23.174366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:23.176796 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:23.179362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:23.180045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=40 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:23.185961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:23.186452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:23.186898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:23.187595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:23.188104 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:23.188572 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:23.243033 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c17bf491-e26c-4fba-93d8-dc29b28013ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action" status: 200 len: 24556 microversion: 2.1 time: 0.073417 Oct 12 23:44:23.243703 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3725/7352] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:44:23 2022] POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action => generated 24556 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:44:34.349271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:34.349906 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:34.351815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=21 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:34.352504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=34 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:34.358402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:34.358895 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:34.359337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:34.360072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:34.360529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:34.360955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:34.712241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2b908771-0b7d-440f-bece-a562937aca23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action" status: 202 len: 0 microversion: 2.1 time: 0.366949 Oct 12 23:44:34.716176 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3628/7353] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:44:34 2022] POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:44:34.724338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:34.725340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:34.729164 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:34.730769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:34.744083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:34.744710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:34.745314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:34.746139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:34.746744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:34.747346 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:34.896754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:34.904946 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9a19d96-c7c4-4a58-aa23-0fd143519950 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1689 microversion: 2.1 time: 0.186626 Oct 12 23:44:34.905642 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3726/7354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:34 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:44:35.932692 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:35.933396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:35.940316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:35.940804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:35.941243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:35.941938 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:35.942458 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:35.942888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:36.079731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:36.087615 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13176d73-106f-4752-a899-4d4d3d8c5528 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1669 microversion: 2.1 time: 0.160173 Oct 12 23:44:36.088222 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3629/7355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:35 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:37.186691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:37.188986 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:37.195800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:37.196323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:37.196775 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:37.197476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:37.197940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:37.198377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:37.248704 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e5374835-6195-46d3-8435-fc6ebb7d7e12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action" status: 200 len: 32623 microversion: 2.1 time: 0.065928 Oct 12 23:44:37.249333 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3727/7356] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:44:37 2022] POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action => generated 32623 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:44:37.260963 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:37.261502 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:37.268770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:37.269870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:37.270317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:37.271001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:37.271455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:37.271880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:37.336234 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7bc9fc4-af66-478d-ad93-1c803b7888b9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action" status: 202 len: 0 microversion: 2.1 time: 0.078908 Oct 12 23:44:37.336921 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3630/7357] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:44:37 2022] POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:44:37.346693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:37.347411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:37.355279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:37.355782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:37.356602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:37.356981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:37.357451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:37.357892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:37.494196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:37.502188 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-375732ea-2121-4395-8992-4d3eb372dbd1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1676 microversion: 2.1 time: 0.160269 Oct 12 23:44:37.503379 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3728/7358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:37 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:44:38.528109 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:38.528818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:38.535259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:38.535746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:38.536233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:38.536926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:38.537380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:38.537807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:38.670030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:38.678360 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24796cec-6420-40fc-bbd5-90a2dbf0ee1d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1684 microversion: 2.1 time: 0.155399 Oct 12 23:44:38.678932 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3631/7359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:38 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:38.771739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:38.773922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:38.781867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:38.782302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:38.782746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:38.784443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:38.784931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:38.785368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:38.835010 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-140ee6eb-8661-4a26-9830-e38f11c003c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action" status: 200 len: 38455 microversion: 2.1 time: 0.067610 Oct 12 23:44:38.835663 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3729/7360] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:44:38 2022] POST /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963/action => generated 38455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:44:39.815980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:39.816603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:39.818252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a05608c6-5f86-4b08-b5eb-da2675c2ddbd req-791ef3c2-b7ae-45ee-b473-0d625567a65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca49cac-1751-4a1f-958b-037bbba75963", "tag": "0ed0c76e-ed9c-417c-b73c-af135f250134"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:39.823884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:39.824540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:39.825076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:39.825880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:39.826434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:39.827105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:39.830171 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a05608c6-5f86-4b08-b5eb-da2675c2ddbd req-791ef3c2-b7ae-45ee-b473-0d625567a65c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:39.830658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a05608c6-5f86-4b08-b5eb-da2675c2ddbd req-791ef3c2-b7ae-45ee-b473-0d625567a65c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:39.831100 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a05608c6-5f86-4b08-b5eb-da2675c2ddbd req-791ef3c2-b7ae-45ee-b473-0d625567a65c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:39.842614 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a05608c6-5f86-4b08-b5eb-da2675c2ddbd req-791ef3c2-b7ae-45ee-b473-0d625567a65c service nova] Creating event network-changed:0ed0c76e-ed9c-417c-b73c-af135f250134 for instance fca49cac-1751-4a1f-958b-037bbba75963 on n-h1-860864-8 Oct 12 23:44:39.848977 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a05608c6-5f86-4b08-b5eb-da2675c2ddbd req-791ef3c2-b7ae-45ee-b473-0d625567a65c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034725 Oct 12 23:44:39.850018 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3730/7361] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:44:39.855303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:44:39.940556 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b99e2922-0d60-4296-9cb5-c317ea9b0ebd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 204 len: 0 microversion: 2.1 time: 0.128423 Oct 12 23:44:39.944627 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3632/7362] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:44:39 2022] DELETE /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:44:39.952928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:39.953896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:39.964972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:39.965802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:39.966295 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:39.967067 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:39.967537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:39.968002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:40.107169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:40.115785 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ef42f12-5f81-4f8e-87cb-ad37a92ad3e6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1690 microversion: 2.1 time: 0.169419 Oct 12 23:44:40.116607 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3731/7363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:39 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:41.139548 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:41.140279 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:41.151181 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:41.151678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:41.152148 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:41.152858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:41.153323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:41.153751 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:41.315595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:41.323389 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f32929f-2df1-4904-83d5-e99d959745f8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1690 microversion: 2.1 time: 0.188129 Oct 12 23:44:41.323974 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3633/7364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:41 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:41.913369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1c2c0abe-a6bf-4c12-88ec-1af1790bcec6 req-de40964c-e1e6-4e06-a3f7-b0a31a868d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca49cac-1751-4a1f-958b-037bbba75963", "name": "network-vif-deleted", "tag": "0ed0c76e-ed9c-417c-b73c-af135f250134"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:41.925322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1c2c0abe-a6bf-4c12-88ec-1af1790bcec6 req-de40964c-e1e6-4e06-a3f7-b0a31a868d17 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:41.925968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1c2c0abe-a6bf-4c12-88ec-1af1790bcec6 req-de40964c-e1e6-4e06-a3f7-b0a31a868d17 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:41.926447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1c2c0abe-a6bf-4c12-88ec-1af1790bcec6 req-de40964c-e1e6-4e06-a3f7-b0a31a868d17 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:41.940865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1c2c0abe-a6bf-4c12-88ec-1af1790bcec6 req-de40964c-e1e6-4e06-a3f7-b0a31a868d17 service nova] Creating event network-vif-deleted:0ed0c76e-ed9c-417c-b73c-af135f250134 for instance fca49cac-1751-4a1f-958b-037bbba75963 on n-h1-860864-8 Oct 12 23:44:41.946032 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1c2c0abe-a6bf-4c12-88ec-1af1790bcec6 req-de40964c-e1e6-4e06-a3f7-b0a31a868d17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037000 Oct 12 23:44:41.946621 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3732/7365] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:44:42.347562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:42.348372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:42.355099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:42.355592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:42.356133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:42.356879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:42.357342 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:42.357769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:42.391065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:42.391981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:42.392096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:42.392512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lazy-loading 'fault' on Instance uuid fca49cac-1751-4a1f-958b-037bbba75963 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:44:42.437499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:42.444685 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-542480b3-43b6-42da-809a-6e65cc3d4075 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 200 len: 1356 microversion: 2.1 time: 0.101551 Oct 12 23:44:42.445256 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3634/7366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:42 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:43.469602 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:43.470945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: fca49cac-1751-4a1f-958b-037bbba75963] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:43.477177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:43.477669 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:43.478116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:43.478810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:43.479269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:43.479700 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:43.495422 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] HTTP exception thrown: Instance fca49cac-1751-4a1f-958b-037bbba75963 could not be found. Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Request method failure captured: Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 HTTP/1.1 Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR1EqMfBn4a1eRNzGr1Ti1kU_C4B2KaChLShiifJk4rvgRq2ljFOr6pHb_GQ7J8fQa2894lIekEq9NnjKEE9Yma8xf0U9QHLP174bSamNMh_QtojnTv_OL9SOQaQ7NHsQNDhzrzCYRpZOWVZWX3WuhCEBcuqXS8Xf3_6bFg_c8fMVRjw Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}] Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: df0e8621054d45828bff5d8bac144bdf Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance fca49cac-1751-4a1f-958b-037bbba75963 could not be found. Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'fca49cac-1751-4a1f-958b-037bbba75963'} Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca49cac-1751-4a1f-958b-037bbba75963 could not be found. Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca49cac-1751-4a1f-958b-037bbba75963 could not be found. Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:44:43.497063 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca49cac-1751-4a1f-958b-037bbba75963 could not be found. Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Returning 404 to user: Instance fca49cac-1751-4a1f-958b-037bbba75963 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-50fa2912-4efc-4697-a3b7-7ef94ccb0079 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963" status: 404 len: 111 microversion: 2.1 time: 0.034024 Oct 12 23:44:43.501984 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3733/7367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:43 2022] GET /compute/v2.1/servers/fca49cac-1751-4a1f-958b-037bbba75963 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:44:46.610481 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a0be03c8-852c-4e15-a529-c1d14f5ebb0f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '.version_select at 0x7f44fe571040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:46.635951 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a0be03c8-852c-4e15-a529-c1d14f5ebb0f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1294560659" status: 202 len: 0 microversion: 2.1 time: 0.028887 Oct 12 23:44:46.637492 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3635/7368] 10.222.0.20 () {58 vars in 1284 bytes} [Wed Oct 12 23:44:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1294560659 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:44:46.662964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c567ab08-a4b6-49df-8f77-d5faed78f1a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: .version_select at 0x7f44ffb83280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-738708512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpcryhwHMKKfeeo6f0zYOW8aLLvqCp9zoNX0SuhmraFKx+GrlDhodx3ka0mKmb3A8KVtQkoSMSrHkjOUdZh5i96YGPQmtgG1LC/en+uU9Xm8ZE63P6r/PXCqHt1KyKqMQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:46.683215 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c567ab08-a4b6-49df-8f77-d5faed78f1a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:44:46.690385 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-c567ab08-a4b6-49df-8f77-d5faed78f1a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:44:46.717822 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c567ab08-a4b6-49df-8f77-d5faed78f1a8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059664 Oct 12 23:44:46.718426 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3734/7369] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:44:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:44:51.816337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1729341655", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "6f74f945-8e14-4faa-a7ce-4e4dc97ab6e2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-738708512", "security_groups": [{"name": "tempest-secgroup-smoke-2052668269"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:51.950483 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] validate_networks() for [('6f74f945-8e14-4faa-a7ce-4e4dc97ab6e2', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:44:52.442920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:52.835746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:44:52.836416 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:44:52.838152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:44:52.838152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:44:52.838152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:44:52.851552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:52.852372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:52.852966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:52.853882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:52.854500 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:52.855094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:52.877956 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:44:52.883677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:44:52.897335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:44:52.899664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:44:52.954371 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b088ce88-ab1e-4f62-9842-1dfbe055162a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.143450 Oct 12 23:44:52.962298 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3636/7370] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:44:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:44:52.968734 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17b7d954-4a0d-4f1d-9eb0-7bbd89f13907 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:52.969461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17b7d954-4a0d-4f1d-9eb0-7bbd89f13907 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:53.041591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-17b7d954-4a0d-4f1d-9eb0-7bbd89f13907 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:53.050633 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17b7d954-4a0d-4f1d-9eb0-7bbd89f13907 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1266 microversion: 2.1 time: 0.087080 Oct 12 23:44:53.052648 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3735/7371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:52 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:44:54.078228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:54.079032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:54.088212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:54.089151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:54.089929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:54.091106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:54.091732 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:54.092355 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:54.170036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:54.179099 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc052384-64ff-41d3-bed0-60d99ea93948 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1336 microversion: 2.1 time: 0.105535 Oct 12 23:44:54.188456 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3637/7372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:54 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1336 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:55.202688 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:55.204102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:55.209928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:44:55.212782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:55.213539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:55.214046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:55.214999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:55.215528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:55.216079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:55.413828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:55.422320 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ba8d503a-4184-40d0-8b0b-68cb6999459e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1392 microversion: 2.1 time: 0.224167 Oct 12 23:44:55.423123 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3736/7373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:55 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:55.556444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-117c2a84-b6ca-4f00-8bf5-cdb9373ee213 req-99158a77-b179-43dc-ba48-2141de3d81f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9189ab-39f9-4288-bd35-b2f5a9cdb79d", "tag": "21ba59f3-a14c-42cc-9221-af16a147ab2b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:55.584753 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-117c2a84-b6ca-4f00-8bf5-cdb9373ee213 req-99158a77-b179-43dc-ba48-2141de3d81f2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:55.585337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-117c2a84-b6ca-4f00-8bf5-cdb9373ee213 req-99158a77-b179-43dc-ba48-2141de3d81f2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:55.585869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-117c2a84-b6ca-4f00-8bf5-cdb9373ee213 req-99158a77-b179-43dc-ba48-2141de3d81f2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:55.607786 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-117c2a84-b6ca-4f00-8bf5-cdb9373ee213 req-99158a77-b179-43dc-ba48-2141de3d81f2 service nova] Creating event network-changed:21ba59f3-a14c-42cc-9221-af16a147ab2b for instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d on n-h1-860864-8 Oct 12 23:44:55.613140 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-117c2a84-b6ca-4f00-8bf5-cdb9373ee213 req-99158a77-b179-43dc-ba48-2141de3d81f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064904 Oct 12 23:44:55.613797 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3638/7374] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:44:56.445751 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:56.446371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:56.453195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:56.453683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:56.454129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:56.455448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:56.455927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:56.456363 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:56.590012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:56.598226 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-181c9537-e784-4ca7-985a-bbb4763f39f2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1392 microversion: 2.1 time: 0.156717 Oct 12 23:44:56.598797 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3737/7375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:56 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:57.624313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:57.625110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:57.632014 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:57.632599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:57.633043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:57.633746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:57.634206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:57.634634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:57.772589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:57.780451 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f18dfc31-f5de-4aef-a5cf-a9e5be747b13 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1392 microversion: 2.1 time: 0.162693 Oct 12 23:44:57.780970 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3639/7376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:57 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:58.803863 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:44:58.804511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:44:58.811391 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:58.811878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:58.812360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:58.813051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:58.813510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:58.813943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:59.228040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:44:59.235753 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-de8e9aaa-0941-438e-8f70-8d280e593f67 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1392 microversion: 2.1 time: 0.435799 Oct 12 23:44:59.236352 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3738/7377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:44:58 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1392 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:44:59.796843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-29774a54-b9d6-435c-8d8e-684857fa50cb req-3b6dad4e-33d2-4e96-904e-4cc531aa2cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9189ab-39f9-4288-bd35-b2f5a9cdb79d", "name": "network-vif-plugged", "status": "completed", "tag": "21ba59f3-a14c-42cc-9221-af16a147ab2b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:44:59.808696 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-29774a54-b9d6-435c-8d8e-684857fa50cb req-3b6dad4e-33d2-4e96-904e-4cc531aa2cc6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:44:59.809886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-29774a54-b9d6-435c-8d8e-684857fa50cb req-3b6dad4e-33d2-4e96-904e-4cc531aa2cc6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:44:59.810329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-29774a54-b9d6-435c-8d8e-684857fa50cb req-3b6dad4e-33d2-4e96-904e-4cc531aa2cc6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:44:59.822506 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-29774a54-b9d6-435c-8d8e-684857fa50cb req-3b6dad4e-33d2-4e96-904e-4cc531aa2cc6 service nova] Creating event network-vif-plugged:21ba59f3-a14c-42cc-9221-af16a147ab2b for instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d on n-h1-860864-8 Oct 12 23:44:59.827519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-29774a54-b9d6-435c-8d8e-684857fa50cb req-3b6dad4e-33d2-4e96-904e-4cc531aa2cc6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 Oct 12 23:44:59.828147 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3640/7378] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:45:00.258676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:00.259340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:00.266281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:00.266804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:00.267256 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:00.267991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:00.269022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:00.269464 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:00.401194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:00.409316 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-02ae8bdb-f173-4fe4-9c48-41a9367ca617 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1392 microversion: 2.1 time: 0.154634 Oct 12 23:45:00.409894 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3739/7379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:00 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:01.432323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:01.433033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:01.440119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:01.440609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:01.441056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:01.441740 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:01.442193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:01.442619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:01.574089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:01.582349 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32c31969-03d0-4302-8682-53bc30ace35b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1564 microversion: 2.1 time: 0.154338 Oct 12 23:45:01.582935 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3641/7380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:01 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:01.605177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:01.605813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:01.613329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:01.613856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:01.614309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:01.615017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:01.615489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:01.615962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:01.744949 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:01.752712 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26d28ae3-884e-4655-a5c2-7d380459001d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1564 microversion: 2.1 time: 0.151539 Oct 12 23:45:01.753288 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3740/7381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:01 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:03.314959 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:03.315580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:03.317423 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-82bfbc3a-011e-40bf-b1a8-3e19d04de170 req-0dfa11ef-d33e-4827-811f-02e5d965a11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9189ab-39f9-4288-bd35-b2f5a9cdb79d", "tag": "21ba59f3-a14c-42cc-9221-af16a147ab2b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:45:03.318406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:03.319518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:03.327651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:03.328580 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:03.329545 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:03.330121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:03.330858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-82bfbc3a-011e-40bf-b1a8-3e19d04de170 req-0dfa11ef-d33e-4827-811f-02e5d965a11b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:03.331298 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:03.332038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-82bfbc3a-011e-40bf-b1a8-3e19d04de170 req-0dfa11ef-d33e-4827-811f-02e5d965a11b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:03.332278 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:03.332447 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-82bfbc3a-011e-40bf-b1a8-3e19d04de170 req-0dfa11ef-d33e-4827-811f-02e5d965a11b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:03.333072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:03.350138 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-82bfbc3a-011e-40bf-b1a8-3e19d04de170 req-0dfa11ef-d33e-4827-811f-02e5d965a11b service nova] Creating event network-changed:21ba59f3-a14c-42cc-9221-af16a147ab2b for instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d on n-h1-860864-8 Oct 12 23:45:03.355307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-82bfbc3a-011e-40bf-b1a8-3e19d04de170 req-0dfa11ef-d33e-4827-811f-02e5d965a11b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042055 Oct 12 23:45:03.355965 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3741/7382] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:45:03.567396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:03.576346 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-209def09-e038-4b13-a70d-e1109f519b9e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1564 microversion: 2.1 time: 0.265406 Oct 12 23:45:03.577172 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3642/7383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:03 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1564 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:24.830808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:24.831668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:24.836165 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:45:24.838512 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:24.846451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:24.846953 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:24.847407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:24.848151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:24.848627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:24.849069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:24.910253 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f6ccd6cc-65b4-47f7-a3ec-8b139426e2b2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d/action" status: 200 len: 24569 microversion: 2.1 time: 0.081234 Oct 12 23:45:24.911163 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3742/7384] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:45:24 2022] POST /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d/action => generated 24569 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:45:35.897552 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:45:35.899797 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:35.902091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:35.902846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=30 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:35.909541 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:35.910042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:35.910475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:35.911160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:35.911637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:35.912091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:35.988700 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d89309d1-fd8a-40c4-b039-5cda90d6e64e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d/action" status: 202 len: 0 microversion: 2.1 time: 0.094872 Oct 12 23:45:35.989348 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3643/7385] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:45:35 2022] POST /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:45:35.998325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:35.999082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:36.002633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:36.003307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:45:36.009719 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:36.009892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:36.010229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:36.010969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:36.011487 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:36.012038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:36.315489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:36.323307 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b506448a-eddb-4053-ae21-8a41a92953ab tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1674 microversion: 2.1 time: 0.329353 Oct 12 23:45:36.323902 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3743/7386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:35 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1674 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:37.348618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:37.349323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:37.355565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:37.356083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:37.356524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:37.357236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:37.357686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:37.358108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:37.489069 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:37.496883 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00eca40a-4e1d-47d1-b6ff-8b389d20aa71 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.154139 Oct 12 23:45:37.497453 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3644/7387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:37 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:38.523272 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:38.523966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:38.531944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:38.532514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:38.532968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:38.533941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:38.534407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:38.534844 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:38.669764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:38.678134 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a425a5e-64af-43aa-a4ef-34ad2a4a6e66 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.158836 Oct 12 23:45:38.678756 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3744/7388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:38 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:39.701766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:39.702385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:39.709778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:39.710263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:39.710704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:39.711401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:39.711858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:39.712316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:39.841703 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:39.849512 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5480bce2-197d-4b31-ba98-017cf5732cb8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.151760 Oct 12 23:45:39.850087 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3645/7389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:39 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:40.872212 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:40.872882 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:40.880387 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:40.880885 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:40.881342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:40.882046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:40.882549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:40.882994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:41.012344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:41.020170 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e961d03-a142-415a-ac37-e7eb47a99458 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.151918 Oct 12 23:45:41.020760 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3745/7390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:40 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:42.043456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:42.044090 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:42.051516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:42.052031 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:42.052473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:42.053156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:42.053601 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:42.054026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:42.191631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:42.199567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7e8402bf-7cd6-4a62-816b-02fd04e9b845 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.159958 Oct 12 23:45:42.200247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3646/7391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:42 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:43.223862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:43.224526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:43.231315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:43.231805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:43.232281 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:43.232980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:43.233439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:43.233871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:43.365599 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:43.373336 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ed54e7c0-96fe-41d4-8e77-ff4cf69fcefe tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.153940 Oct 12 23:45:43.373908 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3746/7392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:43 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:44.396340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:44.396953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:44.403768 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:44.404281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:44.404721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:44.405407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:44.405858 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:44.406280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:44.533812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:44.541473 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a6198d1d-b270-4c5c-b1b1-50531c79557a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.149713 Oct 12 23:45:44.542037 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3647/7393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:44 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:45.565330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:45.565961 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:45.572783 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:45.573278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:45.573729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:45.574434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:45.574898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:45.575349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:45.703643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:45.711338 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44dec8c2-6a25-4dc2-81ca-29fc1c705a2d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.150757 Oct 12 23:45:45.711972 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3747/7394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:45 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:46.810980 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:46.811602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:46.818628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:46.819112 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:46.819553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:46.820276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:46.820736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:46.821166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:46.954400 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:46.962194 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a6e4282-0f1f-48e3-9ef1-472c67fe9c53 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.155192 Oct 12 23:45:46.962774 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3648/7395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:46 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:47.985368 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:47.986002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:47.992992 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:47.993488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:47.993940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:47.994641 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:47.995107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:47.995543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:48.132671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:48.140489 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ff44ebf-e064-40a3-8a43-983ab70761c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.159047 Oct 12 23:45:48.141086 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3748/7396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:47 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:49.165220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:49.165866 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:49.172707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:49.173189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:49.173629 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:49.174318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:49.174771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:49.175195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:49.302910 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:49.310603 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-610226b6-de08-4f92-aa5a-991f1b9e9984 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.149465 Oct 12 23:45:49.311171 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3649/7397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:49 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:50.333397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:50.334060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:50.340595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:50.341091 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:50.341543 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:50.342248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:50.342715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:50.343157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:50.473038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:50.480884 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-184e9bc5-3205-4d28-8cbe-f72cdad861d8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.151589 Oct 12 23:45:50.481462 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3749/7398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:50 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:45:51.504735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:51.505372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:51.512254 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:51.512686 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:51.513123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:51.513812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:51.514264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:51.514689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:51.646513 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:51.654264 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bdde1d08-fea0-4a00-8adf-652abe2a6cb4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1679 microversion: 2.1 time: 0.154102 Oct 12 23:45:51.654846 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3650/7399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:51 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:45:52.677303 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:45:52.677933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:45:52.685136 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:52.685633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:52.686088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:52.686791 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:45:52.687257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:45:52.687699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:45:52.817831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:45:52.825624 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44c6cca2-c352-49a0-9679-02dcea38409d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1682 microversion: 2.1 time: 0.152338 Oct 12 23:45:52.826197 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3750/7400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:45:52 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:17.012026 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:17.014263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:17.016455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:17.017116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:17.022903 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:17.023329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:17.023778 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:17.024496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:17.024952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:17.025377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:17.080402 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8e3c9b29-a874-4529-9ef2-ffa0966ea9d9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d/action" status: 200 len: 69012 microversion: 2.1 time: 0.072508 Oct 12 23:46:17.081048 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3651/7401] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:46:17 2022] POST /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d/action => generated 69012 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:46:24.448862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:24.449384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:24.453021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:24.453853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=48 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:24.458653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:24.459241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:24.459697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:24.460448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:24.460922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:24.461362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:24.491294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:46:24.504826 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f508cf28-6b25-4e8d-8c61-a42d6411f3cf req-0d5c485f-2d1f-4daa-a1ce-6f39f973d347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9189ab-39f9-4288-bd35-b2f5a9cdb79d", "tag": "21ba59f3-a14c-42cc-9221-af16a147ab2b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:24.516457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f508cf28-6b25-4e8d-8c61-a42d6411f3cf req-0d5c485f-2d1f-4daa-a1ce-6f39f973d347 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:24.516953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f508cf28-6b25-4e8d-8c61-a42d6411f3cf req-0d5c485f-2d1f-4daa-a1ce-6f39f973d347 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:24.517391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f508cf28-6b25-4e8d-8c61-a42d6411f3cf req-0d5c485f-2d1f-4daa-a1ce-6f39f973d347 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:24.528250 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f508cf28-6b25-4e8d-8c61-a42d6411f3cf req-0d5c485f-2d1f-4daa-a1ce-6f39f973d347 service nova] Creating event network-changed:21ba59f3-a14c-42cc-9221-af16a147ab2b for instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d on n-h1-860864-8 Oct 12 23:46:24.534401 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f508cf28-6b25-4e8d-8c61-a42d6411f3cf req-0d5c485f-2d1f-4daa-a1ce-6f39f973d347 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093479 Oct 12 23:46:24.536044 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3652/7402] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:46:24.576893 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46f4e521-e4eb-4196-a6d3-f552f050e2e1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 204 len: 0 microversion: 2.1 time: 0.139348 Oct 12 23:46:24.578096 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3751/7403] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:46:24 2022] DELETE /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:46:24.587837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:24.588613 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:24.597738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:24.598444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:24.598889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:24.599586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:24.601335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:24.601832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:24.740724 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:24.748465 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f59642e-70ef-4cd9-97f5-961282eedb2c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1688 microversion: 2.1 time: 0.165873 Oct 12 23:46:24.749046 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3653/7404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:24 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:25.774326 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:25.775070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:25.781897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:25.782381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:25.783080 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:25.783781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:25.784268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:25.784696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:25.967384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:25.975360 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c07db87-7378-40fd-b06f-0da9c4472bf8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 200 len: 1688 microversion: 2.1 time: 0.205793 Oct 12 23:46:25.975963 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3752/7405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:25 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:46:26.520581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-41386bdd-908e-4ea3-9eda-146b20bbfbd5 req-f74083b5-34b6-470d-aa2d-006b0f913ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9189ab-39f9-4288-bd35-b2f5a9cdb79d", "name": "network-vif-deleted", "tag": "21ba59f3-a14c-42cc-9221-af16a147ab2b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:26.530034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-41386bdd-908e-4ea3-9eda-146b20bbfbd5 req-f74083b5-34b6-470d-aa2d-006b0f913ec6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:26.530511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-41386bdd-908e-4ea3-9eda-146b20bbfbd5 req-f74083b5-34b6-470d-aa2d-006b0f913ec6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:26.530944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-41386bdd-908e-4ea3-9eda-146b20bbfbd5 req-f74083b5-34b6-470d-aa2d-006b0f913ec6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:26.543174 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-41386bdd-908e-4ea3-9eda-146b20bbfbd5 req-f74083b5-34b6-470d-aa2d-006b0f913ec6 service nova] Creating event network-vif-deleted:21ba59f3-a14c-42cc-9221-af16a147ab2b for instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d on n-h1-860864-8 Oct 12 23:46:26.548790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-41386bdd-908e-4ea3-9eda-146b20bbfbd5 req-f74083b5-34b6-470d-aa2d-006b0f913ec6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034019 Oct 12 23:46:26.549409 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3654/7406] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:46:27.000073 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:27.000710 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:27.008552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:27.009059 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:27.009511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:27.010225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:27.010693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:27.011129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:27.025182 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] HTTP exception thrown: Instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d could not be found. Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Request method failure captured: Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d HTTP/1.1 Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR1EqMfBn4a1eRNzGr1Ti1kU_C4B2KaChLShiifJk4rvgRq2ljFOr6pHb_GQ7J8fQa2894lIekEq9NnjKEE9Yma8xf0U9QHLP174bSamNMh_QtojnTv_OL9SOQaQ7NHsQNDhzrzCYRpZOWVZWX3WuhCEBcuqXS8Xf3_6bFg_c8fMVRjw Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}] Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: df0e8621054d45828bff5d8bac144bdf Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d could not be found. Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '3d9189ab-39f9-4288-bd35-b2f5a9cdb79d'} Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d could not be found. Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d could not be found. Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:46:27.027036 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d could not be found. Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Returning 404 to user: Instance 3d9189ab-39f9-4288-bd35-b2f5a9cdb79d could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb032c2d-afc3-499b-a6bf-ded78bad4b56 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d" status: 404 len: 111 microversion: 2.1 time: 0.032689 Oct 12 23:46:27.036954 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3753/7407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:26 2022] GET /compute/v2.1/servers/3d9189ab-39f9-4288-bd35-b2f5a9cdb79d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:46:30.172315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-995261a5-8705-4999-8a52-762b320d3060 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '.version_select at 0x7f45050eaee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:30.206155 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-995261a5-8705-4999-8a52-762b320d3060 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-738708512" status: 202 len: 0 microversion: 2.1 time: 0.039622 Oct 12 23:46:30.208091 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3655/7408] 10.222.0.20 () {58 vars in 1281 bytes} [Wed Oct 12 23:46:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-738708512 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:46:30.237070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4ed52c43-2a49-409e-bbd6-1b9d4e1fd5a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: .version_select at 0x7f44fc279820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1425622560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt21zGzWQAybbhCoD234oI/65svawPE1g2RvQS6bQByk6NDARXhq/taC5z9EEIt0M2VO9Vj/kdLovRQhEZx0Pf+M1fGsljUg9ORTM0zgS4sXtXgPPwsM3qv322tT72o5Q=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:30.254158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4ed52c43-2a49-409e-bbd6-1b9d4e1fd5a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:46:30.259246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-4ed52c43-2a49-409e-bbd6-1b9d4e1fd5a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:46:30.283052 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4ed52c43-2a49-409e-bbd6-1b9d4e1fd5a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050445 Oct 12 23:46:30.283658 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3754/7409] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:46:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:46:35.717806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-549472271", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "5471ddaf-de6b-4284-8aa0-8723392719ee"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1425622560", "security_groups": [{"name": "tempest-secgroup-smoke-1765873399"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:35.842813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] validate_networks() for [('5471ddaf-de6b-4284-8aa0-8723392719ee', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:46:36.236036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:46:36.236494 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:46:36.236985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:46:36.237399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:46:36.237816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:46:36.247248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:36.247738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:36.248210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:36.248944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:36.249402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:36.249832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:36.267602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:46:36.273247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:46:36.286555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:46:36.289406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:46:36.339594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4eb1ee32-fdc2-4a61-9b30-2ca2211c8368 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.625508 Oct 12 23:46:36.340482 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3656/7410] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:46:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:46:36.353818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ef0e4eb7-b870-4173-944e-6075b15260c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:36.354454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ef0e4eb7-b870-4173-944e-6075b15260c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:36.416267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ef0e4eb7-b870-4173-944e-6075b15260c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:36.426448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ef0e4eb7-b870-4173-944e-6075b15260c2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1266 microversion: 2.1 time: 0.077798 Oct 12 23:46:36.427116 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3755/7411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:36 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:46:37.455565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:37.456225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:37.465928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:37.466966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:37.467754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:37.469852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:37.470847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:37.471498 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:37.551878 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:37.560257 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1cd7ed1a-ee20-45ba-8b8a-438f42dc9335 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1324 microversion: 2.1 time: 0.112694 Oct 12 23:46:37.560973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3657/7412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:37 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:38.584860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:38.585490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:38.587455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:38.607132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:38.608327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:38.609063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:38.611591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:38.613014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:38.613741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:38.791022 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:38.799712 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa04489c-2536-442e-825a-6d858cce9307 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1392 microversion: 2.1 time: 0.218808 Oct 12 23:46:38.800333 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3756/7413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:38 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1392 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:39.286017 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-1e2495b6-b15a-4924-bba1-bbffc6c891fa req-3c5e761c-a290-49a7-9f2d-12b4f9680984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:39.295482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1e2495b6-b15a-4924-bba1-bbffc6c891fa req-3c5e761c-a290-49a7-9f2d-12b4f9680984 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:39.296065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1e2495b6-b15a-4924-bba1-bbffc6c891fa req-3c5e761c-a290-49a7-9f2d-12b4f9680984 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:39.296562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-1e2495b6-b15a-4924-bba1-bbffc6c891fa req-3c5e761c-a290-49a7-9f2d-12b4f9680984 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:39.309052 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-1e2495b6-b15a-4924-bba1-bbffc6c891fa req-3c5e761c-a290-49a7-9f2d-12b4f9680984 service nova] Creating event network-changed:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h1-860864-8 Oct 12 23:46:39.315434 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-1e2495b6-b15a-4924-bba1-bbffc6c891fa req-3c5e761c-a290-49a7-9f2d-12b4f9680984 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091736 Oct 12 23:46:39.316071 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3658/7414] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:46:39.824630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:39.825263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:39.833048 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:39.833546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:39.834143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:39.834861 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:39.835328 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:39.835768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:39.967185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:39.974909 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-380cfd06-fe17-4729-b66a-6a753c178d0e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1392 microversion: 2.1 time: 0.154615 Oct 12 23:46:39.975484 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3757/7415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:39 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:40.997928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:40.998635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:41.006305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:41.006786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:41.007228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:41.008005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:41.008468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:41.008894 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:41.138597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:41.146334 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-66738b4d-d00f-44fc-bf68-d9e24e748f7a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1392 microversion: 2.1 time: 0.152691 Oct 12 23:46:41.146911 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3659/7416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:40 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:42.169170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:42.169970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:42.177032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:42.177547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:42.177996 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:42.178699 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:42.179161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:42.179593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:42.322393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:42.330941 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e408bc6a-10a2-4a6e-9abc-476fa6c0249d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1392 microversion: 2.1 time: 0.165721 Oct 12 23:46:42.331561 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3758/7417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:42 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:46:43.353718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:43.354361 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:43.362287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:43.362770 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:43.363206 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:43.363919 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:43.364367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:43.364792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:43.497987 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:43.505702 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-079bb10e-9438-482f-b775-82dd81ef00b1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1392 microversion: 2.1 time: 0.155890 Oct 12 23:46:43.506278 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3660/7418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:43 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:44.186294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c164b8d6-25f2-4600-8b2d-bef842d91150 req-9d3f35d8-63fe-4069-b826-110306a79ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "name": "network-vif-plugged", "status": "completed", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:44.192893 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:46:44.193039 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 12 23:46:44.200732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c164b8d6-25f2-4600-8b2d-bef842d91150 req-9d3f35d8-63fe-4069-b826-110306a79ce1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:44.201219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c164b8d6-25f2-4600-8b2d-bef842d91150 req-9d3f35d8-63fe-4069-b826-110306a79ce1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:44.201667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c164b8d6-25f2-4600-8b2d-bef842d91150 req-9d3f35d8-63fe-4069-b826-110306a79ce1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:44.213591 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c164b8d6-25f2-4600-8b2d-bef842d91150 req-9d3f35d8-63fe-4069-b826-110306a79ce1 service nova] Creating event network-vif-plugged:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h1-860864-8 Oct 12 23:46:44.218475 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c164b8d6-25f2-4600-8b2d-bef842d91150 req-9d3f35d8-63fe-4069-b826-110306a79ce1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035906 Oct 12 23:46:44.219708 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3759/7419] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:46:44.528346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:44.528965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:44.536698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:44.537180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:44.537619 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:44.538306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:44.538758 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:44.539183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:44.670239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:44.678012 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2929079f-e492-4dbb-ab9e-321bb2384623 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1392 microversion: 2.1 time: 0.153563 Oct 12 23:46:44.678591 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3661/7420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:44 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:45.701970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:45.702683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:45.708987 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:45.709478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:45.709923 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:45.710614 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:45.711075 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:45.711513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:45.843124 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:45.851321 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f361fd7-909b-411f-916b-cb6d705ab065 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1565 microversion: 2.1 time: 0.154507 Oct 12 23:46:45.851905 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3760/7421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:45 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:45.874030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:45.874646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:45.881396 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:45.881881 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:45.882320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:45.883008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:45.883461 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:45.883898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:46.016791 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:46.024513 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a09ce87a-79b0-4369-a8f4-234fb0941df4 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1565 microversion: 2.1 time: 0.154397 Oct 12 23:46:46.025099 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3662/7422] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:45 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:46:47.596201 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:46:47.596867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:46:47.600042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:47.601625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7d74683b-fbfe-43d7-af9e-bf0f5d4ef482 req-b474b898-d9cf-4b77-8ac5-6bef1c1484ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:46:47.606888 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:47.607589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:47.609139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:47.615227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:47.615738 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:47.616222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:47.616947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:47.617414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:47.617856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:47.627719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d74683b-fbfe-43d7-af9e-bf0f5d4ef482 req-b474b898-d9cf-4b77-8ac5-6bef1c1484ea service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:46:47.628295 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d74683b-fbfe-43d7-af9e-bf0f5d4ef482 req-b474b898-d9cf-4b77-8ac5-6bef1c1484ea service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:46:47.628829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7d74683b-fbfe-43d7-af9e-bf0f5d4ef482 req-b474b898-d9cf-4b77-8ac5-6bef1c1484ea service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:46:47.631828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=49 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:46:47.643442 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7d74683b-fbfe-43d7-af9e-bf0f5d4ef482 req-b474b898-d9cf-4b77-8ac5-6bef1c1484ea service nova] Creating event network-changed:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h1-860864-8 Oct 12 23:46:47.649087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7d74683b-fbfe-43d7-af9e-bf0f5d4ef482 req-b474b898-d9cf-4b77-8ac5-6bef1c1484ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060191 Oct 12 23:46:47.650267 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3663/7423] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:46:47.761805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:46:47.773214 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-98532af1-4ac4-4afc-b4ef-3e180f62f6a3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1565 microversion: 2.1 time: 0.186909 Oct 12 23:46:47.774036 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3761/7424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:46:47 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:09.017398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:47:09.018159 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:47:09.022296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:47:09.024585 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:09.031379 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:09.031851 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:09.032325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:09.033270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:09.033747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:09.034674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:09.085876 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0e813ae-b1ab-489d-8aff-a2887437942b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action" status: 200 len: 24573 microversion: 2.1 time: 0.069934 Oct 12 23:47:09.086557 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3664/7425] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:47:09 2022] POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:47:20.145603 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:47:20.147902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:20.150262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:47:20.151010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:47:20.157206 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:20.157948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:20.158396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:20.159098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:20.159557 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:20.160019 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:20.255248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:20.261329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Old instance type m1.heat2, new instance type m1.heat {{(pid=120542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 12 23:47:20.267853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:47:20.268930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:47:20.269414 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:47:20.269834 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:47:20.270263 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:47:20.334022 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-116d9a44-197c-4837-8f42-272de133ad6a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action" status: 202 len: 0 microversion: 2.1 time: 0.192872 Oct 12 23:47:20.334817 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3762/7426] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:47:20 2022] POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:47:20.343566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:20.344289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:20.347381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:47:20.348232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:47:20.353591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:20.354070 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:20.354705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:20.355410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:20.355915 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:20.356357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:20.492720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:20.500692 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-25a3ca1a-8623-4526-9c24-e4da10e91c0b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1692 microversion: 2.1 time: 0.161373 Oct 12 23:47:20.501261 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3665/7427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:20 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:21.526392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:21.527036 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:21.534321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:21.534809 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:21.535253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:21.535972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:21.536433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:21.536864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:21.668540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:21.677060 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-804f5b15-0b85-47ba-b21d-3830ab2e5734 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1692 microversion: 2.1 time: 0.155369 Oct 12 23:47:21.677664 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3763/7428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:21 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:22.700177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:22.700789 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:22.709141 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:22.709614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:22.710046 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:22.710725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:22.711169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:22.711591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:22.846567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:22.854335 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-19d6d46a-a2a2-4a30-9944-3014de445ab7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1692 microversion: 2.1 time: 0.158079 Oct 12 23:47:22.854900 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3666/7429] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:22 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:23.878088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:23.878764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:23.885712 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:23.886202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:23.886653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:23.887353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:23.887815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:23.888283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:24.016339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:24.024957 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e41086ba-6545-4ed2-b700-a19c8e179740 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1692 microversion: 2.1 time: 0.150829 Oct 12 23:47:24.025539 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3764/7430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:23 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:25.048442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:25.048996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:25.056571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:25.057061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:25.057505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:25.058195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:25.058649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:25.059078 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:25.189283 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:25.197140 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-669a29fd-0cdb-4b9e-a5a8-3841d940bfa9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1692 microversion: 2.1 time: 0.152719 Oct 12 23:47:25.197716 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3667/7431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:25 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:26.220920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:26.221547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:26.228693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:26.229204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:26.229650 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:26.230345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:26.230804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:26.231233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:26.369197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:26.377183 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09736104-2277-4188-a634-bbc3a09ccfaf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1692 microversion: 2.1 time: 0.160204 Oct 12 23:47:26.377769 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3765/7432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:26 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:27.400943 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:27.401572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:27.408833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:27.409318 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:27.409759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:27.410446 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:27.410902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:27.411333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:27.545685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:27.554120 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-991fbdaf-f3fe-4d9a-a4ce-9501a1c1c6e8 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.157128 Oct 12 23:47:27.554707 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3668/7433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:27 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:28.578370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:28.579060 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:28.585966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:28.586461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:28.586913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:28.587609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:28.588107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:28.588541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:28.719698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:28.728160 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c82e3421-4e09-4dfd-8c8c-de579fbe44db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.153725 Oct 12 23:47:28.728744 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3766/7434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:28 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:29.751741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:29.752380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:29.759922 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:29.760415 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:29.760854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:29.761544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:29.761992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:29.762412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:29.890869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:29.898519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1ce22a28-93ec-4d9e-ab88-d66bfeacc13e tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.150864 Oct 12 23:47:29.899084 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3669/7435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:29 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:30.922542 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:30.923167 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:30.931040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:30.931526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:30.932001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:30.932701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:30.933160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:30.933621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:31.066906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:31.074583 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3e8db8a-dff0-4857-8e5c-b42e14453f85 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.156063 Oct 12 23:47:31.075150 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3767/7436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:30 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:32.097926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:32.098540 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:32.105515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:32.105992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:32.106429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:32.107116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:32.107572 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:32.108028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:32.241152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:32.250057 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4beb9866-b1bf-40b6-9e69-5b543ee2d308 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.156041 Oct 12 23:47:32.250629 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3670/7437] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:32 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:33.273367 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:33.273997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:33.280887 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:33.281384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:33.281837 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:33.282799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:33.283264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:33.283702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:33.415476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:33.423275 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67f2b45f-2b4c-43eb-b116-77d0d3bfea0d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.153911 Oct 12 23:47:33.423859 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3768/7438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:33 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:34.447510 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:34.448225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:34.454700 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:34.455190 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:34.455636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:34.456364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:34.457431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:34.457860 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:34.589397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:34.597168 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-314958df-664e-42f6-9b65-7c8c51640198 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.153778 Oct 12 23:47:34.597742 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3671/7439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:34 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:35.619630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:35.620284 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:35.627051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:35.627540 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:35.628003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:35.628768 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:35.629233 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:35.629664 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:35.761302 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:35.769748 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5eb32bb1-9dc4-4754-9efe-736977c04c99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.153557 Oct 12 23:47:35.770323 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3769/7440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:35 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:36.793793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:36.794402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:36.801969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:36.802447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:36.802882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:36.803563 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:36.804043 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:36.804466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:36.933289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:36.940996 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8821a947-b195-4628-b362-e70aa48558a5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.151137 Oct 12 23:47:36.941563 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3672/7441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:36 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:37.964183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:37.964814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:37.971683 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:37.972222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:37.972671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:37.973376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:37.973840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:37.974278 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:38.104931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:38.112681 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89b53277-8a73-40bf-9f14-e604ca42a7cf tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1697 microversion: 2.1 time: 0.152556 Oct 12 23:47:38.113824 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3770/7442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:37 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:39.039072 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d780b184-a8f5-403c-b4a7-f1d4db5f1d04 req-2b3a8040-ce1e-4b83-a96f-8711fa12597c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "name": "network-vif-unplugged", "status": "completed", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:47:39.050701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d780b184-a8f5-403c-b4a7-f1d4db5f1d04 req-2b3a8040-ce1e-4b83-a96f-8711fa12597c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:39.051326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d780b184-a8f5-403c-b4a7-f1d4db5f1d04 req-2b3a8040-ce1e-4b83-a96f-8711fa12597c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:39.051769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d780b184-a8f5-403c-b4a7-f1d4db5f1d04 req-2b3a8040-ce1e-4b83-a96f-8711fa12597c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:39.063982 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d780b184-a8f5-403c-b4a7-f1d4db5f1d04 req-2b3a8040-ce1e-4b83-a96f-8711fa12597c service nova] Creating event network-vif-unplugged:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h2-860864-8 Oct 12 23:47:39.070324 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [req-d780b184-a8f5-403c-b4a7-f1d4db5f1d04 req-2b3a8040-ce1e-4b83-a96f-8711fa12597c service nova] Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120543) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:47:39.082574 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d780b184-a8f5-403c-b4a7-f1d4db5f1d04 req-2b3a8040-ce1e-4b83-a96f-8711fa12597c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046416 Oct 12 23:47:39.083186 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3673/7443] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:47:39.137437 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:39.138204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:39.145739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:39.146241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:39.146696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:39.147413 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:39.148114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:39.148695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:39.375820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:39.384452 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09604c50-1b49-4d6f-9399-bdec71018664 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1696 microversion: 2.1 time: 0.251136 Oct 12 23:47:39.385070 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3771/7444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:39 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1696 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:40.408717 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:40.409421 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:40.416454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:40.416873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:40.417306 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:40.417985 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:40.418432 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:40.418857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:40.552346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:40.560087 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dd66931-c5b4-45a8-b032-88eba04a2bc5 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1694 microversion: 2.1 time: 0.155863 Oct 12 23:47:40.560661 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3674/7445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:40 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:41.117177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-add18872-1bae-48f9-a34e-dcd6e176c167 req-bb1eb75b-4eaf-4ed5-8072-e035b45d8a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:47:41.127754 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-add18872-1bae-48f9-a34e-dcd6e176c167 req-bb1eb75b-4eaf-4ed5-8072-e035b45d8a1c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:41.128280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-add18872-1bae-48f9-a34e-dcd6e176c167 req-bb1eb75b-4eaf-4ed5-8072-e035b45d8a1c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:41.128727 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-add18872-1bae-48f9-a34e-dcd6e176c167 req-bb1eb75b-4eaf-4ed5-8072-e035b45d8a1c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:41.140323 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-add18872-1bae-48f9-a34e-dcd6e176c167 req-bb1eb75b-4eaf-4ed5-8072-e035b45d8a1c service nova] Creating event network-changed:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h2-860864-8 Oct 12 23:47:41.145608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [req-add18872-1bae-48f9-a34e-dcd6e176c167 req-bb1eb75b-4eaf-4ed5-8072-e035b45d8a1c service nova] Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-8', 'n-h1-860864-8'} {{(pid=120542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 12 23:47:41.157027 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-add18872-1bae-48f9-a34e-dcd6e176c167 req-bb1eb75b-4eaf-4ed5-8072-e035b45d8a1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044150 Oct 12 23:47:41.157946 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3772/7446] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:47:41.585995 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:41.587255 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:41.595813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:41.596363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:41.596809 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:41.597763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:41.598282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:41.599519 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:41.779471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:41.788549 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70d2349c-4591-46b3-b827-4d580b207df0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1694 microversion: 2.1 time: 0.207948 Oct 12 23:47:41.789135 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3675/7447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:41 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1694 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:42.813008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:42.813943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:42.820176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:42.820692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:42.821128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:42.821839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:42.822304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:42.822740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:43.033902 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:43.042722 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a76d1b6-904c-40ad-b697-a88963957c23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1691 microversion: 2.1 time: 0.235359 Oct 12 23:47:43.043324 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3773/7448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:42 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:43.066357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:47:43.067532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:43.074708 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:43.075202 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:43.075651 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:43.076389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:43.076850 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:43.077285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:43.136404 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b85d5f91-8c00-45b4-8f4c-88cbba55f19c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action" status: 204 len: 0 microversion: 2.1 time: 0.073830 Oct 12 23:47:43.137326 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3676/7449] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:47:43 2022] POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:47:43.146033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:43.146663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:43.152870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:43.153621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:43.154259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:43.154958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:43.155461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:43.155855 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:43.369353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:43.378271 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b4984637-4f11-415b-881a-899489752d49 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1691 microversion: 2.1 time: 0.236570 Oct 12 23:47:43.379382 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3774/7450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:43 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:43.402884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:43.403771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:43.411162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:43.411750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:43.412292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:43.413136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:43.413710 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:43.414198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:43.633271 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:43.641470 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5bdbcd5f-d261-44dd-9ac3-039887c80cf9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1691 microversion: 2.1 time: 0.242988 Oct 12 23:47:43.642425 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3677/7451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:43 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1691 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:44.665299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:47:44.665932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:47:44.672782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:44.673275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:44.673725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:44.674426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:44.674897 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:44.675829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:44.808803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:47:44.817273 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e4d388e1-27f4-4fd4-b092-0fde0c088851 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1683 microversion: 2.1 time: 0.155873 Oct 12 23:47:44.817862 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3775/7452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:47:44 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:47:45.783211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5d28bd87-834a-4b90-a15f-56de9d7feaa0 req-ff9afea0-906e-41b5-928b-21504cf2be9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "name": "network-vif-plugged", "status": "completed", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:47:45.793382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5d28bd87-834a-4b90-a15f-56de9d7feaa0 req-ff9afea0-906e-41b5-928b-21504cf2be9b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:47:45.793853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5d28bd87-834a-4b90-a15f-56de9d7feaa0 req-ff9afea0-906e-41b5-928b-21504cf2be9b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:47:45.794282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5d28bd87-834a-4b90-a15f-56de9d7feaa0 req-ff9afea0-906e-41b5-928b-21504cf2be9b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:47:45.805878 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5d28bd87-834a-4b90-a15f-56de9d7feaa0 req-ff9afea0-906e-41b5-928b-21504cf2be9b service nova] Creating event network-vif-plugged:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h2-860864-8 Oct 12 23:47:45.811519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5d28bd87-834a-4b90-a15f-56de9d7feaa0 req-ff9afea0-906e-41b5-928b-21504cf2be9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095405 Oct 12 23:47:45.812751 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3678/7453] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:48:06.993980 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:06.996234 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:06.998567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:06.999229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:07.004718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:07.005208 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:07.006299 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:07.006994 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:07.007455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:07.007901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:07.059774 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0643e58-8a48-4409-977d-65a41e1d8670 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action" status: 200 len: 24579 microversion: 2.1 time: 0.070190 Oct 12 23:48:07.060360 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3776/7454] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:48:06 2022] POST /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12/action => generated 24579 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:48:14.435034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=28 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:14.435761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:14.440360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:14.441565 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:14.441709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-517db6c4-1abd-4165-abb4-77f40238d2ff req-62c762ca-ca5b-4428-9055-a224a5cc752f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:14.449036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:14.449520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:14.449953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:14.450646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:14.451089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:14.451515 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:14.453873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-517db6c4-1abd-4165-abb4-77f40238d2ff req-62c762ca-ca5b-4428-9055-a224a5cc752f service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:14.454510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-517db6c4-1abd-4165-abb4-77f40238d2ff req-62c762ca-ca5b-4428-9055-a224a5cc752f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:14.455116 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-517db6c4-1abd-4165-abb4-77f40238d2ff req-62c762ca-ca5b-4428-9055-a224a5cc752f service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:14.467720 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-517db6c4-1abd-4165-abb4-77f40238d2ff req-62c762ca-ca5b-4428-9055-a224a5cc752f service nova] Creating event network-changed:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h2-860864-8 Oct 12 23:48:14.474050 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-517db6c4-1abd-4165-abb4-77f40238d2ff req-62c762ca-ca5b-4428-9055-a224a5cc752f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037078 Oct 12 23:48:14.474656 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3777/7455] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:48:14.482841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:48:14.569788 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-871640a2-39d2-4e05-ba2a-228594a1e655 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 204 len: 0 microversion: 2.1 time: 0.136467 Oct 12 23:48:14.571973 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3679/7456] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:48:14 2022] DELETE /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:48:14.580573 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:14.581545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:14.589356 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:14.589983 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:14.590539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:14.591516 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:14.592040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:14.592570 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:14.753769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:14.764539 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8446734-65c7-4e0b-b917-2831463b1195 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1689 microversion: 2.1 time: 0.188482 Oct 12 23:48:14.765355 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3778/7457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:14 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:15.789297 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:15.790113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:15.797102 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:15.797592 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:15.798035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:15.798763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:15.799216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:15.799641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:15.937259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:15.945012 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-543599dc-da16-41bf-ad5b-fb10b625ce7b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1689 microversion: 2.1 time: 0.160868 Oct 12 23:48:15.945583 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3680/7458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:15 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:16.663685 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-e6c74666-b6fb-432c-a437-ee0f9ef044d9 req-ec637388-2a2c-44c9-91b8-d10607c61696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12", "name": "network-vif-deleted", "tag": "d739d1ec-565a-4271-858a-807f409f4df3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:16.674958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e6c74666-b6fb-432c-a437-ee0f9ef044d9 req-ec637388-2a2c-44c9-91b8-d10607c61696 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:16.675448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e6c74666-b6fb-432c-a437-ee0f9ef044d9 req-ec637388-2a2c-44c9-91b8-d10607c61696 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:16.675905 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-e6c74666-b6fb-432c-a437-ee0f9ef044d9 req-ec637388-2a2c-44c9-91b8-d10607c61696 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:16.688535 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-e6c74666-b6fb-432c-a437-ee0f9ef044d9 req-ec637388-2a2c-44c9-91b8-d10607c61696 service nova] Creating event network-vif-deleted:d739d1ec-565a-4271-858a-807f409f4df3 for instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 on n-h2-860864-8 Oct 12 23:48:16.693317 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-e6c74666-b6fb-432c-a437-ee0f9ef044d9 req-ec637388-2a2c-44c9-91b8-d10607c61696 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033463 Oct 12 23:48:16.694736 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3779/7459] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:48:16.968718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:16.969350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:16.976398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:16.976884 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:16.977316 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:16.978010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:16.978457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:16.978876 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:17.012863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:17.013341 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:17.013777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:17.014226 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lazy-loading 'fault' on Instance uuid eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:48:17.058621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:17.067098 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9eaa6a98-efb1-4c0c-9536-bc1facd36f70 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 200 len: 1356 microversion: 2.1 time: 0.102219 Oct 12 23:48:17.067861 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3681/7460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:16 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:18.095361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:18.096122 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:18.102360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:18.102859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:18.103312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:18.104053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:18.104528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:18.104970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:18.118210 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] HTTP exception thrown: Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 could not be found. Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Request method failure captured: Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 HTTP/1.1 Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR1EqMfBn4a1eRNzGr1Ti1kU_C4B2KaChLShiifJk4rvgRq2ljFOr6pHb_GQ7J8fQa2894lIekEq9NnjKEE9Yma8xf0U9QHLP174bSamNMh_QtojnTv_OL9SOQaQ7NHsQNDhzrzCYRpZOWVZWX3WuhCEBcuqXS8Xf3_6bFg_c8fMVRjw Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}] Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: df0e8621054d45828bff5d8bac144bdf Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 could not be found. Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12'} Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 could not be found. Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 could not be found. Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:48:18.119879 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 could not be found. Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Returning 404 to user: Instance eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ae56172-1dd3-4774-a7c2-5df144ff071b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12" status: 404 len: 111 microversion: 2.1 time: 0.034319 Oct 12 23:48:18.124778 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3780/7461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:18 2022] GET /compute/v2.1/servers/eaaf4b14-13a3-4c9e-9b99-d6e24eb99a12 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:48:21.103929 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bca3f63b-7d75-4127-89a2-7e2b10aeb83d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '.version_select at 0x7f44fe849c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:21.124844 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bca3f63b-7d75-4127-89a2-7e2b10aeb83d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1425622560" status: 202 len: 0 microversion: 2.1 time: 0.024818 Oct 12 23:48:21.125555 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3682/7462] 10.222.0.20 () {58 vars in 1284 bytes} [Wed Oct 12 23:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1425622560 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:48:21.155565 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc5cd299-c541-4156-8e6d-b3a12efa4fe1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: .version_select at 0x7f44fec7aee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1208844289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmNistJRtQxLTFC+SCYBEmHU/Z9oWjZXSJIG6LjGuD/dSM4wDB7+AJjmfmQVFqjtNywp3O4OpmWxet5aRnJ6Guzr6GnCYyrS7GgSFjMvPHNPiDD7bT62vJmdxWpv8MMGw=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:21.172962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-cc5cd299-c541-4156-8e6d-b3a12efa4fe1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:48:21.179959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-cc5cd299-c541-4156-8e6d-b3a12efa4fe1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:48:21.205968 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc5cd299-c541-4156-8e6d-b3a12efa4fe1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055291 Oct 12 23:48:21.206617 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3781/7463] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:48:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:48:26.778315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-283227285", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "85d1efe9-a5cd-4d23-a562-9a334e0b12ac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1208844289", "security_groups": [{"name": "tempest-secgroup-smoke-1129602025"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:26.890427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] validate_networks() for [('85d1efe9-a5cd-4d23-a562-9a334e0b12ac', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:48:27.063475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:27.311761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:48:27.312216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:48:27.312704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:48:27.313115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:48:27.313529 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:48:27.324411 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:27.324896 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:27.325332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:27.326057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:27.327593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:27.328247 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:27.352635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:48:27.358288 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:48:27.373386 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:48:27.375923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:48:27.429627 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-431af135-0637-4e8a-b69d-8e7f30c77d69 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656980 Oct 12 23:48:27.431930 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3683/7464] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:48:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:48:27.443857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0f58500-ffaf-47cd-802e-fdbb0379bb36 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:27.443857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0f58500-ffaf-47cd-802e-fdbb0379bb36 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:27.968803 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0f58500-ffaf-47cd-802e-fdbb0379bb36 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:27.976380 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0f58500-ffaf-47cd-802e-fdbb0379bb36 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1266 microversion: 2.1 time: 0.538482 Oct 12 23:48:27.977554 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3782/7465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:27 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1266 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:29.001743 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:29.003193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:29.011065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:29.011831 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:29.012652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:29.013571 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:29.014055 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:29.014478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:29.082727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:29.091831 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-012704ad-714b-4d0d-afd6-c74615168d92 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1324 microversion: 2.1 time: 0.094953 Oct 12 23:48:29.092757 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3684/7466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:28 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1324 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:30.116898 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:30.117674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:30.120418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:30.128257 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:30.130764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:30.132084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:30.133053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:30.133733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:30.134253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:30.159080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-837cfd7d-8613-4377-a069-401f154f9a2f req-f09af4ed-09b7-48e5-af05-ed0c9f9811c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8ed8f8-0364-4c8e-91f3-f930af580dba", "tag": "7d908e9c-c259-4c30-acf3-538ca4e3d92f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:30.176337 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-837cfd7d-8613-4377-a069-401f154f9a2f req-f09af4ed-09b7-48e5-af05-ed0c9f9811c5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:30.177011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-837cfd7d-8613-4377-a069-401f154f9a2f req-f09af4ed-09b7-48e5-af05-ed0c9f9811c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:30.177443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-837cfd7d-8613-4377-a069-401f154f9a2f req-f09af4ed-09b7-48e5-af05-ed0c9f9811c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:30.190194 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-837cfd7d-8613-4377-a069-401f154f9a2f req-f09af4ed-09b7-48e5-af05-ed0c9f9811c5 service nova] Creating event network-changed:7d908e9c-c259-4c30-acf3-538ca4e3d92f for instance ba8ed8f8-0364-4c8e-91f3-f930af580dba on n-h2-860864-8 Oct 12 23:48:30.196106 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-837cfd7d-8613-4377-a069-401f154f9a2f req-f09af4ed-09b7-48e5-af05-ed0c9f9811c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046814 Oct 12 23:48:30.196808 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3685/7467] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:48:30.364015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:30.372714 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1244c562-1a3f-402e-a092-aaed5ec88185 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1392 microversion: 2.1 time: 0.259922 Oct 12 23:48:30.373327 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3783/7468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:30 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:31.396777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:31.398407 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:31.405485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:31.405970 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:31.406405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:31.407099 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:31.407677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:31.408225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:31.540754 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:31.548622 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ffa8be2f-c03f-4c66-89aa-9d10967d38bb tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1392 microversion: 2.1 time: 0.156165 Oct 12 23:48:31.549204 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3686/7469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:31 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:32.571697 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:32.572334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:32.579265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:32.579746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:32.580224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:32.580915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:32.581375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:32.581805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:32.718320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:32.725992 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-258a4b17-c2dd-4b9e-b9f5-750ff3db448c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1392 microversion: 2.1 time: 0.159045 Oct 12 23:48:32.726575 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3784/7470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:32 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:33.749589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:33.750144 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:33.757636 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:33.758128 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:33.758567 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:33.759263 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:33.759723 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:33.760180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:33.896008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:33.904479 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1fc49753-1f5e-4d35-b6e9-56de514e01db tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1392 microversion: 2.1 time: 0.159002 Oct 12 23:48:33.905058 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3687/7471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:33 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:34.927912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:34.928546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:34.935322 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:34.935810 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:34.936283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:34.936974 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:34.937429 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:34.937858 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:35.070656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:35.078395 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b179d2e-18ac-40f9-b2b4-a248319fa578 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1392 microversion: 2.1 time: 0.154441 Oct 12 23:48:35.078962 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3785/7472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:34 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:35.940183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-acb8d26d-889c-4b1f-80fc-3341202d604c req-77fa4607-3480-432c-8818-e6bc4b2f8698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8ed8f8-0364-4c8e-91f3-f930af580dba", "name": "network-vif-plugged", "status": "completed", "tag": "7d908e9c-c259-4c30-acf3-538ca4e3d92f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:35.952132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-acb8d26d-889c-4b1f-80fc-3341202d604c req-77fa4607-3480-432c-8818-e6bc4b2f8698 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:35.952628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-acb8d26d-889c-4b1f-80fc-3341202d604c req-77fa4607-3480-432c-8818-e6bc4b2f8698 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:35.953067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-acb8d26d-889c-4b1f-80fc-3341202d604c req-77fa4607-3480-432c-8818-e6bc4b2f8698 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:35.969241 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-acb8d26d-889c-4b1f-80fc-3341202d604c req-77fa4607-3480-432c-8818-e6bc4b2f8698 service nova] Creating event network-vif-plugged:7d908e9c-c259-4c30-acf3-538ca4e3d92f for instance ba8ed8f8-0364-4c8e-91f3-f930af580dba on n-h2-860864-8 Oct 12 23:48:35.975015 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-acb8d26d-889c-4b1f-80fc-3341202d604c req-77fa4607-3480-432c-8818-e6bc4b2f8698 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038899 Oct 12 23:48:35.975642 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3688/7473] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:48:36.101715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:36.102370 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:36.109232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:36.109724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:36.110195 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:36.110901 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:36.111361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:36.111794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:36.245704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:36.253518 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d6d75ab-8910-4ae1-8606-b46da4afde8f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1392 microversion: 2.1 time: 0.155773 Oct 12 23:48:36.254104 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3786/7474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:36 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:37.277445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:37.278152 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:37.285737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:37.286225 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:37.286666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:37.287362 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:37.288382 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:37.288815 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:37.340750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:37.367121 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:37.421926 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:37.430460 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75fa9001-94ea-4697-b835-9ce872fc8004 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1565 microversion: 2.1 time: 0.157511 Oct 12 23:48:37.431131 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3689/7475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:37 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:37.453042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:37.453675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:37.456435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:37.462209 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:37.462718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:37.463175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:37.463886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:37.464380 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:37.464828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:37.593623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:37.602029 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5139517-f9a0-4a12-9281-60fea06483dc tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1565 microversion: 2.1 time: 0.153000 Oct 12 23:48:37.602609 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3787/7476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:37 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:48:39.190479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-846e011d-5f8c-43f9-bf63-e8ed53509e40 req-86fc85ef-9739-4fc8-bcbb-67574ef132e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8ed8f8-0364-4c8e-91f3-f930af580dba", "tag": "7d908e9c-c259-4c30-acf3-538ca4e3d92f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:48:39.198758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:48:39.204674 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-846e011d-5f8c-43f9-bf63-e8ed53509e40 req-86fc85ef-9739-4fc8-bcbb-67574ef132e8 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:39.205175 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-846e011d-5f8c-43f9-bf63-e8ed53509e40 req-86fc85ef-9739-4fc8-bcbb-67574ef132e8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:39.205626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-846e011d-5f8c-43f9-bf63-e8ed53509e40 req-86fc85ef-9739-4fc8-bcbb-67574ef132e8 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:39.217717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-846e011d-5f8c-43f9-bf63-e8ed53509e40 req-86fc85ef-9739-4fc8-bcbb-67574ef132e8 service nova] Creating event network-changed:7d908e9c-c259-4c30-acf3-538ca4e3d92f for instance ba8ed8f8-0364-4c8e-91f3-f930af580dba on n-h2-860864-8 Oct 12 23:48:39.223182 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-846e011d-5f8c-43f9-bf63-e8ed53509e40 req-86fc85ef-9739-4fc8-bcbb-67574ef132e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040005 Oct 12 23:48:39.224341 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3788/7477] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:48:39.240406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:48:39.242110 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:48:39.248370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:39.248869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:39.249319 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:39.250028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:48:39.250485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:48:39.250917 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:48:39.395618 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:48:39.406355 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9834b4b5-c178-4f11-a35c-8d5c49105d44 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1565 microversion: 2.1 time: 0.225390 Oct 12 23:48:39.408109 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3690/7478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:48:39 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:49:00.659005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:00.659804 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:00.665081 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:49:00.667369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:00.674219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:00.674709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:00.675155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:00.675847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:00.676329 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:00.676763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:00.729952 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b3defeb-f51a-4ccc-ac7a-932cca49ab12 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action" status: 200 len: 24569 microversion: 2.1 time: 0.072698 Oct 12 23:49:00.730858 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3789/7479] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:49:00 2022] POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action => generated 24569 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:49:11.765480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37379517-d844-41dd-b2d7-ab56c9c7e4a0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:49:11.767957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:11.768736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=36 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:11.774650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37379517-d844-41dd-b2d7-ab56c9c7e4a0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:11.775135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37379517-d844-41dd-b2d7-ab56c9c7e4a0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:11.775576 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37379517-d844-41dd-b2d7-ab56c9c7e4a0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:11.799374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37379517-d844-41dd-b2d7-ab56c9c7e4a0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Going to try to stop instance {{(pid=120543) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 23:49:11.840488 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37379517-d844-41dd-b2d7-ab56c9c7e4a0 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action" status: 202 len: 0 microversion: 2.1 time: 0.078858 Oct 12 23:49:11.841092 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3691/7480] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:49:11 2022] POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:49:11.851453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:11.851836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:11.854926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:11.855645 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:11.862431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:11.863673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:11.864296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:11.865107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:11.865773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:11.866769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:12.000935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:12.009002 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a6b836b-8c5e-4249-8307-9e1a5949b794 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.163028 Oct 12 23:49:12.009569 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3790/7481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:11 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:13.034806 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:13.035427 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:13.041993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:13.042472 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:13.042911 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:13.043599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:13.044091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:13.044518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:13.175393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:13.183717 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cbe00828-1e34-4485-97b6-ab75ffe10f99 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.154181 Oct 12 23:49:13.184318 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3692/7482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:13 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:14.206627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:14.207250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:14.214662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:14.215148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:14.215590 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:14.216305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:14.216769 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:14.217202 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:14.348608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:14.357004 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8728b66b-b0e2-4b89-b62d-d74c7ac668bd tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.154300 Oct 12 23:49:14.357577 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3791/7483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:14 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:15.379644 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:15.380296 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:15.387281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:15.387769 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:15.388243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:15.388937 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:15.389397 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:15.389825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:15.521191 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:15.529658 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a6df65b-2c6c-4485-b23f-75130e8d6b23 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.153909 Oct 12 23:49:15.530247 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3693/7484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:15 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:16.552623 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:16.553283 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:16.560972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:16.561481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:16.561922 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:16.562633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:16.563096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:16.563535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:16.693252 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:16.700915 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1c5003fe-fe96-4d9f-b937-2dc3df287bde tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.152431 Oct 12 23:49:16.701488 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3792/7485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:16 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:17.724214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:17.724863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:17.732549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:17.733045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:17.733490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:17.734186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:17.734645 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:17.735077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:17.866683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:17.874371 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1118952c-02d2-4787-a249-082986f4dfb1 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.154132 Oct 12 23:49:17.874945 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3694/7486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:17 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:18.898227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:18.898853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:18.905455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:18.905947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:18.906400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:18.907101 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:18.907566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:18.908032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:19.040802 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:19.048541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c54291e-abb5-432e-8dd8-c8110cbc6778 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.154763 Oct 12 23:49:19.049113 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3793/7487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:18 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:20.072606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:20.073140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:20.079920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:20.080404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:20.080837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:20.081518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:20.081964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:20.082384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:20.214546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:20.222149 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f6ef60a-3600-4c8a-ab4f-427417e9c1a7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.154203 Oct 12 23:49:20.222717 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3695/7488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:20 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:21.245899 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:21.246454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:21.253610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:21.254102 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:21.254568 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:21.255264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:21.255722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:21.256181 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:21.385523 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:21.393374 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-89857c0c-c423-463e-9a54-18ed95c59356 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.152109 Oct 12 23:49:21.393950 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3794/7489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:21 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:22.417537 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:22.418155 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:22.425165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:22.425650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:22.426091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:22.426777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:22.427231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:22.427656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:22.556544 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:22.564411 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f808d87-2dbe-4771-b491-be3cca8f8ed9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.150994 Oct 12 23:49:22.564983 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3696/7490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:22 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:23.588156 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:23.588972 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:23.595982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:23.596483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:23.596933 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:23.597633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:23.598096 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:23.598533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:23.726984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:23.734742 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5a5a66e-53cd-420f-8b34-2366b52c2739 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.151151 Oct 12 23:49:23.735313 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3795/7491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:23 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:24.758075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:24.758689 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:24.765605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:24.766091 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:24.766531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:24.767224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:24.767679 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:24.768135 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:24.898441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:24.906181 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71f5b6ad-d077-45ae-8e78-239c74be2ae9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.152662 Oct 12 23:49:24.906759 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3697/7492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:24 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:25.929496 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:25.930065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:25.937088 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:25.937579 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:25.938034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:25.938747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:25.939216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:25.939658 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:26.077138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:26.084902 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3cc58da-0c7f-4de6-88a5-e92bd7022c41 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.159505 Oct 12 23:49:26.085477 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3796/7493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:25 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:27.107951 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:27.108532 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:27.115259 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:27.115736 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:27.116727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:27.117404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:27.117882 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:27.118301 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:27.258880 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:27.266655 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-380ef8a4-16df-4865-8a08-e634a3b3b53f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1694 microversion: 2.1 time: 0.162719 Oct 12 23:49:27.267224 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3698/7494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:27 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:28.290724 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:28.291353 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:28.298199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:28.298692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:28.299141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:28.299843 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:28.300325 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:28.300758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:28.429079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:28.436778 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9c9568cb-3207-4d9a-8424-14b1e4fa5492 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1671 microversion: 2.1 time: 0.150858 Oct 12 23:49:28.437349 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3797/7495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:28 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:29.533964 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:49:29.536631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:29.544010 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:29.544487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:29.544923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:29.545603 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:29.546047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:29.546466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:29.597922 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56f78be5-feeb-4224-9b84-c8098fd73873 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action" status: 200 len: 38373 microversion: 2.1 time: 0.067696 Oct 12 23:49:29.598571 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3699/7496] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:49:29 2022] POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action => generated 38373 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:49:29.610958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa931287-f64a-43c3-a13c-caeb2410dfb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:49:29.618501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa931287-f64a-43c3-a13c-caeb2410dfb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:29.618997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa931287-f64a-43c3-a13c-caeb2410dfb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:29.619449 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa931287-f64a-43c3-a13c-caeb2410dfb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:29.641377 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa931287-f64a-43c3-a13c-caeb2410dfb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Going to try to start instance {{(pid=120542) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 23:49:29.683817 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa931287-f64a-43c3-a13c-caeb2410dfb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action" status: 202 len: 0 microversion: 2.1 time: 0.076573 Oct 12 23:49:29.684491 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3798/7497] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:49:29 2022] POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:49:29.693933 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:29.694647 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:29.702608 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:29.703693 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:29.704174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:29.704886 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:29.705346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:29.705777 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:29.845274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:29.853059 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7eb9cd0-67f2-4c5e-aefc-4cc5d7f4a170 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1680 microversion: 2.1 time: 0.163678 Oct 12 23:49:29.853629 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3700/7498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:29 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:30.878476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:49:30.879193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:30.886084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:30.886580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:30.887031 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:30.887739 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:30.888237 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:30.888679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:31.018750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:49:31.026685 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-561c5661-80b6-410d-a4c7-585b3db621df tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1684 microversion: 2.1 time: 0.153280 Oct 12 23:49:31.027188 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3799/7499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:49:30 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:49:55.218305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:49:55.220652 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:49:55.223438 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=20 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:55.224134 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:49:55.230840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:55.231329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:55.231774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:55.232495 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:49:55.232957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:49:55.233392 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:49:55.290891 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a9bfe3f-6170-4581-adbb-dd4a1a24f7a6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action" status: 200 len: 62932 microversion: 2.1 time: 0.076330 Oct 12 23:49:55.291559 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3701/7500] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:49:55 2022] POST /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba/action => generated 62932 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:50:02.651864 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:02.652426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:02.654171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4f8688b1-6a9f-48dc-8f8e-e802d496c15d req-ec8a14bf-a61a-4dfb-8dd2-67fb38d09389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8ed8f8-0364-4c8e-91f3-f930af580dba", "tag": "7d908e9c-c259-4c30-acf3-538ca4e3d92f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:02.654709 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=20 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:02.655564 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:02.660945 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:02.661446 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:02.661891 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:02.662912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:02.663374 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:02.664535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:02.667979 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f8688b1-6a9f-48dc-8f8e-e802d496c15d req-ec8a14bf-a61a-4dfb-8dd2-67fb38d09389 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:02.668492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f8688b1-6a9f-48dc-8f8e-e802d496c15d req-ec8a14bf-a61a-4dfb-8dd2-67fb38d09389 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:02.668920 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f8688b1-6a9f-48dc-8f8e-e802d496c15d req-ec8a14bf-a61a-4dfb-8dd2-67fb38d09389 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:02.681811 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4f8688b1-6a9f-48dc-8f8e-e802d496c15d req-ec8a14bf-a61a-4dfb-8dd2-67fb38d09389 service nova] Creating event network-changed:7d908e9c-c259-4c30-acf3-538ca4e3d92f for instance ba8ed8f8-0364-4c8e-91f3-f930af580dba on n-h2-860864-8 Oct 12 23:50:02.687519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4f8688b1-6a9f-48dc-8f8e-e802d496c15d req-ec8a14bf-a61a-4dfb-8dd2-67fb38d09389 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037550 Oct 12 23:50:02.688159 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3702/7501] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:50:02.696598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:50:02.792271 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-70605bd4-d239-461d-993a-d8629ad4e615 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 204 len: 0 microversion: 2.1 time: 0.144419 Oct 12 23:50:02.793274 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3800/7502] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:50:02 2022] DELETE /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:50:02.802131 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:02.803151 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:02.811368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:02.812183 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:02.812893 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:02.813853 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:02.814609 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:02.815228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:02.956443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:02.964751 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-894a7cda-ecd4-48c7-a468-e516a31b0b9d tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1690 microversion: 2.1 time: 0.166990 Oct 12 23:50:02.965418 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3703/7503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:02 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:03.992995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:03.993839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:04.000873 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:04.001378 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:04.001828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:04.002538 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:04.003012 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:04.003451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:04.179023 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:04.187541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8247c85f-2154-4a00-b19a-abc0393f1be7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1690 microversion: 2.1 time: 0.199540 Oct 12 23:50:04.188156 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3801/7504] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:03 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:04.778642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-bf766a2e-e846-4c2d-a51c-bcf261962460 req-303c8929-76dd-48b6-886b-ef1b50ade54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8ed8f8-0364-4c8e-91f3-f930af580dba", "name": "network-vif-deleted", "tag": "7d908e9c-c259-4c30-acf3-538ca4e3d92f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:04.789094 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bf766a2e-e846-4c2d-a51c-bcf261962460 req-303c8929-76dd-48b6-886b-ef1b50ade54e service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:04.789566 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bf766a2e-e846-4c2d-a51c-bcf261962460 req-303c8929-76dd-48b6-886b-ef1b50ade54e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:04.789993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bf766a2e-e846-4c2d-a51c-bcf261962460 req-303c8929-76dd-48b6-886b-ef1b50ade54e service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:04.801695 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-bf766a2e-e846-4c2d-a51c-bcf261962460 req-303c8929-76dd-48b6-886b-ef1b50ade54e service nova] Creating event network-vif-deleted:7d908e9c-c259-4c30-acf3-538ca4e3d92f for instance ba8ed8f8-0364-4c8e-91f3-f930af580dba on n-h2-860864-8 Oct 12 23:50:04.806371 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-bf766a2e-e846-4c2d-a51c-bcf261962460 req-303c8929-76dd-48b6-886b-ef1b50ade54e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Oct 12 23:50:04.806960 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3704/7505] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:50:05.211317 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:05.212483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:05.220966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:05.221471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:05.221917 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:05.222628 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:05.223092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:05.223528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:05.261003 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:05.261499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:05.261948 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:05.262407 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lazy-loading 'fault' on Instance uuid ba8ed8f8-0364-4c8e-91f3-f930af580dba {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:50:05.304852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:05.312404 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8747bd9d-0662-4be1-99d6-023fa719633f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 200 len: 1356 microversion: 2.1 time: 0.105607 Oct 12 23:50:05.313189 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3802/7506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:05 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:06.337380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:06.338079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: ba8ed8f8-0364-4c8e-91f3-f930af580dba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:06.344307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:06.344795 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:06.345239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:06.345928 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:06.346384 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:06.346812 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:06.360464 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] HTTP exception thrown: Instance ba8ed8f8-0364-4c8e-91f3-f930af580dba could not be found. Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Request method failure captured: Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba HTTP/1.1 Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR1EqMfBn4a1eRNzGr1Ti1kU_C4B2KaChLShiifJk4rvgRq2ljFOr6pHb_GQ7J8fQa2894lIekEq9NnjKEE9Yma8xf0U9QHLP174bSamNMh_QtojnTv_OL9SOQaQ7NHsQNDhzrzCYRpZOWVZWX3WuhCEBcuqXS8Xf3_6bFg_c8fMVRjw Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}] Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: df0e8621054d45828bff5d8bac144bdf Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance ba8ed8f8-0364-4c8e-91f3-f930af580dba could not be found. Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'ba8ed8f8-0364-4c8e-91f3-f930af580dba'} Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8ed8f8-0364-4c8e-91f3-f930af580dba could not be found. Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8ed8f8-0364-4c8e-91f3-f930af580dba could not be found. Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:50:06.362064 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8ed8f8-0364-4c8e-91f3-f930af580dba could not be found. Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Returning 404 to user: Instance ba8ed8f8-0364-4c8e-91f3-f930af580dba could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4460140-2436-4b76-9524-15a0fd6283ba tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba" status: 404 len: 111 microversion: 2.1 time: 0.031317 Oct 12 23:50:06.367868 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3705/7507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:06 2022] GET /compute/v2.1/servers/ba8ed8f8-0364-4c8e-91f3-f930af580dba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:50:09.532434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-22691143-a131-4551-a337-4584c5208bd2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '.version_select at 0x7f44fc382dc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:09.538999 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:50:09.539184 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1208844289 (ip 10.222.0.20) !!! Oct 12 23:50:09.557287 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-22691143-a131-4551-a337-4584c5208bd2 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1208844289" status: 202 len: 0 microversion: 2.1 time: 0.028718 Oct 12 23:50:09.557879 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3803/7508] 10.222.0.20 () {58 vars in 1284 bytes} [Wed Oct 12 23:50:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1208844289 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 23:50:09.591962 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e233dea0-14c6-4257-8dbd-22beeb7bc0b6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: .version_select at 0x7f45043fbaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1388679927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxT/ZVAH2H0//tGqOHzoqSlUho+BqwM7HXdckz/y2RQ4B+4vI44/jBEoLLNc+YjXyDxmQ3Yvn9V5gcQTpVPfMUX7m7nDYRrLmeTxg2KyCedjwXQ9aEnFAbKm+8hU8NT3A=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:09.611040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e233dea0-14c6-4257-8dbd-22beeb7bc0b6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:50:09.616401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-e233dea0-14c6-4257-8dbd-22beeb7bc0b6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:50:09.640892 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e233dea0-14c6-4257-8dbd-22beeb7bc0b6 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053277 Oct 12 23:50:09.641490 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3706/7509] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:50:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:50:15.099789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-548427738", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "networks": [{"uuid": "ff4f1008-7a1b-4584-b2ce-2bc0758314b1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1388679927", "security_groups": [{"name": "tempest-secgroup-smoke-1294732669"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:15.227017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] validate_networks() for [('ff4f1008-7a1b-4584-b2ce-2bc0758314b1', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:50:15.309275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:15.677285 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:50:15.679924 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:50:15.680526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:50:15.680964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:50:15.681408 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:50:15.691632 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:15.692169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:15.692621 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:15.693360 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:15.693823 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:15.694260 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:15.713838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:50:15.719074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Getting quotas for user df0e8621054d45828bff5d8bac144bdf and project 2319faa45dc24547b60d900ae2bbfc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:50:15.731455 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:50:15.733827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:50:15.782724 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e1f21c2a-4422-4e36-83d9-756800c33888 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688823 Oct 12 23:50:15.783568 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3804/7510] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:50:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:50:15.795312 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e5b01a15-8c15-4f08-bee8-8c183520c9e3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:15.796100 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e5b01a15-8c15-4f08-bee8-8c183520c9e3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:15.993387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e5b01a15-8c15-4f08-bee8-8c183520c9e3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:16.001582 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e5b01a15-8c15-4f08-bee8-8c183520c9e3 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1266 microversion: 2.1 time: 0.210441 Oct 12 23:50:16.004085 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3707/7511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:15 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:17.026280 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:17.027014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:17.033888 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:17.034486 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:17.035375 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:17.036222 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:17.036772 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:17.037223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:17.421479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:17.430388 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f2cc2e4-5d12-41fa-b34b-fe8f0820e974 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1324 microversion: 2.1 time: 0.408888 Oct 12 23:50:17.437064 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3805/7512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:17 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:18.398104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-fcb91b43-0fce-47a8-8dfa-2860a7747abc req-e90d115d-f58c-4e6f-8d09-77335198ec59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9031f4b-64fe-42fc-82a8-f013597fd164", "tag": "08651c5f-750f-4f9c-b425-cefd898435e3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:18.405684 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=16 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:18.418082 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fcb91b43-0fce-47a8-8dfa-2860a7747abc req-e90d115d-f58c-4e6f-8d09-77335198ec59 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:18.418730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fcb91b43-0fce-47a8-8dfa-2860a7747abc req-e90d115d-f58c-4e6f-8d09-77335198ec59 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:18.419488 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-fcb91b43-0fce-47a8-8dfa-2860a7747abc req-e90d115d-f58c-4e6f-8d09-77335198ec59 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:18.433724 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-fcb91b43-0fce-47a8-8dfa-2860a7747abc req-e90d115d-f58c-4e6f-8d09-77335198ec59 service nova] Creating event network-changed:08651c5f-750f-4f9c-b425-cefd898435e3 for instance b9031f4b-64fe-42fc-82a8-f013597fd164 on n-h1-860864-8 Oct 12 23:50:18.440326 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-fcb91b43-0fce-47a8-8dfa-2860a7747abc req-e90d115d-f58c-4e6f-8d09-77335198ec59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048154 Oct 12 23:50:18.442270 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3708/7513] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:50:18.455502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:18.456245 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:18.463225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:18.463733 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:18.464238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:18.465309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:18.465680 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:18.466431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:18.610109 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:18.619448 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0091eb79-fd27-4709-ae21-492a2647ee8a tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1392 microversion: 2.1 time: 0.169244 Oct 12 23:50:18.620041 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3806/7514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:18 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:50:19.642582 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:19.643284 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:19.650715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:19.651198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:19.651639 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:19.652363 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:19.652817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:19.653250 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:19.875419 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:19.883871 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9f6d843-e45a-4c3e-bb62-378bb4658f08 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1392 microversion: 2.1 time: 0.245495 Oct 12 23:50:19.884855 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3709/7515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:19 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:20.906654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:20.907308 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:20.915077 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:20.915567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:20.916042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:20.916736 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:20.917198 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:20.917625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:21.049932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:21.057562 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-87e03602-1eff-4824-afe9-b78779256b17 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1392 microversion: 2.1 time: 0.154864 Oct 12 23:50:21.058127 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3807/7516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:20 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:22.082518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:22.083058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:22.090079 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:22.090560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:22.090992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:22.091677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:22.092156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:22.092577 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:22.227185 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:22.235733 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7e4ff35-490c-4454-a244-da5ed53fd678 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1392 microversion: 2.1 time: 0.157388 Oct 12 23:50:22.236360 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3710/7517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:22 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:23.244643 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2fa2f686-59ac-4260-9334-1f653e5a3263 req-d7260ba2-cc1d-4783-a86f-12aa5e625efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9031f4b-64fe-42fc-82a8-f013597fd164", "name": "network-vif-plugged", "status": "completed", "tag": "08651c5f-750f-4f9c-b425-cefd898435e3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:23.255518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fa2f686-59ac-4260-9334-1f653e5a3263 req-d7260ba2-cc1d-4783-a86f-12aa5e625efe service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:23.256032 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fa2f686-59ac-4260-9334-1f653e5a3263 req-d7260ba2-cc1d-4783-a86f-12aa5e625efe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:23.256470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2fa2f686-59ac-4260-9334-1f653e5a3263 req-d7260ba2-cc1d-4783-a86f-12aa5e625efe service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:23.260949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:23.262114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:23.269676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:23.270174 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:23.270520 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2fa2f686-59ac-4260-9334-1f653e5a3263 req-d7260ba2-cc1d-4783-a86f-12aa5e625efe service nova] Creating event network-vif-plugged:08651c5f-750f-4f9c-b425-cefd898435e3 for instance b9031f4b-64fe-42fc-82a8-f013597fd164 on n-h1-860864-8 Oct 12 23:50:23.270649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:23.271315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:23.271771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:23.272244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:23.275676 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2fa2f686-59ac-4260-9334-1f653e5a3263 req-d7260ba2-cc1d-4783-a86f-12aa5e625efe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Oct 12 23:50:23.277693 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3808/7518] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:50:23.450071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:23.457724 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71eca89d-f144-45c6-9ce9-7c8ff7a7ff0c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1392 microversion: 2.1 time: 0.202918 Oct 12 23:50:23.458305 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3711/7519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:23 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:24.482150 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:24.482912 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:24.489349 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:24.489856 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:24.490311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:24.491103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:24.491581 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:24.492110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:24.623630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:24.631425 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-359b1f89-55a8-48e7-abce-d123cb7b45de tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1565 microversion: 2.1 time: 0.154641 Oct 12 23:50:24.632028 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3809/7520] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:24 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:24.654393 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:24.655007 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:24.661840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:24.662322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:24.662760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:24.663702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:24.664184 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:24.664614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:24.796188 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:24.804003 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-92de98b2-d4da-4bd3-866b-dffdc460843c tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1565 microversion: 2.1 time: 0.153734 Oct 12 23:50:24.804569 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3712/7521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:24 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:26.358275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:26.359451 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:26.360737 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-213b8bd7-d36b-4158-8e45-effc96380b8c req-b063e904-a8ef-41c3-a916-fca40a601bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9031f4b-64fe-42fc-82a8-f013597fd164", "tag": "08651c5f-750f-4f9c-b425-cefd898435e3"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:26.363034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:26.363857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:26.367630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:26.369335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:26.369475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:26.369938 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:26.370609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:26.371707 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:26.372431 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:26.373232 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:26.376049 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-213b8bd7-d36b-4158-8e45-effc96380b8c req-b063e904-a8ef-41c3-a916-fca40a601bcf service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:26.376531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-213b8bd7-d36b-4158-8e45-effc96380b8c req-b063e904-a8ef-41c3-a916-fca40a601bcf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:26.376969 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-213b8bd7-d36b-4158-8e45-effc96380b8c req-b063e904-a8ef-41c3-a916-fca40a601bcf service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:26.389858 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-213b8bd7-d36b-4158-8e45-effc96380b8c req-b063e904-a8ef-41c3-a916-fca40a601bcf service nova] Creating event network-changed:08651c5f-750f-4f9c-b425-cefd898435e3 for instance b9031f4b-64fe-42fc-82a8-f013597fd164 on n-h1-860864-8 Oct 12 23:50:26.395057 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-213b8bd7-d36b-4158-8e45-effc96380b8c req-b063e904-a8ef-41c3-a916-fca40a601bcf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038436 Oct 12 23:50:26.395886 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3713/7522] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:50:26.524153 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:26.534589 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d6ab18c-64e4-4fb2-9023-6c7ea185d925 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1565 microversion: 2.1 time: 0.180391 Oct 12 23:50:26.538218 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3810/7523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:26 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:49.778872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:49.781232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:49.783485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=28 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:49.789469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:49.789944 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:49.790380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:49.791622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:49.792095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:49.792518 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:49.843158 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d36460e-f4cd-4e49-ad1e-14037f411f47 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action" status: 200 len: 24571 microversion: 2.1 time: 0.068825 Oct 12 23:50:49.843933 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3714/7524] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:50:49 2022] POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:50:56.258461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:56.259051 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:56.261655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:56.262418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=34 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:50:56.268545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:56.269038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:56.269504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:56.270196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:56.270653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:56.271084 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:56.294138 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lazy-loading 'flavor' on Instance uuid b9031f4b-64fe-42fc-82a8-f013597fd164 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:50:56.358273 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82ad8aca-95aa-445c-8a2b-4282e3eb4276 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action" status: 202 len: 0 microversion: 2.1 time: 0.103744 Oct 12 23:50:56.362133 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3811/7525] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:50:56 2022] POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:50:56.368018 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:56.368833 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:56.377001 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:56.377484 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:56.377924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:56.378669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:56.379122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:56.379549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:56.514727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:56.522465 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23e9e932-3031-4882-918a-5532382a4fb9 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1690 microversion: 2.1 time: 0.158839 Oct 12 23:50:56.523031 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3715/7526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:56 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:57.548103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:57.548821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:57.555039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:57.555532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:57.556014 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:57.556721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:57.557188 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:57.557629 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:57.734532 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:57.742229 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-03d2f705-f0f3-4c37-96ec-1fa1650813da tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1673 microversion: 2.1 time: 0.199282 Oct 12 23:50:57.742807 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3812/7527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:57 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:50:58.835690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:58.837961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:58.845622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:58.846101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:58.846535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:58.847216 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:58.847668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:58.848123 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:58.899411 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e42a6392-8732-4778-8303-ab29638a5e79 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action" status: 200 len: 35242 microversion: 2.1 time: 0.067453 Oct 12 23:50:58.900072 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3716/7528] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:50:58 2022] POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action => generated 35242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 23:50:58.911838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:50:58.912422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:58.920106 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:58.920604 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:58.921053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:58.921761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:58.922229 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:58.922673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:58.988828 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-724c93f6-42d3-49c1-850f-6693896e36c7 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action" status: 202 len: 0 microversion: 2.1 time: 0.080731 Oct 12 23:50:58.989463 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3813/7529] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:50:58 2022] POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:50:58.998989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:50:58.999796 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:50:59.007373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:59.007863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:59.008332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:59.009022 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:50:59.009480 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:50:59.009898 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:50:59.229303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:50:59.237236 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb485f9c-a6e3-4929-bdf2-4410759a2205 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1679 microversion: 2.1 time: 0.242481 Oct 12 23:50:59.237815 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3717/7530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:50:58 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:00.264289 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:00.265041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:00.271330 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:00.271830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:00.272335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:00.273053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:00.273524 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:00.273967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:00.414440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:00.422698 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3f0e6100-5b76-4cb9-8d9c-b7529a1c7f32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1679 microversion: 2.1 time: 0.164218 Oct 12 23:51:00.423272 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3814/7531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:00 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:01.446621 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:01.447223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:01.454199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:01.454683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:01.455122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:01.455810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:01.456303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:01.456733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:01.592872 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:01.600606 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2da9a55f-c629-48f2-b3af-12ec9157d77b tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1682 microversion: 2.1 time: 0.157945 Oct 12 23:51:01.601176 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3718/7532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:01 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:01.696889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:01.699789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:01.706684 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:01.707190 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:01.707647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:01.708403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:01.708871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:01.709310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:01.752039 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd6c3893-800c-4b70-9148-60c21304ea32 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action" status: 200 len: 35242 microversion: 2.1 time: 0.058897 Oct 12 23:51:01.752906 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3815/7533] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:51:01 2022] POST /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164/action => generated 35242 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 23:51:02.731482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:02.732033 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:02.739211 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:02.739775 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:02.740401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:02.740944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-817b39f2-f31f-404e-aec5-a54652c9cee9 req-260ceda4-a691-4e2a-9dab-55d439f9e4fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9031f4b-64fe-42fc-82a8-f013597fd164", "tag": "08651c5f-750f-4f9c-b425-cefd898435e3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:02.741383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:02.741702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:02.742199 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:02.752362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-817b39f2-f31f-404e-aec5-a54652c9cee9 req-260ceda4-a691-4e2a-9dab-55d439f9e4fa service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:02.753160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-817b39f2-f31f-404e-aec5-a54652c9cee9 req-260ceda4-a691-4e2a-9dab-55d439f9e4fa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:02.753600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-817b39f2-f31f-404e-aec5-a54652c9cee9 req-260ceda4-a691-4e2a-9dab-55d439f9e4fa service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:02.770390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:51:02.774406 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-817b39f2-f31f-404e-aec5-a54652c9cee9 req-260ceda4-a691-4e2a-9dab-55d439f9e4fa service nova] Creating event network-changed:08651c5f-750f-4f9c-b425-cefd898435e3 for instance b9031f4b-64fe-42fc-82a8-f013597fd164 on n-h1-860864-8 Oct 12 23:51:02.779451 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-817b39f2-f31f-404e-aec5-a54652c9cee9 req-260ceda4-a691-4e2a-9dab-55d439f9e4fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042361 Oct 12 23:51:02.780117 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3816/7534] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:51:02.857114 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-26bdcfb5-6f54-4eab-b61f-f56266ffd49f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 204 len: 0 microversion: 2.1 time: 0.128824 Oct 12 23:51:02.857818 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3719/7535] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:51:02 2022] DELETE /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:51:02.869622 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:02.870480 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:02.877566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:02.878062 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:02.878511 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:02.879219 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:02.880121 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:02.880631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:03.023140 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:03.031108 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d7bbbfe1-17df-4645-91b8-594c1ed01c59 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1688 microversion: 2.1 time: 0.168175 Oct 12 23:51:03.031703 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3817/7536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:02 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:04.055846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:04.057106 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:04.063998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:04.064474 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:04.064908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:04.065620 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:04.066065 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:04.066485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:04.239220 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:04.247527 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e85bc68e-2694-4e49-b60c-ab5352319584 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1688 microversion: 2.1 time: 0.196029 Oct 12 23:51:04.248146 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3720/7537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:04 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:04.882903 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c62ac3e7-d498-4af5-a035-7da9c80b4afd req-71054791-4fea-4ace-89ac-0e89744f49c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9031f4b-64fe-42fc-82a8-f013597fd164", "name": "network-vif-deleted", "tag": "08651c5f-750f-4f9c-b425-cefd898435e3"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:04.894767 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c62ac3e7-d498-4af5-a035-7da9c80b4afd req-71054791-4fea-4ace-89ac-0e89744f49c0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:04.895182 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c62ac3e7-d498-4af5-a035-7da9c80b4afd req-71054791-4fea-4ace-89ac-0e89744f49c0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:04.895626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c62ac3e7-d498-4af5-a035-7da9c80b4afd req-71054791-4fea-4ace-89ac-0e89744f49c0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:04.907511 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c62ac3e7-d498-4af5-a035-7da9c80b4afd req-71054791-4fea-4ace-89ac-0e89744f49c0 service nova] Creating event network-vif-deleted:08651c5f-750f-4f9c-b425-cefd898435e3 for instance b9031f4b-64fe-42fc-82a8-f013597fd164 on n-h1-860864-8 Oct 12 23:51:04.912813 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c62ac3e7-d498-4af5-a035-7da9c80b4afd req-71054791-4fea-4ace-89ac-0e89744f49c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Oct 12 23:51:04.913409 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3818/7538] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:51:05.272056 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:05.273468 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:05.281663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:05.282232 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:05.282730 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:05.283624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:05.284163 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:05.284657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:05.320842 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:05.321325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:05.321781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:05.322780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lazy-loading 'fault' on Instance uuid b9031f4b-64fe-42fc-82a8-f013597fd164 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:51:05.363328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0e8621054d45828bff5d8bac144bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2319faa45dc24547b60d900ae2bbfc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:05.370558 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2d33bf89-1eea-46c2-a5ff-a8475e960c7f tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 200 len: 1356 microversion: 2.1 time: 0.102659 Oct 12 23:51:05.371395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3721/7539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:05 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:06.397745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:06.398386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] [instance: b9031f4b-64fe-42fc-82a8-f013597fd164] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:06.405180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:06.405675 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:06.406126 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:06.406829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:06.407298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:06.407737 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:06.421282 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] HTTP exception thrown: Instance b9031f4b-64fe-42fc-82a8-f013597fd164 could not be found. Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Request method failure captured: Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 HTTP/1.1 Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR1EqMfBn4a1eRNzGr1Ti1kU_C4B2KaChLShiifJk4rvgRq2ljFOr6pHb_GQ7J8fQa2894lIekEq9NnjKEE9Yma8xf0U9QHLP174bSamNMh_QtojnTv_OL9SOQaQ7NHsQNDhzrzCYRpZOWVZWX3WuhCEBcuqXS8Xf3_6bFg_c8fMVRjw Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2319faa45dc24547b60d900ae2bbfc1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2319faa45dc24547b60d900ae2bbfc1e"}]}] Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2319faa45dc24547b60d900ae2bbfc1e Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2129416963 Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: df0e8621054d45828bff5d8bac144bdf Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2129416963-project Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance b9031f4b-64fe-42fc-82a8-f013597fd164 could not be found. Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': 'b9031f4b-64fe-42fc-82a8-f013597fd164'} Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9031f4b-64fe-42fc-82a8-f013597fd164 could not be found. Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9031f4b-64fe-42fc-82a8-f013597fd164 could not be found. Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:51:06.422970 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9031f4b-64fe-42fc-82a8-f013597fd164 could not be found. Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Returning 404 to user: Instance b9031f4b-64fe-42fc-82a8-f013597fd164 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f8ddaa01-3c5b-49e7-ae23-b2684537c743 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164" status: 404 len: 111 microversion: 2.1 time: 0.032254 Oct 12 23:51:06.427750 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3819/7540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:06 2022] GET /compute/v2.1/servers/b9031f4b-64fe-42fc-82a8-f013597fd164 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:51:09.761624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7003183e-693d-492d-bc56-6ab94904f487 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] Calling method '.version_select at 0x7f44ff91ca60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:09.783687 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7003183e-693d-492d-bc56-6ab94904f487 tempest-TestNetworkAdvancedServerOps-2129416963 tempest-TestNetworkAdvancedServerOps-2129416963-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1388679927" status: 202 len: 0 microversion: 2.1 time: 0.026398 Oct 12 23:51:09.784328 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3722/7541] 10.222.0.20 () {58 vars in 1284 bytes} [Wed Oct 12 23:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1388679927 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:51:20.710656 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=18 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:51:20.711609 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:51:21.041601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d26936e-b55c-4bab-96d6-61fe1c2cc048 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'create', calling method: .version_select at 0x7f44ffe2f820>, body: {"keypair": {"name": "tempest-TestShelveInstance-28904749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWQKqyBj9dcm2tG8YfTGBPOBfX5wcbX5X5mANROoTpVQd5zkaE7KkEOzVU+RI/VK32h0HviDClpxIfyFTPOKT1XzkZLPt1qtjzAUG+CVbb+VoGy5EnKsFIwAeIXFcdVzA=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:21.057502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9d26936e-b55c-4bab-96d6-61fe1c2cc048 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for project 2d237819a0a84c9caa185fd737473863. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:51:21.062742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-9d26936e-b55c-4bab-96d6-61fe1c2cc048 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for user ab235f289f784fed8e6ab35b996f7d9d and project 2d237819a0a84c9caa185fd737473863. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:51:21.090107 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d26936e-b55c-4bab-96d6-61fe1c2cc048 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.385303 Oct 12 23:51:21.091117 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3820/7542] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:51:20 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:51:22.061414 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:51:22.062370 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:51:22.066193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1076746487", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-28904749", "security_groups": [{"name": "tempest-secgroup-smoke-1847843663"}], "networks": [{"uuid": "97396223-0e53-4a64-9efb-c88f196e1d99"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:22.191640 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] validate_networks() for [('97396223-0e53-4a64-9efb-c88f196e1d99', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:51:22.687555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:51:22.688008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:51:22.688485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:51:22.688892 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:51:22.689314 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:51:22.698857 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:22.699326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:22.699755 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:22.700504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:22.700949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:22.701366 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:22.719805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for project 2d237819a0a84c9caa185fd737473863. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:51:22.725383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for user ab235f289f784fed8e6ab35b996f7d9d and project 2d237819a0a84c9caa185fd737473863. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:51:22.738156 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:51:22.740493 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:51:22.790086 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52b9bc67-a97f-43dc-a75d-9f238ce6090c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730458 Oct 12 23:51:22.791006 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3723/7543] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:51:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:51:22.803313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f47c9fd-af08-493f-b120-1d0444775ec2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:22.804004 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f47c9fd-af08-493f-b120-1d0444775ec2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:22.863183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f47c9fd-af08-493f-b120-1d0444775ec2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:22.870410 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f47c9fd-af08-493f-b120-1d0444775ec2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1245 microversion: 2.1 time: 0.072064 Oct 12 23:51:22.870978 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3821/7544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:22 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:23.894908 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:23.895531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:23.922690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:23.923385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:23.924040 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:23.940663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:23.941167 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:23.941623 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:24.061701 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:24.072685 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b3442b5-b3d6-4661-9560-b41187c9b512 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1305 microversion: 2.1 time: 0.182122 Oct 12 23:51:24.090473 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3724/7545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:23 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1305 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:25.100541 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:25.101386 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:25.108761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:25.109339 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:25.109757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:25.110534 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:25.110995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:25.111461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:25.352216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:25.359957 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd3c06a5-b048-4d6a-8fbb-0067328f6fee tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1371 microversion: 2.1 time: 0.263400 Oct 12 23:51:25.360547 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3822/7546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:25 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:25.576720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-96c71303-a46b-41a5-b86e-3d8a4a452e54 req-74edcaa4-6316-4f8d-aca3-834c50ed8ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:25.587587 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-96c71303-a46b-41a5-b86e-3d8a4a452e54 req-74edcaa4-6316-4f8d-aca3-834c50ed8ed0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:25.588105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-96c71303-a46b-41a5-b86e-3d8a4a452e54 req-74edcaa4-6316-4f8d-aca3-834c50ed8ed0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:25.588793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-96c71303-a46b-41a5-b86e-3d8a4a452e54 req-74edcaa4-6316-4f8d-aca3-834c50ed8ed0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:25.604396 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-96c71303-a46b-41a5-b86e-3d8a4a452e54 req-74edcaa4-6316-4f8d-aca3-834c50ed8ed0 service nova] Creating event network-changed:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:51:25.609619 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-96c71303-a46b-41a5-b86e-3d8a4a452e54 req-74edcaa4-6316-4f8d-aca3-834c50ed8ed0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117608 Oct 12 23:51:25.610211 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3725/7547] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:51:26.382940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:26.383569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:26.391383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:26.391744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:26.392216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:26.392930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:26.393714 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:26.394158 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:26.523654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:26.532189 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-408d5022-7f00-4519-bef0-5daa5a76c792 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1371 microversion: 2.1 time: 0.153406 Oct 12 23:51:26.532769 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3823/7548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:26 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:27.556870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:27.557706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:27.563945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:27.564440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:27.564889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:27.565578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:27.566034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:27.566462 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:27.699746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:27.707672 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-68a8459f-f7e2-4963-b539-ad3653e8bb17 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1371 microversion: 2.1 time: 0.156541 Oct 12 23:51:27.708288 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3726/7549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:27 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:28.730458 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:28.731011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:28.737889 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:28.738382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:28.738827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:28.739525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:28.740020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:28.740456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:28.873420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:28.881192 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e437966-f514-472e-88be-18bbd42aa566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1371 microversion: 2.1 time: 0.154798 Oct 12 23:51:28.881767 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3824/7550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:28 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:29.490516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7dbb4785-b167-49bf-90e3-7590f0e8dab1 req-ad8534ef-f282-4fa1-94d1-c0ccf3e82916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "name": "network-vif-plugged", "status": "completed", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:29.502471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7dbb4785-b167-49bf-90e3-7590f0e8dab1 req-ad8534ef-f282-4fa1-94d1-c0ccf3e82916 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:29.502953 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7dbb4785-b167-49bf-90e3-7590f0e8dab1 req-ad8534ef-f282-4fa1-94d1-c0ccf3e82916 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:29.503380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7dbb4785-b167-49bf-90e3-7590f0e8dab1 req-ad8534ef-f282-4fa1-94d1-c0ccf3e82916 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:29.514564 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7dbb4785-b167-49bf-90e3-7590f0e8dab1 req-ad8534ef-f282-4fa1-94d1-c0ccf3e82916 service nova] Creating event network-vif-plugged:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:51:29.519527 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7dbb4785-b167-49bf-90e3-7590f0e8dab1 req-ad8534ef-f282-4fa1-94d1-c0ccf3e82916 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Oct 12 23:51:29.520332 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3727/7551] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:51:29.905255 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:29.905879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:29.912792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:29.913279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:29.913717 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:29.914678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:29.915128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:29.916189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:30.045430 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:30.053319 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6bf16bdc-5568-4b49-9506-7520e8ff1fe0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1371 microversion: 2.1 time: 0.151969 Oct 12 23:51:30.053929 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3825/7552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:29 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:31.076507 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:31.077133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:31.084140 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:31.084616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:31.085045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:31.085722 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:31.086169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:31.086586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:31.220315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:31.227935 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d23e5d2d-41c9-4007-af86-a0a0b1dbf9bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1556 microversion: 2.1 time: 0.155793 Oct 12 23:51:31.229110 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3728/7553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:31 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:31.250829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:51:31.251465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:51:31.258338 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:31.258830 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:31.259307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:31.260039 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:31.260505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:31.260940 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:31.395848 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:51:31.404066 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea0d2f04-62d3-4371-a768-42913f2e8538 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1556 microversion: 2.1 time: 0.157093 Oct 12 23:51:31.404635 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3826/7554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:51:31 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:51:33.736930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-18f8f195-3bc3-4372-895d-a62cf7b53cfc req-0e2b3873-5884-46ec-8a65-3cbbf30b1d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:51:33.742685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:51:33.743408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:51:33.750196 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-18f8f195-3bc3-4372-895d-a62cf7b53cfc req-0e2b3873-5884-46ec-8a65-3cbbf30b1d3a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:51:33.750657 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-18f8f195-3bc3-4372-895d-a62cf7b53cfc req-0e2b3873-5884-46ec-8a65-3cbbf30b1d3a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:51:33.751083 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-18f8f195-3bc3-4372-895d-a62cf7b53cfc req-0e2b3873-5884-46ec-8a65-3cbbf30b1d3a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:51:33.763366 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-18f8f195-3bc3-4372-895d-a62cf7b53cfc req-0e2b3873-5884-46ec-8a65-3cbbf30b1d3a service nova] Creating event network-changed:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:51:33.768495 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-18f8f195-3bc3-4372-895d-a62cf7b53cfc req-0e2b3873-5884-46ec-8a65-3cbbf30b1d3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035268 Oct 12 23:51:33.772167 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3729/7555] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:53:28.997815 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:53:28.998624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:28.999620 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:29.000362 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=30 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:29.001140 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:53:29.001393 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d/action (ip 10.222.0.20) !!! Oct 12 23:53:29.002733 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:53:29.002884 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d/action (ip 10.222.0.20) !!! Oct 12 23:53:29.007333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:53:29.007878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:29.018574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:29.019064 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:29.019504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:29.020249 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:29.020708 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:29.021137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:29.046063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lazy-loading 'flavor' on Instance uuid 64e38822-d800-442c-853d-b09fae9ac12d {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:53:29.233324 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-90d797f1-8fac-45bd-a9e8-a77fbb9013e9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d/action" status: 202 len: 0 microversion: 2.1 time: 0.237308 Oct 12 23:53:29.233932 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3827/7556] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:53:28 2022] POST /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:53:29.242407 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 23:53:29.243267 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:53:29.243767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:29.244790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=26 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:29.246359 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:53:29.246499 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d (ip 10.222.0.20) !!! Oct 12 23:53:29.253522 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:29.254169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:29.268560 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:29.269052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:29.269490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:29.270193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:29.270649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:29.271076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:29.400946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:29.409256 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9bfff436-4420-4779-b463-f38b3096d16e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.170670 Oct 12 23:53:29.409842 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3730/7557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:29 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:30.435434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:30.436180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:30.444340 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:30.444829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:30.445271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:30.445954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:30.446411 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:30.446838 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:30.450205 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41342. Oct 12 23:53:30.582648 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:30.590392 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f41dece-fc15-4a9d-947d-1c6a4bf4c528 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.160786 Oct 12 23:53:30.591470 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3828/7558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:30 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:31.613856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:31.614445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:31.624328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:31.624807 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:31.625244 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:31.625934 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:31.626387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:31.626810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:31.633588 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41348. Oct 12 23:53:31.634385 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41346. Oct 12 23:53:31.765282 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:31.773258 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ab5d8653-dbba-424b-be98-908ce1959b44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.163330 Oct 12 23:53:31.773850 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3731/7559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:31 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:32.795954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:32.796617 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:32.803497 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:32.804018 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:32.804470 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:32.805170 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:32.805635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:32.806070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:32.933638 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:32.941806 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-88737512-cb12-4de9-af12-76565bfb2647 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.150098 Oct 12 23:53:32.942386 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3829/7560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:32 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:33.965628 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:33.966829 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:33.975698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:33.976154 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:33.976591 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:33.977270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:33.977720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:33.978146 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:34.107175 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:34.114807 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5a80b06f-fb17-4c02-9179-b4df6bd9bd6c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.153160 Oct 12 23:53:34.115371 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3732/7561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:33 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:35.138911 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:35.139566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:35.146539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:35.147038 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:35.147482 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:35.148225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:35.148691 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:35.149125 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:35.281704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:35.289445 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56e1eb92-3553-4fbe-a467-96c18c8be962 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.155113 Oct 12 23:53:35.290021 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3830/7562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:35 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:36.313426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:36.314027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:36.321177 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:36.321654 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:36.322085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:36.322765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:36.323213 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:36.323631 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:36.451085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:36.458799 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-524191fa-91fb-4be0-a0bb-9220c3f7e1f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.149894 Oct 12 23:53:36.459367 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3733/7563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:36 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:37.483139 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:37.483765 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:37.490640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:37.491130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:37.491574 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:37.492307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:37.492782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:37.493204 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:37.625870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:37.633604 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-061f2e91-5201-41cb-833b-78e821182d0c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.154942 Oct 12 23:53:37.634186 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3831/7564] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:37 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:38.656773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:38.657389 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:38.664303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:38.664790 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:38.665234 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:38.665930 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:38.666388 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:38.666816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:38.801008 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:38.808749 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-197c7578-3b79-492f-b342-1f8be111567a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.155931 Oct 12 23:53:38.809327 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3734/7565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:38 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:39.833359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:39.833814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:39.840799 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:39.841297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:39.841748 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:39.842655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:39.843129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:39.843567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:39.974412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:39.982692 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0325ca57-6ad3-4715-b95e-db3b178f62e2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1700 microversion: 2.1 time: 0.153901 Oct 12 23:53:39.983270 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3832/7566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:39 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:41.006725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:41.007351 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:41.014406 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:41.014932 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:41.015368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:41.016095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:41.016556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:41.016992 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:41.149669 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:41.158989 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e75b1079-9e76-4a32-a115-ca61441f7e2c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1700 microversion: 2.1 time: 0.156283 Oct 12 23:53:41.159595 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3735/7567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:41 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:42.183291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:42.185429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:42.196685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:42.197179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:42.197615 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:42.198320 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:42.200848 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:42.201307 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:42.234753 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-d135c666-2cf4-4d85-bf1a-e747a1a93ac6 req-42a870c4-1715-4065-908b-f7c55d49b769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "name": "network-vif-plugged", "status": "completed", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:53:42.248445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d135c666-2cf4-4d85-bf1a-e747a1a93ac6 req-42a870c4-1715-4065-908b-f7c55d49b769 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:42.248935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d135c666-2cf4-4d85-bf1a-e747a1a93ac6 req-42a870c4-1715-4065-908b-f7c55d49b769 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:42.249373 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-d135c666-2cf4-4d85-bf1a-e747a1a93ac6 req-42a870c4-1715-4065-908b-f7c55d49b769 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:42.262369 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-d135c666-2cf4-4d85-bf1a-e747a1a93ac6 req-42a870c4-1715-4065-908b-f7c55d49b769 service nova] Creating event network-vif-plugged:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:53:42.268272 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-d135c666-2cf4-4d85-bf1a-e747a1a93ac6 req-42a870c4-1715-4065-908b-f7c55d49b769 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111589 Oct 12 23:53:42.268878 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3833/7568] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:53:42.350447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:42.359142 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7640fc1-add6-438d-9703-d823df30af1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.180115 Oct 12 23:53:42.359793 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3736/7569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:42 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:43.384787 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:43.385598 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:43.393827 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:43.394334 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:43.394789 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:43.395501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:43.396009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:43.396445 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:43.546758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:43.557969 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f9208ea8-e94a-4a38-82e6-05c194aac45d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.178127 Oct 12 23:53:43.559367 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3834/7570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:43 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:44.582378 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:44.583738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:44.592763 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:44.593759 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:44.594430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:44.595440 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:44.595918 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:44.596976 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:44.749725 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:44.758855 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-75ffe21a-9124-4dd0-abd4-434b24c6b813 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.180424 Oct 12 23:53:44.759450 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3737/7571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:44 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:45.783615 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:45.784352 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:45.791488 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:45.792558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:45.793017 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:45.793776 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:45.794422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:45.795040 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:45.939591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:45.949103 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-467a7b03-304e-43e6-8982-e277cb345e53 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.169579 Oct 12 23:53:45.949692 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3835/7572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:45 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:46.973027 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:46.973581 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:46.980731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:46.981224 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:46.982292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:46.983003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:46.983465 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:46.986344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:47.167616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:47.178992 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-92108677-7f36-48d0-9f72-d59379260130 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.209935 Oct 12 23:53:47.179781 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3738/7573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:46 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:48.204045 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:48.204906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:48.212005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:48.212569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:48.213247 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:48.214180 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:48.214877 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:48.215390 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:48.373755 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:48.382251 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5ace50d6-2238-45a9-a63e-adbe75dbdbda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.183371 Oct 12 23:53:48.383165 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3836/7574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:48 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:49.407805 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:49.408604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:49.416630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:49.417385 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:49.417830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:49.418535 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:49.419037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:49.419496 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:49.581088 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:49.590003 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc979787-4a11-4acc-9e0a-e9139e86695c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.186072 Oct 12 23:53:49.590812 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3739/7575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:49 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:50.614633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:50.615269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:50.622301 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:50.622801 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:50.623253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:50.624027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:50.624491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:50.624915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:50.781115 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:50.789503 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d05e6ea-20a7-44bb-b350-e2f79064c95f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1695 microversion: 2.1 time: 0.178732 Oct 12 23:53:50.790075 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3837/7576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:50 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:51.813847 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:51.814492 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:51.821375 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:51.821927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:51.822373 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:51.823060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:51.823511 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:51.823966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:51.958781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:51.967622 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d141fc12-0ebf-4119-a28f-527d9a87b47f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1677 microversion: 2.1 time: 0.157729 Oct 12 23:53:51.968233 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3740/7577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:51 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:52.990764 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:52.991384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:52.998319 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:52.998808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:52.999246 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:52.999955 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:53.000417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:53.000850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:53.136969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:53.144731 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27608cd8-f419-41ae-b962-bfe820d44432 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1677 microversion: 2.1 time: 0.157895 Oct 12 23:53:53.145328 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3838/7578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:52 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:54.168490 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:54.169614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:54.176534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:54.177020 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:54.177457 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:54.178147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:54.178602 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:54.179030 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:54.319685 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:54.327544 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8321aefb-4299-4a12-8d0a-8edfe2005eda tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1680 microversion: 2.1 time: 0.163239 Oct 12 23:53:54.328203 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3741/7579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:54 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:54.350927 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:53:54.351559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:54.359083 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:54.359583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:54.360058 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:54.360761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:54.361225 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:54.361665 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:54.456315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 23:53:54.522976 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db6458f1-49eb-4c5d-ad39-1d0d05f21d67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d/action" status: 202 len: 0 microversion: 2.1 time: 0.175964 Oct 12 23:53:54.523589 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3839/7580] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:53:54 2022] POST /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:53:54.532383 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:54.533061 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:54.539276 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:54.539761 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:54.540253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:54.540954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:54.541410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:54.541832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:54.678067 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:54.685740 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-16c5098d-7803-498f-b4dc-f0b26106becb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1628 microversion: 2.1 time: 0.157911 Oct 12 23:53:54.686320 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3742/7581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:54 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1628 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:55.710321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:55.710857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:55.717510 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:55.718005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:55.718453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:55.719161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:55.719624 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:55.720092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:55.884773 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:55.893670 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-52b154eb-dd4a-4c8c-b7f5-51ba074d1a44 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.188248 Oct 12 23:53:55.894254 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3840/7582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:55 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:56.194916 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "name": "network-vif-unplugged", "status": "completed", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:53:56.208214 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:56.209172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:56.209612 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:56.221569 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] Creating event network-vif-unplugged:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:53:56.225566 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] [4d05e9f6-2793-438d-b46a-964641e06695] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:53:56.919947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:56.920871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:56.928168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:56.928667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:56.929117 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:56.929839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:56.930472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:56.930914 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:56.935323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:57.080535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:57.090857 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f146e06c-a93a-4b88-8d63-17795df05bca tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.176997 Oct 12 23:53:57.092511 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3841/7583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:56 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:57.233275 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] [4d05e9f6-2793-438d-b46a-964641e06695] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41496. Oct 12 23:53:57.237322 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7945fefd-83b9-44f7-9cdc-f16076c3dc39 req-dee77873-14dd-4b3d-8182-e8cd94e37ff6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.046706 Oct 12 23:53:57.237968 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3743/7584] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:53:58.114879 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:58.115509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:58.122592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:58.123098 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:58.123546 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:58.124297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:58.124759 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:58.125196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:58.274811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:58.283405 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-971ee72a-15d3-4cc3-8cbd-11fe073689b7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.172441 Oct 12 23:53:58.289670 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3842/7585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:58 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:53:59.308235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:53:59.309604 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:53:59.312879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=29 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:59.323687 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:59.324459 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:59.324913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:59.325859 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:53:59.326313 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:53:59.326841 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:53:59.330606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=81 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:53:59.473171 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:53:59.481268 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2825477-db7d-4ee4-bc87-f9e329c1422c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.178198 Oct 12 23:53:59.482596 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3744/7586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:53:59 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:54:00.506085 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:54:00.506807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:54:00.509371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:54:00.515721 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:00.516259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:00.516777 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:00.517507 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:00.517976 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:00.518417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:00.659500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:54:00.668921 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-63a32c16-0ceb-4079-9d0f-c9902975296a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.166779 Oct 12 23:54:00.669843 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3843/7587] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:54:00 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:54:01.693927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:54:01.694889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:54:01.702172 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:01.702739 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:01.703239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:01.704029 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:01.704547 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:01.705036 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:01.868508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:54:01.889173 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4d74316f-b3cd-475b-9df0-e75abcd69d97 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.199249 Oct 12 23:54:01.891787 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3745/7588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:54:01 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:54:02.913176 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:54:02.914701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:54:02.922860 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:02.923489 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:02.924057 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:02.924964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:02.925514 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:02.926053 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:03.074537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:54:03.084510 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00fdda9b-bfe6-48e7-ad02-8cca97d4ad05 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.174586 Oct 12 23:54:03.085194 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3844/7589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:54:02 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:54:04.108973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:54:04.109606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:54:04.116525 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:04.117011 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:04.117451 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:04.118143 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:04.118605 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:04.119037 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:04.250745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:54:04.258477 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ff1a0c21-bc67-4512-b66c-83a3f5296d5b tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.153471 Oct 12 23:54:04.259091 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3746/7590] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:54:04 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:54:05.282835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:54:05.283469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:54:05.290333 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:05.290831 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:05.291286 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:05.292313 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:05.293034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:05.293475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:05.428465 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:54:05.438717 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff5809ac-b6a6-407e-90cd-ade62f10edf6 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.160284 Oct 12 23:54:05.439546 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3845/7591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:54:05 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:54:06.463308 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:54:06.463954 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:54:06.470818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:06.471302 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:06.471738 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:06.472456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:06.472905 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:06.473329 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:06.948803 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:54:06.957640 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-811c87a7-4a34-40a4-bcf8-3fdce218bd86 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1686 microversion: 2.1 time: 0.498147 Oct 12 23:54:06.958214 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3747/7592] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:54:06 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1686 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:54:07.982203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:54:07.982828 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:54:07.989805 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:07.990290 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:07.990730 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:07.991417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:07.991874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:07.992327 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:08.128217 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:54:08.135946 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-16c4dd6c-23b8-486a-9172-8e3173993d4d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1673 microversion: 2.1 time: 0.158231 Oct 12 23:54:08.136526 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3846/7593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:54:07 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:54:08.321986 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-56d2e3aa-9e4a-4d49-8bf9-737307117c4d req-5ce44432-e570-4bb7-86cc-0638bb354da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "name": "network-vif-plugged", "status": "completed", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:54:08.332367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-56d2e3aa-9e4a-4d49-8bf9-737307117c4d req-5ce44432-e570-4bb7-86cc-0638bb354da6 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:54:08.332854 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-56d2e3aa-9e4a-4d49-8bf9-737307117c4d req-5ce44432-e570-4bb7-86cc-0638bb354da6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:54:08.333285 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-56d2e3aa-9e4a-4d49-8bf9-737307117c4d req-5ce44432-e570-4bb7-86cc-0638bb354da6 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:54:08.344531 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-56d2e3aa-9e4a-4d49-8bf9-737307117c4d req-5ce44432-e570-4bb7-86cc-0638bb354da6 service nova] Creating event network-vif-plugged:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:54:08.349398 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-56d2e3aa-9e4a-4d49-8bf9-737307117c4d req-5ce44432-e570-4bb7-86cc-0638bb354da6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 Oct 12 23:54:08.350171 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3748/7594] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:55:19.655943 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:19.657335 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=34 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:19.658150 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:55:19.658425 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d (ip 10.222.0.20) !!! Oct 12 23:55:19.662819 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=9 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:19.663382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:19.664080 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=25 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:19.664323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:19.665382 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:55:19.665511 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 12 23:55:19.672159 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:19.672880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:19.673555 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:19.674485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:19.675143 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:19.675779 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:19.675924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-53e7b084-a061-43cb-80bc-d518bbc54666 req-9880cf87-144a-4abd-9929-d379ae12ae5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:55:19.690676 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-53e7b084-a061-43cb-80bc-d518bbc54666 req-9880cf87-144a-4abd-9929-d379ae12ae5c service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:19.691161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-53e7b084-a061-43cb-80bc-d518bbc54666 req-9880cf87-144a-4abd-9929-d379ae12ae5c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:19.691653 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-53e7b084-a061-43cb-80bc-d518bbc54666 req-9880cf87-144a-4abd-9929-d379ae12ae5c service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:19.704519 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-53e7b084-a061-43cb-80bc-d518bbc54666 req-9880cf87-144a-4abd-9929-d379ae12ae5c service nova] Creating event network-changed:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:55:19.705744 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:55:19.709522 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-53e7b084-a061-43cb-80bc-d518bbc54666 req-9880cf87-144a-4abd-9929-d379ae12ae5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050782 Oct 12 23:55:19.710335 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3749/7595] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:55:19.794471 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e36833a8-b1f6-4e78-981f-6329ae73e513 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "DELETE /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 204 len: 0 microversion: 2.1 time: 0.140145 Oct 12 23:55:19.795472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3847/7596] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:55:19 2022] DELETE /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:55:19.804442 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:19.805437 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:19.811578 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:19.812147 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:19.812610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:19.813334 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:19.813787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:19.814424 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:20.020408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:20.028760 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2100a8d-cf91-4e9f-b23d-bb71dc8af526 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.228592 Oct 12 23:55:20.040500 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3750/7597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:19 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:21.054105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:21.054821 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:21.061812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:21.062925 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:21.063376 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:21.064110 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:21.064571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:21.064999 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:21.302661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:21.311323 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92815281-0c25-466e-83e3-7afd51823c0f tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 200 len: 1679 microversion: 2.1 time: 0.261516 Oct 12 23:55:21.322395 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3848/7598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:21 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 1679 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:21.617339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-57082195-5f81-4298-8134-fe5e2fa3066a req-3bce7204-e255-4e33-814b-b2ad783a09c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e38822-d800-442c-853d-b09fae9ac12d", "name": "network-vif-deleted", "tag": "148921a3-314b-47b9-a8c1-386739688a02"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:55:21.628445 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57082195-5f81-4298-8134-fe5e2fa3066a req-3bce7204-e255-4e33-814b-b2ad783a09c1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:21.628923 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57082195-5f81-4298-8134-fe5e2fa3066a req-3bce7204-e255-4e33-814b-b2ad783a09c1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:21.629360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-57082195-5f81-4298-8134-fe5e2fa3066a req-3bce7204-e255-4e33-814b-b2ad783a09c1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:21.645576 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-57082195-5f81-4298-8134-fe5e2fa3066a req-3bce7204-e255-4e33-814b-b2ad783a09c1 service nova] Creating event network-vif-deleted:148921a3-314b-47b9-a8c1-386739688a02 for instance 64e38822-d800-442c-853d-b09fae9ac12d on n-h1-860864-8 Oct 12 23:55:21.650626 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-57082195-5f81-4298-8134-fe5e2fa3066a req-3bce7204-e255-4e33-814b-b2ad783a09c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097789 Oct 12 23:55:21.651291 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3751/7599] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:55:22.335193 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:22.335742 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 64e38822-d800-442c-853d-b09fae9ac12d] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:22.342853 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:22.343359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:22.343815 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:22.344554 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:22.345033 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:22.345476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:22.359814 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] HTTP exception thrown: Instance 64e38822-d800-442c-853d-b09fae9ac12d could not be found. Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Request method failure captured: Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d HTTP/1.1 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR1LzN292udlFnVQtY6Qu7gAtTHNYm379ffhIvrEQ-PcKNM2RzJlKpenZlLjB0QP29nVLBDdKgdpSdA6k5_iKK2IGyKpXsuYedxoKhde5366PEenZ4cg6c8pJ4fDcWdi1En8wdwGWJ8JDkyLUOs1KdMB2pko2UkX2bn_GFnXvVZqcANk Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2d237819a0a84c9caa185fd737473863 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestShelveInstance-991000588 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d237819a0a84c9caa185fd737473863"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2d237819a0a84c9caa185fd737473863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2d237819a0a84c9caa185fd737473863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d237819a0a84c9caa185fd737473863"}]}] Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestShelveInstance-991000588 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2d237819a0a84c9caa185fd737473863 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestShelveInstance-991000588 Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestShelveInstance-991000588-project Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: ab235f289f784fed8e6ab35b996f7d9d Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestShelveInstance-991000588-project Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 64e38822-d800-442c-853d-b09fae9ac12d could not be found. Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '64e38822-d800-442c-853d-b09fae9ac12d'} Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e38822-d800-442c-853d-b09fae9ac12d could not be found. Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e38822-d800-442c-853d-b09fae9ac12d could not be found. Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:55:22.361533 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e38822-d800-442c-853d-b09fae9ac12d could not be found. Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Returning 404 to user: Instance 64e38822-d800-442c-853d-b09fae9ac12d could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b4fe6d6-71f6-4e37-899a-6038632eaae3 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d" status: 404 len: 111 microversion: 2.1 time: 0.031852 Oct 12 23:55:22.367416 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3849/7600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:22 2022] GET /compute/v2.1/servers/64e38822-d800-442c-853d-b09fae9ac12d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:55:22.525426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03f04ee5-f970-4803-8bec-4ca3b64e14ea tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '.version_select at 0x7f44fec62f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:22.549611 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03f04ee5-f970-4803-8bec-4ca3b64e14ea tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-28904749" status: 202 len: 0 microversion: 2.1 time: 0.028451 Oct 12 23:55:22.550206 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3752/7601] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 12 23:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-28904749 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:55:22.567969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-76bab42f-9c83-4185-a6bf-1ef3d782501a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'create', calling method: .version_select at 0x7f44ff476b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1861991885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAehkdDtkqRGwciv/obXgi6Bn5klkik2/8uffLzBOCcvkkxP3V757jqWBUwsk8EIC0a/ZlNRB0tQQ9BJ1haK47qKpdCMUaQa65FVbjuMqAaloOzclZoK0eT0TL9AzhbaIg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:55:22.584990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-76bab42f-9c83-4185-a6bf-1ef3d782501a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for project 2d237819a0a84c9caa185fd737473863. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:55:22.595197 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-76bab42f-9c83-4185-a6bf-1ef3d782501a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for user ab235f289f784fed8e6ab35b996f7d9d and project 2d237819a0a84c9caa185fd737473863. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:55:22.620102 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-76bab42f-9c83-4185-a6bf-1ef3d782501a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.056577 Oct 12 23:55:22.620700 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3850/7602] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 12 23:55:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:55:38.787839 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:38.788625 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:38.792546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-451147109", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1861991885", "security_groups": [{"name": "tempest-secgroup-smoke-1255530546"}], "networks": [{"uuid": "97396223-0e53-4a64-9efb-c88f196e1d99"}], "block_device_mapping_v2": [{"uuid": "703a4b35-c566-4704-a44f-da9de91fe00e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:55:38.909108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] validate_networks() for [('97396223-0e53-4a64-9efb-c88f196e1d99', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 23:55:39.280965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 23:55:39.281391 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 23:55:39.281870 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 23:55:39.282277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 23:55:39.283195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 23:55:39.291958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:39.292441 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:39.292873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:39.293837 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:39.294294 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:39.294718 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:39.311650 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for project 2d237819a0a84c9caa185fd737473863. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 23:55:39.317236 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Getting quotas for user ab235f289f784fed8e6ab35b996f7d9d and project 2d237819a0a84c9caa185fd737473863. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 23:55:39.374264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 23:55:39.377198 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='703a4b35-c566-4704-a44f-da9de91fe00e',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 23:55:39.502352 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5dde7865-da77-4313-a97d-e91fe67d3574 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716112 Oct 12 23:55:39.503055 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3753/7603] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 12 23:55:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 23:55:39.512548 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:39.513732 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:39.514347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:39.518521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7abc5bdb-fddc-49b0-bc4f-a96a99f2a01d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:39.519382 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7abc5bdb-fddc-49b0-bc4f-a96a99f2a01d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:39.580521 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7abc5bdb-fddc-49b0-bc4f-a96a99f2a01d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:39.587460 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7abc5bdb-fddc-49b0-bc4f-a96a99f2a01d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1088 microversion: 2.1 time: 0.076863 Oct 12 23:55:39.588076 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3851/7604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:39 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:40.611993 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:40.612649 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:40.620452 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:40.620949 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:40.621664 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:40.622569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:40.623034 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:40.623466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:40.704032 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:40.713963 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-864a59eb-5853-46ef-bb24-373420b6c44d tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1204 microversion: 2.1 time: 0.107088 Oct 12 23:55:40.714554 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3754/7605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:40 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1204 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 23:55:41.738966 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:41.741667 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:41.748757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:41.749369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:41.749963 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:41.750782 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:41.751425 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:41.752021 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:41.957880 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:41.966587 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f479bdb8-37fd-4128-a1d4-b68f443a0206 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1272 microversion: 2.1 time: 0.232243 Oct 12 23:55:41.967558 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3852/7606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:41 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:41.994476 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a28f32da-e814-4294-ac19-2fb61918ad85 req-5416900f-4639-47f3-81c6-112fb335a846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:55:42.011081 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a28f32da-e814-4294-ac19-2fb61918ad85 req-5416900f-4639-47f3-81c6-112fb335a846 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:42.011569 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a28f32da-e814-4294-ac19-2fb61918ad85 req-5416900f-4639-47f3-81c6-112fb335a846 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:42.012101 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a28f32da-e814-4294-ac19-2fb61918ad85 req-5416900f-4639-47f3-81c6-112fb335a846 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:42.025892 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a28f32da-e814-4294-ac19-2fb61918ad85 req-5416900f-4639-47f3-81c6-112fb335a846 service nova] Creating event network-changed:485b0f19-d809-4150-920f-b67996452ad8 for instance 7c6401cc-7405-432c-8397-a4e117b45fba on n-h2-860864-8 Oct 12 23:55:42.031763 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a28f32da-e814-4294-ac19-2fb61918ad85 req-5416900f-4639-47f3-81c6-112fb335a846 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040447 Oct 12 23:55:42.032925 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3755/7607] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:55:42.992041 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:42.992761 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:42.999657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:43.000320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:43.000871 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:43.002309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:43.002849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:43.003359 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:43.214906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:43.223009 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5af6540a-08b1-458d-9b69-f66b367f81f2 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1272 microversion: 2.1 time: 0.234956 Oct 12 23:55:43.223672 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3853/7608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:42 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:44.246704 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:44.247325 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:44.254179 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:44.254668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:44.255105 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:44.255798 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:44.256277 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:44.256699 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:44.391367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:44.399815 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78bcd8bd-b6ea-4446-9d81-3ccb833e2f57 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1272 microversion: 2.1 time: 0.158184 Oct 12 23:55:44.400441 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3756/7609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:44 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:45.423997 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:45.424644 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:45.431926 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:45.432478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:45.432991 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:45.433818 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:45.434383 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:45.434920 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:45.570184 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:45.578018 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-186dc81e-c7b8-4e72-9fab-95e0b44c7da4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1272 microversion: 2.1 time: 0.159387 Oct 12 23:55:45.578586 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3854/7610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:45 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:46.601087 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:46.601698 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:46.608456 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:46.608935 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:46.609368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:46.610057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:46.611019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:46.611444 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:46.743646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:46.751309 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b2ee6be-5316-4400-a327-8a9a873c46bb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.154135 Oct 12 23:55:46.751874 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3757/7611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:46 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:47.774189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:47.774851 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:47.782298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:47.782792 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:47.783236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:47.783968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:47.784435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:47.784867 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:47.920321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:47.928135 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e584a08-187c-42af-878d-39f296bac64e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.157909 Oct 12 23:55:47.928937 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3855/7612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:47 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:48.950614 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:48.951228 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:48.958118 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:48.958597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:48.959035 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:48.959719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:48.960193 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:48.960616 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:49.091071 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:49.099192 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eb8aa064-7e71-44ea-91f0-bc2fee98da67 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.152538 Oct 12 23:55:49.099765 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3758/7613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:48 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:50.122250 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:50.122915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:50.125695 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:50.133161 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:50.133696 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:50.134149 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:50.134854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:50.135321 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:50.135760 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:50.264440 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:50.272090 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ae52dc84-9ff7-405c-865a-30df2ecefc77 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.153750 Oct 12 23:55:50.272669 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3856/7614] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:50 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:51.295292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:51.295966 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:51.298038 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:51.298773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:55:51.305390 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:51.305877 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:51.306335 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:51.307015 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:51.307471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:51.307946 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:51.439998 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:51.447771 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79eb9203-c435-4a6a-87f9-36f869333802 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.156688 Oct 12 23:55:51.448386 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3759/7615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:51 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:52.471913 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:52.472515 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:52.479312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:52.479795 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:52.480270 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:52.480959 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:52.481420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:52.481847 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:52.621439 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:52.629209 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ffc2768-d938-44b8-90ef-df679b5341e0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.161922 Oct 12 23:55:52.629790 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3857/7616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:52 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:53.652402 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:53.653138 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:53.660475 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:53.660965 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:53.661678 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:53.662381 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:53.662838 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:53.663268 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:53.799352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:53.807048 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0b36112-c256-487b-a37c-4e359105f289 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.158569 Oct 12 23:55:53.807632 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3760/7617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:53 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:54.829747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:54.830369 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:54.837011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:54.837498 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:54.837941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:54.838630 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:54.839087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:54.839518 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:54.968763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:54.976509 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00292834-04d9-49c2-9e01-5fa9bbefcfd7 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.151174 Oct 12 23:55:54.977121 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3858/7618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:54 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:55.815328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-cc6dee11-1138-4361-a8b6-24c3c61d80f3 req-05232058-f6b2-45f6-b596-269490c62773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "name": "network-vif-plugged", "status": "completed", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:55:55.826117 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cc6dee11-1138-4361-a8b6-24c3c61d80f3 req-05232058-f6b2-45f6-b596-269490c62773 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:55.826599 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cc6dee11-1138-4361-a8b6-24c3c61d80f3 req-05232058-f6b2-45f6-b596-269490c62773 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:55.827042 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-cc6dee11-1138-4361-a8b6-24c3c61d80f3 req-05232058-f6b2-45f6-b596-269490c62773 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:55.838430 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-cc6dee11-1138-4361-a8b6-24c3c61d80f3 req-05232058-f6b2-45f6-b596-269490c62773 service nova] Creating event network-vif-plugged:485b0f19-d809-4150-920f-b67996452ad8 for instance 7c6401cc-7405-432c-8397-a4e117b45fba on n-h2-860864-8 Oct 12 23:55:55.843578 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-cc6dee11-1138-4361-a8b6-24c3c61d80f3 req-05232058-f6b2-45f6-b596-269490c62773 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032087 Oct 12 23:55:55.844341 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3761/7619] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:55:55.999079 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:55.999704 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:56.006476 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:56.006960 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:56.007403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:56.008119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:56.008577 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:56.009007 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:56.138323 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:56.146270 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e64dd372-7a4e-414e-b3de-4a198d794566 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1260 microversion: 2.1 time: 0.151091 Oct 12 23:55:56.146859 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3859/7620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:55 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:57.170638 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:57.171332 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:57.177553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:57.178045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:57.178499 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:57.179176 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:57.179627 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:57.180096 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:57.308262 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:57.316670 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc90400d-368e-4a3a-99ea-03094edbb6d9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1445 microversion: 2.1 time: 0.151493 Oct 12 23:55:57.317320 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3762/7621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:57 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:57.338944 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:55:57.339569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:55:57.346345 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:57.346836 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:57.347275 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:57.348016 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:57.348478 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:57.348908 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:57.527297 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:55:57.535042 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2680e764-946b-4b98-aed1-827794d3490c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1445 microversion: 2.1 time: 0.199996 Oct 12 23:55:57.535613 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3860/7622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:55:57 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1445 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:55:59.105902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2bace435-4cdc-4d13-bcc2-f5397bb0d235 req-26780dd2-8f2a-4b01-b728-78db05b587d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:55:59.116543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2bace435-4cdc-4d13-bcc2-f5397bb0d235 req-26780dd2-8f2a-4b01-b728-78db05b587d5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:55:59.118624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2bace435-4cdc-4d13-bcc2-f5397bb0d235 req-26780dd2-8f2a-4b01-b728-78db05b587d5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:55:59.118624 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2bace435-4cdc-4d13-bcc2-f5397bb0d235 req-26780dd2-8f2a-4b01-b728-78db05b587d5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:55:59.129561 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2bace435-4cdc-4d13-bcc2-f5397bb0d235 req-26780dd2-8f2a-4b01-b728-78db05b587d5 service nova] Creating event network-changed:485b0f19-d809-4150-920f-b67996452ad8 for instance 7c6401cc-7405-432c-8397-a4e117b45fba on n-h2-860864-8 Oct 12 23:55:59.134572 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2bace435-4cdc-4d13-bcc2-f5397bb0d235 req-26780dd2-8f2a-4b01-b728-78db05b587d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032399 Oct 12 23:55:59.135368 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3763/7623] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:57:54.364486 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:57:54.365544 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=22 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:57:54.366291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=54 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:57:54.367116 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:57:54.367298 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba/action (ip 10.222.0.20) !!! Oct 12 23:57:54.369039 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 23:57:54.369220 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba/action (ip 10.222.0.20) !!! Oct 12 23:57:54.425194 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:57:54.425745 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:57:54.431661 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:54.432187 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:54.432640 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:54.433371 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:54.433835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:54.434266 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:54.457199 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lazy-loading 'flavor' on Instance uuid 7c6401cc-7405-432c-8397-a4e117b45fba {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 23:57:54.528575 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4eb2847-a15f-47a1-886f-336de177a449 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba/action" status: 202 len: 0 microversion: 2.1 time: 0.165646 Oct 12 23:57:54.529364 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3861/7624] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:57:54 2022] POST /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:57:54.535847 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:57:54.536800 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 23:57:54.537470 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:57:54.538310 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=50 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:57:54.545280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:57:54.546075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:57:54.554873 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:54.555377 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:54.555846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:54.556562 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:54.557024 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:54.557454 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:54.695215 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:57:54.704295 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f57e85cf-9ab8-48cb-86ad-616c881e5d42 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.170216 Oct 12 23:57:54.705132 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3764/7625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:57:54 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:57:55.731015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:57:55.731785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:57:55.734800 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3e96063-e855-4765-b1eb-7b495cad42c1] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 23:57:55.742499 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:55.743002 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:55.743485 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:55.744241 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:55.744735 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:55.745173 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:55.750070 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41862. Oct 12 23:57:55.881715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:57:55.889630 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1baebfcf-6087-4f01-a704-484ab8ff241c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.162930 Oct 12 23:57:55.890202 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3862/7626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:57:55 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:57:56.912733 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:57:56.913346 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:57:56.925824 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41866. Oct 12 23:57:56.932412 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:56.932889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:56.933322 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:56.934004 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:56.934453 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:56.934869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:56.940917 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41868. Oct 12 23:57:57.068331 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:57:57.077032 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-eddc50f5-aec2-4664-a9d0-ddfa00f7ba99 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.168434 Oct 12 23:57:57.077724 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3765/7627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:57:56 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:57:58.100259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:57:58.100896 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:57:58.109552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:58.110050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:58.110504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:58.111216 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:58.111689 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:58.112160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:58.118303 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3e96063-e855-4765-b1eb-7b495cad42c1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41872. Oct 12 23:57:58.244224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:57:58.252739 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3aa93b0-c06d-4b47-8414-89058d5eca0e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.156496 Oct 12 23:57:58.253320 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3863/7628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:57:58 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:57:59.276051 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:57:59.276586 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:57:59.283997 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:59.284478 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:59.284907 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:59.285593 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:57:59.286039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:57:59.286455 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:57:59.417221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:57:59.426984 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-53ee7706-41ff-4341-967f-33a0319cfd1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.154954 Oct 12 23:57:59.427570 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3766/7629] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:57:59 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:00.450311 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:00.450969 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:00.457859 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:00.458351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:00.458800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:00.459502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:00.460005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:00.460448 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:00.595716 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:00.603541 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-006d77d9-97c7-4d93-aedf-9cc4facb14fc tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.157179 Oct 12 23:58:00.604145 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3864/7630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:00 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:01.627349 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:01.628025 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:01.634879 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:01.635364 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:01.635823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:01.636516 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:01.636973 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:01.637398 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:01.772643 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:01.780594 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9697244e-005c-4f6c-89eb-93274bdb42f4 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.157180 Oct 12 23:58:01.781160 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3767/7631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:01 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:02.804490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:02.805120 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:02.812774 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:02.813262 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:02.813703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:02.814396 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:02.814854 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:02.815309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:02.947312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:02.955341 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4db57553-d0bf-47bd-91d1-894486b11e6a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.154745 Oct 12 23:58:02.955975 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3865/7632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:02 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:03.979005 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:03.979550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:03.986869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:03.987350 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:03.987786 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:03.988505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:03.988961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:03.989387 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:04.119405 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:04.127791 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-106988e0-8c42-43bb-a753-4cd04d9735c0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.152775 Oct 12 23:58:04.128395 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3768/7633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:03 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:05.150655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:05.151309 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:05.158833 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:05.159324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:05.159766 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:05.160535 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:05.160993 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:05.161424 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:05.303962 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:05.311863 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-faabadde-a3bd-4554-b7dd-e9bb657b13d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.165184 Oct 12 23:58:05.312472 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3866/7634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:05 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:06.334721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:06.335287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:06.342230 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:06.342711 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:06.343157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:06.343846 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:06.344323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:06.344747 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:06.478253 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:06.486503 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1308f27-e824-4c55-b8f4-16d478970f50 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.155830 Oct 12 23:58:06.487079 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3769/7635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:06 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:07.515642 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:07.516608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:07.523693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:07.524226 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:07.524673 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:07.525381 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:07.525840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:07.526269 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:07.657069 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:07.664992 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-746f8064-24f0-452f-92bb-892b0e2adfc0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.159359 Oct 12 23:58:07.665567 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3867/7636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:07 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:08.689169 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:08.689781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:08.697107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:08.697584 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:08.698192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:08.698731 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:08.699186 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:08.699606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:08.833550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:08.841940 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24cd57a6-e2ec-4d80-95a3-cae2e162c505 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1570 microversion: 2.1 time: 0.156815 Oct 12 23:58:08.842514 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3770/7637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:08 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:08.864663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:58:08.865268 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:08.872687 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:08.873214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:08.873663 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:08.874366 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:08.874835 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:08.875271 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:08.903421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 23:58:08.969501 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e4fd1784-4cd2-480f-93f5-cb9d3d222503 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "POST /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba/action" status: 202 len: 0 microversion: 2.1 time: 0.108555 Oct 12 23:58:08.970030 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3868/7638] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 12 23:58:08 2022] POST /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 23:58:08.978352 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:08.978971 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:08.985674 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:08.986161 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:08.986595 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:08.987280 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:08.987727 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:08.988550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:09.127787 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:09.135856 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f4ec647-9f27-4e9d-860b-b4b70eda743a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1518 microversion: 2.1 time: 0.161357 Oct 12 23:58:09.136545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3771/7639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:08 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:10.159729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:10.160567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:10.166973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:10.167471 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:10.167930 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:10.168639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:10.169588 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:10.170456 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:10.312294 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:10.321444 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7db6d603-c1e7-4c81-b595-958b8a8a7f1c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1520 microversion: 2.1 time: 0.166108 Oct 12 23:58:10.322801 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3869/7640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:10 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:10.416430 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a2565a29-a25c-47a3-8af8-891b4047e53b req-f3c5a6a2-98a8-49bb-a6a5-c1931bd281b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "name": "network-vif-unplugged", "status": "completed", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:58:10.435816 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a2565a29-a25c-47a3-8af8-891b4047e53b req-f3c5a6a2-98a8-49bb-a6a5-c1931bd281b0 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:10.436804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a2565a29-a25c-47a3-8af8-891b4047e53b req-f3c5a6a2-98a8-49bb-a6a5-c1931bd281b0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:10.437520 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a2565a29-a25c-47a3-8af8-891b4047e53b req-f3c5a6a2-98a8-49bb-a6a5-c1931bd281b0 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:10.457003 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.compute.server_external_events [req-a2565a29-a25c-47a3-8af8-891b4047e53b req-f3c5a6a2-98a8-49bb-a6a5-c1931bd281b0 service nova] Unable to find a host for instance 7c6401cc-7405-432c-8397-a4e117b45fba. Dropping event network-vif-unplugged {{(pid=120543) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 23:58:10.458305 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a2565a29-a25c-47a3-8af8-891b4047e53b req-f3c5a6a2-98a8-49bb-a6a5-c1931bd281b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047055 Oct 12 23:58:10.459742 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3772/7641] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 23:58:11.346152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:11.346813 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:11.354152 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:11.354653 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:11.355103 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:11.355808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:11.356304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:11.357415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:11.499481 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:11.508558 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e24e449b-cf15-4dbd-96c5-37598004b48e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1520 microversion: 2.1 time: 0.166107 Oct 12 23:58:11.509221 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3870/7642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:11 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:12.534635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:12.535264 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:12.542503 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:12.542904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:12.543374 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:12.544622 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:12.545326 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:12.545742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:12.680719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:12.688548 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e40907d8-4267-4c9c-83c5-3ddb14bbf702 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1520 microversion: 2.1 time: 0.157950 Oct 12 23:58:12.689127 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3773/7643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:12 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:13.712163 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:13.712798 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:13.720364 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:13.720866 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:13.721320 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:13.722025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:13.722491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:13.722928 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:13.856968 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:13.864865 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-35b8c278-2855-49da-95ba-f05282fff548 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1520 microversion: 2.1 time: 0.156701 Oct 12 23:58:13.865450 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3871/7644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:13 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:14.888449 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:14.889750 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:14.896745 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:14.897231 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:14.897671 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:14.898369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:14.898828 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:14.899292 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:15.110927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:15.119054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60f4f185-dcfa-4e58-a97b-60e817fa1502 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.235122 Oct 12 23:58:15.119634 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3774/7645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:14 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:15.588505 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7083c4c8-e855-42dc-a4d5-773b1859f845 req-cc33d789-2546-4b6a-b84a-e1869e02068b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:58:15.609087 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7083c4c8-e855-42dc-a4d5-773b1859f845 req-cc33d789-2546-4b6a-b84a-e1869e02068b service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:15.609593 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7083c4c8-e855-42dc-a4d5-773b1859f845 req-cc33d789-2546-4b6a-b84a-e1869e02068b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:15.610042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7083c4c8-e855-42dc-a4d5-773b1859f845 req-cc33d789-2546-4b6a-b84a-e1869e02068b service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:15.621409 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7083c4c8-e855-42dc-a4d5-773b1859f845 req-cc33d789-2546-4b6a-b84a-e1869e02068b service nova] Creating event network-changed:485b0f19-d809-4150-920f-b67996452ad8 for instance 7c6401cc-7405-432c-8397-a4e117b45fba on n-h1-860864-8 Oct 12 23:58:15.626644 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7083c4c8-e855-42dc-a4d5-773b1859f845 req-cc33d789-2546-4b6a-b84a-e1869e02068b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041877 Oct 12 23:58:15.627253 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3872/7646] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:58:16.143166 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:16.143781 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:16.150690 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:16.151168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:16.151606 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:16.152323 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:16.152774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:16.153192 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:16.282952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:16.290736 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0f39c0dd-68b9-4190-bf02-83af69eecbd9 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.151531 Oct 12 23:58:16.291308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3775/7647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:16 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:17.314822 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:17.315569 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:17.322559 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:17.323052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:17.323501 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:17.324228 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:17.324693 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:17.325128 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:17.453671 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:17.461588 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23aa2883-5ae7-4f29-a228-f9553640fd28 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.150992 Oct 12 23:58:17.462170 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3873/7648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:17 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:18.485431 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:18.486057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:18.493019 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:18.493504 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:18.493950 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:18.494641 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:18.495103 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:18.495527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:18.628261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:18.636054 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-570b7989-82d5-47c9-9c90-8e2dec349e41 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.154659 Oct 12 23:58:18.636645 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3776/7649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:18 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:19.659807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:19.660400 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:19.667324 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:19.667817 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:19.668300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:19.669001 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:19.669469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:19.669907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:19.804296 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:19.812782 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8d218f34-ac97-42c4-9135-cb84f5d39850 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.157015 Oct 12 23:58:19.813367 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3874/7650] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:19 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:20.835832 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:20.836466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:20.843856 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:20.844360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:20.844792 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:20.845469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:20.845912 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:20.846328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:20.975291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:20.983769 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-482b086e-f46b-4ad9-a851-fe2057ef606c tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.151862 Oct 12 23:58:20.984377 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3777/7651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:20 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:22.006807 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:22.007435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:22.014893 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:22.015393 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:22.015839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:22.016558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:22.017026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:22.017461 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:22.021635 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:58:22.149259 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:22.157873 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71e8af7b-defe-41e1-9bbf-93f185c43684 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.154958 Oct 12 23:58:22.158451 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3875/7652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:22 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:23.181666 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:23.182287 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:23.189164 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:23.189656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:23.190095 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:23.190785 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:23.191240 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:23.191667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:23.320975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:23.328651 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bd64429b-81d0-4a33-92f1-dba7d8e124ec tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.151026 Oct 12 23:58:23.329238 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3778/7653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:23 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:24.352703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:24.353261 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:24.360583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:24.361066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:24.361503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:24.362189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:24.362646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:24.363074 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:24.494462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:24.502867 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9f13fe03-2c47-41d8-9ece-ee4f5a3caca5 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.154162 Oct 12 23:58:24.503446 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3876/7654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:24 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:25.525901 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:25.526439 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:25.529133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=31 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:58:25.534501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:25.534977 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:25.535408 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:25.536126 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:25.536589 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:25.537000 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:25.539497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=87 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:58:25.672333 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:25.680190 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-468a2272-62af-4c95-905e-6856d3f2010a tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.158287 Oct 12 23:58:25.680767 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3779/7655] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:25 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:26.704611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:26.704611 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:26.707095 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:58:26.712558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:26.713288 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:26.713778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:26.714702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:26.715177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:26.715722 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:26.851657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:26.860391 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f408692-ac92-4886-a617-33f37afe9609 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.160608 Oct 12 23:58:26.860977 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3877/7656] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:26 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:27.426133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-10a59a09-aa69-450b-a515-9dde161e440b req-aa0f26e5-22cb-4686-b48e-f488168a3770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "name": "network-vif-plugged", "status": "completed", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:58:27.435721 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-10a59a09-aa69-450b-a515-9dde161e440b req-aa0f26e5-22cb-4686-b48e-f488168a3770 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:27.436243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-10a59a09-aa69-450b-a515-9dde161e440b req-aa0f26e5-22cb-4686-b48e-f488168a3770 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:27.436675 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-10a59a09-aa69-450b-a515-9dde161e440b req-aa0f26e5-22cb-4686-b48e-f488168a3770 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:27.447864 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-10a59a09-aa69-450b-a515-9dde161e440b req-aa0f26e5-22cb-4686-b48e-f488168a3770 service nova] Creating event network-vif-plugged:485b0f19-d809-4150-920f-b67996452ad8 for instance 7c6401cc-7405-432c-8397-a4e117b45fba on n-h1-860864-8 Oct 12 23:58:27.453567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-10a59a09-aa69-450b-a515-9dde161e440b req-aa0f26e5-22cb-4686-b48e-f488168a3770 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031438 Oct 12 23:58:27.454167 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3780/7657] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:58:27.883444 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:27.884107 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:27.890907 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:27.891394 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:27.891839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:27.892550 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:27.893011 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:27.893438 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:28.021258 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:28.029624 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-159c8898-4677-4dc1-bdf9-c1740eb15138 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1576 microversion: 2.1 time: 0.150120 Oct 12 23:58:28.030189 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3878/7658] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:27 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:58:29.053760 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:58:29.054433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:58:29.061160 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:29.061646 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:29.062085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:29.062773 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:58:29.063227 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:58:29.063656 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:58:29.196257 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:58:29.204113 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23a2d5aa-4789-43f4-9ba2-d669a6ed43d1 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1563 microversion: 2.1 time: 0.155637 Oct 12 23:58:29.204695 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3781/7659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:58:29 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:59:45.791075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:59:45.791822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=13 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:59:45.793185 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:59:45.794114 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=22 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 23:59:45.795564 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:59:45.796006 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 12 23:59:45.798150 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:59:45.798288 n-d-860864-8 devstack@n-api.service[120542]: Wed Oct 12 23:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba (ip 10.222.0.20) !!! Oct 12 23:59:45.799356 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 23:59:45.799639 n-d-860864-8 devstack@n-api.service[120543]: Wed Oct 12 23:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 12 23:59:45.811549 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:45.812052 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:45.822422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:45.822558 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:45.822947 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:45.823655 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:45.824148 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:45.824584 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:45.854441 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 23:59:45.880434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8b179a05-ab32-4bb8-800a-d176fd563015 req-185a678b-7b26-4889-be22-c69541d9a983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:59:45.890047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8b179a05-ab32-4bb8-800a-d176fd563015 req-185a678b-7b26-4889-be22-c69541d9a983 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:45.890443 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8b179a05-ab32-4bb8-800a-d176fd563015 req-185a678b-7b26-4889-be22-c69541d9a983 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:45.891077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8b179a05-ab32-4bb8-800a-d176fd563015 req-185a678b-7b26-4889-be22-c69541d9a983 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:45.903721 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8b179a05-ab32-4bb8-800a-d176fd563015 req-185a678b-7b26-4889-be22-c69541d9a983 service nova] Creating event network-changed:485b0f19-d809-4150-920f-b67996452ad8 for instance 7c6401cc-7405-432c-8397-a4e117b45fba on n-h1-860864-8 Oct 12 23:59:45.909639 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8b179a05-ab32-4bb8-800a-d176fd563015 req-185a678b-7b26-4889-be22-c69541d9a983 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120229 Oct 12 23:59:45.910545 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3782/7660] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 23:59:45.951237 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85444cfa-9f99-4135-b24a-44323fc1d2d0 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 204 len: 0 microversion: 2.1 time: 0.165398 Oct 12 23:59:45.954979 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3879/7661] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 12 23:59:45 2022] DELETE /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 23:59:45.962357 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:45.963195 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:45.969663 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:45.970433 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:45.971293 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:45.971982 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:45.972508 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:45.972994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:46.111122 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:59:46.119189 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc46b33a-2e35-4a59-ace3-ced60cf1db62 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.161989 Oct 12 23:59:46.119866 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3783/7662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:59:45 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:59:47.143137 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:47.143852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:47.150820 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:47.151307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:47.151781 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:47.152513 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:47.152981 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:47.153412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:47.296718 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:59:47.305258 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1cef96ec-b01e-4da3-a767-5967b5347ca8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1569 microversion: 2.1 time: 0.166252 Oct 12 23:59:47.306043 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3880/7663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:59:47 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:59:48.101426 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e8ecedd7-2454-4c4b-befd-18ac969ad205 req-3756212c-93f0-44c9-8256-f93b82c74bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6401cc-7405-432c-8397-a4e117b45fba", "name": "network-vif-deleted", "tag": "485b0f19-d809-4150-920f-b67996452ad8"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 23:59:48.114076 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e8ecedd7-2454-4c4b-befd-18ac969ad205 req-3756212c-93f0-44c9-8256-f93b82c74bc5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:48.115039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e8ecedd7-2454-4c4b-befd-18ac969ad205 req-3756212c-93f0-44c9-8256-f93b82c74bc5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:48.115471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e8ecedd7-2454-4c4b-befd-18ac969ad205 req-3756212c-93f0-44c9-8256-f93b82c74bc5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:48.126961 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e8ecedd7-2454-4c4b-befd-18ac969ad205 req-3756212c-93f0-44c9-8256-f93b82c74bc5 service nova] Creating event network-vif-deleted:485b0f19-d809-4150-920f-b67996452ad8 for instance 7c6401cc-7405-432c-8397-a4e117b45fba on n-h1-860864-8 Oct 12 23:59:48.132800 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e8ecedd7-2454-4c4b-befd-18ac969ad205 req-3756212c-93f0-44c9-8256-f93b82c74bc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035533 Oct 12 23:59:48.133604 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3784/7664] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 12 23:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 23:59:48.329157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:48.329701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:48.336662 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:48.337142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:48.337592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:48.338300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:48.338762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:48.339203 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:48.408503 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:59:48.417349 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-18c2e844-a953-4825-9898-65d34a94b7f8 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1219 microversion: 2.1 time: 0.092278 Oct 12 23:59:48.418413 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3881/7665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:59:48 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:59:49.442843 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:49.443546 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:49.449744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:49.450223 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:49.450659 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:49.451353 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:49.451793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:49.452239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:49.514107 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:59:49.522536 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-26e0a663-9d26-4099-b935-b7325fe7999e tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1219 microversion: 2.1 time: 0.084889 Oct 12 23:59:49.523102 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3785/7666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:59:49 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:59:50.546312 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:50.546941 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:50.553995 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:50.554490 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:50.554932 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:50.555639 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:50.556142 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:50.556576 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:50.621316 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:59:50.629268 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-96ecc1f3-e00a-4def-885b-b53700ec2cbb tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1219 microversion: 2.1 time: 0.087177 Oct 12 23:59:50.629850 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3882/7667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:59:50 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:59:51.653913 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:51.654550 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:51.662047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:51.662543 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:51.662988 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:51.663818 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:51.664372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:51.664800 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:51.730021 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab235f289f784fed8e6ab35b996f7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d237819a0a84c9caa185fd737473863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 23:59:51.737874 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8d729953-be5c-43f5-9f42-ad1fe83b35ab tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 200 len: 1219 microversion: 2.1 time: 0.088808 Oct 12 23:59:51.738457 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3786/7668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:59:51 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 23:59:52.761434 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:52.761982 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] [instance: 7c6401cc-7405-432c-8397-a4e117b45fba] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 23:59:52.770189 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:52.770829 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:52.771770 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:52.772537 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 23:59:52.773006 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 23:59:52.773443 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 23:59:52.787243 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] HTTP exception thrown: Instance 7c6401cc-7405-432c-8397-a4e117b45fba could not be found. Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Request method failure captured: Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba HTTP/1.1 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: Accept: application/json Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: Accept-Encoding: identity Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: Connection: close Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: Content-Length: 0 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: Content-Type: application/json Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: Host: 10.222.0.20 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: Openstack-System-Scope: None Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.12 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjR1LzN292udlFnVQtY6Qu7gAtTHNYm379ffhIvrEQ-PcKNM2RzJlKpenZlLjB0QP29nVLBDdKgdpSdA6k5_iKK2IGyKpXsuYedxoKhde5366PEenZ4cg6c8pJ4fDcWdi1En8wdwGWJ8JDkyLUOs1KdMB2pko2UkX2bn_GFnXvVZqcANk Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Id: None Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Domain-Name: None Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Identity-Status: Confirmed Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Is-Admin-Project: True Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Id: default Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Domain-Name: Default Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Id: 2d237819a0a84c9caa185fd737473863 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Project-Name: tempest-TestShelveInstance-991000588 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Role: reader,member Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Roles: reader,member Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d237819a0a84c9caa185fd737473863"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2d237819a0a84c9caa185fd737473863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2d237819a0a84c9caa185fd737473863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d237819a0a84c9caa185fd737473863"}]}] Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant: tempest-TestShelveInstance-991000588 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Id: 2d237819a0a84c9caa185fd737473863 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestShelveInstance-991000588 Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-User: tempest-TestShelveInstance-991000588-project Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Id: default Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Domain-Name: Default Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Id: ab235f289f784fed8e6ab35b996f7d9d Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: X-User-Name: tempest-TestShelveInstance-991000588-project Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: method: > Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: exception: Instance 7c6401cc-7405-432c-8397-a4e117b45fba could not be found. Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: action_args: {'id': '7c6401cc-7405-432c-8397-a4e117b45fba'} Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6401cc-7405-432c-8397-a4e117b45fba could not be found. Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6401cc-7405-432c-8397-a4e117b45fba could not be found. Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 23:59:52.789627 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6401cc-7405-432c-8397-a4e117b45fba could not be found. Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Returning 404 to user: Instance 7c6401cc-7405-432c-8397-a4e117b45fba could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ec5f59c-ca8a-4c1a-82aa-6fce599e6468 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba" status: 404 len: 111 microversion: 2.1 time: 0.034085 Oct 12 23:59:52.794454 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3883/7669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 12 23:59:52 2022] GET /compute/v2.1/servers/7c6401cc-7405-432c-8397-a4e117b45fba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 23:59:52.955744 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b1ba584-1003-4d1d-a29a-83be1b81ea75 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] Calling method '.version_select at 0x7f44fe810c10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 23:59:52.986426 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b1ba584-1003-4d1d-a29a-83be1b81ea75 tempest-TestShelveInstance-991000588 tempest-TestShelveInstance-991000588-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1861991885" status: 202 len: 0 microversion: 2.1 time: 0.034743 Oct 12 23:59:52.991570 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3787/7670] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Oct 12 23:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1861991885 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 00:00:10.516567 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:00:10.517005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:00:10.934509 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00915d08-d46e-4c8d-a85e-5325e2eca82f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Action: 'create', calling method: .version_select at 0x7f44ffc88d30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1321362826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUyqYGrPSPyTrB5BOz5jL8/NlurjWssmTO9XmcwBtkB4YnaCdvMGTJXlYlSvCxRC76f/Zu9A0NNqhAFM7JHEgMaBlghBETt5MAMzgiEZvHCrG+RErSK8YI9dcDq/xpMCA=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:00:10.951347 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-00915d08-d46e-4c8d-a85e-5325e2eca82f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Getting quotas for project 3aea348f41544549bebcde4c9096b857. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 00:00:10.957183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-00915d08-d46e-4c8d-a85e-5325e2eca82f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Getting quotas for user f5a140a5397c43d2b8834d3841a98b6b and project 3aea348f41544549bebcde4c9096b857. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 00:00:10.990728 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00915d08-d46e-4c8d-a85e-5325e2eca82f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.481019 Oct 13 00:00:10.991850 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3884/7671] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 13 00:00:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 00:00:12.005553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=22 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:00:12.007116 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:00:12.011460 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1993717918", "imageRef": "d8a76847-f2a3-4e2c-96d3-13bb62ec0d50", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1321362826", "security_groups": [{"name": "tempest-secgroup-smoke-253198444"}], "networks": [{"uuid": "7135311b-4b1c-4b5b-b0c7-73635218b26d"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:00:12.123410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] validate_networks() for [('7135311b-4b1c-4b5b-b0c7-73635218b26d', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 00:00:12.634347 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 00:00:12.634824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 00:00:12.635300 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 00:00:12.635771 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 00:00:12.636212 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 00:00:12.645075 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:12.645555 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:12.645989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:12.646715 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:12.647741 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:12.648210 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:12.665823 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Getting quotas for project 3aea348f41544549bebcde4c9096b857. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 00:00:12.671309 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.quota [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Getting quotas for user f5a140a5397c43d2b8834d3841a98b6b and project 3aea348f41544549bebcde4c9096b857. Resources: {'ram', 'cores', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 00:00:12.684246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 00:00:12.686527 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8a76847-f2a3-4e2c-96d3-13bb62ec0d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 00:00:12.732920 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5bd4cf7-3dce-41b4-b67f-ae3264aca682 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729316 Oct 13 00:00:12.734150 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3788/7672] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 13 00:00:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 00:00:12.747020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ffd8c562-9f73-4081-9063-914208028e56 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:12.748417 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ffd8c562-9f73-4081-9063-914208028e56 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:12.811078 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffd8c562-9f73-4081-9063-914208028e56 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:12.819385 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ffd8c562-9f73-4081-9063-914208028e56 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1249 microversion: 2.1 time: 0.076570 Oct 13 00:00:12.832257 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3885/7673] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:12 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 00:00:13.843549 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:13.844340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:13.852201 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:13.852958 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:13.853399 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:13.854104 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:13.854556 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:13.854981 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:13.935482 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:13.944823 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3dbd7c5a-c19e-4487-9f68-52c97d6324f8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1309 microversion: 2.1 time: 0.106970 Oct 13 00:00:13.953747 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3789/7674] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:13 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:14.969545 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:14.970785 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:14.979168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:14.979698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:14.980174 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:14.981123 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:14.981747 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:14.982351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:15.229964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:15.240174 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1f897752-a5a9-4cb3-88b4-0417ac0b18ba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1374 microversion: 2.1 time: 0.274520 Oct 13 00:00:15.241465 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3886/7675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:14 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1374 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:15.448108 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-88145463-ce42-46f0-ac78-6360fdec5c84 req-1fb5b978-5cc2-489c-8e3c-8c33e292efd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8", "tag": "7eaadc79-7029-4397-af58-c107d8b5e551"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:00:15.459243 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-88145463-ce42-46f0-ac78-6360fdec5c84 req-1fb5b978-5cc2-489c-8e3c-8c33e292efd2 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:15.460380 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-88145463-ce42-46f0-ac78-6360fdec5c84 req-1fb5b978-5cc2-489c-8e3c-8c33e292efd2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:15.460813 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-88145463-ce42-46f0-ac78-6360fdec5c84 req-1fb5b978-5cc2-489c-8e3c-8c33e292efd2 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:15.472408 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-88145463-ce42-46f0-ac78-6360fdec5c84 req-1fb5b978-5cc2-489c-8e3c-8c33e292efd2 service nova] Creating event network-changed:7eaadc79-7029-4397-af58-c107d8b5e551 for instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 on n-h1-860864-8 Oct 13 00:00:15.477415 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-88145463-ce42-46f0-ac78-6360fdec5c84 req-1fb5b978-5cc2-489c-8e3c-8c33e292efd2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033968 Oct 13 00:00:15.478182 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3790/7676] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 00:00:16.262651 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:16.263469 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:16.270412 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:16.270906 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:16.271354 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:16.272160 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:16.272631 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:16.273066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:16.414009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:16.422059 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-309ef30f-8155-4da7-9e3a-b9f14543104b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1374 microversion: 2.1 time: 0.163388 Oct 13 00:00:16.422636 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3887/7677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:16 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:17.446524 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:17.447233 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:17.453501 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:17.453984 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:17.454425 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:17.455125 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:17.455583 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:17.456114 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:17.590180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:17.597836 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7d52255a-4be1-44ef-bcf9-f32e1e7a04ce tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1374 microversion: 2.1 time: 0.156469 Oct 13 00:00:17.598412 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3791/7678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:17 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:18.620310 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:18.620942 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:18.627874 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:18.628403 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:18.628849 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:18.629547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:18.630015 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:18.630450 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:18.764894 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:18.773357 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34bb160b-adc9-438c-aa88-44786139e02a tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1374 microversion: 2.1 time: 0.157383 Oct 13 00:00:18.773937 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3888/7679] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:18 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:19.796356 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:19.796978 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:19.803810 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:19.804328 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:19.804767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:19.805469 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:19.805921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:19.806344 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:20.013119 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:20.020810 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b10b913-4b43-46e1-adfe-456e8e9ab08d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1374 microversion: 2.1 time: 0.228770 Oct 13 00:00:20.021368 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3792/7680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:19 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1374 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 00:00:21.044816 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:21.045397 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:21.052520 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:21.053009 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:21.053453 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:21.054141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:21.054601 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:21.055034 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:21.186998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:21.195400 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0b998d2-a0af-441d-9a4b-581ffac3e869 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1374 microversion: 2.1 time: 0.154657 Oct 13 00:00:21.195989 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3889/7681] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:21 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:21.971269 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-07c259a4-5789-429f-b6a6-2eb2b2680a32 req-4d42d546-21dc-470e-bf9d-227dc94e8fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8", "name": "network-vif-plugged", "status": "completed", "tag": "7eaadc79-7029-4397-af58-c107d8b5e551"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:00:21.982057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-07c259a4-5789-429f-b6a6-2eb2b2680a32 req-4d42d546-21dc-470e-bf9d-227dc94e8fd9 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:21.982057 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-07c259a4-5789-429f-b6a6-2eb2b2680a32 req-4d42d546-21dc-470e-bf9d-227dc94e8fd9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:21.982266 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-07c259a4-5789-429f-b6a6-2eb2b2680a32 req-4d42d546-21dc-470e-bf9d-227dc94e8fd9 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:21.993185 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-07c259a4-5789-429f-b6a6-2eb2b2680a32 req-4d42d546-21dc-470e-bf9d-227dc94e8fd9 service nova] Creating event network-vif-plugged:7eaadc79-7029-4397-af58-c107d8b5e551 for instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 on n-h1-860864-8 Oct 13 00:00:21.998104 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-07c259a4-5789-429f-b6a6-2eb2b2680a32 req-4d42d546-21dc-470e-bf9d-227dc94e8fd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089690 Oct 13 00:00:21.998688 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3793/7682] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:00:22.218729 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:22.219279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:22.226129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:22.226618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:22.227066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:22.227756 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:22.228248 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:22.228678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:22.365020 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:22.372752 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-475e504e-cf65-49d6-8d25-97adc7230a59 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1374 microversion: 2.1 time: 0.158025 Oct 13 00:00:22.373341 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3890/7683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:22 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:23.393059 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:00:23.393830 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:00:23.399372 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:23.400136 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:23.407060 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:23.407534 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:23.407991 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:23.408668 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:23.409115 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:23.409539 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:23.547045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:23.555764 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6b05e9af-3375-43fd-a94d-8f79a9a6aaec tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1560 microversion: 2.1 time: 0.163685 Oct 13 00:00:23.556384 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3794/7684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:23 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:23.578421 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:00:23.579056 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:00:23.581939 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:00:23.586958 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:23.587454 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:23.587916 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:23.588627 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:23.589092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:23.589528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:23.718583 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:00:23.726836 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-640a9e20-910d-4a44-a048-3aeec1105bb7 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1560 microversion: 2.1 time: 0.152551 Oct 13 00:00:23.727417 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3891/7685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:00:23 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:00:25.327637 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-ed888d5e-f073-4bd4-9a9d-9753c2d1b430 req-18c3002d-8691-465c-81a3-792c982ae0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8", "tag": "7eaadc79-7029-4397-af58-c107d8b5e551"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:00:25.337957 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ed888d5e-f073-4bd4-9a9d-9753c2d1b430 req-18c3002d-8691-465c-81a3-792c982ae0c4 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:00:25.338435 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ed888d5e-f073-4bd4-9a9d-9753c2d1b430 req-18c3002d-8691-465c-81a3-792c982ae0c4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:00:25.338863 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-ed888d5e-f073-4bd4-9a9d-9753c2d1b430 req-18c3002d-8691-465c-81a3-792c982ae0c4 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:00:25.351306 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-ed888d5e-f073-4bd4-9a9d-9753c2d1b430 req-18c3002d-8691-465c-81a3-792c982ae0c4 service nova] Creating event network-changed:7eaadc79-7029-4397-af58-c107d8b5e551 for instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 on n-h1-860864-8 Oct 13 00:00:25.360364 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-ed888d5e-f073-4bd4-9a9d-9753c2d1b430 req-18c3002d-8691-465c-81a3-792c982ae0c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Oct 13 00:00:25.361005 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3795/7686] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:02:20.556433 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 00:02:20.557273 n-d-860864-8 devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3e96063-e855-4765-b1eb-7b495cad42c1] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 00:02:20.557790 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:20.558587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=36 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:20.559376 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 00:02:20.559517 n-d-860864-8 devstack@n-api.service[120542]: Thu Oct 13 00:02:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8/action (ip 10.222.0.20) !!! Oct 13 00:02:20.561685 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 13 00:02:20.561833 n-d-860864-8 devstack@n-api.service[120542]: Thu Oct 13 00:02:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8/action (ip 10.222.0.20) !!! Oct 13 00:02:20.566500 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1100289345"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:02:20.568954 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:20.581504 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:20.581990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:20.582433 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:20.583130 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:20.583587 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:20.584046 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:20.875752 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0624350-af67-4a56-8912-e967ba8af52f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "POST /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.321239 Oct 13 00:02:20.879947 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3892/7687] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 13 00:02:20 2022] POST /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 00:02:26.487856 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 00:02:26.488707 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 00:02:26.489303 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:26.490045 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=32 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:26.501975 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7beae3eb-fb08-461b-8d88-b91ab568421f req-c81c1f11-b16c-4039-8cf6-001522b43137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8", "name": "network-vif-plugged", "status": "completed", "tag": "7eaadc79-7029-4397-af58-c107d8b5e551"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:02:26.519989 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7beae3eb-fb08-461b-8d88-b91ab568421f req-c81c1f11-b16c-4039-8cf6-001522b43137 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:26.520485 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7beae3eb-fb08-461b-8d88-b91ab568421f req-c81c1f11-b16c-4039-8cf6-001522b43137 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:26.520921 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7beae3eb-fb08-461b-8d88-b91ab568421f req-c81c1f11-b16c-4039-8cf6-001522b43137 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:26.536685 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7beae3eb-fb08-461b-8d88-b91ab568421f req-c81c1f11-b16c-4039-8cf6-001522b43137 service nova] Creating event network-vif-plugged:7eaadc79-7029-4397-af58-c107d8b5e551 for instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 on n-h1-860864-8 Oct 13 00:02:26.543629 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7beae3eb-fb08-461b-8d88-b91ab568421f req-c81c1f11-b16c-4039-8cf6-001522b43137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057333 Oct 13 00:02:26.545567 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3796/7688] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:02:34.420571 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1606321060", "imageRef": "458c2449-5a4f-4a34-8eae-361d6cadbce1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1321362826", "security_groups": [{"name": "tempest-secgroup-smoke-253198444"}], "networks": [{"uuid": "7135311b-4b1c-4b5b-b0c7-73635218b26d"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:02:34.432452 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:34.433141 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:34.456087 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3e96063-e855-4765-b1eb-7b495cad42c1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42380. Oct 13 00:02:34.457469 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] [f157a9c8-f283-4064-808f-4c5f9126901e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42378. Oct 13 00:02:34.543155 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] validate_networks() for [('7135311b-4b1c-4b5b-b0c7-73635218b26d', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 00:02:34.964852 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 00:02:34.965307 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 00:02:34.965794 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 00:02:34.966214 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 00:02:34.966637 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 00:02:34.975420 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:34.975850 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:34.976337 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:34.977070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:34.977531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:34.977967 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:34.994814 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Getting quotas for project 3aea348f41544549bebcde4c9096b857. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 00:02:35.000065 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.quota [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Getting quotas for user f5a140a5397c43d2b8834d3841a98b6b and project 3aea348f41544549bebcde4c9096b857. Resources: {'ram', 'cores', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 00:02:35.012950 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 00:02:35.015426 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='458c2449-5a4f-4a34-8eae-361d6cadbce1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 00:02:35.063876 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f0a5b0ac-0f30-43c9-8879-5c8c07476669 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.647545 Oct 13 00:02:35.064575 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3893/7689] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 13 00:02:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 00:02:35.078712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4c0e6391-bc67-4601-a90b-4491d06e94fa tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:35.079281 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4c0e6391-bc67-4601-a90b-4491d06e94fa tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:35.092898 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42396. Oct 13 00:02:35.094231 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42394. Oct 13 00:02:35.142369 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-4c0e6391-bc67-4601-a90b-4491d06e94fa tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:35.150062 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4c0e6391-bc67-4601-a90b-4491d06e94fa tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1249 microversion: 2.1 time: 0.077237 Oct 13 00:02:35.150961 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3797/7690] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:35 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:36.173952 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:36.175343 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:36.182786 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:36.183291 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:36.183741 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:36.184610 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:36.185093 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:36.185531 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:36.265279 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:36.273131 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47e36da6-cb10-4dd5-b292-15ccd8d5b5d5 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1319 microversion: 2.1 time: 0.103903 Oct 13 00:02:36.273704 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3894/7691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:36 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1319 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:36.477058 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-764d5098-50bf-4463-9626-7319c118bd22 req-515e87a3-871a-499d-a938-3baed68c92d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8", "name": "network-vif-unplugged", "status": "completed", "tag": "7eaadc79-7029-4397-af58-c107d8b5e551"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:02:36.502774 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-764d5098-50bf-4463-9626-7319c118bd22 req-515e87a3-871a-499d-a938-3baed68c92d1 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:36.503270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-764d5098-50bf-4463-9626-7319c118bd22 req-515e87a3-871a-499d-a938-3baed68c92d1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:36.503707 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-764d5098-50bf-4463-9626-7319c118bd22 req-515e87a3-871a-499d-a938-3baed68c92d1 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:36.531310 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-764d5098-50bf-4463-9626-7319c118bd22 req-515e87a3-871a-499d-a938-3baed68c92d1 service nova] Creating event network-vif-unplugged:7eaadc79-7029-4397-af58-c107d8b5e551 for instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 on n-h1-860864-8 Oct 13 00:02:36.543567 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-764d5098-50bf-4463-9626-7319c118bd22 req-515e87a3-871a-499d-a938-3baed68c92d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069995 Oct 13 00:02:36.544823 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3798/7692] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:02:37.296811 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:37.297395 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:37.304731 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:37.305227 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:37.305676 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:37.306401 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:37.306862 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:37.307298 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:37.460763 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:37.469892 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4846da99-dfc8-49fc-95c8-026f578b028b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.177183 Oct 13 00:02:37.476170 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3895/7693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:37 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:38.496635 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:38.497410 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:38.503531 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:38.504039 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:38.504473 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:38.505157 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:38.505607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:38.506028 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:38.647766 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:38.656397 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca60a5f4-1c9b-4499-b6cd-277d09b5cdcd tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.164801 Oct 13 00:02:38.657088 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3799/7694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:38 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:39.681392 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:39.682082 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:39.689348 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:39.689840 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:39.690592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:39.691305 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:39.691762 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:39.692223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:39.863479 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:39.872953 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-41ceff9b-6b6a-4ec6-8f55-a2366ca05a3c tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.196180 Oct 13 00:02:39.875645 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3896/7695] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:39 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:40.896491 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:40.897221 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:40.904009 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:40.904487 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:40.904914 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:40.905607 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:40.906052 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:40.906471 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:41.048821 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:41.057790 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5d61011d-159c-48d1-9176-5384f8741bcb tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.165090 Oct 13 00:02:41.058571 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3800/7696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:40 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:42.081771 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:42.082384 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:42.089808 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:42.090398 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:42.090892 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:42.091725 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:42.092342 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:42.092758 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:42.235525 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:42.244970 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6babd5a-1239-4751-8fbc-7d57c5cc9aba tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.167293 Oct 13 00:02:42.256307 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3897/7697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:42 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:43.269339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:43.269941 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:43.277648 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:43.278133 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:43.278573 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:43.279258 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:43.279712 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:43.280168 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:43.444261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:43.453267 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aad61737-c1fd-4b29-8f8c-92ba5ac9408f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.187720 Oct 13 00:02:43.457113 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3801/7698] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:43 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:44.484633 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:44.485253 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:44.493151 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:44.493646 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:44.494094 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:44.494800 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:44.495265 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:44.495702 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:44.728008 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:44.735846 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85346f77-ca41-4d1b-a7ec-e9c472645b6b tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.255139 Oct 13 00:02:44.736448 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3898/7699] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:44 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:45.154719 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b3db539f-81a0-4065-b399-1960dd3a6d76 req-62835320-147b-4420-9b70-c09d0f3b7529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d32365-5f8b-4d39-a555-3be42a33f3e0", "tag": "cd067b0d-d3d6-4522-a865-e3a7110aa49d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:02:45.160765 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:45.166924 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b3db539f-81a0-4065-b399-1960dd3a6d76 req-62835320-147b-4420-9b70-c09d0f3b7529 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:45.167401 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b3db539f-81a0-4065-b399-1960dd3a6d76 req-62835320-147b-4420-9b70-c09d0f3b7529 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:45.167835 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b3db539f-81a0-4065-b399-1960dd3a6d76 req-62835320-147b-4420-9b70-c09d0f3b7529 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:45.183610 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b3db539f-81a0-4065-b399-1960dd3a6d76 req-62835320-147b-4420-9b70-c09d0f3b7529 service nova] Creating event network-changed:cd067b0d-d3d6-4522-a865-e3a7110aa49d for instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 on n-h2-860864-8 Oct 13 00:02:45.189175 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b3db539f-81a0-4065-b399-1960dd3a6d76 req-62835320-147b-4420-9b70-c09d0f3b7529 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038680 Oct 13 00:02:45.189794 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3802/7700] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 00:02:45.758618 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:45.759300 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:45.761238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:45.762315 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:02:45.769177 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:45.769681 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:45.770129 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:45.770839 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:45.771692 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:45.771812 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:45.904990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:45.913151 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81e75ed7-3832-4fbe-bb22-5e1f689bf229 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.158544 Oct 13 00:02:45.913730 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3899/7701] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:45 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:46.938242 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:46.938927 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:46.945610 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:46.946086 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:46.946512 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:46.947187 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:46.947634 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:46.948085 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:47.083746 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:47.091723 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c59b46cf-1d48-4f26-918d-014c42230352 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.158640 Oct 13 00:02:47.092326 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3803/7702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:46 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:48.114042 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:48.114715 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:48.121595 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:48.122090 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:48.122539 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:48.123238 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:48.123701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:48.124172 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:48.261050 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:48.268759 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-60b3d69f-63f5-43f4-a21c-7aa9f803b9d9 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.158602 Oct 13 00:02:48.269337 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3900/7703] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:48 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:49.291289 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:49.291955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:49.299305 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:49.299788 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:49.300274 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:49.300955 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:49.301404 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:49.301825 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:49.440150 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:49.448808 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e31e611c-53bf-48b3-8f5c-8f079ebaa1e4 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.162059 Oct 13 00:02:49.450589 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3804/7704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:49 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:50.472183 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:50.472757 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:50.479668 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:50.480200 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:50.480654 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:50.481361 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:50.481857 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:50.482293 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:50.618119 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:50.625896 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-306e0598-b823-470e-b6eb-6fa0ef93a74e tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.157835 Oct 13 00:02:50.626469 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3901/7705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:50 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:51.649705 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:51.650360 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:51.660434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:51.660434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:51.660434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:51.660434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:51.660434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:51.660434 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:51.689236 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7180ecd6-a8ab-4f0d-b6f7-a2d2e2670998 req-f9e9c39f-6ddd-42f3-bb86-ad467351ccb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d32365-5f8b-4d39-a555-3be42a33f3e0", "name": "network-vif-plugged", "status": "completed", "tag": "cd067b0d-d3d6-4522-a865-e3a7110aa49d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:02:51.701977 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7180ecd6-a8ab-4f0d-b6f7-a2d2e2670998 req-f9e9c39f-6ddd-42f3-bb86-ad467351ccb3 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:51.702483 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7180ecd6-a8ab-4f0d-b6f7-a2d2e2670998 req-f9e9c39f-6ddd-42f3-bb86-ad467351ccb3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:51.702934 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7180ecd6-a8ab-4f0d-b6f7-a2d2e2670998 req-f9e9c39f-6ddd-42f3-bb86-ad467351ccb3 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:51.718102 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7180ecd6-a8ab-4f0d-b6f7-a2d2e2670998 req-f9e9c39f-6ddd-42f3-bb86-ad467351ccb3 service nova] Creating event network-vif-plugged:cd067b0d-d3d6-4522-a865-e3a7110aa49d for instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 on n-h2-860864-8 Oct 13 00:02:51.723641 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7180ecd6-a8ab-4f0d-b6f7-a2d2e2670998 req-f9e9c39f-6ddd-42f3-bb86-ad467351ccb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038368 Oct 13 00:02:51.725320 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3902/7706] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 00:02:51.822885 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:51.830517 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a2143e1-dad4-40ec-a452-52afcaa8721d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.185509 Oct 13 00:02:51.831087 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3805/7707] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:51 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:52.854475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:52.855196 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:52.861552 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:52.862063 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:52.862502 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:52.863210 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:52.863679 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:52.864146 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:53.005740 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:53.014209 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ee98880-c6c6-43ba-872d-ca8f12e75519 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1374 microversion: 2.1 time: 0.164842 Oct 13 00:02:53.014787 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3903/7708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:52 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:54.036749 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:54.037291 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:54.044630 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:54.045113 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:54.045553 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:54.046238 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:54.046945 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:54.047368 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:54.177339 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:54.185708 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-163cf709-cfb6-4442-b937-311ecee43c4d tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1559 microversion: 2.1 time: 0.152917 Oct 13 00:02:54.186267 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3806/7709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:54 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:54.207566 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:02:54.208224 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:02:54.215462 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:54.215984 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:54.216435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:54.217132 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:54.217591 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:54.218026 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:54.346647 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:02:54.354901 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c34f97ab-5638-475c-bd9c-ceb268129701 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1559 microversion: 2.1 time: 0.151179 Oct 13 00:02:54.355477 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3904/7710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:02:54 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:02:56.220132 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-d016c1f5-8396-41aa-b7e1-23efb836da8a req-2daeedcc-548b-4c17-84b3-daef5e4bd9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d32365-5f8b-4d39-a555-3be42a33f3e0", "tag": "cd067b0d-d3d6-4522-a865-e3a7110aa49d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:02:56.230794 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d016c1f5-8396-41aa-b7e1-23efb836da8a req-2daeedcc-548b-4c17-84b3-daef5e4bd9c5 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:02:56.231270 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d016c1f5-8396-41aa-b7e1-23efb836da8a req-2daeedcc-548b-4c17-84b3-daef5e4bd9c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:02:56.231702 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-d016c1f5-8396-41aa-b7e1-23efb836da8a req-2daeedcc-548b-4c17-84b3-daef5e4bd9c5 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:02:56.243282 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-d016c1f5-8396-41aa-b7e1-23efb836da8a req-2daeedcc-548b-4c17-84b3-daef5e4bd9c5 service nova] Creating event network-changed:cd067b0d-d3d6-4522-a865-e3a7110aa49d for instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 on n-h2-860864-8 Oct 13 00:02:56.248788 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-d016c1f5-8396-41aa-b7e1-23efb836da8a req-2daeedcc-548b-4c17-84b3-daef5e4bd9c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032380 Oct 13 00:02:56.249407 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3807/7711] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:04:34.769379 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:04:34.770147 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=64 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:04:34.771398 n-d-860864-8 devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 00:04:34.771398 n-d-860864-8 devstack@n-api.service[120542]: Thu Oct 13 00:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0/action (ip 10.222.0.20) !!! Oct 13 00:04:34.776886 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-290518460"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:04:34.779223 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:34.788049 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:34.788547 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:34.788998 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:34.789701 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:34.790168 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:34.790608 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:34.995643 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-884a4e20-059b-4cc7-a757-24f92125ef60 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "POST /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0/action" status: 202 len: 0 microversion: 2.1 time: 0.228034 Oct 13 00:04:34.996491 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3905/7712] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 13 00:04:34 2022] POST /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 00:04:40.167668 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 00:04:40.170490 n-d-860864-8 devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 00:04:40.171395 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=26 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:04:40.173343 n-d-860864-8 devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=50 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:04:40.174865 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 00:04:40.175400 n-d-860864-8 devstack@n-api.service[120543]: Thu Oct 13 00:04:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 13 00:04:40.178787 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 00:04:40.179173 n-d-860864-8 devstack@n-api.service[120543]: Thu Oct 13 00:04:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 13 00:04:40.188942 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8654e6b5-805b-455d-a1c8-db78ae2a1d0c req-e6013830-3377-4636-a778-69cee79bc37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d32365-5f8b-4d39-a555-3be42a33f3e0", "name": "network-vif-plugged", "status": "completed", "tag": "cd067b0d-d3d6-4522-a865-e3a7110aa49d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:04:40.210642 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8654e6b5-805b-455d-a1c8-db78ae2a1d0c req-e6013830-3377-4636-a778-69cee79bc37a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:40.212590 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8654e6b5-805b-455d-a1c8-db78ae2a1d0c req-e6013830-3377-4636-a778-69cee79bc37a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:40.214248 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8654e6b5-805b-455d-a1c8-db78ae2a1d0c req-e6013830-3377-4636-a778-69cee79bc37a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:40.242072 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8654e6b5-805b-455d-a1c8-db78ae2a1d0c req-e6013830-3377-4636-a778-69cee79bc37a service nova] Creating event network-vif-plugged:cd067b0d-d3d6-4522-a865-e3a7110aa49d for instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 on n-h2-860864-8 Oct 13 00:04:40.248547 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8654e6b5-805b-455d-a1c8-db78ae2a1d0c req-e6013830-3377-4636-a778-69cee79bc37a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088868 Oct 13 00:04:40.249773 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3808/7713] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:04:48.630626 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:04:48.631625 n-d-860864-8 devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 00:04:48.646019 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0b74e0-caf2-4e49-86b3-4d07083cac7d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42682. Oct 13 00:04:48.647287 n-d-860864-8 devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] [9a5cd035-5c25-4092-9433-046fa1b441f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42684. Oct 13 00:04:48.650070 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:48.651027 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:48.659472 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:48.660422 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:48.660878 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:48.661600 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:48.662068 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:48.662703 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:48.690678 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 00:04:48.703720 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-28ad421e-1472-418b-8ee3-66227d141f67 req-de4b83f9-070d-47e7-952d-fd1a5dddac68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d32365-5f8b-4d39-a555-3be42a33f3e0", "tag": "cd067b0d-d3d6-4522-a865-e3a7110aa49d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:04:48.715551 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-28ad421e-1472-418b-8ee3-66227d141f67 req-de4b83f9-070d-47e7-952d-fd1a5dddac68 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:48.716189 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-28ad421e-1472-418b-8ee3-66227d141f67 req-de4b83f9-070d-47e7-952d-fd1a5dddac68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:48.716691 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-28ad421e-1472-418b-8ee3-66227d141f67 req-de4b83f9-070d-47e7-952d-fd1a5dddac68 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:48.727825 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-28ad421e-1472-418b-8ee3-66227d141f67 req-de4b83f9-070d-47e7-952d-fd1a5dddac68 service nova] Creating event network-changed:cd067b0d-d3d6-4522-a865-e3a7110aa49d for instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 on n-h2-860864-8 Oct 13 00:04:48.733656 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-28ad421e-1472-418b-8ee3-66227d141f67 req-de4b83f9-070d-47e7-952d-fd1a5dddac68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102883 Oct 13 00:04:48.734308 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3809/7714] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:04:48.790785 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d7510d46-9e8b-4503-8146-b802674b0f19 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 204 len: 0 microversion: 2.1 time: 0.162088 Oct 13 00:04:48.793822 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3906/7715] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 13 00:04:48 2022] DELETE /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 00:04:48.802793 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:48.803505 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:48.811706 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:48.813089 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:48.813742 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:48.814447 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:48.814904 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:48.815330 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:48.954852 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:04:48.962987 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd8dcd71-428b-4bb5-bbb4-f4a092ad3f63 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1684 microversion: 2.1 time: 0.164429 Oct 13 00:04:48.963648 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3810/7716] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:48 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:04:49.986825 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:49.987597 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:49.995025 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:49.995517 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:49.995989 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:49.996698 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:49.997157 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:49.997592 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:50.205580 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:04:50.213598 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8486e854-04c1-45ab-ae12-75abd12ff817 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1684 microversion: 2.1 time: 0.231192 Oct 13 00:04:50.214173 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3907/7717] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:49 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1684 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:04:51.237889 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:51.238822 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:51.246317 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:51.246804 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:51.247246 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:51.248041 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:51.248497 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:51.249162 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:51.388315 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:04:51.397366 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-44bc2836-9525-414c-a281-34d86a28d34f tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 200 len: 1684 microversion: 2.1 time: 0.163943 Oct 13 00:04:51.398155 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3811/7718] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:51 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:04:51.604442 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1ddf2d53-cfb1-44c8-bb82-d4476280b6e2 req-4250e772-d4db-4677-a534-d4b04fbd2b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d32365-5f8b-4d39-a555-3be42a33f3e0", "name": "network-vif-deleted", "tag": "cd067b0d-d3d6-4522-a865-e3a7110aa49d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:04:51.618169 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ddf2d53-cfb1-44c8-bb82-d4476280b6e2 req-4250e772-d4db-4677-a534-d4b04fbd2b50 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:51.618657 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ddf2d53-cfb1-44c8-bb82-d4476280b6e2 req-4250e772-d4db-4677-a534-d4b04fbd2b50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:51.619092 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1ddf2d53-cfb1-44c8-bb82-d4476280b6e2 req-4250e772-d4db-4677-a534-d4b04fbd2b50 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:51.633009 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1ddf2d53-cfb1-44c8-bb82-d4476280b6e2 req-4250e772-d4db-4677-a534-d4b04fbd2b50 service nova] Creating event network-vif-deleted:cd067b0d-d3d6-4522-a865-e3a7110aa49d for instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 on n-h2-860864-8 Oct 13 00:04:51.639804 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1ddf2d53-cfb1-44c8-bb82-d4476280b6e2 req-4250e772-d4db-4677-a534-d4b04fbd2b50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038872 Oct 13 00:04:51.640466 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3908/7719] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:04:52.422626 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:52.423367 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: d5d32365-5f8b-4d39-a555-3be42a33f3e0] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:52.430767 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:52.431239 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:52.431667 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:52.432371 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:52.432817 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:52.433235 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:52.446619 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] HTTP exception thrown: Instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 could not be found. Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Request method failure captured: Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 HTTP/1.1 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR1UFpp6DKvTQ1gp4wk4FPD0_LkwUbHWvntg91rQc2a8dQq4W2sddunosOfI_QrGACdMsV0e2KbQvCNRVfqfDOYaFUZILj-4cmM-JNTqy56z_oJQ2cpUtrx0sdtfbA3mjzaggQexDoQ-TW7B7tyyd97aiobEFqkS1XGxxvjXoOXYPq0Q Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 3aea348f41544549bebcde4c9096b857 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestSnapshotPattern-219709549 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aea348f41544549bebcde4c9096b857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aea348f41544549bebcde4c9096b857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aea348f41544549bebcde4c9096b857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aea348f41544549bebcde4c9096b857"}]}] Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestSnapshotPattern-219709549 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 3aea348f41544549bebcde4c9096b857 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestSnapshotPattern-219709549 Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestSnapshotPattern-219709549-project Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: f5a140a5397c43d2b8834d3841a98b6b Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestSnapshotPattern-219709549-project Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 could not be found. Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'd5d32365-5f8b-4d39-a555-3be42a33f3e0'} Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 could not be found. Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 could not be found. Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 00:04:52.448311 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 could not be found. Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Returning 404 to user: Instance d5d32365-5f8b-4d39-a555-3be42a33f3e0 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-67cb4da6-97b6-4001-81f5-bd0809e4d2ac tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0" status: 404 len: 111 microversion: 2.1 time: 0.031233 Oct 13 00:04:52.453869 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3812/7720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:52 2022] GET /compute/v2.1/servers/d5d32365-5f8b-4d39-a555-3be42a33f3e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 00:04:53.757870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:53.758990 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:53.763996 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8c09512f-4b50-423a-9770-2555ad77138c req-552776cf-9c38-445c-a6f3-845d9cbe7095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8", "tag": "7eaadc79-7029-4397-af58-c107d8b5e551"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:04:53.776780 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8c09512f-4b50-423a-9770-2555ad77138c req-552776cf-9c38-445c-a6f3-845d9cbe7095 service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:53.777256 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8c09512f-4b50-423a-9770-2555ad77138c req-552776cf-9c38-445c-a6f3-845d9cbe7095 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:53.777683 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8c09512f-4b50-423a-9770-2555ad77138c req-552776cf-9c38-445c-a6f3-845d9cbe7095 service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:53.778435 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:53.779005 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:53.779526 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:53.780351 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:53.780931 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:53.781491 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:53.789226 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8c09512f-4b50-423a-9770-2555ad77138c req-552776cf-9c38-445c-a6f3-845d9cbe7095 service nova] Creating event network-changed:7eaadc79-7029-4397-af58-c107d8b5e551 for instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 on n-h1-860864-8 Oct 13 00:04:53.794835 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8c09512f-4b50-423a-9770-2555ad77138c req-552776cf-9c38-445c-a6f3-845d9cbe7095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034402 Oct 13 00:04:53.795750 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3813/7721] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:04:53.808935 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 00:04:53.899252 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-654798d2-222d-4ca9-8673-7ea81f632494 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 204 len: 0 microversion: 2.1 time: 0.145709 Oct 13 00:04:53.900501 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3909/7722] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 13 00:04:53 2022] DELETE /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 00:04:53.909735 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:53.910429 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:53.916952 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:53.917466 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:53.917902 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:53.918597 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:53.919047 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:53.919467 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:54.056299 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.policy [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:04:54.064135 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-200c0749-45bc-49f6-8193-1fbc7369a161 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1683 microversion: 2.1 time: 0.158720 Oct 13 00:04:54.064713 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3814/7723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:53 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:04:55.089304 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:55.089973 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:55.096778 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:55.097267 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:55.097713 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:55.098418 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:55.098884 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:55.099314 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:55.281388 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:04:55.289105 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4ab89f7-bd24-4664-ae59-61c587c3fd76 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1683 microversion: 2.1 time: 0.204777 Oct 13 00:04:55.289699 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3910/7724] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:55 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 00:04:56.172048 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-a4b11383-7080-42d0-bd91-005938878a45 req-98364cda-287c-4281-ae4e-1fac0c8ae00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8", "name": "network-vif-deleted", "tag": "7eaadc79-7029-4397-af58-c107d8b5e551"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 00:04:56.182340 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a4b11383-7080-42d0-bd91-005938878a45 req-98364cda-287c-4281-ae4e-1fac0c8ae00a service nova] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:56.182824 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a4b11383-7080-42d0-bd91-005938878a45 req-98364cda-287c-4281-ae4e-1fac0c8ae00a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:56.183261 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-a4b11383-7080-42d0-bd91-005938878a45 req-98364cda-287c-4281-ae4e-1fac0c8ae00a service nova] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:56.194836 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-a4b11383-7080-42d0-bd91-005938878a45 req-98364cda-287c-4281-ae4e-1fac0c8ae00a service nova] Creating event network-vif-deleted:7eaadc79-7029-4397-af58-c107d8b5e551 for instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 on n-h1-860864-8 Oct 13 00:04:56.200144 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-a4b11383-7080-42d0-bd91-005938878a45 req-98364cda-287c-4281-ae4e-1fac0c8ae00a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091174 Oct 13 00:04:56.200737 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3815/7725] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 13 00:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 00:04:56.312344 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:56.312915 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:56.319746 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:56.320264 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:56.321358 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:56.322066 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:56.322528 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:56.322965 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:56.354475 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:56.354964 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:56.355415 n-d-860864-8 devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:56.355870 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lazy-loading 'fault' on Instance uuid e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 00:04:56.402105 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.policy [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a140a5397c43d2b8834d3841a98b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aea348f41544549bebcde4c9096b857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 00:04:56.410281 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-175b7f40-e685-4d30-b5e9-e3a715bf06ab tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 200 len: 1339 microversion: 2.1 time: 0.101776 Oct 13 00:04:56.410871 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3911/7726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:56 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 00:04:57.435139 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:57.435840 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] [instance: e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 00:04:57.442077 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:57.442557 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:57.442994 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:57.443677 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Acquiring lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 00:04:57.444165 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 00:04:57.444594 n-d-860864-8 devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Lock "868d7b64-7f61-47de-bdbf-7158aa15f4f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 00:04:57.457577 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] HTTP exception thrown: Instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 could not be found. Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Request method failure captured: Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 HTTP/1.1 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: Accept: application/json Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: Accept-Encoding: identity Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: Connection: close Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: Content-Length: 0 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: Content-Type: application/json Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: Host: 10.222.0.20 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: Openstack-System-Scope: None Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.12 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjR1UFpp6DKvTQ1gp4wk4FPD0_LkwUbHWvntg91rQc2a8dQq4W2sddunosOfI_QrGACdMsV0e2KbQvCNRVfqfDOYaFUZILj-4cmM-JNTqy56z_oJQ2cpUtrx0sdtfbA3mjzaggQexDoQ-TW7B7tyyd97aiobEFqkS1XGxxvjXoOXYPq0Q Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Id: None Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Domain-Name: None Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Identity-Status: Confirmed Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Is-Admin-Project: True Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Id: default Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Domain-Name: Default Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Id: 3aea348f41544549bebcde4c9096b857 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Project-Name: tempest-TestSnapshotPattern-219709549 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Role: reader,member Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Roles: reader,member Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aea348f41544549bebcde4c9096b857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aea348f41544549bebcde4c9096b857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aea348f41544549bebcde4c9096b857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aea348f41544549bebcde4c9096b857"}]}] Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant: tempest-TestSnapshotPattern-219709549 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Id: 3aea348f41544549bebcde4c9096b857 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestSnapshotPattern-219709549 Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-User: tempest-TestSnapshotPattern-219709549-project Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Id: default Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-User-Domain-Name: Default Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-User-Id: f5a140a5397c43d2b8834d3841a98b6b Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: X-User-Name: tempest-TestSnapshotPattern-219709549-project Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: method: > Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: exception: Instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 could not be found. Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: action_args: {'id': 'e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8'} Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 could not be found. Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 could not be found. Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 00:04:57.459180 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 could not be found. Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Returning 404 to user: Instance e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-215c2c55-b8a4-411b-af2b-d4409b890db8 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8" status: 404 len: 111 microversion: 2.1 time: 0.030612 Oct 13 00:04:57.464961 n-d-860864-8 devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3816/7727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 13 00:04:57 2022] GET /compute/v2.1/servers/e6d9b9b8-0c75-4b5e-9ebd-cfa44bba2aa8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 00:04:57.620010 n-d-860864-8 devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb7282f5-1f95-431a-b8a0-c136cb63e3d0 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] Calling method '.version_select at 0x7f44fec9a310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 00:04:57.648142 n-d-860864-8 devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb7282f5-1f95-431a-b8a0-c136cb63e3d0 tempest-TestSnapshotPattern-219709549 tempest-TestSnapshotPattern-219709549-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1321362826" status: 202 len: 0 microversion: 2.1 time: 0.032323 Oct 13 00:04:57.649411 n-d-860864-8 devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3912/7728] 10.222.0.20 () {58 vars in 1257 bytes} [Thu Oct 13 00:04:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1321362826 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)